2024-04-25T13:26:11.088 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T13:26:11.088 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_pdonnell@teuthology --name pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi --verbose --archive /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673164 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/mds-flush} -- /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673164/orig.config.yaml 2024-04-25T13:26:11.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T13:26:11.227 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673164 branch: wip-pdonnell-testing-20240425.015853-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/mds-flush} email: pdonnell@redhat.com first_in_suite: false job_id: '7673164' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-pdonnell-testing-20240425.015853-debug ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 kclient: syntax: v1 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240425.015853-debug sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 owner: scheduled_pdonnell@teuthology priority: 85 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1880 sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 sleep_before_teardown: 0 subset: 178/512 suite: fs suite_branch: wip-pdonnell-testing-20240425.015853-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi123.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNOtvxA9q55RkpU+SXNUJVqxo/VB8eW8qqt0QLPqz5TbfegV4iiKTMbhiPI9mjhoewluIIuvNvNAWY0/c0G5psw= smithi130.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNhq2gPWHXg+AtqQOsRvglb7BOcmowkaR8qZZoJLmeEpZuQybn6Uq5xtttIgbZoVUcUDn0OOfvN6ucIECX72Cvs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_flush teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_10:00:23 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T13:26:11.227 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa; will attempt to use it 2024-04-25T13:26:11.228 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks 2024-04-25T13:26:11.228 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T13:26:11.229 INFO:teuthology.task.internal:Checking packages... 2024-04-25T13:26:11.257 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '994e2f20102a20fa9a27966c14b625cc01884df8' 2024-04-25T13:26:11.257 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T13:26:11.257 INFO:teuthology.packaging:ref: None 2024-04-25T13:26:11.257 INFO:teuthology.packaging:tag: None 2024-04-25T13:26:11.257 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240425.015853-debug 2024-04-25T13:26:11.257 INFO:teuthology.packaging:sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:26:11.257 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-pdonnell-testing-20240425.015853-debug 2024-04-25T13:26:11.399 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:26:11.400 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T13:26:11.407 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T13:26:11.407 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T13:26:11.466 INFO:teuthology.task.internal:Saving configuration 2024-04-25T13:26:11.483 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T13:26:11.489 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T13:26:11.512 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673164', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 13:19:30.394153', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJMDN6qichW+rSI/HPzZv9Mni4uKN+zY/txFRX6X7prO'} 2024-04-25T13:26:11.534 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673164', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 13:19:30.393279', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIA+13fjO46rt4+x3rspYs72fKfEuoVuD0HXLbl0veseD'} 2024-04-25T13:26:11.534 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T13:26:11.541 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-25T13:26:11.541 INFO:teuthology.task.internal:roles: ubuntu@smithi130.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-25T13:26:11.541 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T13:26:11.615 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7c57c1e3a0>, signals=[15]) 2024-04-25T13:26:11.615 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T13:26:11.622 INFO:teuthology.task.internal:Opening connections... 2024-04-25T13:26:11.622 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi123.front.sepia.ceph.com 2024-04-25T13:26:11.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:26:11.705 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi130.front.sepia.ceph.com 2024-04-25T13:26:11.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:26:11.782 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T13:26:11.788 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2024-04-25T13:26:11.793 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2024-04-25T13:26:11.793 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2024-04-25T13:26:11.843 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T13:26:11.843 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Ubuntu" 2024-04-25T13:26:11.843 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="22.04" 2024-04-25T13:26:11.843 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T13:26:11.843 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_CODENAME=jammy 2024-04-25T13:26:11.843 INFO:teuthology.orchestra.run.smithi123.stdout:ID=ubuntu 2024-04-25T13:26:11.843 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE=debian 2024-04-25T13:26:11.843 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T13:26:11.843 INFO:teuthology.orchestra.run.smithi123.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T13:26:11.844 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T13:26:11.844 INFO:teuthology.orchestra.run.smithi123.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T13:26:11.844 INFO:teuthology.orchestra.run.smithi123.stdout:UBUNTU_CODENAME=jammy 2024-04-25T13:26:11.844 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2024-04-25T13:26:11.865 DEBUG:teuthology.orchestra.run.smithi130:> uname -m 2024-04-25T13:26:11.870 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64 2024-04-25T13:26:11.870 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2024-04-25T13:26:11.916 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T13:26:11.916 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="Ubuntu" 2024-04-25T13:26:11.916 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="22.04" 2024-04-25T13:26:11.916 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T13:26:11.916 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_CODENAME=jammy 2024-04-25T13:26:11.916 INFO:teuthology.orchestra.run.smithi130.stdout:ID=ubuntu 2024-04-25T13:26:11.916 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE=debian 2024-04-25T13:26:11.916 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T13:26:11.916 INFO:teuthology.orchestra.run.smithi130.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T13:26:11.916 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T13:26:11.917 INFO:teuthology.orchestra.run.smithi130.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T13:26:11.917 INFO:teuthology.orchestra.run.smithi130.stdout:UBUNTU_CODENAME=jammy 2024-04-25T13:26:11.917 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2024-04-25T13:26:11.940 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T13:26:11.950 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T13:26:11.985 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T13:26:11.985 DEBUG:teuthology.orchestra.run.smithi123:> test '!' -e /home/ubuntu/cephtest 2024-04-25T13:26:11.989 DEBUG:teuthology.orchestra.run.smithi130:> test '!' -e /home/ubuntu/cephtest 2024-04-25T13:26:11.994 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T13:26:12.011 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T13:26:12.012 DEBUG:teuthology.orchestra.run.smithi123:> test -z $(ls -A /var/lib/ceph) 2024-04-25T13:26:12.037 DEBUG:teuthology.orchestra.run.smithi130:> test -z $(ls -A /var/lib/ceph) 2024-04-25T13:26:12.058 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T13:26:12.113 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T13:26:12.128 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-04-25T13:26:12.128 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-04-25T13:26:12.129 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-04-25T13:26:12.129 DEBUG:teuthology.orchestra.run.smithi123:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T13:26:12.129 DEBUG:teuthology.orchestra.run.smithi130:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T13:26:12.133 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:26:12.134 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-04-25T13:26:12.137 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:26:12.138 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-04-25T13:26:12.301 DEBUG:teuthology.task.kernel:sha1 for client.1 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T13:26:12.301 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-25T13:26:12.301 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2024-04-25T13:26:12.307 INFO:teuthology.orchestra.run.smithi130.stdout:5.15.0-56-generic 2024-04-25T13:26:12.307 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T13:26:12.307 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-25T13:26:12.307 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-04-25T13:26:12.308 DEBUG:teuthology.orchestra.run.smithi130:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-25T13:26:12.368 INFO:teuthology.orchestra.run.smithi130.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-25T13:26:12.429 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T13:26:12.429 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-25T13:26:12.429 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2024-04-25T13:26:12.435 INFO:teuthology.orchestra.run.smithi123.stdout:5.15.0-56-generic 2024-04-25T13:26:12.435 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T13:26:12.435 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-25T13:26:12.435 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-04-25T13:26:12.435 DEBUG:teuthology.orchestra.run.smithi123:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-25T13:26:12.488 INFO:teuthology.orchestra.run.smithi130.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-25T13:26:12.488 INFO:teuthology.orchestra.run.smithi130.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-25T13:26:12.488 INFO:teuthology.orchestra.run.smithi130.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-25T13:26:12.488 INFO:teuthology.orchestra.run.smithi130.stderr:hint: 2024-04-25T13:26:12.488 INFO:teuthology.orchestra.run.smithi130.stderr:hint: git config --global init.defaultBranch 2024-04-25T13:26:12.488 INFO:teuthology.orchestra.run.smithi130.stderr:hint: 2024-04-25T13:26:12.488 INFO:teuthology.orchestra.run.smithi130.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-25T13:26:12.489 INFO:teuthology.orchestra.run.smithi130.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-25T13:26:12.489 INFO:teuthology.orchestra.run.smithi130.stderr:hint: 2024-04-25T13:26:12.489 INFO:teuthology.orchestra.run.smithi130.stderr:hint: git branch -m 2024-04-25T13:26:12.490 INFO:teuthology.orchestra.run.smithi130.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-25T13:26:12.492 DEBUG:teuthology.orchestra.run.smithi130:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-25T13:26:12.493 INFO:teuthology.orchestra.run.smithi123.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-25T13:26:12.562 DEBUG:teuthology.orchestra.run.smithi130:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-25T13:26:12.618 DEBUG:teuthology.orchestra.run.smithi130:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-25T13:26:12.647 INFO:teuthology.orchestra.run.smithi123.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-25T13:26:12.647 INFO:teuthology.orchestra.run.smithi123.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-25T13:26:12.647 INFO:teuthology.orchestra.run.smithi123.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-25T13:26:12.647 INFO:teuthology.orchestra.run.smithi123.stderr:hint: 2024-04-25T13:26:12.647 INFO:teuthology.orchestra.run.smithi123.stderr:hint: git config --global init.defaultBranch 2024-04-25T13:26:12.647 INFO:teuthology.orchestra.run.smithi123.stderr:hint: 2024-04-25T13:26:12.647 INFO:teuthology.orchestra.run.smithi123.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-25T13:26:12.647 INFO:teuthology.orchestra.run.smithi123.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-25T13:26:12.647 INFO:teuthology.orchestra.run.smithi123.stderr:hint: 2024-04-25T13:26:12.647 INFO:teuthology.orchestra.run.smithi123.stderr:hint: git branch -m 2024-04-25T13:26:12.648 INFO:teuthology.orchestra.run.smithi123.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-25T13:26:12.649 DEBUG:teuthology.orchestra.run.smithi123:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-25T13:26:12.714 DEBUG:teuthology.orchestra.run.smithi123:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-25T13:26:12.767 DEBUG:teuthology.orchestra.run.smithi123:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-25T13:27:54.907 INFO:teuthology.orchestra.run.smithi130.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-25T13:27:54.907 INFO:teuthology.orchestra.run.smithi130.stderr: * [new branch] main -> origin/main 2024-04-25T13:27:54.940 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20190312 -> 20190312 2024-04-25T13:27:54.940 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20190416 -> 20190416 2024-04-25T13:27:54.940 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20190514 -> 20190514 2024-04-25T13:27:54.940 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20190618 -> 20190618 2024-04-25T13:27:54.940 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20190717 -> 20190717 2024-04-25T13:27:54.940 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20190815 -> 20190815 2024-04-25T13:27:54.941 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20190923 -> 20190923 2024-04-25T13:27:54.941 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20191022 -> 20191022 2024-04-25T13:27:54.941 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20191215 -> 20191215 2024-04-25T13:27:54.941 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20200122 -> 20200122 2024-04-25T13:27:54.943 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20200316 -> 20200316 2024-04-25T13:27:54.943 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20200421 -> 20200421 2024-04-25T13:27:54.943 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20200519 -> 20200519 2024-04-25T13:27:54.943 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20200619 -> 20200619 2024-04-25T13:27:54.943 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20200721 -> 20200721 2024-04-25T13:27:54.943 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20200817 -> 20200817 2024-04-25T13:27:54.943 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20200918 -> 20200918 2024-04-25T13:27:54.943 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20201022 -> 20201022 2024-04-25T13:27:54.943 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20201118 -> 20201118 2024-04-25T13:27:54.944 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20201218 -> 20201218 2024-04-25T13:27:54.944 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20210208 -> 20210208 2024-04-25T13:27:54.944 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20210315 -> 20210315 2024-04-25T13:27:54.944 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20210511 -> 20210511 2024-04-25T13:27:54.944 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20210716 -> 20210716 2024-04-25T13:27:54.944 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20210818 -> 20210818 2024-04-25T13:27:54.944 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20210919 -> 20210919 2024-04-25T13:27:54.944 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20211027 -> 20211027 2024-04-25T13:27:54.944 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20211216 -> 20211216 2024-04-25T13:27:54.944 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20220209 -> 20220209 2024-04-25T13:27:54.944 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20220310 -> 20220310 2024-04-25T13:27:54.947 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20220411 -> 20220411 2024-04-25T13:27:54.947 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20220509 -> 20220509 2024-04-25T13:27:54.947 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20220610 -> 20220610 2024-04-25T13:27:54.947 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20220708 -> 20220708 2024-04-25T13:27:54.947 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20220815 -> 20220815 2024-04-25T13:27:54.947 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20220913 -> 20220913 2024-04-25T13:27:54.947 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20221012 -> 20221012 2024-04-25T13:27:54.947 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20221109 -> 20221109 2024-04-25T13:27:54.947 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20221214 -> 20221214 2024-04-25T13:27:54.947 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20230117 -> 20230117 2024-04-25T13:27:54.947 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20230210 -> 20230210 2024-04-25T13:27:54.948 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20230310 -> 20230310 2024-04-25T13:27:54.948 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20230404 -> 20230404 2024-04-25T13:27:54.948 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20230515 -> 20230515 2024-04-25T13:27:54.948 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20230625 -> 20230625 2024-04-25T13:27:54.948 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20230804 -> 20230804 2024-04-25T13:27:54.948 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20230919 -> 20230919 2024-04-25T13:27:54.948 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20231030 -> 20231030 2024-04-25T13:27:54.948 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20231111 -> 20231111 2024-04-25T13:27:54.948 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20231211 -> 20231211 2024-04-25T13:27:54.948 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20240115 -> 20240115 2024-04-25T13:27:54.948 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20240220 -> 20240220 2024-04-25T13:27:54.948 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20240312 -> 20240312 2024-04-25T13:27:54.948 INFO:teuthology.orchestra.run.smithi130.stderr: * [new tag] 20240410 -> 20240410 2024-04-25T13:27:56.032 INFO:teuthology.orchestra.run.smithi123.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-25T13:27:56.032 INFO:teuthology.orchestra.run.smithi123.stderr: * [new branch] main -> origin/main 2024-04-25T13:27:56.066 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20190312 -> 20190312 2024-04-25T13:27:56.066 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20190416 -> 20190416 2024-04-25T13:27:56.066 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20190514 -> 20190514 2024-04-25T13:27:56.066 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20190618 -> 20190618 2024-04-25T13:27:56.066 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20190717 -> 20190717 2024-04-25T13:27:56.066 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20190815 -> 20190815 2024-04-25T13:27:56.066 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20190923 -> 20190923 2024-04-25T13:27:56.067 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20191022 -> 20191022 2024-04-25T13:27:56.068 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20191215 -> 20191215 2024-04-25T13:27:56.068 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20200122 -> 20200122 2024-04-25T13:27:56.068 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20200316 -> 20200316 2024-04-25T13:27:56.068 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20200421 -> 20200421 2024-04-25T13:27:56.068 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20200519 -> 20200519 2024-04-25T13:27:56.068 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20200619 -> 20200619 2024-04-25T13:27:56.068 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20200721 -> 20200721 2024-04-25T13:27:56.069 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20200817 -> 20200817 2024-04-25T13:27:56.069 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20200918 -> 20200918 2024-04-25T13:27:56.069 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20201022 -> 20201022 2024-04-25T13:27:56.069 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20201118 -> 20201118 2024-04-25T13:27:56.069 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20201218 -> 20201218 2024-04-25T13:27:56.069 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20210208 -> 20210208 2024-04-25T13:27:56.069 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20210315 -> 20210315 2024-04-25T13:27:56.069 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20210511 -> 20210511 2024-04-25T13:27:56.070 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20210716 -> 20210716 2024-04-25T13:27:56.070 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20210818 -> 20210818 2024-04-25T13:27:56.070 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20210919 -> 20210919 2024-04-25T13:27:56.071 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20211027 -> 20211027 2024-04-25T13:27:56.071 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20211216 -> 20211216 2024-04-25T13:27:56.071 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20220209 -> 20220209 2024-04-25T13:27:56.071 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20220310 -> 20220310 2024-04-25T13:27:56.072 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20220411 -> 20220411 2024-04-25T13:27:56.072 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20220509 -> 20220509 2024-04-25T13:27:56.072 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20220610 -> 20220610 2024-04-25T13:27:56.072 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20220708 -> 20220708 2024-04-25T13:27:56.072 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20220815 -> 20220815 2024-04-25T13:27:56.073 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20220913 -> 20220913 2024-04-25T13:27:56.073 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20221012 -> 20221012 2024-04-25T13:27:56.073 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20221109 -> 20221109 2024-04-25T13:27:56.073 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20221214 -> 20221214 2024-04-25T13:27:56.073 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20230117 -> 20230117 2024-04-25T13:27:56.074 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20230210 -> 20230210 2024-04-25T13:27:56.074 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20230310 -> 20230310 2024-04-25T13:27:56.074 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20230404 -> 20230404 2024-04-25T13:27:56.074 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20230515 -> 20230515 2024-04-25T13:27:56.074 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20230625 -> 20230625 2024-04-25T13:27:56.074 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20230804 -> 20230804 2024-04-25T13:27:56.075 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20230919 -> 20230919 2024-04-25T13:27:56.075 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20231030 -> 20231030 2024-04-25T13:27:56.075 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20231111 -> 20231111 2024-04-25T13:27:56.075 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20231211 -> 20231211 2024-04-25T13:27:56.075 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20240115 -> 20240115 2024-04-25T13:27:56.075 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20240220 -> 20240220 2024-04-25T13:27:56.076 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20240312 -> 20240312 2024-04-25T13:27:56.076 INFO:teuthology.orchestra.run.smithi123.stderr: * [new tag] 20240410 -> 20240410 2024-04-25T13:27:59.212 INFO:teuthology.orchestra.run.smithi130.stderr:Updating files: 45% (1529/3381) Updating files: 46% (1556/3381) Updating files: 47% (1590/3381) Updating files: 48% (1623/3381) Updating files: 49% (1657/3381) Updating files: 50% (1691/3381) Updating files: 51% (1725/3381) Updating files: 52% (1759/3381) Updating files: 53% (1792/3381) Updating files: 54% (1826/3381) Updating files: 55% (1860/3381) Updating files: 56% (1894/3381) Updating files: 57% (1928/3381) Updating files: 58% (1961/3381) Updating files: 59% (1995/3381) Updating files: 59% (2011/3381) Updating files: 60% (2029/3381) Updating files: 61% (2063/3381) Updating files: 62% (2097/3381) Updating files: 63% (2131/3381) Updating files: 64% (2164/3381) Updating files: 65% (2198/3381) Updating files: 66% (2232/3381) Updating files: 67% (2266/3381) Updating files: 68% (2300/3381) Updating files: 69% (2333/3381) Updating files: 69% (2362/3381) Updating files: 70% (2367/3381) Updating files: 71% (2401/3381) Updating files: 72% (2435/3381) Updating files: 73% (2469/3381) Updating files: 74% (2502/3381) Updating files: 75% (2536/3381) Updating files: 76% (2570/3381) Updating files: 77% (2604/3381) Updating files: 78% (2638/3381) Updating files: 79% (2671/3381) Updating files: 80% (2705/3381) Updating files: 81% (2739/3381) Updating files: 82% (2773/3381) Updating files: 83% (2807/3381) Updating files: 83% (2812/3381) Updating files: 84% (2841/3381) Updating files: 85% (2874/3381) Updating files: 86% (2908/3381) Updating files: 87% (2942/3381) Updating files: 88% (2976/3381) Updating files: 89% (3010/3381) Updating files: 90% (3043/3381) Updating files: 91% (3077/3381) Updating files: 92% (3111/3381) Updating files: 93% (3145/3381) Updating files: 94% (3179/3381) Updating files: 95% (3212/3381) Updating files: 96% (3246/3381) Updating files: 97% (3280/3381) Updating files: 98% (3314/3381) Updating files: 99% (3348/3381) Updating files: 100% (3381/3381) Updating files: 100% (3381/3381), done. 2024-04-25T13:27:59.217 INFO:teuthology.orchestra.run.smithi130.stdout:HEAD is now at 63a66b66 Merge branch 'robot/pr-0-1713990671' into 'main' 2024-04-25T13:27:59.238 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-04-25T13:27:59.239 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T13:27:59.387 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-25T13:27:59.387 DEBUG:teuthology.orchestra.run.smithi130:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-25T13:27:59.390 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi130.front.sepia.ceph.com to complete... 2024-04-25T13:28:00.332 INFO:teuthology.orchestra.run.smithi123.stderr:Updating files: 45% (1530/3381) Updating files: 46% (1556/3381) Updating files: 47% (1590/3381) Updating files: 48% (1623/3381) Updating files: 49% (1657/3381) Updating files: 50% (1691/3381) Updating files: 51% (1725/3381) Updating files: 52% (1759/3381) Updating files: 53% (1792/3381) Updating files: 54% (1826/3381) Updating files: 55% (1860/3381) Updating files: 56% (1894/3381) Updating files: 57% (1928/3381) Updating files: 58% (1961/3381) Updating files: 59% (1995/3381) Updating files: 59% (2012/3381) Updating files: 60% (2029/3381) Updating files: 61% (2063/3381) Updating files: 62% (2097/3381) Updating files: 63% (2131/3381) Updating files: 64% (2164/3381) Updating files: 65% (2198/3381) Updating files: 66% (2232/3381) Updating files: 67% (2266/3381) Updating files: 68% (2300/3381) Updating files: 69% (2333/3381) Updating files: 70% (2367/3381) Updating files: 71% (2401/3381) Updating files: 71% (2411/3381) Updating files: 72% (2435/3381) Updating files: 73% (2469/3381) Updating files: 74% (2502/3381) Updating files: 75% (2536/3381) Updating files: 76% (2570/3381) Updating files: 77% (2604/3381) Updating files: 78% (2638/3381) Updating files: 79% (2671/3381) Updating files: 80% (2705/3381) Updating files: 81% (2739/3381) Updating files: 82% (2773/3381) Updating files: 83% (2807/3381) Updating files: 83% (2814/3381) Updating files: 84% (2841/3381) Updating files: 85% (2874/3381) Updating files: 86% (2908/3381) Updating files: 87% (2942/3381) Updating files: 88% (2976/3381) Updating files: 89% (3010/3381) Updating files: 90% (3043/3381) Updating files: 91% (3077/3381) Updating files: 92% (3111/3381) Updating files: 93% (3145/3381) Updating files: 94% (3179/3381) Updating files: 95% (3212/3381) Updating files: 96% (3246/3381) Updating files: 97% (3280/3381) Updating files: 98% (3314/3381) Updating files: 99% (3348/3381) Updating files: 100% (3381/3381) Updating files: 100% (3381/3381), done. 2024-04-25T13:28:00.337 INFO:teuthology.orchestra.run.smithi123.stdout:HEAD is now at 63a66b66 Merge branch 'robot/pr-0-1713990671' into 'main' 2024-04-25T13:28:00.359 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-25T13:28:00.359 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T13:28:00.582 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-25T13:28:00.582 DEBUG:teuthology.orchestra.run.smithi123:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-25T13:28:00.585 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi123.front.sepia.ceph.com to complete... 2024-04-25T13:28:06.618 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25 13:28:06 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-25T13:28:06.618 INFO:teuthology.orchestra.run.smithi130.stderr:FINISHED --2024-04-25 13:28:06-- 2024-04-25T13:28:06.619 INFO:teuthology.orchestra.run.smithi130.stderr:Total wall clock time: 7.2s 2024-04-25T13:28:06.619 INFO:teuthology.orchestra.run.smithi130.stderr:Downloaded: 1 files, 43M in 6.9s (6.23 MB/s) 2024-04-25T13:28:06.623 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-04-25T13:28:06.623 DEBUG:teuthology.orchestra.run.smithi130:> sudo dpkg -i /tmp/linux-image.deb 2024-04-25T13:28:06.911 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-25T13:28:08.937 INFO:teuthology.orchestra.run.smithi130.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-25T13:28:08.941 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-25T13:28:09.092 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-25T13:28:10.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25 13:28:09 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-25T13:28:10.296 INFO:teuthology.orchestra.run.smithi123.stderr:FINISHED --2024-04-25 13:28:09-- 2024-04-25T13:28:10.296 INFO:teuthology.orchestra.run.smithi123.stderr:Total wall clock time: 9.7s 2024-04-25T13:28:10.296 INFO:teuthology.orchestra.run.smithi123.stderr:Downloaded: 1 files, 43M in 9.3s (4.61 MB/s) 2024-04-25T13:28:10.301 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-25T13:28:10.301 DEBUG:teuthology.orchestra.run.smithi123:> sudo dpkg -i /tmp/linux-image.deb 2024-04-25T13:28:10.556 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-25T13:28:12.555 INFO:teuthology.orchestra.run.smithi123.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-25T13:28:12.559 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-25T13:28:12.709 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-25T13:28:13.005 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-25T13:28:13.099 INFO:teuthology.orchestra.run.smithi130.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T13:28:16.991 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-25T13:28:17.093 INFO:teuthology.orchestra.run.smithi123.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T13:28:35.560 INFO:teuthology.orchestra.run.smithi130.stderr:Sourcing file `/etc/default/grub' 2024-04-25T13:28:35.573 INFO:teuthology.orchestra.run.smithi130.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T13:28:35.602 INFO:teuthology.orchestra.run.smithi130.stderr:Generating grub configuration file ... 2024-04-25T13:28:35.926 INFO:teuthology.orchestra.run.smithi130.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T13:28:35.945 INFO:teuthology.orchestra.run.smithi130.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T13:28:36.268 INFO:teuthology.orchestra.run.smithi130.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T13:28:36.276 INFO:teuthology.orchestra.run.smithi130.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T13:28:36.337 INFO:teuthology.orchestra.run.smithi130.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T13:28:36.343 INFO:teuthology.orchestra.run.smithi130.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T13:28:36.491 INFO:teuthology.orchestra.run.smithi130.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T13:28:36.492 INFO:teuthology.orchestra.run.smithi130.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T13:28:36.492 INFO:teuthology.orchestra.run.smithi130.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T13:28:36.531 INFO:teuthology.orchestra.run.smithi130.stderr:done 2024-04-25T13:28:36.746 DEBUG:teuthology.orchestra.run.smithi130:> dpkg-deb -c /tmp/linux-image.deb 2024-04-25T13:28:36.754 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-25T13:28:36.754 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-25T13:28:36.754 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-25T13:28:36.773 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-25T13:28:36.773 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T13:28:36.795 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-25T13:28:36.795 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-25T13:28:36.795 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-25T13:28:36.795 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-25T13:28:36.795 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-25T13:28:36.796 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-25T13:28:36.796 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-25T13:28:36.796 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-25T13:28:36.796 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-25T13:28:36.796 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-25T13:28:36.796 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-25T13:28:36.796 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-25T13:28:36.796 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-25T13:28:36.796 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-25T13:28:36.799 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-25T13:28:36.799 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-25T13:28:36.799 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-25T13:28:36.799 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-25T13:28:36.799 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-25T13:28:36.799 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-25T13:28:36.799 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-25T13:28:36.799 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-25T13:28:36.800 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-25T13:28:36.800 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-25T13:28:36.800 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-25T13:28:36.800 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-25T13:28:36.800 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-25T13:28:36.800 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-25T13:28:36.800 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-25T13:28:36.800 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-25T13:28:36.800 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-25T13:28:36.800 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-25T13:28:36.800 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-25T13:28:36.800 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-25T13:28:36.801 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-25T13:28:36.801 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-25T13:28:36.801 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-25T13:28:36.801 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-25T13:28:36.801 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-25T13:28:36.801 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-25T13:28:36.801 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-25T13:28:36.801 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-25T13:28:36.801 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-25T13:28:36.824 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-25T13:28:36.824 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-25T13:28:36.824 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-25T13:28:36.824 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-25T13:28:36.824 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-25T13:28:36.824 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-25T13:28:36.824 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-25T13:28:36.824 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-25T13:28:36.824 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-25T13:28:36.824 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-25T13:28:36.824 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-25T13:28:36.825 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-25T13:28:36.825 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-25T13:28:36.825 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-25T13:28:36.825 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-25T13:28:36.825 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-25T13:28:36.825 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-25T13:28:36.825 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-25T13:28:36.825 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-25T13:28:36.825 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-25T13:28:36.825 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-25T13:28:36.825 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-25T13:28:36.825 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-25T13:28:36.825 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-25T13:28:36.826 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-25T13:28:36.826 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-25T13:28:36.826 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-25T13:28:36.826 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-25T13:28:36.826 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-25T13:28:36.826 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-25T13:28:36.826 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-25T13:28:36.826 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-25T13:28:36.826 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-25T13:28:36.826 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-25T13:28:36.826 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-25T13:28:36.826 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-25T13:28:36.826 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-25T13:28:36.826 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-25T13:28:36.827 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-25T13:28:36.827 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-25T13:28:36.827 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-25T13:28:36.827 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-25T13:28:36.827 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-25T13:28:36.827 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-25T13:28:36.827 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-25T13:28:36.827 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-25T13:28:36.827 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-25T13:28:36.827 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-25T13:28:36.827 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-25T13:28:36.827 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-25T13:28:36.827 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-25T13:28:36.828 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-25T13:28:36.828 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-25T13:28:36.828 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-25T13:28:36.828 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-25T13:28:36.828 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-25T13:28:36.828 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-25T13:28:36.828 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-25T13:28:36.828 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-25T13:28:36.828 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-25T13:28:36.828 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-25T13:28:36.828 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-25T13:28:36.828 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-25T13:28:36.828 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-25T13:28:36.828 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-25T13:28:36.829 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-25T13:28:36.829 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-25T13:28:36.829 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-25T13:28:36.829 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-25T13:28:36.829 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-25T13:28:36.829 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-25T13:28:36.829 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-25T13:28:36.829 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-25T13:28:36.829 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-25T13:28:36.829 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-25T13:28:36.829 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-25T13:28:36.829 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-25T13:28:36.829 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-25T13:28:36.830 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-25T13:28:36.830 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-25T13:28:36.830 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-25T13:28:36.830 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-25T13:28:36.830 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-25T13:28:36.830 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-25T13:28:36.830 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-25T13:28:36.830 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-25T13:28:36.830 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-25T13:28:36.830 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-25T13:28:36.830 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-25T13:28:36.830 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-25T13:28:36.830 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-25T13:28:36.831 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-25T13:28:36.831 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-25T13:28:36.831 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-25T13:28:36.831 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-25T13:28:36.831 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-25T13:28:36.831 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-25T13:28:36.831 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-25T13:28:36.831 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-25T13:28:36.831 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-25T13:28:36.831 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-25T13:28:36.831 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-25T13:28:36.831 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-25T13:28:36.831 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-25T13:28:36.832 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-25T13:28:36.832 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-25T13:28:36.832 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-25T13:28:36.832 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-25T13:28:36.832 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-25T13:28:36.832 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-25T13:28:36.832 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-25T13:28:36.832 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-25T13:28:36.832 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-25T13:28:36.832 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-25T13:28:36.832 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-25T13:28:36.832 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-25T13:28:36.832 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-25T13:28:36.833 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-25T13:28:36.833 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-25T13:28:36.833 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-25T13:28:36.833 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-25T13:28:36.833 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-25T13:28:36.833 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-25T13:28:36.833 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-25T13:28:36.833 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-25T13:28:36.833 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-25T13:28:36.833 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-25T13:28:36.833 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-25T13:28:36.833 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-25T13:28:36.833 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-25T13:28:36.834 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-25T13:28:36.834 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-25T13:28:36.834 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-25T13:28:36.834 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-25T13:28:36.834 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-25T13:28:36.834 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-25T13:28:36.834 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-25T13:28:36.834 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-25T13:28:36.834 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-25T13:28:36.834 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-25T13:28:36.834 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-25T13:28:36.834 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-25T13:28:36.834 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-25T13:28:36.835 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-25T13:28:36.835 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-25T13:28:36.835 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-25T13:28:36.835 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-25T13:28:36.835 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-25T13:28:36.835 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-25T13:28:36.835 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-25T13:28:36.835 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-25T13:28:36.835 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-25T13:28:36.835 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-25T13:28:36.835 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-25T13:28:36.835 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-25T13:28:36.835 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-25T13:28:36.836 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-25T13:28:36.836 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-25T13:28:36.836 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-25T13:28:36.836 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-25T13:28:36.836 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-25T13:28:36.836 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-25T13:28:36.836 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-25T13:28:36.836 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-25T13:28:36.836 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-25T13:28:36.836 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-25T13:28:36.836 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-25T13:28:36.836 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-25T13:28:36.836 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-25T13:28:36.837 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-25T13:28:36.837 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-25T13:28:36.837 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-25T13:28:36.837 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-25T13:28:36.837 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-25T13:28:36.837 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-25T13:28:36.837 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-25T13:28:36.837 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-25T13:28:36.837 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-25T13:28:36.837 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-25T13:28:36.837 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-25T13:28:36.837 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-25T13:28:36.837 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-25T13:28:36.838 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-25T13:28:36.838 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-25T13:28:36.838 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-25T13:28:36.838 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-25T13:28:36.838 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-25T13:28:36.838 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-25T13:28:36.838 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-25T13:28:36.838 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-25T13:28:36.838 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-25T13:28:36.838 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-25T13:28:36.838 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-25T13:28:36.838 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-25T13:28:36.838 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-25T13:28:36.839 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-25T13:28:36.839 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-25T13:28:36.839 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-25T13:28:36.839 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-25T13:28:36.839 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-25T13:28:36.839 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-25T13:28:36.839 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-25T13:28:36.839 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-25T13:28:36.896 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-25T13:28:36.896 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-25T13:28:36.896 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-25T13:28:36.896 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-25T13:28:36.896 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-25T13:28:36.896 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-25T13:28:36.896 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-25T13:28:36.896 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-25T13:28:36.896 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-25T13:28:36.897 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-25T13:28:36.897 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-25T13:28:36.897 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-25T13:28:36.897 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-25T13:28:36.897 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-25T13:28:36.897 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-25T13:28:36.897 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-25T13:28:36.897 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-25T13:28:36.897 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-25T13:28:36.897 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-25T13:28:36.897 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-25T13:28:36.897 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-25T13:28:36.897 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-25T13:28:36.898 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-25T13:28:36.898 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-25T13:28:36.898 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-25T13:28:36.898 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-25T13:28:36.898 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-25T13:28:36.898 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-25T13:28:36.898 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-25T13:28:36.898 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-25T13:28:36.898 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-25T13:28:36.898 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-25T13:28:36.898 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-25T13:28:36.898 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-25T13:28:36.899 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-25T13:28:36.899 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-25T13:28:36.899 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-25T13:28:36.899 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-25T13:28:36.899 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-25T13:28:36.899 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-25T13:28:36.899 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-25T13:28:36.899 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-25T13:28:36.899 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-25T13:28:36.899 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-25T13:28:36.899 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-25T13:28:36.899 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-25T13:28:36.899 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-25T13:28:36.899 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-25T13:28:36.900 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-25T13:28:36.900 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-25T13:28:36.900 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-25T13:28:36.900 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-25T13:28:36.900 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-25T13:28:36.900 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-25T13:28:36.900 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-25T13:28:36.900 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-25T13:28:36.900 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-25T13:28:36.900 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-25T13:28:36.900 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-25T13:28:36.901 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-25T13:28:36.901 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-25T13:28:36.901 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-25T13:28:36.901 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-25T13:28:36.901 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-25T13:28:36.901 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-25T13:28:36.901 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-25T13:28:36.901 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-25T13:28:36.901 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-25T13:28:36.902 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-25T13:28:36.902 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-25T13:28:36.902 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-25T13:28:36.902 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-25T13:28:36.903 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-25T13:28:36.903 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-25T13:28:36.903 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-25T13:28:36.903 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-25T13:28:36.903 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-25T13:28:36.903 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-25T13:28:36.903 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-25T13:28:36.903 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-25T13:28:36.903 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-25T13:28:36.904 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-25T13:28:36.904 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-25T13:28:36.904 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-25T13:28:36.904 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-25T13:28:36.904 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-25T13:28:36.904 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-25T13:28:36.904 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-25T13:28:36.904 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-25T13:28:36.904 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-25T13:28:36.904 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-25T13:28:36.905 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-25T13:28:36.905 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-25T13:28:36.905 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-25T13:28:36.905 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-25T13:28:36.905 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-25T13:28:36.905 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-25T13:28:36.905 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-25T13:28:36.905 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-25T13:28:36.905 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-25T13:28:36.905 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-25T13:28:36.905 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-25T13:28:36.905 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-25T13:28:36.906 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-25T13:28:36.906 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-25T13:28:36.906 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-25T13:28:36.906 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-25T13:28:36.906 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-25T13:28:36.906 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-25T13:28:36.906 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-25T13:28:36.906 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-25T13:28:36.906 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-25T13:28:36.906 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-25T13:28:36.906 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-25T13:28:36.906 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-25T13:28:36.906 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-25T13:28:36.907 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-25T13:28:36.907 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-25T13:28:36.907 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-25T13:28:36.907 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-25T13:28:36.907 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-25T13:28:36.907 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-25T13:28:36.907 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-25T13:28:36.907 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-25T13:28:36.907 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-25T13:28:36.907 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-25T13:28:36.907 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-25T13:28:36.907 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-25T13:28:36.907 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-25T13:28:36.907 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-25T13:28:36.908 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-25T13:28:36.908 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-25T13:28:36.908 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-25T13:28:36.908 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-25T13:28:36.908 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-25T13:28:36.908 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-25T13:28:36.908 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-25T13:28:36.908 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-25T13:28:36.908 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-25T13:28:36.908 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-25T13:28:36.908 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-25T13:28:36.908 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-25T13:28:36.908 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-25T13:28:36.909 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-25T13:28:36.909 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-25T13:28:36.909 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-25T13:28:36.910 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-25T13:28:36.910 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-25T13:28:36.910 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-25T13:28:36.910 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-25T13:28:36.910 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-25T13:28:36.910 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-25T13:28:36.910 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-25T13:28:36.910 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-25T13:28:36.910 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-25T13:28:36.910 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-25T13:28:36.910 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-25T13:28:36.910 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-25T13:28:36.910 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-25T13:28:36.911 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-25T13:28:36.911 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-25T13:28:36.911 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-25T13:28:36.911 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-25T13:28:36.911 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-25T13:28:36.911 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-25T13:28:36.911 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-25T13:28:36.911 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-25T13:28:36.911 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-25T13:28:36.911 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-25T13:28:36.911 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-25T13:28:36.911 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-25T13:28:36.911 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-25T13:28:36.911 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-25T13:28:36.912 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-25T13:28:36.912 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-25T13:28:36.912 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-25T13:28:36.912 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-25T13:28:36.912 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-25T13:28:36.912 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-25T13:28:36.912 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-25T13:28:36.912 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-25T13:28:36.912 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-25T13:28:36.912 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-25T13:28:36.912 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-25T13:28:36.912 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-25T13:28:36.912 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-25T13:28:36.913 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-25T13:28:36.913 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-25T13:28:36.913 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-25T13:28:36.913 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-25T13:28:36.913 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-25T13:28:36.913 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-25T13:28:36.913 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-25T13:28:36.913 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-25T13:28:36.913 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-25T13:28:36.913 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-25T13:28:36.913 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-25T13:28:36.913 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-25T13:28:36.913 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-25T13:28:36.913 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-25T13:28:36.914 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-25T13:28:36.914 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-25T13:28:36.914 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-25T13:28:36.914 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-25T13:28:36.914 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-25T13:28:36.914 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-25T13:28:36.914 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-25T13:28:36.914 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-25T13:28:36.914 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-25T13:28:36.914 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-25T13:28:36.914 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-25T13:28:36.914 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-25T13:28:36.914 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-25T13:28:36.915 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-25T13:28:36.915 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-25T13:28:36.915 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-25T13:28:36.915 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-25T13:28:36.915 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-25T13:28:36.915 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-25T13:28:36.915 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-25T13:28:36.915 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-25T13:28:36.915 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-25T13:28:36.915 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-25T13:28:36.915 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-25T13:28:36.915 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-25T13:28:36.915 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-25T13:28:36.915 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-25T13:28:36.916 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-25T13:28:36.916 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-25T13:28:36.916 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-25T13:28:36.916 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-25T13:28:36.916 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-25T13:28:36.916 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-25T13:28:36.916 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-25T13:28:36.916 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-25T13:28:36.916 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-25T13:28:36.916 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-25T13:28:36.916 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-25T13:28:36.917 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-25T13:28:36.917 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-25T13:28:36.917 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-25T13:28:36.917 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-25T13:28:36.917 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-25T13:28:36.917 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-25T13:28:36.917 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-25T13:28:36.917 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-25T13:28:36.917 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-25T13:28:36.917 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-25T13:28:36.917 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-25T13:28:36.917 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-25T13:28:36.917 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-25T13:28:36.918 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-25T13:28:36.918 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-25T13:28:36.918 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-25T13:28:36.918 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-25T13:28:36.918 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-25T13:28:36.918 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-25T13:28:36.918 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-25T13:28:36.918 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-25T13:28:36.918 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-25T13:28:36.918 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-25T13:28:36.918 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-25T13:28:36.918 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-25T13:28:36.919 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-25T13:28:36.919 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-25T13:28:36.919 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-25T13:28:36.919 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-25T13:28:36.919 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-25T13:28:36.919 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-25T13:28:36.919 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-25T13:28:36.919 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-25T13:28:36.919 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-25T13:28:36.919 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-25T13:28:36.919 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-25T13:28:36.919 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-25T13:28:36.919 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-25T13:28:36.920 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-25T13:28:36.920 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-25T13:28:36.920 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-25T13:28:36.920 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-25T13:28:36.920 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-25T13:28:36.920 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-25T13:28:36.920 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-25T13:28:36.920 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-25T13:28:36.920 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-25T13:28:36.920 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-25T13:28:36.920 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-25T13:28:36.920 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-25T13:28:36.920 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-25T13:28:36.921 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-25T13:28:36.921 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-25T13:28:36.921 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-25T13:28:36.921 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-25T13:28:36.921 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-25T13:28:36.921 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-25T13:28:36.921 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-25T13:28:36.921 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-25T13:28:36.921 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-25T13:28:36.921 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-25T13:28:36.921 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-25T13:28:36.921 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-25T13:28:36.922 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-25T13:28:36.922 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-25T13:28:36.922 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-25T13:28:36.922 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-25T13:28:36.922 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-25T13:28:36.922 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-25T13:28:36.922 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-25T13:28:36.922 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-25T13:28:36.922 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-25T13:28:36.922 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-25T13:28:36.922 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-25T13:28:36.922 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-25T13:28:36.923 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-25T13:28:36.923 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-25T13:28:36.923 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-25T13:28:36.923 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-25T13:28:36.923 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-25T13:28:36.923 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-25T13:28:36.923 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-25T13:28:36.923 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-25T13:28:36.923 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-25T13:28:36.923 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-25T13:28:36.923 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-25T13:28:36.923 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-25T13:28:36.924 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-25T13:28:36.924 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-25T13:28:36.924 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-25T13:28:36.924 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-25T13:28:36.924 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-25T13:28:36.924 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-25T13:28:36.924 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-25T13:28:36.924 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-25T13:28:36.924 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-25T13:28:36.924 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-25T13:28:36.924 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-25T13:28:36.924 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-25T13:28:36.925 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-25T13:28:36.925 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-25T13:28:36.925 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-25T13:28:36.925 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-25T13:28:36.925 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-25T13:28:36.925 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-25T13:28:36.925 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-25T13:28:36.925 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-25T13:28:36.925 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-25T13:28:36.925 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-25T13:28:36.925 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-25T13:28:36.925 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-25T13:28:36.926 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-25T13:28:36.926 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-25T13:28:36.926 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-25T13:28:36.926 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-25T13:28:36.926 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-25T13:28:36.926 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-25T13:28:36.926 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-25T13:28:36.926 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-25T13:28:36.926 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-25T13:28:36.926 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-25T13:28:36.926 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-25T13:28:36.927 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-25T13:28:36.927 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-25T13:28:36.927 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-25T13:28:36.927 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-25T13:28:36.927 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-25T13:28:36.927 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-25T13:28:36.927 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-25T13:28:36.927 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-25T13:28:36.927 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-25T13:28:36.927 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-25T13:28:36.927 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-25T13:28:36.928 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-25T13:28:36.928 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-25T13:28:36.928 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-25T13:28:36.928 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-25T13:28:36.928 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-25T13:28:36.928 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-25T13:28:36.928 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-25T13:28:36.928 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-25T13:28:36.928 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-25T13:28:36.928 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-25T13:28:36.928 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-25T13:28:36.928 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-25T13:28:36.929 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-25T13:28:36.929 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-25T13:28:36.929 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-25T13:28:36.929 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-25T13:28:36.929 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-25T13:28:36.929 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-25T13:28:36.929 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-25T13:28:36.929 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-25T13:28:36.929 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-25T13:28:36.929 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-25T13:28:36.930 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-25T13:28:36.930 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-25T13:28:36.930 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-25T13:28:36.930 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-25T13:28:36.930 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-25T13:28:36.930 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-25T13:28:36.931 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-25T13:28:36.931 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-25T13:28:36.931 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-25T13:28:36.931 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-25T13:28:36.931 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-25T13:28:36.931 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-25T13:28:36.931 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-25T13:28:36.931 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-25T13:28:36.931 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-25T13:28:36.931 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-25T13:28:36.932 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-25T13:28:36.932 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-25T13:28:36.932 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-25T13:28:36.932 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-25T13:28:36.932 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-25T13:28:36.932 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-25T13:28:36.932 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-25T13:28:36.932 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-25T13:28:36.932 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-25T13:28:36.932 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-25T13:28:36.932 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-25T13:28:36.932 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-25T13:28:36.933 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-25T13:28:36.933 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-25T13:28:36.933 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-25T13:28:36.933 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-25T13:28:36.933 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-25T13:28:36.933 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-25T13:28:36.933 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-25T13:28:36.933 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-25T13:28:36.933 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-25T13:28:36.933 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-25T13:28:36.933 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-25T13:28:36.933 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-25T13:28:36.934 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-25T13:28:36.934 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-25T13:28:36.934 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-25T13:28:36.934 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-25T13:28:36.934 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-25T13:28:36.934 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-25T13:28:36.934 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-25T13:28:36.934 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-25T13:28:36.934 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-25T13:28:36.934 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-25T13:28:36.934 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-25T13:28:36.934 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-25T13:28:36.934 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-25T13:28:36.935 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-25T13:28:36.935 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-25T13:28:36.935 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-25T13:28:36.935 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-25T13:28:36.935 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-25T13:28:36.935 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-25T13:28:36.935 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-25T13:28:36.935 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-25T13:28:36.935 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-25T13:28:36.935 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-25T13:28:36.935 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-25T13:28:36.935 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-25T13:28:36.935 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-25T13:28:36.935 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-25T13:28:36.935 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-25T13:28:36.936 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-25T13:28:36.936 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-25T13:28:36.936 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-25T13:28:36.936 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-25T13:28:36.936 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-25T13:28:36.936 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-25T13:28:36.936 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-25T13:28:36.936 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-25T13:28:36.936 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-25T13:28:36.936 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-25T13:28:36.936 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-25T13:28:36.936 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-25T13:28:36.937 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-25T13:28:36.937 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-25T13:28:36.937 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-25T13:28:36.937 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-25T13:28:36.937 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-25T13:28:36.937 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-25T13:28:36.937 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-25T13:28:36.937 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-25T13:28:36.937 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-25T13:28:36.937 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-25T13:28:36.937 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-25T13:28:36.937 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-25T13:28:36.937 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-25T13:28:36.938 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-25T13:28:36.938 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-25T13:28:36.938 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-25T13:28:36.938 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-25T13:28:36.938 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-25T13:28:36.938 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-25T13:28:36.938 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-25T13:28:36.938 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-25T13:28:36.938 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-25T13:28:36.938 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-25T13:28:36.938 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-25T13:28:36.938 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-25T13:28:36.939 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-25T13:28:36.939 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-25T13:28:36.939 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-25T13:28:36.939 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-25T13:28:36.939 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-25T13:28:36.939 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-25T13:28:36.939 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-25T13:28:36.939 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-25T13:28:36.939 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-25T13:28:36.939 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-25T13:28:36.939 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-25T13:28:36.940 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-25T13:28:36.940 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-25T13:28:36.940 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-25T13:28:36.940 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-25T13:28:36.940 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-25T13:28:36.940 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-25T13:28:36.940 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-25T13:28:36.940 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-25T13:28:36.940 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-25T13:28:36.940 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-25T13:28:36.940 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-25T13:28:36.940 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-25T13:28:36.940 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-25T13:28:36.941 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-25T13:28:36.941 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-25T13:28:36.941 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-25T13:28:36.941 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-25T13:28:36.941 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-25T13:28:36.941 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-25T13:28:36.941 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-25T13:28:36.941 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-25T13:28:36.941 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-25T13:28:36.941 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-25T13:28:36.942 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-25T13:28:36.942 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-25T13:28:36.942 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-25T13:28:36.942 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-25T13:28:36.942 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-25T13:28:36.942 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-25T13:28:36.942 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-25T13:28:36.942 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-25T13:28:36.942 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-25T13:28:36.943 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-25T13:28:36.943 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-25T13:28:36.943 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-25T13:28:36.943 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-25T13:28:36.943 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-25T13:28:36.943 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-25T13:28:36.943 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-25T13:28:36.943 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-25T13:28:36.943 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-25T13:28:36.943 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-25T13:28:36.943 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-25T13:28:36.944 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-25T13:28:36.944 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-25T13:28:36.944 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-25T13:28:36.944 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-25T13:28:36.944 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-25T13:28:36.944 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-25T13:28:36.944 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-25T13:28:36.944 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-25T13:28:36.944 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-25T13:28:36.944 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-25T13:28:36.944 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-25T13:28:36.945 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-25T13:28:36.945 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-25T13:28:36.945 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-25T13:28:36.945 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-25T13:28:36.945 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-25T13:28:36.945 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-25T13:28:36.945 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-25T13:28:36.945 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-25T13:28:36.945 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-25T13:28:36.945 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-25T13:28:36.945 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-25T13:28:36.945 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-25T13:28:36.945 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-25T13:28:36.946 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-25T13:28:36.946 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-25T13:28:36.946 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-25T13:28:36.946 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-25T13:28:36.946 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-25T13:28:36.946 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-25T13:28:36.946 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-25T13:28:36.946 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-25T13:28:36.946 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-25T13:28:36.946 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-25T13:28:36.946 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-25T13:28:36.947 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-25T13:28:36.947 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-25T13:28:36.947 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-25T13:28:36.947 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-25T13:28:36.947 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-25T13:28:36.947 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-25T13:28:36.947 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-25T13:28:36.947 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-25T13:28:36.947 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-25T13:28:36.947 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-25T13:28:36.947 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-25T13:28:36.947 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-25T13:28:36.948 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-25T13:28:36.948 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-25T13:28:36.948 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-25T13:28:36.948 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-25T13:28:36.948 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-25T13:28:36.948 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-25T13:28:36.948 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-25T13:28:36.948 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-25T13:28:36.948 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-25T13:28:36.948 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-25T13:28:36.949 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-25T13:28:36.949 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-25T13:28:36.949 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-25T13:28:36.949 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-25T13:28:36.949 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-25T13:28:36.949 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-25T13:28:36.949 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-25T13:28:36.949 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-25T13:28:36.949 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-25T13:28:36.949 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-25T13:28:36.949 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-25T13:28:36.949 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-25T13:28:36.950 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-25T13:28:36.950 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-25T13:28:36.950 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-25T13:28:36.950 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-25T13:28:36.950 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-25T13:28:36.950 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-25T13:28:36.950 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-25T13:28:36.950 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-25T13:28:36.950 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-25T13:28:36.950 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-25T13:28:36.950 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-25T13:28:36.950 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-25T13:28:36.950 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-25T13:28:36.950 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-25T13:28:36.951 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-25T13:28:36.951 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-25T13:28:36.951 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-25T13:28:36.951 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-25T13:28:36.951 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-25T13:28:36.951 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-25T13:28:36.951 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-25T13:28:36.951 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-25T13:28:36.951 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-25T13:28:36.951 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-25T13:28:36.951 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-25T13:28:36.951 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-25T13:28:36.952 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-25T13:28:36.952 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-25T13:28:36.952 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-25T13:28:36.952 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-25T13:28:36.952 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-25T13:28:36.952 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-25T13:28:36.952 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-25T13:28:36.952 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-25T13:28:36.952 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-25T13:28:36.952 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-25T13:28:36.953 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-25T13:28:37.023 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-25T13:28:37.023 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-25T13:28:37.023 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-25T13:28:37.024 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-25T13:28:37.024 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-25T13:28:37.024 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-25T13:28:37.024 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-25T13:28:37.024 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-25T13:28:37.024 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-25T13:28:37.024 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-25T13:28:37.024 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-25T13:28:37.024 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-25T13:28:37.024 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-25T13:28:37.024 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-25T13:28:37.024 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-25T13:28:37.024 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-25T13:28:37.024 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-25T13:28:37.025 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-25T13:28:37.025 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-25T13:28:37.025 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-25T13:28:37.025 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-25T13:28:37.025 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-25T13:28:37.025 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-25T13:28:37.025 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-25T13:28:37.025 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-25T13:28:37.025 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-25T13:28:37.025 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-25T13:28:37.025 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-25T13:28:37.025 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-25T13:28:37.025 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-25T13:28:37.025 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-25T13:28:37.025 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-25T13:28:37.026 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-25T13:28:37.026 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-25T13:28:37.026 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-25T13:28:37.026 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-25T13:28:37.026 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-25T13:28:37.026 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-25T13:28:37.026 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-25T13:28:37.026 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-25T13:28:37.026 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-25T13:28:37.026 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-25T13:28:37.026 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-25T13:28:37.026 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-25T13:28:37.026 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-25T13:28:37.026 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-25T13:28:37.027 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-25T13:28:37.027 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-25T13:28:37.027 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-25T13:28:37.027 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-25T13:28:37.027 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-25T13:28:37.027 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-25T13:28:37.027 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-25T13:28:37.027 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-25T13:28:37.027 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-25T13:28:37.027 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-25T13:28:37.027 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-25T13:28:37.027 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-25T13:28:37.027 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-25T13:28:37.027 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-25T13:28:37.027 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-25T13:28:37.028 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-25T13:28:37.028 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-25T13:28:37.028 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-25T13:28:37.028 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-25T13:28:37.028 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-25T13:28:37.028 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-25T13:28:37.028 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-25T13:28:37.028 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-25T13:28:37.028 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-25T13:28:37.028 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-25T13:28:37.028 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-25T13:28:37.028 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-25T13:28:37.028 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-25T13:28:37.028 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-25T13:28:37.029 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-25T13:28:37.029 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-25T13:28:37.029 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-25T13:28:37.029 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-25T13:28:37.029 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-25T13:28:37.029 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-25T13:28:37.029 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-25T13:28:37.029 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-25T13:28:37.029 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-25T13:28:37.029 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-25T13:28:37.029 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-25T13:28:37.029 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-25T13:28:37.029 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-25T13:28:37.029 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-25T13:28:37.029 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-25T13:28:37.030 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-25T13:28:37.030 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-25T13:28:37.030 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-25T13:28:37.030 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-25T13:28:37.030 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-25T13:28:37.030 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-25T13:28:37.030 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-25T13:28:37.030 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-25T13:28:37.030 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-25T13:28:37.030 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-25T13:28:37.030 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-25T13:28:37.030 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-25T13:28:37.030 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-25T13:28:37.030 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-25T13:28:37.031 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-25T13:28:37.031 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-25T13:28:37.031 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-25T13:28:37.031 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-25T13:28:37.031 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-25T13:28:37.031 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-25T13:28:37.031 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-25T13:28:37.031 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-25T13:28:37.031 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-25T13:28:37.031 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-25T13:28:37.031 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-25T13:28:37.031 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-25T13:28:37.031 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-25T13:28:37.031 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-25T13:28:37.031 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-25T13:28:37.032 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-25T13:28:37.032 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-25T13:28:37.032 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-25T13:28:37.032 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-25T13:28:37.032 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-25T13:28:37.032 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-25T13:28:37.032 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-25T13:28:37.032 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-25T13:28:37.032 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-25T13:28:37.032 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-25T13:28:37.032 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-25T13:28:37.032 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-25T13:28:37.032 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-25T13:28:37.032 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-25T13:28:37.033 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-25T13:28:37.033 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-25T13:28:37.033 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-25T13:28:37.033 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-25T13:28:37.033 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-25T13:28:37.033 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-25T13:28:37.033 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-25T13:28:37.033 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-25T13:28:37.033 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-25T13:28:37.033 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-25T13:28:37.033 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-25T13:28:37.033 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-25T13:28:37.033 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-25T13:28:37.033 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-25T13:28:37.033 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-25T13:28:37.034 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-25T13:28:37.034 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-25T13:28:37.034 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-25T13:28:37.034 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-25T13:28:37.034 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-25T13:28:37.034 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-25T13:28:37.034 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-25T13:28:37.034 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-25T13:28:37.034 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-25T13:28:37.034 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-25T13:28:37.034 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-25T13:28:37.034 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-25T13:28:37.034 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-25T13:28:37.034 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-25T13:28:37.035 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-25T13:28:37.035 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-25T13:28:37.035 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-25T13:28:37.035 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-25T13:28:37.035 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-25T13:28:37.035 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-25T13:28:37.035 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-25T13:28:37.035 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-25T13:28:37.035 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-25T13:28:37.035 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-25T13:28:37.035 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-25T13:28:37.035 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-25T13:28:37.035 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-25T13:28:37.035 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-25T13:28:37.035 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-25T13:28:37.036 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-25T13:28:37.036 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-25T13:28:37.036 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-25T13:28:37.036 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-25T13:28:37.036 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-25T13:28:37.036 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-25T13:28:37.036 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-25T13:28:37.036 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-25T13:28:37.036 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-25T13:28:37.036 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-25T13:28:37.036 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-25T13:28:37.036 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-25T13:28:37.036 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-25T13:28:37.036 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-25T13:28:37.037 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-25T13:28:37.037 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-25T13:28:37.037 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-25T13:28:37.037 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-25T13:28:37.037 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-25T13:28:37.037 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-25T13:28:37.037 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-25T13:28:37.037 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-25T13:28:37.037 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-25T13:28:37.037 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-25T13:28:37.037 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-25T13:28:37.037 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-25T13:28:37.037 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-25T13:28:37.037 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-25T13:28:37.038 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-25T13:28:37.038 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-25T13:28:37.038 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-25T13:28:37.038 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-25T13:28:37.038 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-25T13:28:37.038 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-25T13:28:37.038 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-25T13:28:37.038 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-25T13:28:37.038 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-25T13:28:37.038 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-25T13:28:37.038 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-25T13:28:37.038 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-25T13:28:37.038 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-25T13:28:37.038 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-25T13:28:37.038 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-25T13:28:37.039 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-25T13:28:37.039 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-25T13:28:37.039 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-25T13:28:37.039 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-25T13:28:37.039 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-25T13:28:37.039 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-25T13:28:37.039 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-25T13:28:37.039 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-25T13:28:37.039 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-25T13:28:37.039 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-25T13:28:37.039 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-25T13:28:37.039 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-25T13:28:37.039 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-25T13:28:37.039 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-25T13:28:37.040 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-25T13:28:37.040 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-25T13:28:37.040 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-25T13:28:37.040 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-25T13:28:37.040 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-25T13:28:37.040 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-25T13:28:37.040 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-25T13:28:37.040 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-25T13:28:37.040 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-25T13:28:37.040 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-25T13:28:37.040 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-25T13:28:37.040 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-25T13:28:37.040 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-25T13:28:37.040 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-25T13:28:37.040 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-25T13:28:37.041 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-25T13:28:37.041 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-25T13:28:37.041 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-25T13:28:37.041 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-25T13:28:37.041 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-25T13:28:37.041 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-25T13:28:37.041 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-25T13:28:37.041 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-25T13:28:37.041 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-25T13:28:37.041 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-25T13:28:37.041 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-25T13:28:37.041 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-25T13:28:37.041 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-25T13:28:37.041 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-25T13:28:37.042 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-25T13:28:37.042 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-25T13:28:37.042 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-25T13:28:37.042 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-25T13:28:37.042 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-25T13:28:37.042 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-25T13:28:37.042 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-25T13:28:37.042 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-25T13:28:37.042 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-25T13:28:37.042 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-25T13:28:37.042 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-25T13:28:37.042 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-25T13:28:37.042 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-25T13:28:37.042 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-25T13:28:37.043 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-25T13:28:37.043 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-25T13:28:37.043 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-25T13:28:37.043 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-25T13:28:37.043 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-25T13:28:37.043 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-25T13:28:37.043 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-25T13:28:37.043 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-25T13:28:37.043 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-25T13:28:37.043 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-25T13:28:37.043 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-25T13:28:37.043 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-25T13:28:37.043 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-25T13:28:37.043 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-25T13:28:37.044 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-25T13:28:37.044 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-25T13:28:37.044 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-25T13:28:37.044 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-25T13:28:37.044 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-25T13:28:37.044 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-25T13:28:37.044 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-25T13:28:37.044 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-25T13:28:37.044 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-25T13:28:37.044 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-25T13:28:37.044 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-25T13:28:37.045 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-25T13:28:37.045 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-25T13:28:37.045 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-25T13:28:37.045 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-25T13:28:37.045 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-25T13:28:37.045 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-25T13:28:37.045 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-25T13:28:37.045 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-25T13:28:37.045 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-25T13:28:37.045 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-25T13:28:37.045 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-25T13:28:37.045 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-25T13:28:37.045 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-25T13:28:37.045 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-25T13:28:37.045 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-25T13:28:37.046 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-25T13:28:37.046 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-25T13:28:37.046 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-25T13:28:37.046 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-25T13:28:37.046 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-25T13:28:37.046 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-25T13:28:37.046 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-25T13:28:37.046 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-25T13:28:37.046 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-25T13:28:37.046 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-25T13:28:37.046 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-25T13:28:37.046 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-25T13:28:37.046 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-25T13:28:37.047 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-25T13:28:37.047 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-25T13:28:37.047 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-25T13:28:37.047 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-25T13:28:37.047 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-25T13:28:37.047 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-25T13:28:37.047 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-25T13:28:37.047 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-25T13:28:37.047 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-25T13:28:37.047 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-25T13:28:37.047 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-25T13:28:37.047 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-25T13:28:37.047 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-25T13:28:37.047 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-25T13:28:37.047 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-25T13:28:37.048 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-25T13:28:37.048 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-25T13:28:37.048 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-25T13:28:37.048 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-25T13:28:37.048 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-25T13:28:37.048 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-25T13:28:37.048 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-25T13:28:37.048 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-25T13:28:37.048 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-25T13:28:37.048 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-25T13:28:37.048 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-25T13:28:37.048 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-25T13:28:37.048 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-25T13:28:37.048 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-25T13:28:37.048 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-25T13:28:37.049 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-25T13:28:37.049 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-25T13:28:37.049 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-25T13:28:37.049 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-25T13:28:37.049 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-25T13:28:37.049 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-25T13:28:37.049 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-25T13:28:37.049 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-25T13:28:37.049 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-25T13:28:37.049 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-25T13:28:37.049 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-25T13:28:37.049 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-25T13:28:37.049 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-25T13:28:37.049 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-25T13:28:37.050 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-25T13:28:37.050 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-25T13:28:37.050 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-25T13:28:37.050 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-25T13:28:37.050 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-25T13:28:37.050 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-25T13:28:37.050 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-25T13:28:37.050 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-25T13:28:37.050 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-25T13:28:37.050 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-25T13:28:37.050 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-25T13:28:37.050 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-25T13:28:37.050 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-25T13:28:37.050 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-25T13:28:37.050 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-25T13:28:37.051 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-25T13:28:37.051 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-25T13:28:37.051 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-25T13:28:37.051 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-25T13:28:37.051 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-25T13:28:37.051 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-25T13:28:37.051 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-25T13:28:37.051 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-25T13:28:37.051 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-25T13:28:37.051 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-25T13:28:37.051 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-25T13:28:37.051 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-25T13:28:37.051 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-25T13:28:37.051 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-25T13:28:37.051 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-25T13:28:37.052 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-25T13:28:37.052 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-25T13:28:37.052 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-25T13:28:37.052 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-25T13:28:37.052 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-25T13:28:37.052 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-25T13:28:37.052 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-25T13:28:37.052 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-25T13:28:37.052 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-25T13:28:37.052 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-25T13:28:37.052 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-25T13:28:37.052 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-25T13:28:37.052 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-25T13:28:37.052 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-25T13:28:37.053 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-25T13:28:37.053 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-25T13:28:37.053 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-25T13:28:37.053 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-25T13:28:37.053 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-25T13:28:37.053 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-25T13:28:37.053 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-25T13:28:37.053 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-25T13:28:37.053 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-25T13:28:37.053 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-25T13:28:37.053 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-25T13:28:37.053 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-25T13:28:37.053 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-25T13:28:37.053 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-25T13:28:37.053 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-25T13:28:37.054 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-25T13:28:37.054 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-25T13:28:37.054 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-25T13:28:37.054 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-25T13:28:37.054 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-25T13:28:37.054 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-25T13:28:37.054 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-25T13:28:37.054 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-25T13:28:37.054 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-25T13:28:37.054 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-25T13:28:37.054 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-25T13:28:37.054 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-25T13:28:37.054 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-25T13:28:37.054 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-25T13:28:37.055 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-25T13:28:37.055 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-25T13:28:37.055 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-25T13:28:37.055 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-25T13:28:37.055 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-25T13:28:37.055 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-25T13:28:37.055 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-25T13:28:37.055 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-25T13:28:37.055 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-25T13:28:37.055 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-25T13:28:37.055 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-25T13:28:37.055 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-25T13:28:37.055 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-25T13:28:37.055 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-25T13:28:37.055 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-25T13:28:37.056 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-25T13:28:37.056 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-25T13:28:37.056 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-25T13:28:37.056 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-25T13:28:37.056 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-25T13:28:37.056 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-25T13:28:37.056 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-25T13:28:37.056 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-25T13:28:37.056 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-25T13:28:37.056 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-25T13:28:37.056 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-25T13:28:37.056 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-25T13:28:37.056 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-25T13:28:37.056 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-25T13:28:37.057 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-25T13:28:37.057 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-25T13:28:37.057 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-25T13:28:37.057 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-25T13:28:37.057 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-25T13:28:37.057 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-25T13:28:37.057 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-25T13:28:37.057 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-25T13:28:37.057 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-25T13:28:37.057 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-25T13:28:37.057 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-25T13:28:37.057 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-25T13:28:37.057 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-25T13:28:37.057 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-25T13:28:37.057 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-25T13:28:37.058 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-25T13:28:37.058 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-25T13:28:37.058 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-25T13:28:37.058 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-25T13:28:37.058 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-25T13:28:37.058 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-25T13:28:37.058 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-25T13:28:37.058 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-25T13:28:37.058 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-25T13:28:37.058 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-25T13:28:37.058 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-25T13:28:37.058 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-25T13:28:37.058 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-25T13:28:37.058 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-25T13:28:37.059 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-25T13:28:37.059 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-25T13:28:37.059 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-25T13:28:37.059 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-25T13:28:37.059 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-25T13:28:37.059 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-25T13:28:37.059 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-25T13:28:37.059 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-25T13:28:37.059 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-25T13:28:37.059 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-25T13:28:37.059 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-25T13:28:37.059 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-25T13:28:37.059 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-25T13:28:37.059 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-25T13:28:37.060 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-25T13:28:37.060 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-25T13:28:37.060 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-25T13:28:37.060 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-25T13:28:37.060 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-25T13:28:37.060 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-25T13:28:37.060 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-25T13:28:37.060 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-25T13:28:37.060 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-25T13:28:37.060 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-25T13:28:37.060 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-25T13:28:37.060 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-25T13:28:37.060 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-25T13:28:37.060 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-25T13:28:37.060 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-25T13:28:37.061 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-25T13:28:37.061 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-25T13:28:37.061 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-25T13:28:37.061 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-25T13:28:37.061 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-25T13:28:37.061 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-25T13:28:37.061 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-25T13:28:37.061 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-25T13:28:37.061 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-25T13:28:37.061 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-25T13:28:37.061 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-25T13:28:37.061 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-25T13:28:37.061 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-25T13:28:37.061 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-25T13:28:37.061 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-25T13:28:37.062 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-25T13:28:37.062 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-25T13:28:37.062 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-25T13:28:37.062 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-25T13:28:37.062 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-25T13:28:37.062 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-25T13:28:37.062 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-25T13:28:37.062 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-25T13:28:37.062 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-25T13:28:37.062 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-25T13:28:37.062 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-25T13:28:37.062 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-25T13:28:37.062 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-25T13:28:37.062 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-25T13:28:37.063 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-25T13:28:37.063 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-25T13:28:37.063 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-25T13:28:37.063 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-25T13:28:37.063 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-25T13:28:37.063 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-25T13:28:37.063 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-25T13:28:37.063 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-25T13:28:37.063 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-25T13:28:37.063 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-25T13:28:37.063 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-25T13:28:37.063 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-25T13:28:37.063 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-25T13:28:37.063 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-25T13:28:37.064 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-25T13:28:37.064 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-25T13:28:37.064 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-25T13:28:37.064 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-25T13:28:37.064 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-25T13:28:37.064 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-25T13:28:37.064 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-25T13:28:37.064 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-25T13:28:37.064 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-25T13:28:37.064 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-25T13:28:37.064 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-25T13:28:37.064 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-25T13:28:37.064 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-25T13:28:37.064 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-25T13:28:37.064 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-25T13:28:37.065 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-25T13:28:37.065 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-25T13:28:37.065 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-25T13:28:37.065 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-25T13:28:37.065 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-25T13:28:37.065 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-25T13:28:37.065 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-25T13:28:37.065 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-25T13:28:37.065 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-25T13:28:37.065 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-25T13:28:37.065 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-25T13:28:37.065 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-25T13:28:37.065 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-25T13:28:37.065 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-25T13:28:37.066 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-25T13:28:37.066 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-25T13:28:37.066 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-25T13:28:37.066 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-25T13:28:37.066 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-25T13:28:37.066 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-25T13:28:37.066 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-25T13:28:37.066 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-25T13:28:37.066 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-25T13:28:37.066 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-25T13:28:37.066 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-25T13:28:37.066 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-25T13:28:37.066 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-25T13:28:37.066 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-25T13:28:37.067 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-25T13:28:37.067 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-25T13:28:37.067 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-25T13:28:37.067 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-25T13:28:37.067 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-25T13:28:37.067 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-25T13:28:37.067 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-25T13:28:37.067 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-25T13:28:37.067 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-25T13:28:37.067 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-25T13:28:37.067 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-25T13:28:37.067 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-25T13:28:37.067 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-25T13:28:37.067 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-25T13:28:37.068 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-25T13:28:37.068 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-25T13:28:37.068 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-25T13:28:37.068 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-25T13:28:37.068 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-25T13:28:37.068 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-25T13:28:37.068 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-25T13:28:37.068 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-25T13:28:37.068 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-25T13:28:37.068 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-25T13:28:37.068 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-25T13:28:37.068 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-25T13:28:37.068 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-25T13:28:37.068 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-25T13:28:37.068 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-25T13:28:37.069 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-25T13:28:37.069 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-25T13:28:37.069 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-25T13:28:37.069 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-25T13:28:37.069 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-25T13:28:37.069 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-25T13:28:37.069 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-25T13:28:37.069 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-25T13:28:37.069 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-25T13:28:37.069 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-25T13:28:37.069 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-25T13:28:37.069 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-25T13:28:37.069 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-25T13:28:37.069 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-25T13:28:37.069 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-25T13:28:37.070 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-25T13:28:37.070 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-25T13:28:37.070 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-25T13:28:37.070 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-25T13:28:37.070 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-25T13:28:37.070 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-25T13:28:37.070 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-25T13:28:37.070 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-25T13:28:37.070 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-25T13:28:37.070 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-25T13:28:37.070 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-25T13:28:37.070 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-25T13:28:37.070 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-25T13:28:37.070 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-25T13:28:37.071 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-25T13:28:37.071 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-25T13:28:37.071 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-25T13:28:37.071 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-25T13:28:37.071 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-25T13:28:37.071 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-25T13:28:37.071 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-25T13:28:37.071 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-25T13:28:37.071 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-25T13:28:37.071 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-25T13:28:37.071 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-25T13:28:37.071 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-25T13:28:37.071 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-25T13:28:37.071 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-25T13:28:37.071 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-25T13:28:37.072 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-25T13:28:37.072 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-25T13:28:37.072 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-25T13:28:37.072 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-25T13:28:37.072 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-25T13:28:37.072 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-25T13:28:37.072 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-25T13:28:37.072 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-25T13:28:37.072 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-25T13:28:37.072 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-25T13:28:37.072 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-25T13:28:37.072 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-25T13:28:37.072 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-25T13:28:37.072 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-25T13:28:37.072 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-25T13:28:37.073 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-25T13:28:37.073 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-25T13:28:37.073 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-25T13:28:37.073 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-25T13:28:37.073 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-25T13:28:37.073 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-25T13:28:37.073 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-25T13:28:37.073 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-25T13:28:37.073 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-25T13:28:37.073 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-25T13:28:37.073 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-25T13:28:37.073 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-25T13:28:37.073 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-25T13:28:37.073 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-25T13:28:37.073 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-25T13:28:37.074 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-25T13:28:37.074 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-25T13:28:37.074 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-25T13:28:37.074 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-25T13:28:37.074 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-25T13:28:37.074 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-25T13:28:37.074 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-25T13:28:37.074 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-25T13:28:37.074 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-25T13:28:37.074 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-25T13:28:37.074 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-25T13:28:37.074 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-25T13:28:37.074 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-25T13:28:37.074 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-25T13:28:37.075 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-25T13:28:37.075 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-25T13:28:37.075 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-25T13:28:37.075 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-25T13:28:37.075 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-25T13:28:37.075 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-25T13:28:37.075 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-25T13:28:37.075 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-25T13:28:37.075 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-25T13:28:37.075 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-25T13:28:37.075 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-25T13:28:37.075 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-25T13:28:37.075 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-25T13:28:37.075 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-25T13:28:37.075 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-25T13:28:37.076 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-25T13:28:37.076 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-25T13:28:37.076 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-25T13:28:37.076 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-25T13:28:37.076 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-25T13:28:37.076 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-25T13:28:37.076 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-25T13:28:37.076 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-25T13:28:37.076 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-25T13:28:37.076 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-25T13:28:37.076 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-25T13:28:37.076 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-25T13:28:37.076 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-25T13:28:37.076 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-25T13:28:37.076 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-25T13:28:37.077 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-25T13:28:37.077 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-25T13:28:37.077 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-25T13:28:37.077 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-25T13:28:37.077 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-25T13:28:37.077 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-25T13:28:37.077 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-25T13:28:37.077 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-25T13:28:37.077 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-25T13:28:37.077 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-25T13:28:37.077 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-25T13:28:37.077 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-25T13:28:37.077 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-25T13:28:37.077 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-25T13:28:37.077 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-25T13:28:37.078 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-25T13:28:37.078 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-25T13:28:37.078 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-25T13:28:37.078 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-25T13:28:37.078 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-25T13:28:37.078 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-25T13:28:37.078 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-25T13:28:37.078 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-25T13:28:37.078 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-25T13:28:37.078 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-25T13:28:37.078 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-25T13:28:37.079 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-25T13:28:37.079 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-25T13:28:37.079 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-25T13:28:37.079 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-25T13:28:37.079 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-25T13:28:37.079 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-25T13:28:37.079 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-25T13:28:37.079 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-25T13:28:37.079 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-25T13:28:37.079 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-25T13:28:37.079 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-25T13:28:37.079 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-25T13:28:37.079 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-25T13:28:37.079 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-25T13:28:37.080 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-25T13:28:37.080 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-25T13:28:37.080 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-25T13:28:37.080 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-25T13:28:37.080 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-25T13:28:37.080 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-25T13:28:37.080 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-25T13:28:37.080 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-25T13:28:37.080 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-25T13:28:37.080 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-25T13:28:37.080 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-25T13:28:37.080 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-25T13:28:37.080 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-25T13:28:37.080 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-25T13:28:37.080 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-25T13:28:37.081 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-25T13:28:37.081 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-25T13:28:37.081 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-25T13:28:37.081 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-25T13:28:37.081 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-25T13:28:37.081 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-25T13:28:37.081 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-25T13:28:37.081 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-25T13:28:37.081 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-25T13:28:37.081 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-25T13:28:37.081 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-25T13:28:37.081 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-25T13:28:37.081 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-25T13:28:37.081 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-25T13:28:37.081 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-25T13:28:37.082 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-25T13:28:37.082 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-25T13:28:37.082 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-25T13:28:37.082 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-25T13:28:37.082 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-25T13:28:37.082 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-25T13:28:37.082 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-25T13:28:37.082 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-25T13:28:37.082 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-25T13:28:37.082 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-25T13:28:37.082 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-25T13:28:37.082 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-25T13:28:37.082 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-25T13:28:37.082 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-25T13:28:37.083 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-25T13:28:37.083 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-25T13:28:37.083 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-25T13:28:37.083 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-25T13:28:37.083 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-25T13:28:37.083 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-25T13:28:37.083 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-25T13:28:37.083 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-25T13:28:37.083 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-25T13:28:37.083 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-25T13:28:37.083 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-25T13:28:37.083 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-25T13:28:37.083 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-25T13:28:37.083 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-25T13:28:37.084 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-25T13:28:37.084 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-25T13:28:37.084 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-25T13:28:37.084 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-25T13:28:37.084 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-25T13:28:37.084 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-25T13:28:37.084 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-25T13:28:37.139 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-25T13:28:37.139 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-25T13:28:37.140 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-25T13:28:37.140 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-25T13:28:37.140 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-25T13:28:37.140 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-25T13:28:37.140 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-25T13:28:37.140 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-25T13:28:37.140 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-25T13:28:37.140 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-25T13:28:37.140 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-25T13:28:37.140 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-25T13:28:37.140 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-25T13:28:37.140 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-25T13:28:37.140 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-25T13:28:37.141 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-25T13:28:37.141 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-25T13:28:37.141 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-25T13:28:37.141 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-25T13:28:37.141 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-25T13:28:37.141 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-25T13:28:37.141 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-25T13:28:37.141 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-25T13:28:37.141 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-25T13:28:37.141 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-25T13:28:37.141 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-25T13:28:37.141 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-25T13:28:37.141 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-25T13:28:37.141 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-25T13:28:37.142 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-25T13:28:37.142 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-25T13:28:37.142 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-25T13:28:37.142 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-25T13:28:37.142 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-25T13:28:37.142 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-25T13:28:37.142 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-25T13:28:37.142 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-25T13:28:37.142 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-25T13:28:37.142 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-25T13:28:37.142 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-25T13:28:37.142 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-25T13:28:37.142 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-25T13:28:37.142 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-25T13:28:37.143 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-25T13:28:37.143 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-25T13:28:37.143 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-25T13:28:37.143 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-25T13:28:37.143 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-25T13:28:37.143 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-25T13:28:37.143 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-25T13:28:37.143 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-25T13:28:37.143 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-25T13:28:37.143 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-25T13:28:37.143 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-25T13:28:37.143 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-25T13:28:37.143 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-25T13:28:37.143 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-25T13:28:37.144 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-25T13:28:37.144 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-25T13:28:37.144 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-25T13:28:37.144 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-25T13:28:37.144 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-25T13:28:37.144 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-25T13:28:37.144 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-25T13:28:37.144 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-25T13:28:37.144 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-25T13:28:37.144 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-25T13:28:37.144 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-25T13:28:37.144 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-25T13:28:37.144 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-25T13:28:37.144 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-25T13:28:37.144 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-25T13:28:37.145 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-25T13:28:37.145 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-25T13:28:37.145 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-25T13:28:37.145 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-25T13:28:37.145 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-25T13:28:37.145 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-25T13:28:37.145 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-25T13:28:37.145 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-25T13:28:37.145 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-25T13:28:37.145 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-25T13:28:37.145 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-25T13:28:37.145 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-25T13:28:37.145 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-25T13:28:37.145 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-25T13:28:37.146 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-25T13:28:37.146 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-25T13:28:37.146 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-25T13:28:37.146 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-25T13:28:37.146 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-25T13:28:37.146 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-25T13:28:37.146 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-25T13:28:37.146 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-25T13:28:37.146 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-25T13:28:37.146 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-25T13:28:37.146 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-25T13:28:37.146 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-25T13:28:37.146 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-25T13:28:37.146 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-25T13:28:37.147 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-25T13:28:37.147 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-25T13:28:37.147 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-25T13:28:37.147 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-25T13:28:37.147 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-25T13:28:37.147 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-25T13:28:37.147 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-25T13:28:37.147 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-25T13:28:37.147 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-25T13:28:37.147 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-25T13:28:37.147 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-25T13:28:37.147 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-25T13:28:37.147 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-25T13:28:37.147 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-25T13:28:37.148 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-25T13:28:37.148 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-25T13:28:37.148 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-25T13:28:37.148 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-25T13:28:37.148 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-25T13:28:37.148 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-25T13:28:37.148 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-25T13:28:37.148 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-25T13:28:37.148 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-25T13:28:37.148 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-25T13:28:37.148 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-25T13:28:37.148 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-25T13:28:37.148 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-25T13:28:37.148 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-25T13:28:37.148 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-25T13:28:37.149 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-25T13:28:37.149 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-25T13:28:37.149 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-25T13:28:37.149 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-25T13:28:37.149 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-25T13:28:37.149 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-25T13:28:37.149 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-25T13:28:37.149 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-25T13:28:37.149 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-25T13:28:37.149 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-25T13:28:37.149 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-25T13:28:37.149 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-25T13:28:37.149 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-25T13:28:37.149 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-25T13:28:37.149 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-25T13:28:37.150 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-25T13:28:37.150 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-25T13:28:37.150 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-25T13:28:37.150 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-25T13:28:37.150 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-25T13:28:37.150 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-25T13:28:37.150 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-25T13:28:37.150 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-25T13:28:37.150 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-25T13:28:37.150 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-25T13:28:37.150 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-25T13:28:37.150 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-25T13:28:37.150 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-25T13:28:37.150 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-25T13:28:37.151 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-25T13:28:37.151 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-25T13:28:37.151 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-25T13:28:37.151 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-25T13:28:37.151 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-25T13:28:37.151 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-25T13:28:37.151 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-25T13:28:37.151 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-25T13:28:37.151 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-25T13:28:37.151 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-25T13:28:37.151 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-25T13:28:37.151 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-25T13:28:37.151 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-25T13:28:37.151 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-25T13:28:37.151 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-25T13:28:37.152 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-25T13:28:37.152 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-25T13:28:37.152 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-25T13:28:37.152 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-25T13:28:37.152 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-25T13:28:37.152 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-25T13:28:37.152 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-25T13:28:37.152 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-25T13:28:37.152 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-25T13:28:37.152 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-25T13:28:37.152 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-25T13:28:37.152 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-25T13:28:37.152 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-25T13:28:37.152 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-25T13:28:37.153 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-25T13:28:37.153 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-25T13:28:37.153 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-25T13:28:37.153 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-25T13:28:37.153 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-25T13:28:37.153 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-25T13:28:37.153 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-25T13:28:37.153 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-25T13:28:37.153 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-25T13:28:37.153 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-25T13:28:37.153 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-25T13:28:37.153 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-25T13:28:37.153 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-25T13:28:37.153 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-25T13:28:37.153 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-25T13:28:37.154 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-25T13:28:37.154 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-25T13:28:37.154 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-25T13:28:37.154 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-25T13:28:37.154 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-25T13:28:37.154 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-25T13:28:37.154 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-25T13:28:37.154 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-25T13:28:37.154 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-25T13:28:37.154 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-25T13:28:37.154 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-25T13:28:37.154 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-25T13:28:37.154 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-25T13:28:37.154 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-25T13:28:37.154 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-25T13:28:37.155 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-25T13:28:37.155 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-25T13:28:37.155 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-25T13:28:37.155 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-25T13:28:37.155 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-25T13:28:37.155 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-25T13:28:37.155 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-25T13:28:37.155 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-25T13:28:37.155 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-25T13:28:37.155 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-25T13:28:37.155 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-25T13:28:37.155 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-25T13:28:37.155 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-25T13:28:37.155 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-25T13:28:37.156 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-25T13:28:37.156 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-25T13:28:37.156 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-25T13:28:37.156 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-25T13:28:37.156 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-25T13:28:37.156 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-25T13:28:37.156 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-25T13:28:37.156 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-25T13:28:37.156 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-25T13:28:37.156 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-25T13:28:37.156 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-25T13:28:37.156 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-25T13:28:37.156 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-25T13:28:37.156 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-25T13:28:37.157 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-25T13:28:37.157 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-25T13:28:37.157 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-25T13:28:37.157 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-25T13:28:37.157 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-25T13:28:37.157 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-25T13:28:37.157 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-25T13:28:37.157 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-25T13:28:37.157 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-25T13:28:37.157 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-25T13:28:37.157 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-25T13:28:37.157 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-25T13:28:37.157 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-25T13:28:37.157 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-25T13:28:37.157 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-25T13:28:37.158 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-25T13:28:37.158 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-25T13:28:37.158 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-25T13:28:37.158 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-25T13:28:37.158 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-25T13:28:37.158 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-25T13:28:37.158 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-25T13:28:37.158 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-25T13:28:37.158 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-25T13:28:37.158 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-25T13:28:37.158 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-25T13:28:37.158 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-25T13:28:37.158 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-25T13:28:37.158 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-25T13:28:37.159 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-25T13:28:37.159 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-25T13:28:37.159 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-25T13:28:37.159 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-25T13:28:37.159 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-25T13:28:37.159 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-25T13:28:37.159 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-25T13:28:37.159 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-25T13:28:37.159 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-25T13:28:37.159 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-25T13:28:37.159 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-25T13:28:37.159 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-25T13:28:37.159 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-25T13:28:37.159 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-25T13:28:37.159 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-25T13:28:37.160 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-25T13:28:37.160 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-25T13:28:37.160 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-25T13:28:37.160 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-25T13:28:37.160 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-25T13:28:37.160 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-25T13:28:37.160 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-25T13:28:37.160 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-25T13:28:37.160 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-25T13:28:37.160 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-25T13:28:37.160 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-25T13:28:37.160 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-25T13:28:37.160 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-25T13:28:37.160 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-25T13:28:37.160 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-25T13:28:37.161 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-25T13:28:37.161 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-25T13:28:37.161 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-25T13:28:37.161 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-25T13:28:37.161 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-25T13:28:37.161 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-25T13:28:37.161 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-25T13:28:37.161 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-25T13:28:37.161 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-25T13:28:37.161 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-25T13:28:37.161 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-25T13:28:37.161 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-25T13:28:37.161 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-25T13:28:37.161 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-25T13:28:37.161 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-25T13:28:37.162 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-25T13:28:37.162 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-25T13:28:37.162 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-25T13:28:37.162 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-25T13:28:37.162 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-25T13:28:37.162 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-25T13:28:37.162 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-25T13:28:37.162 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-25T13:28:37.162 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-25T13:28:37.162 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-25T13:28:37.162 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-25T13:28:37.162 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-25T13:28:37.162 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-25T13:28:37.162 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-25T13:28:37.162 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-25T13:28:37.163 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-25T13:28:37.163 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-25T13:28:37.163 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-25T13:28:37.163 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-25T13:28:37.163 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-25T13:28:37.163 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-25T13:28:37.163 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-25T13:28:37.163 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-25T13:28:37.163 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-25T13:28:37.163 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-25T13:28:37.163 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-25T13:28:37.163 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-25T13:28:37.163 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-25T13:28:37.163 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-25T13:28:37.164 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-25T13:28:37.164 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-25T13:28:37.164 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-25T13:28:37.164 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-25T13:28:37.164 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-25T13:28:37.164 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-25T13:28:37.164 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-25T13:28:37.164 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-25T13:28:37.164 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-25T13:28:37.164 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-25T13:28:37.164 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-25T13:28:37.164 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-25T13:28:37.164 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-25T13:28:37.164 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-25T13:28:37.164 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-25T13:28:37.165 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-25T13:28:37.165 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-25T13:28:37.165 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-25T13:28:37.165 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-25T13:28:37.165 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-25T13:28:37.165 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-25T13:28:37.165 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-25T13:28:37.165 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-25T13:28:37.165 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-25T13:28:37.165 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-25T13:28:37.165 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-25T13:28:37.165 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-25T13:28:37.165 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-25T13:28:37.165 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-25T13:28:37.166 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-25T13:28:37.166 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-25T13:28:37.166 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-25T13:28:37.166 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-25T13:28:37.166 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-25T13:28:37.166 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-25T13:28:37.166 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-25T13:28:37.166 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-25T13:28:37.166 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-25T13:28:37.166 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-25T13:28:37.166 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-25T13:28:37.166 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-25T13:28:37.166 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-25T13:28:37.166 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-25T13:28:37.166 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-25T13:28:37.167 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-25T13:28:37.167 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-25T13:28:37.167 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-25T13:28:37.167 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-25T13:28:37.167 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-25T13:28:37.167 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-25T13:28:37.167 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-25T13:28:37.167 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-25T13:28:37.167 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-25T13:28:37.167 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-25T13:28:37.167 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-25T13:28:37.167 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-25T13:28:37.167 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-25T13:28:37.168 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-25T13:28:37.168 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-25T13:28:37.168 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-25T13:28:37.168 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-25T13:28:37.168 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-25T13:28:37.168 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-25T13:28:37.168 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-25T13:28:37.168 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-25T13:28:37.168 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-25T13:28:37.168 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-25T13:28:37.168 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-25T13:28:37.168 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-25T13:28:37.168 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-25T13:28:37.168 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-25T13:28:37.168 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-25T13:28:37.169 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-25T13:28:37.169 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-25T13:28:37.169 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-25T13:28:37.169 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-25T13:28:37.169 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-25T13:28:37.169 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-25T13:28:37.169 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-25T13:28:37.169 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-25T13:28:37.169 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-25T13:28:37.169 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-25T13:28:37.169 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-25T13:28:37.169 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-25T13:28:37.169 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-25T13:28:37.169 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-25T13:28:37.170 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-25T13:28:37.170 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-25T13:28:37.170 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-25T13:28:37.170 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-25T13:28:37.170 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-25T13:28:37.170 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-25T13:28:37.170 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-25T13:28:37.170 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-25T13:28:37.170 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-25T13:28:37.170 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-25T13:28:37.170 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-25T13:28:37.170 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-25T13:28:37.170 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-25T13:28:37.170 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-25T13:28:37.170 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-25T13:28:37.171 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-25T13:28:37.171 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-25T13:28:37.171 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-25T13:28:37.171 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-25T13:28:37.171 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-25T13:28:37.171 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-25T13:28:37.171 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-25T13:28:37.171 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-25T13:28:37.171 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-25T13:28:37.171 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-25T13:28:37.171 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-25T13:28:37.171 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-25T13:28:37.171 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-25T13:28:37.171 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-25T13:28:37.171 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-25T13:28:37.172 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-25T13:28:37.172 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-25T13:28:37.172 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-25T13:28:37.172 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-25T13:28:37.172 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-25T13:28:37.172 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-25T13:28:37.172 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-25T13:28:37.172 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-25T13:28:37.172 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-25T13:28:37.172 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-25T13:28:37.172 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-25T13:28:37.172 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-25T13:28:37.172 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-25T13:28:37.172 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-25T13:28:37.172 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-25T13:28:37.173 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-25T13:28:37.173 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-25T13:28:37.173 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-25T13:28:37.173 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-25T13:28:37.173 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-25T13:28:37.173 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-25T13:28:37.173 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-25T13:28:37.173 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-25T13:28:37.173 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-25T13:28:37.173 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-25T13:28:37.173 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-25T13:28:37.173 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-25T13:28:37.173 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-25T13:28:37.173 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-25T13:28:37.174 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-25T13:28:37.174 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-25T13:28:37.174 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-25T13:28:37.174 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-25T13:28:37.174 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-25T13:28:37.174 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-25T13:28:37.174 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-25T13:28:37.174 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-25T13:28:37.174 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-25T13:28:37.174 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-25T13:28:37.174 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-25T13:28:37.174 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-25T13:28:37.174 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-25T13:28:37.174 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-25T13:28:37.175 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-25T13:28:37.175 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-25T13:28:37.175 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-25T13:28:37.175 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-25T13:28:37.175 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-25T13:28:37.175 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-25T13:28:37.175 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-25T13:28:37.175 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-25T13:28:37.175 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-25T13:28:37.175 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-25T13:28:37.175 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-25T13:28:37.175 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-25T13:28:37.175 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-25T13:28:37.175 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-25T13:28:37.176 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-25T13:28:37.176 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-25T13:28:37.176 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-25T13:28:37.176 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-25T13:28:37.176 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-25T13:28:37.176 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-25T13:28:37.176 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-25T13:28:37.176 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-25T13:28:37.176 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-25T13:28:37.176 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-25T13:28:37.176 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-25T13:28:37.176 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-25T13:28:37.176 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-25T13:28:37.176 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-25T13:28:37.176 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-25T13:28:37.177 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-25T13:28:37.177 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-25T13:28:37.177 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-25T13:28:37.177 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-25T13:28:37.177 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-25T13:28:37.177 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-25T13:28:37.177 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-25T13:28:37.177 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-25T13:28:37.177 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-25T13:28:37.177 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-25T13:28:37.177 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-25T13:28:37.177 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-25T13:28:37.177 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-25T13:28:37.177 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-25T13:28:37.177 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-25T13:28:37.178 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-25T13:28:37.178 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-25T13:28:37.178 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-25T13:28:37.178 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-25T13:28:37.178 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-25T13:28:37.178 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-25T13:28:37.178 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-25T13:28:37.178 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-25T13:28:37.178 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-25T13:28:37.178 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-25T13:28:37.178 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-25T13:28:37.178 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-25T13:28:37.178 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-25T13:28:37.178 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-25T13:28:37.179 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-25T13:28:37.179 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-25T13:28:37.179 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-25T13:28:37.179 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-25T13:28:37.179 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-25T13:28:37.179 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-25T13:28:37.179 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-25T13:28:37.179 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-25T13:28:37.179 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-25T13:28:37.179 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-25T13:28:37.179 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-25T13:28:37.179 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-25T13:28:37.179 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-25T13:28:37.179 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-25T13:28:37.180 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-25T13:28:37.180 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-25T13:28:37.180 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-25T13:28:37.180 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-25T13:28:37.180 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-25T13:28:37.180 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-25T13:28:37.180 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-25T13:28:37.180 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-25T13:28:37.180 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-25T13:28:37.180 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-25T13:28:37.180 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-25T13:28:37.180 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-25T13:28:37.180 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-25T13:28:37.180 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-25T13:28:37.180 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-25T13:28:37.181 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-25T13:28:37.181 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-25T13:28:37.181 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-25T13:28:37.181 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-25T13:28:37.181 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-25T13:28:37.181 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-25T13:28:37.181 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-25T13:28:37.181 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-25T13:28:37.181 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-25T13:28:37.181 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-25T13:28:37.181 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-25T13:28:37.181 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-25T13:28:37.181 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-25T13:28:37.181 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-25T13:28:37.182 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-25T13:28:37.182 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-25T13:28:37.182 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-25T13:28:37.182 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-25T13:28:37.182 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-25T13:28:37.182 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-25T13:28:37.182 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-25T13:28:37.182 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-25T13:28:37.182 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-25T13:28:37.182 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-25T13:28:37.182 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-25T13:28:37.182 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-25T13:28:37.182 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-25T13:28:37.182 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-25T13:28:37.182 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-25T13:28:37.183 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-25T13:28:37.183 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-25T13:28:37.183 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-25T13:28:37.183 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-25T13:28:37.183 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-25T13:28:37.183 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-25T13:28:37.183 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-25T13:28:37.183 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-25T13:28:37.183 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-25T13:28:37.183 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-25T13:28:37.183 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-25T13:28:37.183 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-25T13:28:37.183 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-25T13:28:37.183 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-25T13:28:37.184 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-25T13:28:37.184 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-25T13:28:37.184 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-25T13:28:37.184 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-25T13:28:37.184 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-25T13:28:37.184 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-25T13:28:37.184 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-25T13:28:37.184 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-25T13:28:37.184 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-25T13:28:37.184 INFO:teuthology.orchestra.run.smithi130.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-25T13:28:37.184 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-25T13:28:37.184 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-25T13:28:37.190 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-25T13:28:37.190 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-25T13:28:37.190 DEBUG:teuthology.orchestra.run.smithi130:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-25T13:28:37.196 INFO:teuthology.orchestra.run.smithi130.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T13:28:37.196 INFO:teuthology.orchestra.run.smithi130.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T13:28:37.196 INFO:teuthology.orchestra.run.smithi130.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T13:28:37.197 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-25T13:28:37.197 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-25T13:28:37.197 DEBUG:teuthology.orchestra.run.smithi130:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-25T13:28:37.241 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi130.front.sepia.ceph.com to complete... 2024-04-25T13:28:37.681 INFO:teuthology.orchestra.run.smithi130.stderr:Sourcing file `/etc/default/grub' 2024-04-25T13:28:37.682 INFO:teuthology.orchestra.run.smithi130.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T13:28:37.700 INFO:teuthology.orchestra.run.smithi130.stderr:Generating grub configuration file ... 2024-04-25T13:28:37.901 INFO:teuthology.orchestra.run.smithi130.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T13:28:37.907 INFO:teuthology.orchestra.run.smithi130.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T13:28:38.151 INFO:teuthology.orchestra.run.smithi130.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T13:28:38.156 INFO:teuthology.orchestra.run.smithi130.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T13:28:38.194 INFO:teuthology.orchestra.run.smithi130.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T13:28:38.199 INFO:teuthology.orchestra.run.smithi130.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T13:28:38.376 INFO:teuthology.orchestra.run.smithi130.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T13:28:38.376 INFO:teuthology.orchestra.run.smithi130.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T13:28:38.376 INFO:teuthology.orchestra.run.smithi130.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T13:28:38.392 INFO:teuthology.orchestra.run.smithi130.stderr:done 2024-04-25T13:28:39.540 INFO:teuthology.orchestra.run.smithi123.stderr:Sourcing file `/etc/default/grub' 2024-04-25T13:28:39.562 INFO:teuthology.orchestra.run.smithi123.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T13:28:39.588 INFO:teuthology.orchestra.run.smithi123.stderr:Generating grub configuration file ... 2024-04-25T13:28:39.912 INFO:teuthology.orchestra.run.smithi123.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T13:28:39.927 INFO:teuthology.orchestra.run.smithi123.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T13:28:40.249 INFO:teuthology.orchestra.run.smithi123.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T13:28:40.264 INFO:teuthology.orchestra.run.smithi123.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T13:28:40.323 INFO:teuthology.orchestra.run.smithi123.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T13:28:40.328 INFO:teuthology.orchestra.run.smithi123.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T13:28:40.518 INFO:teuthology.orchestra.run.smithi123.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T13:28:40.518 INFO:teuthology.orchestra.run.smithi123.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T13:28:40.518 INFO:teuthology.orchestra.run.smithi123.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T13:28:40.555 INFO:teuthology.orchestra.run.smithi123.stderr:done 2024-04-25T13:28:40.771 DEBUG:teuthology.orchestra.run.smithi123:> dpkg-deb -c /tmp/linux-image.deb 2024-04-25T13:28:40.778 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-25T13:28:40.778 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-25T13:28:40.778 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-25T13:28:40.796 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-25T13:28:40.796 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T13:28:40.816 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-25T13:28:40.816 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-25T13:28:40.816 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-25T13:28:40.816 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-25T13:28:40.816 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-25T13:28:40.816 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-25T13:28:40.817 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-25T13:28:40.817 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-25T13:28:40.817 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-25T13:28:40.817 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-25T13:28:40.817 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-25T13:28:40.817 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-25T13:28:40.817 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-25T13:28:40.817 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-25T13:28:40.820 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-25T13:28:40.820 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-25T13:28:40.820 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-25T13:28:40.820 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-25T13:28:40.820 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-25T13:28:40.820 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-25T13:28:40.820 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-25T13:28:40.820 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-25T13:28:40.820 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-25T13:28:40.821 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-25T13:28:40.821 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-25T13:28:40.821 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-25T13:28:40.821 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-25T13:28:40.821 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-25T13:28:40.821 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-25T13:28:40.821 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-25T13:28:40.821 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-25T13:28:40.821 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-25T13:28:40.821 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-25T13:28:40.821 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-25T13:28:40.821 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-25T13:28:40.821 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-25T13:28:40.822 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-25T13:28:40.822 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-25T13:28:40.822 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-25T13:28:40.822 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-25T13:28:40.822 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-25T13:28:40.822 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-25T13:28:40.822 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-25T13:28:40.876 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-25T13:28:40.876 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-25T13:28:40.876 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-25T13:28:40.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-25T13:28:40.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-25T13:28:40.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-25T13:28:40.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-25T13:28:40.877 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-25T13:28:40.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-25T13:28:40.877 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-25T13:28:40.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-25T13:28:40.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-25T13:28:40.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-25T13:28:40.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-25T13:28:40.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-25T13:28:40.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-25T13:28:40.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-25T13:28:40.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-25T13:28:40.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-25T13:28:40.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-25T13:28:40.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-25T13:28:40.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-25T13:28:40.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-25T13:28:40.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-25T13:28:40.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-25T13:28:40.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-25T13:28:40.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-25T13:28:40.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-25T13:28:40.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-25T13:28:40.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-25T13:28:40.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-25T13:28:40.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-25T13:28:40.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-25T13:28:40.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-25T13:28:40.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-25T13:28:40.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-25T13:28:40.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-25T13:28:40.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-25T13:28:40.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-25T13:28:40.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-25T13:28:40.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-25T13:28:40.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-25T13:28:40.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-25T13:28:40.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-25T13:28:40.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-25T13:28:40.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-25T13:28:40.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-25T13:28:40.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-25T13:28:40.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-25T13:28:40.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-25T13:28:40.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-25T13:28:40.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-25T13:28:40.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-25T13:28:40.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-25T13:28:40.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-25T13:28:40.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-25T13:28:40.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-25T13:28:40.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-25T13:28:40.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-25T13:28:40.881 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-25T13:28:40.881 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-25T13:28:40.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-25T13:28:40.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-25T13:28:40.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-25T13:28:40.881 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-25T13:28:40.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-25T13:28:40.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-25T13:28:40.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-25T13:28:40.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-25T13:28:40.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-25T13:28:40.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-25T13:28:40.882 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-25T13:28:40.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-25T13:28:40.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-25T13:28:40.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-25T13:28:40.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-25T13:28:40.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-25T13:28:40.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-25T13:28:40.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-25T13:28:40.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-25T13:28:40.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-25T13:28:40.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-25T13:28:40.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-25T13:28:40.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-25T13:28:40.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-25T13:28:40.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-25T13:28:40.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-25T13:28:40.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-25T13:28:40.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-25T13:28:40.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-25T13:28:40.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-25T13:28:40.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-25T13:28:40.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-25T13:28:40.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-25T13:28:40.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-25T13:28:40.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-25T13:28:40.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-25T13:28:40.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-25T13:28:40.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-25T13:28:40.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-25T13:28:40.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-25T13:28:40.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-25T13:28:40.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-25T13:28:40.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-25T13:28:40.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-25T13:28:40.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-25T13:28:40.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-25T13:28:40.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-25T13:28:40.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-25T13:28:40.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-25T13:28:40.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-25T13:28:40.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-25T13:28:40.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-25T13:28:40.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-25T13:28:40.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-25T13:28:40.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-25T13:28:40.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-25T13:28:40.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-25T13:28:40.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-25T13:28:40.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-25T13:28:40.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-25T13:28:40.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-25T13:28:40.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-25T13:28:40.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-25T13:28:40.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-25T13:28:40.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-25T13:28:40.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-25T13:28:40.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-25T13:28:40.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-25T13:28:40.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-25T13:28:40.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-25T13:28:40.886 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-25T13:28:40.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-25T13:28:40.886 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-25T13:28:40.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-25T13:28:40.886 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-25T13:28:40.886 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-25T13:28:40.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-25T13:28:40.886 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-25T13:28:40.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-25T13:28:40.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-25T13:28:40.887 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-25T13:28:40.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-25T13:28:40.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-25T13:28:40.887 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-25T13:28:40.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-25T13:28:40.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-25T13:28:40.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-25T13:28:40.887 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-25T13:28:40.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-25T13:28:40.887 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-25T13:28:40.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-25T13:28:40.887 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-25T13:28:40.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-25T13:28:40.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-25T13:28:40.887 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-25T13:28:40.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-25T13:28:40.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-25T13:28:40.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-25T13:28:40.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-25T13:28:40.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-25T13:28:40.888 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-25T13:28:40.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-25T13:28:40.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-25T13:28:40.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-25T13:28:40.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-25T13:28:40.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-25T13:28:40.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-25T13:28:40.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-25T13:28:40.889 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-25T13:28:40.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-25T13:28:40.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-25T13:28:40.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-25T13:28:40.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-25T13:28:40.889 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-25T13:28:40.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-25T13:28:40.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-25T13:28:40.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-25T13:28:40.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-25T13:28:40.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-25T13:28:40.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-25T13:28:40.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-25T13:28:40.889 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-25T13:28:40.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-25T13:28:40.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-25T13:28:40.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-25T13:28:40.890 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-25T13:28:40.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-25T13:28:40.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-25T13:28:40.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-25T13:28:40.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-25T13:28:40.890 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-25T13:28:40.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-25T13:28:40.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-25T13:28:40.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-25T13:28:40.890 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-25T13:28:40.890 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-25T13:28:40.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-25T13:28:40.891 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-25T13:28:40.891 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-25T13:28:40.891 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-25T13:28:40.891 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-25T13:28:40.891 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-25T13:28:40.891 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-25T13:28:40.891 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-25T13:28:40.891 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-25T13:28:40.891 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-25T13:28:40.891 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-25T13:28:40.891 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-25T13:28:40.891 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-25T13:28:40.891 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-25T13:28:40.891 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-25T13:28:40.891 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-25T13:28:40.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-25T13:28:40.892 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-25T13:28:40.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-25T13:28:40.892 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-25T13:28:40.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-25T13:28:40.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-25T13:28:40.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-25T13:28:40.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-25T13:28:40.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-25T13:28:40.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-25T13:28:40.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-25T13:28:40.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-25T13:28:40.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-25T13:28:40.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-25T13:28:40.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-25T13:28:40.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-25T13:28:40.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-25T13:28:40.893 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-25T13:28:40.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-25T13:28:40.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-25T13:28:40.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-25T13:28:40.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-25T13:28:40.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-25T13:28:40.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-25T13:28:40.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-25T13:28:40.893 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-25T13:28:40.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-25T13:28:40.893 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-25T13:28:40.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-25T13:28:40.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-25T13:28:40.894 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-25T13:28:40.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-25T13:28:40.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-25T13:28:40.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-25T13:28:40.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-25T13:28:40.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-25T13:28:40.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-25T13:28:40.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-25T13:28:40.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-25T13:28:40.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-25T13:28:40.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-25T13:28:40.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-25T13:28:40.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-25T13:28:40.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-25T13:28:40.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-25T13:28:40.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-25T13:28:40.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-25T13:28:40.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-25T13:28:40.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-25T13:28:40.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-25T13:28:40.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-25T13:28:40.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-25T13:28:40.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-25T13:28:40.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-25T13:28:40.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-25T13:28:40.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-25T13:28:40.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-25T13:28:40.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-25T13:28:40.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-25T13:28:40.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-25T13:28:40.896 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-25T13:28:40.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-25T13:28:40.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-25T13:28:40.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-25T13:28:40.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-25T13:28:40.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-25T13:28:40.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-25T13:28:40.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-25T13:28:40.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-25T13:28:40.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-25T13:28:40.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-25T13:28:40.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-25T13:28:40.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-25T13:28:40.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-25T13:28:40.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-25T13:28:40.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-25T13:28:40.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-25T13:28:40.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-25T13:28:40.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-25T13:28:40.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-25T13:28:40.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-25T13:28:40.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-25T13:28:40.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-25T13:28:40.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-25T13:28:40.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-25T13:28:40.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-25T13:28:40.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-25T13:28:40.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-25T13:28:40.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-25T13:28:40.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-25T13:28:40.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-25T13:28:40.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-25T13:28:40.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-25T13:28:40.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-25T13:28:40.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-25T13:28:40.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-25T13:28:40.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-25T13:28:40.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-25T13:28:40.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-25T13:28:40.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-25T13:28:40.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-25T13:28:40.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-25T13:28:40.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-25T13:28:40.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-25T13:28:40.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-25T13:28:40.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-25T13:28:40.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-25T13:28:40.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-25T13:28:40.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-25T13:28:40.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-25T13:28:40.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-25T13:28:40.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-25T13:28:40.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-25T13:28:40.900 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-25T13:28:40.900 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-25T13:28:40.900 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-25T13:28:40.900 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-25T13:28:40.900 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-25T13:28:40.900 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-25T13:28:40.900 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-25T13:28:40.900 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-25T13:28:40.900 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-25T13:28:40.900 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-25T13:28:40.900 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-25T13:28:40.900 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-25T13:28:40.900 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-25T13:28:40.900 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-25T13:28:40.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-25T13:28:40.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-25T13:28:40.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-25T13:28:40.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-25T13:28:40.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-25T13:28:40.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-25T13:28:40.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-25T13:28:40.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-25T13:28:40.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-25T13:28:40.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-25T13:28:40.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-25T13:28:40.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-25T13:28:40.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-25T13:28:40.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-25T13:28:40.902 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-25T13:28:40.902 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-25T13:28:40.902 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-25T13:28:40.902 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-25T13:28:40.902 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-25T13:28:40.902 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-25T13:28:40.902 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-25T13:28:40.902 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-25T13:28:40.902 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-25T13:28:40.904 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-25T13:28:40.904 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-25T13:28:40.904 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-25T13:28:40.904 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-25T13:28:40.904 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-25T13:28:40.904 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-25T13:28:40.904 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-25T13:28:40.904 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-25T13:28:40.904 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-25T13:28:40.905 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-25T13:28:40.905 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-25T13:28:40.905 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-25T13:28:40.905 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-25T13:28:40.905 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-25T13:28:40.905 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-25T13:28:40.905 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-25T13:28:40.905 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-25T13:28:40.905 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-25T13:28:40.905 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-25T13:28:40.905 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-25T13:28:40.905 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-25T13:28:40.905 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-25T13:28:40.905 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-25T13:28:40.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-25T13:28:40.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-25T13:28:40.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-25T13:28:40.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-25T13:28:40.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-25T13:28:40.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-25T13:28:40.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-25T13:28:40.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-25T13:28:40.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-25T13:28:40.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-25T13:28:40.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-25T13:28:40.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-25T13:28:40.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-25T13:28:40.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-25T13:28:40.907 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-25T13:28:40.907 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-25T13:28:40.907 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-25T13:28:40.910 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-25T13:28:40.910 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-25T13:28:40.910 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-25T13:28:40.910 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-25T13:28:40.910 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-25T13:28:40.910 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-25T13:28:40.910 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-25T13:28:40.911 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-25T13:28:40.911 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-25T13:28:40.911 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-25T13:28:40.911 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-25T13:28:40.911 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-25T13:28:40.911 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-25T13:28:40.911 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-25T13:28:40.911 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-25T13:28:40.912 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-25T13:28:40.912 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-25T13:28:40.912 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-25T13:28:40.912 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-25T13:28:40.912 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-25T13:28:40.912 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-25T13:28:40.912 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-25T13:28:40.913 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-25T13:28:40.913 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-25T13:28:40.913 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-25T13:28:40.913 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-25T13:28:40.913 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-25T13:28:40.913 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-25T13:28:40.913 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-25T13:28:40.913 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-25T13:28:40.913 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-25T13:28:40.913 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-25T13:28:40.914 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-25T13:28:40.914 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-25T13:28:40.914 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-25T13:28:40.914 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-25T13:28:40.914 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-25T13:28:40.914 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-25T13:28:40.914 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-25T13:28:40.914 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-25T13:28:40.914 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-25T13:28:40.914 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-25T13:28:40.914 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-25T13:28:40.914 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-25T13:28:40.914 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-25T13:28:40.914 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-25T13:28:40.915 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-25T13:28:40.915 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-25T13:28:40.915 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-25T13:28:40.915 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-25T13:28:40.915 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-25T13:28:40.915 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-25T13:28:40.915 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-25T13:28:40.915 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-25T13:28:40.915 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-25T13:28:40.915 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-25T13:28:40.915 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-25T13:28:40.915 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-25T13:28:40.915 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-25T13:28:40.915 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-25T13:28:40.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-25T13:28:40.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-25T13:28:40.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-25T13:28:40.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-25T13:28:40.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-25T13:28:40.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-25T13:28:40.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-25T13:28:40.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-25T13:28:40.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-25T13:28:40.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-25T13:28:40.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-25T13:28:40.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-25T13:28:40.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-25T13:28:40.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-25T13:28:40.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-25T13:28:40.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-25T13:28:40.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-25T13:28:40.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-25T13:28:40.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-25T13:28:40.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-25T13:28:40.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-25T13:28:40.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-25T13:28:40.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-25T13:28:40.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-25T13:28:40.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-25T13:28:40.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-25T13:28:40.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-25T13:28:40.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-25T13:28:40.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-25T13:28:40.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-25T13:28:40.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-25T13:28:40.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-25T13:28:40.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-25T13:28:40.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-25T13:28:40.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-25T13:28:40.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-25T13:28:40.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-25T13:28:40.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-25T13:28:40.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-25T13:28:40.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-25T13:28:40.918 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-25T13:28:40.918 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-25T13:28:40.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-25T13:28:40.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-25T13:28:40.919 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-25T13:28:40.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-25T13:28:40.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-25T13:28:40.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-25T13:28:40.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-25T13:28:40.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-25T13:28:40.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-25T13:28:40.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-25T13:28:40.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-25T13:28:40.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-25T13:28:40.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-25T13:28:40.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-25T13:28:40.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-25T13:28:40.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-25T13:28:40.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-25T13:28:40.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-25T13:28:40.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-25T13:28:40.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-25T13:28:40.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-25T13:28:40.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-25T13:28:40.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-25T13:28:40.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-25T13:28:40.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-25T13:28:40.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-25T13:28:40.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-25T13:28:40.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-25T13:28:40.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-25T13:28:40.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-25T13:28:40.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-25T13:28:40.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-25T13:28:40.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-25T13:28:40.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-25T13:28:40.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-25T13:28:40.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-25T13:28:40.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-25T13:28:40.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-25T13:28:40.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-25T13:28:40.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-25T13:28:40.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-25T13:28:40.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-25T13:28:40.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-25T13:28:40.921 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-25T13:28:40.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-25T13:28:40.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-25T13:28:40.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-25T13:28:40.922 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-25T13:28:40.922 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-25T13:28:40.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-25T13:28:40.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-25T13:28:40.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-25T13:28:40.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-25T13:28:40.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-25T13:28:40.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-25T13:28:40.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-25T13:28:40.922 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-25T13:28:40.922 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-25T13:28:40.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-25T13:28:40.923 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-25T13:28:40.923 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-25T13:28:40.923 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-25T13:28:40.923 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-25T13:28:40.923 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-25T13:28:40.923 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-25T13:28:40.923 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-25T13:28:40.923 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-25T13:28:40.984 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-25T13:28:40.984 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-25T13:28:40.984 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-25T13:28:40.984 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-25T13:28:40.984 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-25T13:28:40.984 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-25T13:28:40.984 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-25T13:28:40.984 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-25T13:28:40.984 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-25T13:28:40.984 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-25T13:28:40.984 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-25T13:28:40.984 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-25T13:28:40.985 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-25T13:28:40.985 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-25T13:28:40.985 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-25T13:28:40.985 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-25T13:28:40.985 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-25T13:28:40.985 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-25T13:28:40.985 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-25T13:28:40.985 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-25T13:28:40.985 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-25T13:28:40.985 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-25T13:28:40.985 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-25T13:28:40.985 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-25T13:28:40.985 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-25T13:28:40.985 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-25T13:28:40.985 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-25T13:28:40.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-25T13:28:40.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-25T13:28:40.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-25T13:28:40.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-25T13:28:40.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-25T13:28:40.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-25T13:28:40.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-25T13:28:40.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-25T13:28:40.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-25T13:28:40.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-25T13:28:40.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-25T13:28:40.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-25T13:28:40.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-25T13:28:40.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-25T13:28:40.987 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-25T13:28:40.987 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-25T13:28:40.987 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-25T13:28:40.987 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-25T13:28:40.987 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-25T13:28:40.987 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-25T13:28:40.987 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-25T13:28:40.987 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-25T13:28:40.987 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-25T13:28:40.987 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-25T13:28:40.987 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-25T13:28:40.987 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-25T13:28:40.987 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-25T13:28:40.987 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-25T13:28:40.988 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-25T13:28:40.988 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-25T13:28:40.988 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-25T13:28:40.988 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-25T13:28:40.988 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-25T13:28:40.988 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-25T13:28:40.988 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-25T13:28:40.988 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-25T13:28:40.988 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-25T13:28:40.988 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-25T13:28:40.988 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-25T13:28:40.988 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-25T13:28:40.988 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-25T13:28:40.988 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-25T13:28:40.988 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-25T13:28:40.989 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-25T13:28:40.989 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-25T13:28:40.989 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-25T13:28:40.989 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-25T13:28:40.989 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-25T13:28:40.989 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-25T13:28:40.989 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-25T13:28:40.989 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-25T13:28:40.989 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-25T13:28:40.989 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-25T13:28:40.989 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-25T13:28:40.989 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-25T13:28:40.989 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-25T13:28:40.989 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-25T13:28:40.990 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-25T13:28:40.990 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-25T13:28:40.990 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-25T13:28:40.990 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-25T13:28:40.990 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-25T13:28:40.990 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-25T13:28:40.990 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-25T13:28:40.990 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-25T13:28:40.990 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-25T13:28:40.990 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-25T13:28:40.990 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-25T13:28:40.990 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-25T13:28:40.990 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-25T13:28:40.991 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-25T13:28:40.991 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-25T13:28:40.991 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-25T13:28:40.991 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-25T13:28:40.991 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-25T13:28:40.991 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-25T13:28:40.991 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-25T13:28:40.991 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-25T13:28:40.991 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-25T13:28:40.991 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-25T13:28:40.991 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-25T13:28:40.991 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-25T13:28:40.991 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-25T13:28:40.991 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-25T13:28:40.991 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-25T13:28:40.992 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-25T13:28:40.992 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-25T13:28:40.992 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-25T13:28:40.992 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-25T13:28:40.992 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-25T13:28:40.992 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-25T13:28:40.992 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-25T13:28:40.992 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-25T13:28:40.992 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-25T13:28:40.992 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-25T13:28:40.992 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-25T13:28:40.992 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-25T13:28:40.992 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-25T13:28:40.992 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-25T13:28:40.993 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-25T13:28:40.993 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-25T13:28:40.993 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-25T13:28:40.993 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-25T13:28:40.993 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-25T13:28:40.993 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-25T13:28:40.993 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-25T13:28:40.993 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-25T13:28:40.993 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-25T13:28:40.993 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-25T13:28:40.993 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-25T13:28:40.993 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-25T13:28:40.993 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-25T13:28:40.993 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-25T13:28:40.994 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-25T13:28:40.994 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-25T13:28:40.994 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-25T13:28:40.994 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-25T13:28:40.994 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-25T13:28:40.994 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-25T13:28:40.994 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-25T13:28:40.994 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-25T13:28:40.994 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-25T13:28:40.994 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-25T13:28:40.994 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-25T13:28:40.994 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-25T13:28:40.994 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-25T13:28:40.994 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-25T13:28:40.995 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-25T13:28:40.995 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-25T13:28:40.995 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-25T13:28:40.995 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-25T13:28:40.995 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-25T13:28:40.995 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-25T13:28:40.995 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-25T13:28:40.995 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-25T13:28:40.995 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-25T13:28:40.995 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-25T13:28:40.995 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-25T13:28:40.995 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-25T13:28:40.995 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-25T13:28:40.995 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-25T13:28:40.995 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-25T13:28:40.996 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-25T13:28:40.996 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-25T13:28:40.996 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-25T13:28:40.996 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-25T13:28:40.996 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-25T13:28:40.996 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-25T13:28:40.996 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-25T13:28:40.996 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-25T13:28:40.996 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-25T13:28:40.996 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-25T13:28:40.996 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-25T13:28:40.996 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-25T13:28:40.996 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-25T13:28:40.996 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-25T13:28:40.996 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-25T13:28:40.997 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-25T13:28:40.997 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-25T13:28:40.997 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-25T13:28:40.997 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-25T13:28:40.997 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-25T13:28:40.997 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-25T13:28:40.997 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-25T13:28:40.997 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-25T13:28:40.997 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-25T13:28:40.997 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-25T13:28:40.997 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-25T13:28:40.997 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-25T13:28:40.997 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-25T13:28:40.997 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-25T13:28:40.998 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-25T13:28:40.998 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-25T13:28:40.998 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-25T13:28:40.998 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-25T13:28:40.998 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-25T13:28:40.998 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-25T13:28:40.998 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-25T13:28:40.998 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-25T13:28:40.998 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-25T13:28:40.998 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-25T13:28:40.998 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-25T13:28:40.998 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-25T13:28:40.998 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-25T13:28:40.998 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-25T13:28:40.999 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-25T13:28:40.999 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-25T13:28:40.999 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-25T13:28:40.999 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-25T13:28:40.999 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-25T13:28:40.999 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-25T13:28:40.999 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-25T13:28:40.999 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-25T13:28:40.999 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-25T13:28:40.999 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-25T13:28:40.999 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-25T13:28:40.999 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-25T13:28:40.999 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-25T13:28:40.999 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-25T13:28:41.000 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-25T13:28:41.000 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-25T13:28:41.000 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-25T13:28:41.000 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-25T13:28:41.000 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-25T13:28:41.000 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-25T13:28:41.000 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-25T13:28:41.000 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-25T13:28:41.000 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-25T13:28:41.000 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-25T13:28:41.000 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-25T13:28:41.000 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-25T13:28:41.000 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-25T13:28:41.000 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-25T13:28:41.000 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-25T13:28:41.001 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-25T13:28:41.001 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-25T13:28:41.001 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-25T13:28:41.001 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-25T13:28:41.001 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-25T13:28:41.001 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-25T13:28:41.001 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-25T13:28:41.001 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-25T13:28:41.001 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-25T13:28:41.001 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-25T13:28:41.001 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-25T13:28:41.001 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-25T13:28:41.001 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-25T13:28:41.001 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-25T13:28:41.001 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-25T13:28:41.002 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-25T13:28:41.002 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-25T13:28:41.002 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-25T13:28:41.002 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-25T13:28:41.002 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-25T13:28:41.002 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-25T13:28:41.002 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-25T13:28:41.002 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-25T13:28:41.002 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-25T13:28:41.002 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-25T13:28:41.002 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-25T13:28:41.002 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-25T13:28:41.002 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-25T13:28:41.003 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-25T13:28:41.003 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-25T13:28:41.003 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-25T13:28:41.003 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-25T13:28:41.003 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-25T13:28:41.003 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-25T13:28:41.003 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-25T13:28:41.003 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-25T13:28:41.003 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-25T13:28:41.003 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-25T13:28:41.003 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-25T13:28:41.003 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-25T13:28:41.003 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-25T13:28:41.003 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-25T13:28:41.003 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-25T13:28:41.004 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-25T13:28:41.004 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-25T13:28:41.004 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-25T13:28:41.004 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-25T13:28:41.004 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-25T13:28:41.004 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-25T13:28:41.004 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-25T13:28:41.004 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-25T13:28:41.004 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-25T13:28:41.004 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-25T13:28:41.004 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-25T13:28:41.004 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-25T13:28:41.004 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-25T13:28:41.004 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-25T13:28:41.005 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-25T13:28:41.005 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-25T13:28:41.005 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-25T13:28:41.005 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-25T13:28:41.005 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-25T13:28:41.005 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-25T13:28:41.005 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-25T13:28:41.005 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-25T13:28:41.005 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-25T13:28:41.005 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-25T13:28:41.005 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-25T13:28:41.005 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-25T13:28:41.005 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-25T13:28:41.005 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-25T13:28:41.006 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-25T13:28:41.006 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-25T13:28:41.006 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-25T13:28:41.006 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-25T13:28:41.006 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-25T13:28:41.006 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-25T13:28:41.006 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-25T13:28:41.006 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-25T13:28:41.006 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-25T13:28:41.006 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-25T13:28:41.006 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-25T13:28:41.006 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-25T13:28:41.006 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-25T13:28:41.007 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-25T13:28:41.007 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-25T13:28:41.007 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-25T13:28:41.007 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-25T13:28:41.007 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-25T13:28:41.007 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-25T13:28:41.007 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-25T13:28:41.007 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-25T13:28:41.007 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-25T13:28:41.007 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-25T13:28:41.007 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-25T13:28:41.007 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-25T13:28:41.007 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-25T13:28:41.007 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-25T13:28:41.008 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-25T13:28:41.008 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-25T13:28:41.008 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-25T13:28:41.008 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-25T13:28:41.008 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-25T13:28:41.008 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-25T13:28:41.008 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-25T13:28:41.008 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-25T13:28:41.008 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-25T13:28:41.008 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-25T13:28:41.008 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-25T13:28:41.008 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-25T13:28:41.008 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-25T13:28:41.008 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-25T13:28:41.008 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-25T13:28:41.009 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-25T13:28:41.009 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-25T13:28:41.009 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-25T13:28:41.009 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-25T13:28:41.009 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-25T13:28:41.009 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-25T13:28:41.009 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-25T13:28:41.009 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-25T13:28:41.009 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-25T13:28:41.009 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-25T13:28:41.009 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-25T13:28:41.009 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-25T13:28:41.010 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-25T13:28:41.010 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-25T13:28:41.010 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-25T13:28:41.010 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-25T13:28:41.010 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-25T13:28:41.010 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-25T13:28:41.010 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-25T13:28:41.010 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-25T13:28:41.010 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-25T13:28:41.010 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-25T13:28:41.010 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-25T13:28:41.010 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-25T13:28:41.010 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-25T13:28:41.010 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-25T13:28:41.010 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-25T13:28:41.011 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-25T13:28:41.011 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-25T13:28:41.011 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-25T13:28:41.011 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-25T13:28:41.011 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-25T13:28:41.011 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-25T13:28:41.011 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-25T13:28:41.011 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-25T13:28:41.011 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-25T13:28:41.011 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-25T13:28:41.011 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-25T13:28:41.011 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-25T13:28:41.011 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-25T13:28:41.011 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-25T13:28:41.012 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-25T13:28:41.012 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-25T13:28:41.012 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-25T13:28:41.012 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-25T13:28:41.012 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-25T13:28:41.012 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-25T13:28:41.012 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-25T13:28:41.012 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-25T13:28:41.012 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-25T13:28:41.012 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-25T13:28:41.012 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-25T13:28:41.012 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-25T13:28:41.012 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-25T13:28:41.012 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-25T13:28:41.012 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-25T13:28:41.013 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-25T13:28:41.013 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-25T13:28:41.013 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-25T13:28:41.013 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-25T13:28:41.013 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-25T13:28:41.013 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-25T13:28:41.013 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-25T13:28:41.013 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-25T13:28:41.013 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-25T13:28:41.013 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-25T13:28:41.013 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-25T13:28:41.013 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-25T13:28:41.013 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-25T13:28:41.013 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-25T13:28:41.013 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-25T13:28:41.014 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-25T13:28:41.014 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-25T13:28:41.014 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-25T13:28:41.014 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-25T13:28:41.014 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-25T13:28:41.014 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-25T13:28:41.014 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-25T13:28:41.014 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-25T13:28:41.014 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-25T13:28:41.014 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-25T13:28:41.014 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-25T13:28:41.014 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-25T13:28:41.014 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-25T13:28:41.014 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-25T13:28:41.015 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-25T13:28:41.015 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-25T13:28:41.015 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-25T13:28:41.015 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-25T13:28:41.015 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-25T13:28:41.015 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-25T13:28:41.015 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-25T13:28:41.015 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-25T13:28:41.015 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-25T13:28:41.015 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-25T13:28:41.015 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-25T13:28:41.015 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-25T13:28:41.015 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-25T13:28:41.015 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-25T13:28:41.015 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-25T13:28:41.016 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-25T13:28:41.016 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-25T13:28:41.016 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-25T13:28:41.016 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-25T13:28:41.016 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-25T13:28:41.016 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-25T13:28:41.016 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-25T13:28:41.016 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-25T13:28:41.016 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-25T13:28:41.016 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-25T13:28:41.016 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-25T13:28:41.016 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-25T13:28:41.016 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-25T13:28:41.016 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-25T13:28:41.016 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-25T13:28:41.017 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-25T13:28:41.017 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-25T13:28:41.017 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-25T13:28:41.017 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-25T13:28:41.017 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-25T13:28:41.017 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-25T13:28:41.017 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-25T13:28:41.017 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-25T13:28:41.017 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-25T13:28:41.017 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-25T13:28:41.017 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-25T13:28:41.017 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-25T13:28:41.017 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-25T13:28:41.017 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-25T13:28:41.017 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-25T13:28:41.018 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-25T13:28:41.018 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-25T13:28:41.018 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-25T13:28:41.018 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-25T13:28:41.018 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-25T13:28:41.018 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-25T13:28:41.018 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-25T13:28:41.018 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-25T13:28:41.018 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-25T13:28:41.018 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-25T13:28:41.018 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-25T13:28:41.018 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-25T13:28:41.018 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-25T13:28:41.018 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-25T13:28:41.019 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-25T13:28:41.019 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-25T13:28:41.019 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-25T13:28:41.019 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-25T13:28:41.019 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-25T13:28:41.019 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-25T13:28:41.019 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-25T13:28:41.019 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-25T13:28:41.019 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-25T13:28:41.019 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-25T13:28:41.019 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-25T13:28:41.019 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-25T13:28:41.019 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-25T13:28:41.019 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-25T13:28:41.019 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-25T13:28:41.020 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-25T13:28:41.020 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-25T13:28:41.020 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-25T13:28:41.020 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-25T13:28:41.020 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-25T13:28:41.020 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-25T13:28:41.020 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-25T13:28:41.020 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-25T13:28:41.020 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-25T13:28:41.020 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-25T13:28:41.020 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-25T13:28:41.020 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-25T13:28:41.020 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-25T13:28:41.020 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-25T13:28:41.020 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-25T13:28:41.021 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-25T13:28:41.021 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-25T13:28:41.021 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-25T13:28:41.021 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-25T13:28:41.021 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-25T13:28:41.021 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-25T13:28:41.021 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-25T13:28:41.021 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-25T13:28:41.021 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-25T13:28:41.021 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-25T13:28:41.021 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-25T13:28:41.021 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-25T13:28:41.021 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-25T13:28:41.021 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-25T13:28:41.022 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-25T13:28:41.022 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-25T13:28:41.022 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-25T13:28:41.022 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-25T13:28:41.022 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-25T13:28:41.022 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-25T13:28:41.022 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-25T13:28:41.022 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-25T13:28:41.022 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-25T13:28:41.022 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-25T13:28:41.022 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-25T13:28:41.022 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-25T13:28:41.022 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-25T13:28:41.022 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-25T13:28:41.022 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-25T13:28:41.023 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-25T13:28:41.023 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-25T13:28:41.023 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-25T13:28:41.023 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-25T13:28:41.023 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-25T13:28:41.023 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-25T13:28:41.023 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-25T13:28:41.023 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-25T13:28:41.023 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-25T13:28:41.023 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-25T13:28:41.023 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-25T13:28:41.023 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-25T13:28:41.023 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-25T13:28:41.023 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-25T13:28:41.024 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-25T13:28:41.024 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-25T13:28:41.024 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-25T13:28:41.024 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-25T13:28:41.024 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-25T13:28:41.024 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-25T13:28:41.024 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-25T13:28:41.024 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-25T13:28:41.024 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-25T13:28:41.024 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-25T13:28:41.024 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-25T13:28:41.024 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-25T13:28:41.024 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-25T13:28:41.024 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-25T13:28:41.024 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-25T13:28:41.025 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-25T13:28:41.025 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-25T13:28:41.025 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-25T13:28:41.025 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-25T13:28:41.025 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-25T13:28:41.025 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-25T13:28:41.025 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-25T13:28:41.025 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-25T13:28:41.025 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-25T13:28:41.025 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-25T13:28:41.025 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-25T13:28:41.025 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-25T13:28:41.025 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-25T13:28:41.025 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-25T13:28:41.025 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-25T13:28:41.026 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-25T13:28:41.026 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-25T13:28:41.026 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-25T13:28:41.026 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-25T13:28:41.026 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-25T13:28:41.026 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-25T13:28:41.026 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-25T13:28:41.026 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-25T13:28:41.026 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-25T13:28:41.026 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-25T13:28:41.026 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-25T13:28:41.026 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-25T13:28:41.026 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-25T13:28:41.026 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-25T13:28:41.027 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-25T13:28:41.027 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-25T13:28:41.027 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-25T13:28:41.027 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-25T13:28:41.027 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-25T13:28:41.027 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-25T13:28:41.027 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-25T13:28:41.027 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-25T13:28:41.027 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-25T13:28:41.027 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-25T13:28:41.027 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-25T13:28:41.027 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-25T13:28:41.027 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-25T13:28:41.027 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-25T13:28:41.028 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-25T13:28:41.028 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-25T13:28:41.028 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-25T13:28:41.028 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-25T13:28:41.028 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-25T13:28:41.028 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-25T13:28:41.028 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-25T13:28:41.028 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-25T13:28:41.028 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-25T13:28:41.028 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-25T13:28:41.028 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-25T13:28:41.028 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-25T13:28:41.028 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-25T13:28:41.028 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-25T13:28:41.028 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-25T13:28:41.029 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-25T13:28:41.029 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-25T13:28:41.029 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-25T13:28:41.029 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-25T13:28:41.029 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-25T13:28:41.029 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-25T13:28:41.029 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-25T13:28:41.029 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-25T13:28:41.029 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-25T13:28:41.029 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-25T13:28:41.029 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-25T13:28:41.029 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-25T13:28:41.029 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-25T13:28:41.029 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-25T13:28:41.029 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-25T13:28:41.030 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-25T13:28:41.030 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-25T13:28:41.030 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-25T13:28:41.030 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-25T13:28:41.030 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-25T13:28:41.030 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-25T13:28:41.030 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-25T13:28:41.030 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-25T13:28:41.030 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-25T13:28:41.030 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-25T13:28:41.030 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-25T13:28:41.030 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-25T13:28:41.030 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-25T13:28:41.030 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-25T13:28:41.030 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-25T13:28:41.031 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-25T13:28:41.031 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-25T13:28:41.031 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-25T13:28:41.031 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-25T13:28:41.031 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-25T13:28:41.031 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-25T13:28:41.031 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-25T13:28:41.031 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-25T13:28:41.031 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-25T13:28:41.031 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-25T13:28:41.031 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-25T13:28:41.031 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-25T13:28:41.031 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-25T13:28:41.031 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-25T13:28:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-25T13:28:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-25T13:28:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-25T13:28:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-25T13:28:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-25T13:28:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-25T13:28:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-25T13:28:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-25T13:28:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-25T13:28:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-25T13:28:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-25T13:28:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-25T13:28:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-25T13:28:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-25T13:28:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-25T13:28:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-25T13:28:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-25T13:28:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-25T13:28:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-25T13:28:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-25T13:28:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-25T13:28:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-25T13:28:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-25T13:28:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-25T13:28:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-25T13:28:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-25T13:28:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-25T13:28:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-25T13:28:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-25T13:28:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-25T13:28:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-25T13:28:41.034 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-25T13:28:41.034 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-25T13:28:41.034 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-25T13:28:41.034 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-25T13:28:41.034 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-25T13:28:41.034 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-25T13:28:41.078 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-25T13:28:41.078 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-25T13:28:41.078 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-25T13:28:41.078 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-25T13:28:41.078 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-25T13:28:41.078 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-25T13:28:41.078 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-25T13:28:41.078 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-25T13:28:41.078 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-25T13:28:41.078 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-25T13:28:41.079 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-25T13:28:41.079 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-25T13:28:41.079 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-25T13:28:41.079 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-25T13:28:41.079 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-25T13:28:41.079 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-25T13:28:41.079 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-25T13:28:41.079 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-25T13:28:41.079 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-25T13:28:41.079 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-25T13:28:41.079 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-25T13:28:41.079 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-25T13:28:41.079 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-25T13:28:41.079 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-25T13:28:41.079 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-25T13:28:41.080 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-25T13:28:41.080 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-25T13:28:41.080 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-25T13:28:41.080 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-25T13:28:41.080 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-25T13:28:41.080 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-25T13:28:41.080 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-25T13:28:41.080 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-25T13:28:41.080 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-25T13:28:41.080 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-25T13:28:41.080 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-25T13:28:41.080 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-25T13:28:41.080 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-25T13:28:41.080 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-25T13:28:41.081 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-25T13:28:41.081 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-25T13:28:41.081 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-25T13:28:41.081 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-25T13:28:41.081 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-25T13:28:41.081 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-25T13:28:41.081 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-25T13:28:41.081 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-25T13:28:41.081 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-25T13:28:41.081 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-25T13:28:41.081 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-25T13:28:41.081 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-25T13:28:41.081 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-25T13:28:41.081 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-25T13:28:41.081 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-25T13:28:41.082 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-25T13:28:41.082 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-25T13:28:41.082 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-25T13:28:41.082 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-25T13:28:41.082 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-25T13:28:41.082 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-25T13:28:41.082 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-25T13:28:41.082 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-25T13:28:41.082 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-25T13:28:41.082 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-25T13:28:41.082 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-25T13:28:41.082 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-25T13:28:41.082 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-25T13:28:41.082 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-25T13:28:41.083 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-25T13:28:41.083 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-25T13:28:41.083 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-25T13:28:41.083 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-25T13:28:41.083 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-25T13:28:41.083 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-25T13:28:41.083 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-25T13:28:41.083 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-25T13:28:41.083 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-25T13:28:41.083 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-25T13:28:41.083 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-25T13:28:41.083 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-25T13:28:41.083 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-25T13:28:41.083 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-25T13:28:41.084 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-25T13:28:41.084 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-25T13:28:41.084 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-25T13:28:41.084 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-25T13:28:41.084 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-25T13:28:41.084 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-25T13:28:41.084 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-25T13:28:41.084 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-25T13:28:41.084 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-25T13:28:41.084 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-25T13:28:41.084 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-25T13:28:41.084 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-25T13:28:41.084 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-25T13:28:41.084 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-25T13:28:41.084 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-25T13:28:41.085 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-25T13:28:41.085 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-25T13:28:41.085 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-25T13:28:41.085 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-25T13:28:41.085 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-25T13:28:41.085 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-25T13:28:41.085 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-25T13:28:41.085 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-25T13:28:41.085 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-25T13:28:41.085 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-25T13:28:41.085 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-25T13:28:41.085 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-25T13:28:41.085 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-25T13:28:41.085 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-25T13:28:41.085 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-25T13:28:41.086 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-25T13:28:41.086 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-25T13:28:41.086 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-25T13:28:41.086 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-25T13:28:41.086 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-25T13:28:41.086 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-25T13:28:41.086 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-25T13:28:41.086 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-25T13:28:41.086 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-25T13:28:41.086 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-25T13:28:41.086 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-25T13:28:41.086 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-25T13:28:41.086 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-25T13:28:41.086 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-25T13:28:41.087 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-25T13:28:41.087 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-25T13:28:41.087 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-25T13:28:41.087 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-25T13:28:41.087 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-25T13:28:41.087 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-25T13:28:41.087 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-25T13:28:41.087 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-25T13:28:41.087 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-25T13:28:41.087 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-25T13:28:41.087 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-25T13:28:41.087 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-25T13:28:41.087 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-25T13:28:41.087 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-25T13:28:41.087 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-25T13:28:41.088 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-25T13:28:41.088 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-25T13:28:41.088 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-25T13:28:41.088 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-25T13:28:41.088 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-25T13:28:41.088 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-25T13:28:41.088 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-25T13:28:41.088 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-25T13:28:41.088 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-25T13:28:41.088 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-25T13:28:41.088 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-25T13:28:41.088 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-25T13:28:41.088 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-25T13:28:41.088 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-25T13:28:41.088 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-25T13:28:41.089 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-25T13:28:41.089 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-25T13:28:41.089 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-25T13:28:41.089 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-25T13:28:41.089 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-25T13:28:41.089 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-25T13:28:41.089 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-25T13:28:41.089 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-25T13:28:41.089 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-25T13:28:41.089 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-25T13:28:41.089 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-25T13:28:41.089 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-25T13:28:41.089 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-25T13:28:41.089 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-25T13:28:41.090 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-25T13:28:41.090 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-25T13:28:41.090 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-25T13:28:41.090 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-25T13:28:41.090 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-25T13:28:41.090 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-25T13:28:41.090 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-25T13:28:41.090 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-25T13:28:41.090 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-25T13:28:41.090 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-25T13:28:41.090 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-25T13:28:41.090 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-25T13:28:41.090 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-25T13:28:41.090 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-25T13:28:41.091 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-25T13:28:41.091 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-25T13:28:41.091 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-25T13:28:41.091 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-25T13:28:41.091 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-25T13:28:41.091 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-25T13:28:41.091 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-25T13:28:41.091 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-25T13:28:41.091 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-25T13:28:41.091 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-25T13:28:41.091 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-25T13:28:41.091 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-25T13:28:41.091 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-25T13:28:41.092 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-25T13:28:41.092 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-25T13:28:41.092 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-25T13:28:41.092 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-25T13:28:41.092 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-25T13:28:41.092 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-25T13:28:41.092 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-25T13:28:41.092 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-25T13:28:41.092 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-25T13:28:41.092 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-25T13:28:41.092 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-25T13:28:41.092 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-25T13:28:41.092 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-25T13:28:41.092 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-25T13:28:41.092 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-25T13:28:41.093 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-25T13:28:41.093 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-25T13:28:41.093 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-25T13:28:41.093 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-25T13:28:41.093 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-25T13:28:41.093 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-25T13:28:41.093 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-25T13:28:41.093 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-25T13:28:41.093 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-25T13:28:41.093 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-25T13:28:41.093 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-25T13:28:41.093 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-25T13:28:41.093 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-25T13:28:41.093 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-25T13:28:41.093 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-25T13:28:41.094 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-25T13:28:41.094 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-25T13:28:41.094 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-25T13:28:41.094 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-25T13:28:41.094 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-25T13:28:41.094 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-25T13:28:41.094 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-25T13:28:41.094 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-25T13:28:41.094 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-25T13:28:41.094 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-25T13:28:41.094 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-25T13:28:41.094 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-25T13:28:41.094 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-25T13:28:41.094 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-25T13:28:41.095 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-25T13:28:41.095 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-25T13:28:41.095 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-25T13:28:41.095 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-25T13:28:41.095 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-25T13:28:41.095 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-25T13:28:41.095 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-25T13:28:41.095 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-25T13:28:41.095 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-25T13:28:41.095 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-25T13:28:41.095 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-25T13:28:41.095 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-25T13:28:41.095 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-25T13:28:41.095 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-25T13:28:41.095 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-25T13:28:41.096 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-25T13:28:41.096 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-25T13:28:41.096 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-25T13:28:41.096 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-25T13:28:41.096 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-25T13:28:41.096 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-25T13:28:41.096 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-25T13:28:41.096 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-25T13:28:41.096 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-25T13:28:41.096 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-25T13:28:41.096 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-25T13:28:41.096 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-25T13:28:41.096 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-25T13:28:41.096 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-25T13:28:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-25T13:28:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-25T13:28:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-25T13:28:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-25T13:28:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-25T13:28:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-25T13:28:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-25T13:28:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-25T13:28:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-25T13:28:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-25T13:28:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-25T13:28:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-25T13:28:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-25T13:28:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-25T13:28:41.097 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-25T13:28:41.098 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-25T13:28:41.098 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-25T13:28:41.098 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-25T13:28:41.098 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-25T13:28:41.098 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-25T13:28:41.098 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-25T13:28:41.098 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-25T13:28:41.098 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-25T13:28:41.098 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-25T13:28:41.098 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-25T13:28:41.098 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-25T13:28:41.098 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-25T13:28:41.098 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-25T13:28:41.098 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-25T13:28:41.099 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-25T13:28:41.099 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-25T13:28:41.099 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-25T13:28:41.099 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-25T13:28:41.099 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-25T13:28:41.099 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-25T13:28:41.099 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-25T13:28:41.099 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-25T13:28:41.099 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-25T13:28:41.099 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-25T13:28:41.099 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-25T13:28:41.099 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-25T13:28:41.099 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-25T13:28:41.099 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-25T13:28:41.099 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-25T13:28:41.100 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-25T13:28:41.100 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-25T13:28:41.100 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-25T13:28:41.100 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-25T13:28:41.100 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-25T13:28:41.100 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-25T13:28:41.100 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-25T13:28:41.100 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-25T13:28:41.100 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-25T13:28:41.100 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-25T13:28:41.100 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-25T13:28:41.100 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-25T13:28:41.100 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-25T13:28:41.101 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-25T13:28:41.101 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-25T13:28:41.101 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-25T13:28:41.101 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-25T13:28:41.101 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-25T13:28:41.101 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-25T13:28:41.101 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-25T13:28:41.101 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-25T13:28:41.101 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-25T13:28:41.101 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-25T13:28:41.101 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-25T13:28:41.101 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-25T13:28:41.101 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-25T13:28:41.101 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-25T13:28:41.102 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-25T13:28:41.102 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-25T13:28:41.102 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-25T13:28:41.102 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-25T13:28:41.102 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-25T13:28:41.102 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-25T13:28:41.102 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-25T13:28:41.102 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-25T13:28:41.102 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-25T13:28:41.102 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-25T13:28:41.102 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-25T13:28:41.102 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-25T13:28:41.102 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-25T13:28:41.102 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-25T13:28:41.103 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-25T13:28:41.103 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-25T13:28:41.103 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-25T13:28:41.103 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-25T13:28:41.103 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-25T13:28:41.103 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-25T13:28:41.103 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-25T13:28:41.103 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-25T13:28:41.103 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-25T13:28:41.103 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-25T13:28:41.103 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-25T13:28:41.103 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-25T13:28:41.103 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-25T13:28:41.103 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-25T13:28:41.103 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-25T13:28:41.104 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-25T13:28:41.104 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-25T13:28:41.104 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-25T13:28:41.104 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-25T13:28:41.104 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-25T13:28:41.104 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-25T13:28:41.104 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-25T13:28:41.104 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-25T13:28:41.104 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-25T13:28:41.104 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-25T13:28:41.104 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-25T13:28:41.104 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-25T13:28:41.104 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-25T13:28:41.104 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-25T13:28:41.104 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-25T13:28:41.105 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-25T13:28:41.105 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-25T13:28:41.105 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-25T13:28:41.105 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-25T13:28:41.105 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-25T13:28:41.105 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-25T13:28:41.105 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-25T13:28:41.105 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-25T13:28:41.105 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-25T13:28:41.105 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-25T13:28:41.105 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-25T13:28:41.105 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-25T13:28:41.105 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-25T13:28:41.105 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-25T13:28:41.105 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-25T13:28:41.106 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-25T13:28:41.106 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-25T13:28:41.106 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-25T13:28:41.106 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-25T13:28:41.106 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-25T13:28:41.106 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-25T13:28:41.106 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-25T13:28:41.106 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-25T13:28:41.106 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-25T13:28:41.106 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-25T13:28:41.106 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-25T13:28:41.106 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-25T13:28:41.106 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-25T13:28:41.106 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-25T13:28:41.107 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-25T13:28:41.107 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-25T13:28:41.107 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-25T13:28:41.107 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-25T13:28:41.107 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-25T13:28:41.107 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-25T13:28:41.107 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-25T13:28:41.107 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-25T13:28:41.107 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-25T13:28:41.107 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-25T13:28:41.107 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-25T13:28:41.107 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-25T13:28:41.107 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-25T13:28:41.107 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-25T13:28:41.108 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-25T13:28:41.108 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-25T13:28:41.108 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-25T13:28:41.108 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-25T13:28:41.108 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-25T13:28:41.108 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-25T13:28:41.108 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-25T13:28:41.108 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-25T13:28:41.108 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-25T13:28:41.108 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-25T13:28:41.108 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-25T13:28:41.108 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-25T13:28:41.108 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-25T13:28:41.108 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-25T13:28:41.108 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-25T13:28:41.109 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-25T13:28:41.109 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-25T13:28:41.109 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-25T13:28:41.109 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-25T13:28:41.109 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-25T13:28:41.109 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-25T13:28:41.109 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-25T13:28:41.109 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-25T13:28:41.109 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-25T13:28:41.109 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-25T13:28:41.109 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-25T13:28:41.109 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-25T13:28:41.109 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-25T13:28:41.109 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-25T13:28:41.110 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-25T13:28:41.110 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-25T13:28:41.110 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-25T13:28:41.110 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-25T13:28:41.110 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-25T13:28:41.110 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-25T13:28:41.110 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-25T13:28:41.110 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-25T13:28:41.110 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-25T13:28:41.110 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-25T13:28:41.110 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-25T13:28:41.110 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-25T13:28:41.110 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-25T13:28:41.110 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-25T13:28:41.111 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-25T13:28:41.111 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-25T13:28:41.111 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-25T13:28:41.111 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-25T13:28:41.111 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-25T13:28:41.111 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-25T13:28:41.111 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-25T13:28:41.111 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-25T13:28:41.111 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-25T13:28:41.111 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-25T13:28:41.111 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-25T13:28:41.111 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-25T13:28:41.111 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-25T13:28:41.111 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-25T13:28:41.112 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-25T13:28:41.112 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-25T13:28:41.112 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-25T13:28:41.112 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-25T13:28:41.112 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-25T13:28:41.112 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-25T13:28:41.112 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-25T13:28:41.112 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-25T13:28:41.112 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-25T13:28:41.112 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-25T13:28:41.112 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-25T13:28:41.112 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-25T13:28:41.112 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-25T13:28:41.112 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-25T13:28:41.112 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-25T13:28:41.113 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-25T13:28:41.113 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-25T13:28:41.113 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-25T13:28:41.113 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-25T13:28:41.113 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-25T13:28:41.113 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-25T13:28:41.113 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-25T13:28:41.113 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-25T13:28:41.113 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-25T13:28:41.113 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-25T13:28:41.113 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-25T13:28:41.113 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-25T13:28:41.113 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-25T13:28:41.113 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-25T13:28:41.113 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-25T13:28:41.114 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-25T13:28:41.114 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-25T13:28:41.114 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-25T13:28:41.114 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-25T13:28:41.114 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-25T13:28:41.114 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-25T13:28:41.114 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-25T13:28:41.114 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-25T13:28:41.114 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-25T13:28:41.114 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-25T13:28:41.114 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-25T13:28:41.114 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-25T13:28:41.114 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-25T13:28:41.114 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-25T13:28:41.114 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-25T13:28:41.115 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-25T13:28:41.115 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-25T13:28:41.115 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-25T13:28:41.115 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-25T13:28:41.115 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-25T13:28:41.115 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-25T13:28:41.115 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-25T13:28:41.115 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-25T13:28:41.115 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-25T13:28:41.115 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-25T13:28:41.115 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-25T13:28:41.115 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-25T13:28:41.115 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-25T13:28:41.115 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-25T13:28:41.115 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-25T13:28:41.116 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-25T13:28:41.116 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-25T13:28:41.116 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-25T13:28:41.116 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-25T13:28:41.116 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-25T13:28:41.116 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-25T13:28:41.116 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-25T13:28:41.116 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-25T13:28:41.116 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-25T13:28:41.116 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-25T13:28:41.116 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-25T13:28:41.116 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-25T13:28:41.157 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-25T13:28:41.157 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-25T13:28:41.158 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-25T13:28:41.158 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-25T13:28:41.158 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-25T13:28:41.158 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-25T13:28:41.158 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-25T13:28:41.158 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-25T13:28:41.158 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-25T13:28:41.158 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-25T13:28:41.158 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-25T13:28:41.158 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-25T13:28:41.158 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-25T13:28:41.158 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-25T13:28:41.158 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-25T13:28:41.158 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-25T13:28:41.159 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-25T13:28:41.159 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-25T13:28:41.159 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-25T13:28:41.159 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-25T13:28:41.159 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-25T13:28:41.159 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-25T13:28:41.159 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-25T13:28:41.159 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-25T13:28:41.159 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-25T13:28:41.159 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-25T13:28:41.159 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-25T13:28:41.159 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-25T13:28:41.159 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-25T13:28:41.159 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-25T13:28:41.160 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-25T13:28:41.160 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-25T13:28:41.160 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-25T13:28:41.160 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-25T13:28:41.160 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-25T13:28:41.160 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-25T13:28:41.160 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-25T13:28:41.160 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-25T13:28:41.160 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-25T13:28:41.160 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-25T13:28:41.160 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-25T13:28:41.160 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-25T13:28:41.160 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-25T13:28:41.160 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-25T13:28:41.160 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-25T13:28:41.161 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-25T13:28:41.161 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-25T13:28:41.161 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-25T13:28:41.161 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-25T13:28:41.161 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-25T13:28:41.161 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-25T13:28:41.161 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-25T13:28:41.161 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-25T13:28:41.161 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-25T13:28:41.161 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-25T13:28:41.161 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-25T13:28:41.161 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-25T13:28:41.161 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-25T13:28:41.161 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-25T13:28:41.161 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-25T13:28:41.162 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-25T13:28:41.162 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-25T13:28:41.162 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-25T13:28:41.162 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-25T13:28:41.162 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-25T13:28:41.162 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-25T13:28:41.162 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-25T13:28:41.162 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-25T13:28:41.162 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-25T13:28:41.162 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-25T13:28:41.162 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-25T13:28:41.162 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-25T13:28:41.162 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-25T13:28:41.162 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-25T13:28:41.163 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-25T13:28:41.163 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-25T13:28:41.163 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-25T13:28:41.163 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-25T13:28:41.163 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-25T13:28:41.163 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-25T13:28:41.163 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-25T13:28:41.163 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-25T13:28:41.163 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-25T13:28:41.163 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-25T13:28:41.163 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-25T13:28:41.163 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-25T13:28:41.163 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-25T13:28:41.163 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-25T13:28:41.163 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-25T13:28:41.164 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-25T13:28:41.164 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-25T13:28:41.164 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-25T13:28:41.164 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-25T13:28:41.164 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-25T13:28:41.164 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-25T13:28:41.164 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-25T13:28:41.164 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-25T13:28:41.164 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-25T13:28:41.164 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-25T13:28:41.164 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-25T13:28:41.164 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-25T13:28:41.164 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-25T13:28:41.164 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-25T13:28:41.164 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-25T13:28:41.165 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-25T13:28:41.165 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-25T13:28:41.165 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-25T13:28:41.165 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-25T13:28:41.165 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-25T13:28:41.165 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-25T13:28:41.165 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-25T13:28:41.165 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-25T13:28:41.165 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-25T13:28:41.165 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-25T13:28:41.165 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-25T13:28:41.165 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-25T13:28:41.165 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-25T13:28:41.165 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-25T13:28:41.165 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-25T13:28:41.166 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-25T13:28:41.166 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-25T13:28:41.166 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-25T13:28:41.166 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-25T13:28:41.166 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-25T13:28:41.166 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-25T13:28:41.166 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-25T13:28:41.166 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-25T13:28:41.166 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-25T13:28:41.166 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-25T13:28:41.166 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-25T13:28:41.166 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-25T13:28:41.166 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-25T13:28:41.166 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-25T13:28:41.166 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-25T13:28:41.167 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-25T13:28:41.167 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-25T13:28:41.167 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-25T13:28:41.167 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-25T13:28:41.167 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-25T13:28:41.167 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-25T13:28:41.167 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-25T13:28:41.167 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-25T13:28:41.167 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-25T13:28:41.167 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-25T13:28:41.167 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-25T13:28:41.167 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-25T13:28:41.167 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-25T13:28:41.167 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-25T13:28:41.167 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-25T13:28:41.168 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-25T13:28:41.168 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-25T13:28:41.168 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-25T13:28:41.168 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-25T13:28:41.168 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-25T13:28:41.168 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-25T13:28:41.168 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-25T13:28:41.168 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-25T13:28:41.168 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-25T13:28:41.168 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-25T13:28:41.168 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-25T13:28:41.168 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-25T13:28:41.168 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-25T13:28:41.168 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-25T13:28:41.168 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-25T13:28:41.169 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-25T13:28:41.169 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-25T13:28:41.169 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-25T13:28:41.169 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-25T13:28:41.169 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-25T13:28:41.169 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-25T13:28:41.169 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-25T13:28:41.169 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-25T13:28:41.169 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-25T13:28:41.169 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-25T13:28:41.169 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-25T13:28:41.169 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-25T13:28:41.169 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-25T13:28:41.169 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-25T13:28:41.169 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-25T13:28:41.170 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-25T13:28:41.170 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-25T13:28:41.170 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-25T13:28:41.170 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-25T13:28:41.170 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-25T13:28:41.170 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-25T13:28:41.170 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-25T13:28:41.170 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-25T13:28:41.170 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-25T13:28:41.170 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-25T13:28:41.170 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-25T13:28:41.170 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-25T13:28:41.170 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-25T13:28:41.170 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-25T13:28:41.171 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-25T13:28:41.171 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-25T13:28:41.171 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-25T13:28:41.171 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-25T13:28:41.171 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-25T13:28:41.171 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-25T13:28:41.171 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-25T13:28:41.171 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-25T13:28:41.171 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-25T13:28:41.171 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-25T13:28:41.171 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-25T13:28:41.171 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-25T13:28:41.171 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-25T13:28:41.171 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-25T13:28:41.171 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-25T13:28:41.172 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-25T13:28:41.172 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-25T13:28:41.172 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-25T13:28:41.172 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-25T13:28:41.172 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-25T13:28:41.172 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-25T13:28:41.172 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-25T13:28:41.172 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-25T13:28:41.172 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-25T13:28:41.172 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-25T13:28:41.172 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-25T13:28:41.172 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-25T13:28:41.172 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-25T13:28:41.172 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-25T13:28:41.172 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-25T13:28:41.173 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-25T13:28:41.173 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-25T13:28:41.173 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-25T13:28:41.173 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-25T13:28:41.173 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-25T13:28:41.173 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-25T13:28:41.173 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-25T13:28:41.173 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-25T13:28:41.173 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-25T13:28:41.173 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-25T13:28:41.173 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-25T13:28:41.173 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-25T13:28:41.173 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-25T13:28:41.173 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-25T13:28:41.174 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-25T13:28:41.174 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-25T13:28:41.174 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-25T13:28:41.174 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-25T13:28:41.174 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-25T13:28:41.174 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-25T13:28:41.174 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-25T13:28:41.174 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-25T13:28:41.174 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-25T13:28:41.174 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-25T13:28:41.174 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-25T13:28:41.174 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-25T13:28:41.174 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-25T13:28:41.174 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-25T13:28:41.174 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-25T13:28:41.175 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-25T13:28:41.175 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-25T13:28:41.175 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-25T13:28:41.175 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-25T13:28:41.175 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-25T13:28:41.175 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-25T13:28:41.175 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-25T13:28:41.175 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-25T13:28:41.175 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-25T13:28:41.175 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-25T13:28:41.175 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-25T13:28:41.175 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-25T13:28:41.175 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-25T13:28:41.175 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-25T13:28:41.176 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-25T13:28:41.176 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-25T13:28:41.176 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-25T13:28:41.176 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-25T13:28:41.176 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-25T13:28:41.176 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-25T13:28:41.176 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-25T13:28:41.176 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-25T13:28:41.176 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-25T13:28:41.176 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-25T13:28:41.176 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-25T13:28:41.176 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-25T13:28:41.176 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-25T13:28:41.176 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-25T13:28:41.176 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-25T13:28:41.177 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-25T13:28:41.177 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-25T13:28:41.177 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-25T13:28:41.177 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-25T13:28:41.177 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-25T13:28:41.177 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-25T13:28:41.177 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-25T13:28:41.177 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-25T13:28:41.177 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-25T13:28:41.177 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-25T13:28:41.177 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-25T13:28:41.177 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-25T13:28:41.177 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-25T13:28:41.177 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-25T13:28:41.177 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-25T13:28:41.178 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-25T13:28:41.178 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-25T13:28:41.178 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-25T13:28:41.178 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-25T13:28:41.178 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-25T13:28:41.178 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-25T13:28:41.178 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-25T13:28:41.178 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-25T13:28:41.178 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-25T13:28:41.178 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-25T13:28:41.178 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-25T13:28:41.178 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-25T13:28:41.178 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-25T13:28:41.178 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-25T13:28:41.179 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-25T13:28:41.179 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-25T13:28:41.179 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-25T13:28:41.179 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-25T13:28:41.179 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-25T13:28:41.179 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-25T13:28:41.179 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-25T13:28:41.179 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-25T13:28:41.179 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-25T13:28:41.179 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-25T13:28:41.179 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-25T13:28:41.179 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-25T13:28:41.179 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-25T13:28:41.179 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-25T13:28:41.179 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-25T13:28:41.180 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-25T13:28:41.180 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-25T13:28:41.180 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-25T13:28:41.180 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-25T13:28:41.180 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-25T13:28:41.180 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-25T13:28:41.180 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-25T13:28:41.180 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-25T13:28:41.180 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-25T13:28:41.180 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-25T13:28:41.180 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-25T13:28:41.180 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-25T13:28:41.180 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-25T13:28:41.180 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-25T13:28:41.181 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-25T13:28:41.181 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-25T13:28:41.181 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-25T13:28:41.181 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-25T13:28:41.181 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-25T13:28:41.181 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-25T13:28:41.181 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-25T13:28:41.181 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-25T13:28:41.181 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-25T13:28:41.181 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-25T13:28:41.181 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-25T13:28:41.181 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-25T13:28:41.181 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-25T13:28:41.181 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-25T13:28:41.181 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-25T13:28:41.182 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-25T13:28:41.182 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-25T13:28:41.182 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-25T13:28:41.182 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-25T13:28:41.182 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-25T13:28:41.182 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-25T13:28:41.182 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-25T13:28:41.182 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-25T13:28:41.182 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-25T13:28:41.182 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-25T13:28:41.182 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-25T13:28:41.182 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-25T13:28:41.182 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-25T13:28:41.182 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-25T13:28:41.183 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-25T13:28:41.183 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-25T13:28:41.183 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-25T13:28:41.183 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-25T13:28:41.183 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-25T13:28:41.183 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-25T13:28:41.183 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-25T13:28:41.183 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-25T13:28:41.183 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-25T13:28:41.183 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-25T13:28:41.183 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-25T13:28:41.183 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-25T13:28:41.183 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-25T13:28:41.183 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-25T13:28:41.183 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-25T13:28:41.184 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-25T13:28:41.184 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-25T13:28:41.184 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-25T13:28:41.184 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-25T13:28:41.184 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-25T13:28:41.184 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-25T13:28:41.184 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-25T13:28:41.184 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-25T13:28:41.184 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-25T13:28:41.184 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-25T13:28:41.184 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-25T13:28:41.184 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-25T13:28:41.184 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-25T13:28:41.184 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-25T13:28:41.185 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-25T13:28:41.185 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-25T13:28:41.185 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-25T13:28:41.185 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-25T13:28:41.185 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-25T13:28:41.185 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-25T13:28:41.185 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-25T13:28:41.185 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-25T13:28:41.185 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-25T13:28:41.185 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-25T13:28:41.185 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-25T13:28:41.185 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-25T13:28:41.185 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-25T13:28:41.185 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-25T13:28:41.185 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-25T13:28:41.185 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-25T13:28:41.186 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-25T13:28:41.186 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-25T13:28:41.186 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-25T13:28:41.186 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-25T13:28:41.186 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-25T13:28:41.186 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-25T13:28:41.186 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-25T13:28:41.186 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-25T13:28:41.186 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-25T13:28:41.186 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-25T13:28:41.186 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-25T13:28:41.186 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-25T13:28:41.186 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-25T13:28:41.186 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-25T13:28:41.187 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-25T13:28:41.187 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-25T13:28:41.187 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-25T13:28:41.187 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-25T13:28:41.187 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-25T13:28:41.187 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-25T13:28:41.187 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-25T13:28:41.187 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-25T13:28:41.187 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-25T13:28:41.187 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-25T13:28:41.187 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-25T13:28:41.187 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-25T13:28:41.187 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-25T13:28:41.187 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-25T13:28:41.188 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-25T13:28:41.188 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-25T13:28:41.188 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-25T13:28:41.188 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-25T13:28:41.188 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-25T13:28:41.188 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-25T13:28:41.188 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-25T13:28:41.188 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-25T13:28:41.188 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-25T13:28:41.188 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-25T13:28:41.188 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-25T13:28:41.188 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-25T13:28:41.188 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-25T13:28:41.188 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-25T13:28:41.189 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-25T13:28:41.189 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-25T13:28:41.189 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-25T13:28:41.189 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-25T13:28:41.189 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-25T13:28:41.189 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-25T13:28:41.189 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-25T13:28:41.189 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-25T13:28:41.189 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-25T13:28:41.189 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-25T13:28:41.189 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-25T13:28:41.189 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-25T13:28:41.189 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-25T13:28:41.189 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-25T13:28:41.189 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-25T13:28:41.190 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-25T13:28:41.190 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-25T13:28:41.190 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-25T13:28:41.190 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-25T13:28:41.190 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-25T13:28:41.190 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-25T13:28:41.190 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-25T13:28:41.190 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-25T13:28:41.190 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-25T13:28:41.190 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-25T13:28:41.190 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-25T13:28:41.190 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-25T13:28:41.190 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-25T13:28:41.190 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-25T13:28:41.190 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-25T13:28:41.191 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-25T13:28:41.191 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-25T13:28:41.191 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-25T13:28:41.191 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-25T13:28:41.191 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-25T13:28:41.191 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-25T13:28:41.191 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-25T13:28:41.191 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-25T13:28:41.191 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-25T13:28:41.191 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-25T13:28:41.191 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-25T13:28:41.191 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-25T13:28:41.191 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-25T13:28:41.191 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-25T13:28:41.191 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-25T13:28:41.192 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-25T13:28:41.192 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-25T13:28:41.192 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-25T13:28:41.192 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-25T13:28:41.192 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-25T13:28:41.192 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-25T13:28:41.192 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-25T13:28:41.192 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-25T13:28:41.192 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-25T13:28:41.192 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-25T13:28:41.192 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-25T13:28:41.192 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-25T13:28:41.192 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-25T13:28:41.192 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-25T13:28:41.192 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-25T13:28:41.193 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-25T13:28:41.193 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-25T13:28:41.193 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-25T13:28:41.193 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-25T13:28:41.193 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-25T13:28:41.193 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-25T13:28:41.193 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-25T13:28:41.193 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-25T13:28:41.193 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-25T13:28:41.193 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-25T13:28:41.193 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-25T13:28:41.193 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-25T13:28:41.193 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-25T13:28:41.198 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-25T13:28:41.198 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-25T13:28:41.198 DEBUG:teuthology.orchestra.run.smithi123:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-25T13:28:41.207 INFO:teuthology.orchestra.run.smithi123.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T13:28:41.207 INFO:teuthology.orchestra.run.smithi123.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T13:28:41.207 INFO:teuthology.orchestra.run.smithi123.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T13:28:41.208 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-25T13:28:41.208 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-25T13:28:41.208 DEBUG:teuthology.orchestra.run.smithi123:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-25T13:28:41.251 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi123.front.sepia.ceph.com to complete... 2024-04-25T13:28:41.695 INFO:teuthology.orchestra.run.smithi123.stderr:Sourcing file `/etc/default/grub' 2024-04-25T13:28:41.696 INFO:teuthology.orchestra.run.smithi123.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T13:28:41.704 INFO:teuthology.orchestra.run.smithi123.stderr:Generating grub configuration file ... 2024-04-25T13:28:41.927 INFO:teuthology.orchestra.run.smithi123.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T13:28:41.933 INFO:teuthology.orchestra.run.smithi123.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T13:28:42.209 INFO:teuthology.orchestra.run.smithi123.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T13:28:42.215 INFO:teuthology.orchestra.run.smithi123.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T13:28:42.256 INFO:teuthology.orchestra.run.smithi123.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T13:28:42.262 INFO:teuthology.orchestra.run.smithi123.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T13:28:42.412 INFO:teuthology.orchestra.run.smithi123.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T13:28:42.412 INFO:teuthology.orchestra.run.smithi123.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T13:28:42.412 INFO:teuthology.orchestra.run.smithi123.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T13:28:42.426 INFO:teuthology.orchestra.run.smithi123.stderr:done 2024-04-25T13:29:09.502 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-04-25T13:29:09.503 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-04-25T13:29:09.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:29:13.566 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-25T13:29:13.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-04-25T13:29:13.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:29:27.839 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-04-25T13:29:31.938 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-04-25T13:29:36.844 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-04-25T13:29:36.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:29:39.902 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-04-25T13:29:40.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-04-25T13:29:40.941 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:29:44.002 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-04-25T13:29:51.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-04-25T13:29:51.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:29:56.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-04-25T13:29:56.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:30:10.335 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2024-04-25T13:30:14.430 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.123 2024-04-25T13:30:25.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-04-25T13:30:25.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:30:25.618 DEBUG:teuthology.orchestra.run.smithi130:> true 2024-04-25T13:30:26.260 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-04-25T13:30:26.260 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.9.0-rc3-g806ec36b2112"... 2024-04-25T13:30:26.261 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2024-04-25T13:30:26.309 INFO:teuthology.orchestra.run.smithi130.stdout:6.9.0-rc3-g806ec36b2112 2024-04-25T13:30:26.309 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-25T13:30:26.309 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T13:30:26.309 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T13:30:27.311 DEBUG:teuthology.parallel:result is None 2024-04-25T13:30:29.431 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-04-25T13:30:29.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:30:30.010 DEBUG:teuthology.orchestra.run.smithi123:> true 2024-04-25T13:30:30.917 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-04-25T13:30:30.917 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-04-25T13:30:30.917 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2024-04-25T13:30:30.969 INFO:teuthology.orchestra.run.smithi123.stdout:6.9.0-rc3-g806ec36b2112 2024-04-25T13:30:30.970 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-25T13:30:30.970 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T13:30:30.970 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T13:30:31.970 DEBUG:teuthology.parallel:result is None 2024-04-25T13:30:31.971 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T13:30:31.985 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T13:30:31.985 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T13:30:31.988 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T13:30:31.997 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T13:30:32.048 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T13:30:32.104 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T13:30:32.104 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T13:30:32.107 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T13:30:32.161 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T13:30:32.179 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T13:30:32.180 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T13:30:32.184 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T13:30:32.272 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:30:32.295 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:30:32.310 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:30:32.332 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T13:30:32.335 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T13:30:32.342 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T13:30:32.342 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T13:30:32.345 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T13:30:32.365 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T13:30:32.374 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T13:30:32.374 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T13:30:32.409 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T13:30:32.417 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T13:30:32.466 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T13:30:32.522 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:30:32.522 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T13:30:32.588 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T13:30:32.597 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T13:30:32.650 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:30:32.650 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T13:30:32.723 DEBUG:teuthology.orchestra.run.smithi123:> sudo service rsyslog restart 2024-04-25T13:30:32.726 DEBUG:teuthology.orchestra.run.smithi130:> sudo service rsyslog restart 2024-04-25T13:30:32.863 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T13:30:32.870 INFO:teuthology.task.internal:Starting timer... 2024-04-25T13:30:32.870 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T13:30:32.940 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T13:30:32.963 DEBUG:teuthology.task.selinux:Excluding smithi123: OS 'ubuntu' does not support SELinux 2024-04-25T13:30:32.963 DEBUG:teuthology.task.selinux:Excluding smithi130: OS 'ubuntu' does not support SELinux 2024-04-25T13:30:32.963 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T13:30:32.963 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-25T13:30:32.963 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T13:30:32.964 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T13:30:32.991 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-25T13:30:32.996 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-25T13:30:33.260 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T13:30:33.275 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T13:30:33.277 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi123.front.sepia.ceph.com,smithi130.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T13:38:11.522 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi123.front.sepia.ceph.com'), Remote(name='ubuntu@smithi130.front.sepia.ceph.com')] 2024-04-25T13:38:11.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-04-25T13:38:11.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:38:11.604 DEBUG:teuthology.orchestra.run.smithi123:> true 2024-04-25T13:38:11.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-04-25T13:38:11.705 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-04-25T13:38:11.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T13:38:11.787 DEBUG:teuthology.orchestra.run.smithi130:> true 2024-04-25T13:38:11.892 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-04-25T13:38:11.893 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T13:38:11.904 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T13:38:11.904 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T13:38:11.905 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:38:11.907 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T13:38:11.907 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:38:11.942 INFO:teuthology.orchestra.run.smithi123.stdout:25 Apr 13:38:11 ntpd[17263]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T13:38:11.942 INFO:teuthology.orchestra.run.smithi123.stdout:25 Apr 13:38:11 ntpd[17263]: Command line: ntpd -gq 2024-04-25T13:38:11.943 INFO:teuthology.orchestra.run.smithi123.stdout:25 Apr 13:38:11 ntpd[17263]: ---------------------------------------------------- 2024-04-25T13:38:11.943 INFO:teuthology.orchestra.run.smithi123.stdout:25 Apr 13:38:11 ntpd[17263]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T13:38:11.943 INFO:teuthology.orchestra.run.smithi123.stdout:25 Apr 13:38:11 ntpd[17263]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T13:38:11.943 INFO:teuthology.orchestra.run.smithi123.stdout:25 Apr 13:38:11 ntpd[17263]: corporation. Support and training for ntp-4 are 2024-04-25T13:38:11.943 INFO:teuthology.orchestra.run.smithi123.stdout:25 Apr 13:38:11 ntpd[17263]: available at https://www.nwtime.org/support 2024-04-25T13:38:11.943 INFO:teuthology.orchestra.run.smithi123.stdout:25 Apr 13:38:11 ntpd[17263]: ---------------------------------------------------- 2024-04-25T13:38:11.943 INFO:teuthology.orchestra.run.smithi123.stdout:25 Apr 13:38:11 ntpd[17263]: proto: precision = 0.042 usec (-24) 2024-04-25T13:38:11.944 INFO:teuthology.orchestra.run.smithi123.stdout:25 Apr 13:38:11 ntpd[17263]: basedate set to 2022-02-04 2024-04-25T13:38:11.944 INFO:teuthology.orchestra.run.smithi123.stdout:25 Apr 13:38:11 ntpd[17263]: gps base set to 2022-02-06 (week 2196) 2024-04-25T13:38:11.944 INFO:teuthology.orchestra.run.smithi123.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T13:38:11.944 INFO:teuthology.orchestra.run.smithi123.stdout:25 Apr 13:38:11 ntpd[17263]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T13:38:11.944 INFO:teuthology.orchestra.run.smithi123.stdout:25 Apr 13:38:11 ntpd[17263]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T13:38:11.945 INFO:teuthology.orchestra.run.smithi123.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T13:38:11.945 INFO:teuthology.orchestra.run.smithi123.stdout:25 Apr 13:38:11 ntpd[17263]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T13:38:11.945 INFO:teuthology.orchestra.run.smithi123.stdout:25 Apr 13:38:11 ntpd[17263]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T13:38:11.945 INFO:teuthology.orchestra.run.smithi123.stdout:25 Apr 13:38:11 ntpd[17263]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T13:38:11.946 INFO:teuthology.orchestra.run.smithi123.stdout:25 Apr 13:38:11 ntpd[17263]: Listen normally on 3 enp3s0f1 172.21.15.123:123 2024-04-25T13:38:11.946 INFO:teuthology.orchestra.run.smithi123.stdout:25 Apr 13:38:11 ntpd[17263]: Listen normally on 4 lo [::1]:123 2024-04-25T13:38:11.946 INFO:teuthology.orchestra.run.smithi123.stdout:25 Apr 13:38:11 ntpd[17263]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d3f1%5]:123 2024-04-25T13:38:11.946 INFO:teuthology.orchestra.run.smithi123.stdout:25 Apr 13:38:11 ntpd[17263]: Listening on routing socket on fd #22 for interface updates 2024-04-25T13:38:11.971 INFO:teuthology.orchestra.run.smithi130.stdout:25 Apr 13:38:11 ntpd[17220]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T13:38:11.971 INFO:teuthology.orchestra.run.smithi130.stdout:25 Apr 13:38:11 ntpd[17220]: Command line: ntpd -gq 2024-04-25T13:38:11.971 INFO:teuthology.orchestra.run.smithi130.stdout:25 Apr 13:38:11 ntpd[17220]: ---------------------------------------------------- 2024-04-25T13:38:11.972 INFO:teuthology.orchestra.run.smithi130.stdout:25 Apr 13:38:11 ntpd[17220]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T13:38:11.972 INFO:teuthology.orchestra.run.smithi130.stdout:25 Apr 13:38:11 ntpd[17220]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T13:38:11.972 INFO:teuthology.orchestra.run.smithi130.stdout:25 Apr 13:38:11 ntpd[17220]: corporation. Support and training for ntp-4 are 2024-04-25T13:38:11.972 INFO:teuthology.orchestra.run.smithi130.stdout:25 Apr 13:38:11 ntpd[17220]: available at https://www.nwtime.org/support 2024-04-25T13:38:11.972 INFO:teuthology.orchestra.run.smithi130.stdout:25 Apr 13:38:11 ntpd[17220]: ---------------------------------------------------- 2024-04-25T13:38:11.972 INFO:teuthology.orchestra.run.smithi130.stdout:25 Apr 13:38:11 ntpd[17220]: proto: precision = 0.042 usec (-24) 2024-04-25T13:38:11.973 INFO:teuthology.orchestra.run.smithi130.stdout:25 Apr 13:38:11 ntpd[17220]: basedate set to 2022-02-04 2024-04-25T13:38:11.973 INFO:teuthology.orchestra.run.smithi130.stdout:25 Apr 13:38:11 ntpd[17220]: gps base set to 2022-02-06 (week 2196) 2024-04-25T13:38:11.973 INFO:teuthology.orchestra.run.smithi130.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T13:38:11.973 INFO:teuthology.orchestra.run.smithi130.stdout:25 Apr 13:38:11 ntpd[17220]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T13:38:11.973 INFO:teuthology.orchestra.run.smithi130.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T13:38:11.974 INFO:teuthology.orchestra.run.smithi130.stdout:25 Apr 13:38:11 ntpd[17220]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T13:38:11.975 INFO:teuthology.orchestra.run.smithi130.stdout:25 Apr 13:38:11 ntpd[17220]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T13:38:11.975 INFO:teuthology.orchestra.run.smithi130.stdout:25 Apr 13:38:11 ntpd[17220]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T13:38:11.975 INFO:teuthology.orchestra.run.smithi130.stdout:25 Apr 13:38:11 ntpd[17220]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T13:38:11.975 INFO:teuthology.orchestra.run.smithi130.stdout:25 Apr 13:38:11 ntpd[17220]: Listen normally on 3 enp3s0f1 172.21.15.130:123 2024-04-25T13:38:11.975 INFO:teuthology.orchestra.run.smithi130.stdout:25 Apr 13:38:11 ntpd[17220]: Listen normally on 4 lo [::1]:123 2024-04-25T13:38:11.975 INFO:teuthology.orchestra.run.smithi130.stdout:25 Apr 13:38:11 ntpd[17220]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f37%5]:123 2024-04-25T13:38:11.975 INFO:teuthology.orchestra.run.smithi130.stdout:25 Apr 13:38:11 ntpd[17220]: Listening on routing socket on fd #22 for interface updates 2024-04-25T13:38:12.943 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:12 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:12.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:12 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:12.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:12 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:12.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:12 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:12.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:12 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:12.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:12 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:12.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:12 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:38:12.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:12 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:38:12.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:12 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:12.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:12 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:12.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:12 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:38:12.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:12 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:38:12.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:12 ntpd[17220]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:12.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:12 ntpd[17220]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:12.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:12 ntpd[17220]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:12.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:12 ntpd[17220]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:12.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:12 ntpd[17220]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:12.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:12 ntpd[17220]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:12.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:12 ntpd[17220]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:38:12.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:12 ntpd[17220]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:38:12.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:12 ntpd[17220]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:12.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:12 ntpd[17220]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:12.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:12 ntpd[17220]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:38:12.974 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:12 ntpd[17220]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:38:14.943 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:14 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:14.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:14 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:14.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:14 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:14.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:14 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:14.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:14 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:14.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:14 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:14.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:14 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:38:14.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:14 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:38:14.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:14 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:14.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:14 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:14.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:14 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:38:14.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:14 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:38:14.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:14 ntpd[17220]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:14.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:14 ntpd[17220]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:14.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:14 ntpd[17220]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:14.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:14 ntpd[17220]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:14.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:14 ntpd[17220]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:14.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:14 ntpd[17220]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:14.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:14 ntpd[17220]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:14.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:14 ntpd[17220]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:14.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:14 ntpd[17220]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:38:14.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:14 ntpd[17220]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:38:14.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:14 ntpd[17220]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:14.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:14 ntpd[17220]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:14.974 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:14 ntpd[17220]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:38:14.974 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:14 ntpd[17220]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:38:15.943 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:15 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:15.943 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:15 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:15.943 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:15 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:15.943 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:15 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:15.943 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:15 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:38:15.943 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:15 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:38:15.972 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:15 ntpd[17220]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:15.972 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:15 ntpd[17220]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:15.972 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:15 ntpd[17220]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:15.972 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:15 ntpd[17220]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:15.972 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:15 ntpd[17220]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:38:15.972 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:15 ntpd[17220]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:38:16.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:16 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:16.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:16 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:16.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:16 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:16.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:16 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:16.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:16 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:16.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:16 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:16.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:16 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:16.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:16 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:16.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:16 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:38:16.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:16 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:38:16.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:16 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:16.945 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:16 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:16.945 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:16 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:38:16.945 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:16 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:38:16.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:16 ntpd[17220]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:16.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:16 ntpd[17220]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:16.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:16 ntpd[17220]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:16.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:16 ntpd[17220]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:16.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:16 ntpd[17220]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:16.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:16 ntpd[17220]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:16.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:16 ntpd[17220]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:38:16.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:16 ntpd[17220]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:38:16.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:16 ntpd[17220]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:16.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:16 ntpd[17220]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:16.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:16 ntpd[17220]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:38:16.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:16 ntpd[17220]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:38:17.943 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:17 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:17.943 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:17 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:17.943 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:17 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:17.943 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:17 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:17.943 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:17 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:38:17.943 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:17 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:38:17.972 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:17 ntpd[17220]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:17.972 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:17 ntpd[17220]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:17.972 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:17 ntpd[17220]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:17.972 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:17 ntpd[17220]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:17.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:17 ntpd[17220]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:38:17.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:17 ntpd[17220]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:38:18.943 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:18 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:18.943 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:18 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:18.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:18 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:18.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:18 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:18.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:18 ntpd[17263]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:18.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:18 ntpd[17263]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:18.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:18 ntpd[17263]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:38:18.944 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:18 ntpd[17263]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:38:18.944 INFO:teuthology.orchestra.run.smithi123.stdout:25 Apr 13:38:18 ntpd[17263]: ntpd: time slew +0.000866 s 2024-04-25T13:38:18.944 INFO:teuthology.orchestra.run.smithi123.stdout:ntpd: time slew +0.000866s 2024-04-25T13:38:18.945 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:18 ntpd[17263]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T13:38:18.945 INFO:teuthology.orchestra.run.smithi123.stderr:25 Apr 13:38:18 ntpd[17263]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T13:38:18.972 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:18 ntpd[17220]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:18.972 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:18 ntpd[17220]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:18.972 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:18 ntpd[17220]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:18.972 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:18 ntpd[17220]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:18.972 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:18 ntpd[17220]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T13:38:18.972 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:18 ntpd[17220]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T13:38:18.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:18 ntpd[17220]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T13:38:18.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:18 ntpd[17220]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T13:38:18.973 INFO:teuthology.orchestra.run.smithi130.stdout:25 Apr 13:38:18 ntpd[17220]: ntpd: time slew -0.000628 s 2024-04-25T13:38:18.973 INFO:teuthology.orchestra.run.smithi130.stdout:ntpd: time slew -0.000628s 2024-04-25T13:38:18.973 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:18 ntpd[17220]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T13:38:18.974 INFO:teuthology.orchestra.run.smithi130.stderr:25 Apr 13:38:18 ntpd[17220]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T13:38:19.045 INFO:teuthology.orchestra.run.smithi123.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T13:38:19.045 INFO:teuthology.orchestra.run.smithi123.stdout:============================================================================== 2024-04-25T13:38:19.045 INFO:teuthology.orchestra.run.smithi123.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:38:19.045 INFO:teuthology.orchestra.run.smithi123.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:38:19.045 INFO:teuthology.orchestra.run.smithi123.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:38:19.045 INFO:teuthology.orchestra.run.smithi123.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:38:19.100 INFO:teuthology.orchestra.run.smithi130.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T13:38:19.100 INFO:teuthology.orchestra.run.smithi130.stdout:============================================================================== 2024-04-25T13:38:19.100 INFO:teuthology.orchestra.run.smithi130.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:38:19.100 INFO:teuthology.orchestra.run.smithi130.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:38:19.100 INFO:teuthology.orchestra.run.smithi130.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:38:19.100 INFO:teuthology.orchestra.run.smithi130.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:38:19.101 INFO:teuthology.run_tasks:Running task install... 2024-04-25T13:38:19.110 DEBUG:teuthology.task.install:project ceph 2024-04-25T13:38:19.110 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}} 2024-04-25T13:38:19.110 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'} 2024-04-25T13:38:19.110 INFO:teuthology.task.install:Using flavor: default 2024-04-25T13:38:19.116 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T13:38:19.116 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T13:38:19.116 DEBUG:teuthology.orchestra.run.smithi123:> sudo apt-key list | grep Ceph 2024-04-25T13:38:19.117 DEBUG:teuthology.orchestra.run.smithi130:> sudo apt-key list | grep Ceph 2024-04-25T13:38:19.219 INFO:teuthology.orchestra.run.smithi123.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T13:38:19.248 INFO:teuthology.orchestra.run.smithi130.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T13:38:19.269 INFO:teuthology.orchestra.run.smithi123.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T13:38:19.270 INFO:teuthology.orchestra.run.smithi123.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T13:38:19.271 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-25T13:38:19.272 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-25T13:38:19.272 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:38:19.298 INFO:teuthology.orchestra.run.smithi130.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T13:38:19.298 INFO:teuthology.orchestra.run.smithi130.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T13:38:19.300 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-25T13:38:19.300 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-25T13:38:19.300 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:38:19.607 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default/ 2024-04-25T13:38:19.607 INFO:teuthology.task.install.deb:Package version is 19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:38:19.625 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default/ 2024-04-25T13:38:19.625 INFO:teuthology.task.install.deb:Package version is 19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:38:19.718 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:38:19.719 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T13:38:19.738 DEBUG:teuthology.orchestra.run.smithi123:> sudo apt-get update 2024-04-25T13:38:19.873 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:38:19.874 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T13:38:19.894 DEBUG:teuthology.orchestra.run.smithi130:> sudo apt-get update 2024-04-25T13:38:19.973 INFO:teuthology.orchestra.run.smithi123.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T13:38:19.995 INFO:teuthology.orchestra.run.smithi123.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T13:38:20.018 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T13:38:20.018 INFO:teuthology.orchestra.run.smithi123.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T13:38:20.040 INFO:teuthology.orchestra.run.smithi123.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,406 B] 2024-04-25T13:38:20.051 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T13:38:20.072 INFO:teuthology.orchestra.run.smithi123.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-25T13:38:20.124 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T13:38:20.206 INFO:teuthology.orchestra.run.smithi123.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T13:38:20.208 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T13:38:20.208 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T13:38:20.277 INFO:teuthology.orchestra.run.smithi130.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T13:38:20.282 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T13:38:20.337 INFO:teuthology.orchestra.run.smithi130.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T13:38:20.365 INFO:teuthology.orchestra.run.smithi130.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T13:38:20.396 INFO:teuthology.orchestra.run.smithi130.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T13:38:20.455 INFO:teuthology.orchestra.run.smithi130.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,406 B] 2024-04-25T13:38:20.528 INFO:teuthology.orchestra.run.smithi130.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-25T13:38:20.601 INFO:teuthology.orchestra.run.smithi123.stdout:Fetched 29.2 kB in 1s (45.6 kB/s) 2024-04-25T13:38:20.791 INFO:teuthology.orchestra.run.smithi130.stdout:Fetched 29.2 kB in 1s (43.3 kB/s) 2024-04-25T13:38:21.577 INFO:teuthology.orchestra.run.smithi123.stdout:Reading package lists... 2024-04-25T13:38:21.591 DEBUG:teuthology.orchestra.run.smithi123:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3291-g994e2f20-1jammy cephadm=19.0.0-3291-g994e2f20-1jammy ceph-mds=19.0.0-3291-g994e2f20-1jammy ceph-mgr=19.0.0-3291-g994e2f20-1jammy ceph-common=19.0.0-3291-g994e2f20-1jammy ceph-fuse=19.0.0-3291-g994e2f20-1jammy ceph-test=19.0.0-3291-g994e2f20-1jammy ceph-volume=19.0.0-3291-g994e2f20-1jammy radosgw=19.0.0-3291-g994e2f20-1jammy python3-rados=19.0.0-3291-g994e2f20-1jammy python3-rgw=19.0.0-3291-g994e2f20-1jammy python3-cephfs=19.0.0-3291-g994e2f20-1jammy python3-rbd=19.0.0-3291-g994e2f20-1jammy libcephfs2=19.0.0-3291-g994e2f20-1jammy libcephfs-dev=19.0.0-3291-g994e2f20-1jammy librados2=19.0.0-3291-g994e2f20-1jammy librbd1=19.0.0-3291-g994e2f20-1jammy rbd-fuse=19.0.0-3291-g994e2f20-1jammy python3-cephfs=19.0.0-3291-g994e2f20-1jammy cephfs-shell=19.0.0-3291-g994e2f20-1jammy cephfs-top=19.0.0-3291-g994e2f20-1jammy cephfs-mirror=19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:38:21.665 INFO:teuthology.orchestra.run.smithi123.stdout:Reading package lists... 2024-04-25T13:38:21.770 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2024-04-25T13:38:21.784 DEBUG:teuthology.orchestra.run.smithi130:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3291-g994e2f20-1jammy cephadm=19.0.0-3291-g994e2f20-1jammy ceph-mds=19.0.0-3291-g994e2f20-1jammy ceph-mgr=19.0.0-3291-g994e2f20-1jammy ceph-common=19.0.0-3291-g994e2f20-1jammy ceph-fuse=19.0.0-3291-g994e2f20-1jammy ceph-test=19.0.0-3291-g994e2f20-1jammy ceph-volume=19.0.0-3291-g994e2f20-1jammy radosgw=19.0.0-3291-g994e2f20-1jammy python3-rados=19.0.0-3291-g994e2f20-1jammy python3-rgw=19.0.0-3291-g994e2f20-1jammy python3-cephfs=19.0.0-3291-g994e2f20-1jammy python3-rbd=19.0.0-3291-g994e2f20-1jammy libcephfs2=19.0.0-3291-g994e2f20-1jammy libcephfs-dev=19.0.0-3291-g994e2f20-1jammy librados2=19.0.0-3291-g994e2f20-1jammy librbd1=19.0.0-3291-g994e2f20-1jammy rbd-fuse=19.0.0-3291-g994e2f20-1jammy python3-cephfs=19.0.0-3291-g994e2f20-1jammy cephfs-shell=19.0.0-3291-g994e2f20-1jammy cephfs-top=19.0.0-3291-g994e2f20-1jammy cephfs-mirror=19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:38:21.839 INFO:teuthology.orchestra.run.smithi123.stdout:Building dependency tree... 2024-04-25T13:38:21.840 INFO:teuthology.orchestra.run.smithi123.stdout:Reading state information... 2024-04-25T13:38:21.859 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2024-04-25T13:38:22.012 INFO:teuthology.orchestra.run.smithi123.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:38:22.012 INFO:teuthology.orchestra.run.smithi123.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:38:22.013 INFO:teuthology.orchestra.run.smithi123.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:38:22.013 INFO:teuthology.orchestra.run.smithi123.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:38:22.013 INFO:teuthology.orchestra.run.smithi123.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T13:38:22.013 INFO:teuthology.orchestra.run.smithi123.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:38:22.013 INFO:teuthology.orchestra.run.smithi123.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:38:22.015 INFO:teuthology.orchestra.run.smithi123.stdout:The following additional packages will be installed: 2024-04-25T13:38:22.015 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T13:38:22.015 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T13:38:22.015 INFO:teuthology.orchestra.run.smithi123.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T13:38:22.015 INFO:teuthology.orchestra.run.smithi123.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T13:38:22.016 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T13:38:22.016 INFO:teuthology.orchestra.run.smithi123.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T13:38:22.016 INFO:teuthology.orchestra.run.smithi123.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T13:38:22.016 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T13:38:22.016 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T13:38:22.016 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-25T13:38:22.016 INFO:teuthology.orchestra.run.smithi123.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-25T13:38:22.016 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-25T13:38:22.016 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-25T13:38:22.016 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-25T13:38:22.016 INFO:teuthology.orchestra.run.smithi123.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-25T13:38:22.016 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-25T13:38:22.016 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-25T13:38:22.016 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-25T13:38:22.017 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-25T13:38:22.017 INFO:teuthology.orchestra.run.smithi123.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-25T13:38:22.017 INFO:teuthology.orchestra.run.smithi123.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-25T13:38:22.017 INFO:teuthology.orchestra.run.smithi123.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-25T13:38:22.017 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-25T13:38:22.017 INFO:teuthology.orchestra.run.smithi123.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-25T13:38:22.017 INFO:teuthology.orchestra.run.smithi123.stdout:Suggested packages: 2024-04-25T13:38:22.017 INFO:teuthology.orchestra.run.smithi123.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T13:38:22.017 INFO:teuthology.orchestra.run.smithi123.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T13:38:22.017 INFO:teuthology.orchestra.run.smithi123.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T13:38:22.018 INFO:teuthology.orchestra.run.smithi123.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T13:38:22.018 INFO:teuthology.orchestra.run.smithi123.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T13:38:22.018 INFO:teuthology.orchestra.run.smithi123.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T13:38:22.018 INFO:teuthology.orchestra.run.smithi123.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T13:38:22.018 INFO:teuthology.orchestra.run.smithi123.stdout:Recommended packages: 2024-04-25T13:38:22.018 INFO:teuthology.orchestra.run.smithi123.stdout: btrfs-tools 2024-04-25T13:38:22.034 INFO:teuthology.orchestra.run.smithi130.stdout:Building dependency tree... 2024-04-25T13:38:22.035 INFO:teuthology.orchestra.run.smithi130.stdout:Reading state information... 2024-04-25T13:38:22.168 INFO:teuthology.orchestra.run.smithi123.stdout:The following NEW packages will be installed: 2024-04-25T13:38:22.168 INFO:teuthology.orchestra.run.smithi123.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T13:38:22.168 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T13:38:22.168 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-25T13:38:22.168 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-25T13:38:22.170 INFO:teuthology.orchestra.run.smithi123.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T13:38:22.170 INFO:teuthology.orchestra.run.smithi123.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-25T13:38:22.170 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-25T13:38:22.170 INFO:teuthology.orchestra.run.smithi123.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-25T13:38:22.170 INFO:teuthology.orchestra.run.smithi123.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-25T13:38:22.170 INFO:teuthology.orchestra.run.smithi123.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-25T13:38:22.170 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-25T13:38:22.170 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-25T13:38:22.170 INFO:teuthology.orchestra.run.smithi123.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-25T13:38:22.170 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T13:38:22.171 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T13:38:22.171 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T13:38:22.171 INFO:teuthology.orchestra.run.smithi123.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T13:38:22.171 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T13:38:22.171 INFO:teuthology.orchestra.run.smithi123.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T13:38:22.171 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-25T13:38:22.171 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-25T13:38:22.171 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-25T13:38:22.171 INFO:teuthology.orchestra.run.smithi123.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T13:38:22.171 INFO:teuthology.orchestra.run.smithi123.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T13:38:22.171 INFO:teuthology.orchestra.run.smithi123.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T13:38:22.171 INFO:teuthology.orchestra.run.smithi123.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T13:38:22.171 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-25T13:38:22.171 INFO:teuthology.orchestra.run.smithi123.stdout: socat unzip xmlstarlet zip 2024-04-25T13:38:22.210 INFO:teuthology.orchestra.run.smithi130.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:38:22.210 INFO:teuthology.orchestra.run.smithi130.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:38:22.210 INFO:teuthology.orchestra.run.smithi130.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:38:22.210 INFO:teuthology.orchestra.run.smithi130.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:38:22.210 INFO:teuthology.orchestra.run.smithi130.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T13:38:22.211 INFO:teuthology.orchestra.run.smithi130.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:38:22.211 INFO:teuthology.orchestra.run.smithi130.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:38:22.211 INFO:teuthology.orchestra.run.smithi130.stdout:The following additional packages will be installed: 2024-04-25T13:38:22.211 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T13:38:22.212 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T13:38:22.212 INFO:teuthology.orchestra.run.smithi130.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T13:38:22.212 INFO:teuthology.orchestra.run.smithi130.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T13:38:22.213 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T13:38:22.213 INFO:teuthology.orchestra.run.smithi130.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T13:38:22.213 INFO:teuthology.orchestra.run.smithi130.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T13:38:22.213 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T13:38:22.213 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T13:38:22.213 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-25T13:38:22.213 INFO:teuthology.orchestra.run.smithi130.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-25T13:38:22.214 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-25T13:38:22.214 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-25T13:38:22.214 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-25T13:38:22.214 INFO:teuthology.orchestra.run.smithi130.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-25T13:38:22.214 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-25T13:38:22.214 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-25T13:38:22.214 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-25T13:38:22.214 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-25T13:38:22.214 INFO:teuthology.orchestra.run.smithi130.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-25T13:38:22.214 INFO:teuthology.orchestra.run.smithi130.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-25T13:38:22.214 INFO:teuthology.orchestra.run.smithi130.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-25T13:38:22.214 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-25T13:38:22.215 INFO:teuthology.orchestra.run.smithi130.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-25T13:38:22.215 INFO:teuthology.orchestra.run.smithi130.stdout:Suggested packages: 2024-04-25T13:38:22.215 INFO:teuthology.orchestra.run.smithi130.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T13:38:22.215 INFO:teuthology.orchestra.run.smithi130.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T13:38:22.215 INFO:teuthology.orchestra.run.smithi130.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T13:38:22.215 INFO:teuthology.orchestra.run.smithi130.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T13:38:22.215 INFO:teuthology.orchestra.run.smithi130.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T13:38:22.215 INFO:teuthology.orchestra.run.smithi130.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T13:38:22.215 INFO:teuthology.orchestra.run.smithi130.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T13:38:22.215 INFO:teuthology.orchestra.run.smithi130.stdout:Recommended packages: 2024-04-25T13:38:22.215 INFO:teuthology.orchestra.run.smithi130.stdout: btrfs-tools 2024-04-25T13:38:22.364 INFO:teuthology.orchestra.run.smithi130.stdout:The following NEW packages will be installed: 2024-04-25T13:38:22.364 INFO:teuthology.orchestra.run.smithi130.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T13:38:22.364 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T13:38:22.364 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-25T13:38:22.366 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-25T13:38:22.366 INFO:teuthology.orchestra.run.smithi130.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T13:38:22.366 INFO:teuthology.orchestra.run.smithi130.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-25T13:38:22.366 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-25T13:38:22.366 INFO:teuthology.orchestra.run.smithi130.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-25T13:38:22.366 INFO:teuthology.orchestra.run.smithi130.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-25T13:38:22.367 INFO:teuthology.orchestra.run.smithi130.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-25T13:38:22.367 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-25T13:38:22.367 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-25T13:38:22.367 INFO:teuthology.orchestra.run.smithi130.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-25T13:38:22.367 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T13:38:22.367 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T13:38:22.367 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T13:38:22.367 INFO:teuthology.orchestra.run.smithi130.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T13:38:22.367 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T13:38:22.367 INFO:teuthology.orchestra.run.smithi130.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T13:38:22.367 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-25T13:38:22.367 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-25T13:38:22.367 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-25T13:38:22.367 INFO:teuthology.orchestra.run.smithi130.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T13:38:22.367 INFO:teuthology.orchestra.run.smithi130.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T13:38:22.367 INFO:teuthology.orchestra.run.smithi130.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T13:38:22.368 INFO:teuthology.orchestra.run.smithi130.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T13:38:22.368 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-25T13:38:22.368 INFO:teuthology.orchestra.run.smithi130.stdout: socat unzip xmlstarlet zip 2024-04-25T13:38:22.368 INFO:teuthology.orchestra.run.smithi123.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-25T13:38:22.368 INFO:teuthology.orchestra.run.smithi123.stdout:Need to get 175 MB of archives. 2024-04-25T13:38:22.368 INFO:teuthology.orchestra.run.smithi123.stdout:After this operation, 887 MB of additional disk space will be used. 2024-04-25T13:38:22.368 INFO:teuthology.orchestra.run.smithi123.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-25T13:38:22.395 INFO:teuthology.orchestra.run.smithi123.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3291-g994e2f20-1jammy [3,525 kB] 2024-04-25T13:38:22.449 INFO:teuthology.orchestra.run.smithi123.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T13:38:22.495 INFO:teuthology.orchestra.run.smithi123.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-25T13:38:22.563 INFO:teuthology.orchestra.run.smithi130.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-25T13:38:22.563 INFO:teuthology.orchestra.run.smithi130.stdout:Need to get 175 MB of archives. 2024-04-25T13:38:22.563 INFO:teuthology.orchestra.run.smithi130.stdout:After this operation, 887 MB of additional disk space will be used. 2024-04-25T13:38:22.563 INFO:teuthology.orchestra.run.smithi130.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-25T13:38:22.591 INFO:teuthology.orchestra.run.smithi130.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3291-g994e2f20-1jammy [3,525 kB] 2024-04-25T13:38:22.645 INFO:teuthology.orchestra.run.smithi130.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T13:38:22.691 INFO:teuthology.orchestra.run.smithi130.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-25T13:38:22.701 INFO:teuthology.orchestra.run.smithi123.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T13:38:22.802 INFO:teuthology.orchestra.run.smithi123.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T13:38:22.813 INFO:teuthology.orchestra.run.smithi123.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T13:38:22.863 INFO:teuthology.orchestra.run.smithi123.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3291-g994e2f20-1jammy [3,287 kB] 2024-04-25T13:38:22.866 INFO:teuthology.orchestra.run.smithi123.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T13:38:22.893 INFO:teuthology.orchestra.run.smithi130.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T13:38:22.987 INFO:teuthology.orchestra.run.smithi130.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T13:38:23.000 INFO:teuthology.orchestra.run.smithi130.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T13:38:23.041 INFO:teuthology.orchestra.run.smithi123.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T13:38:23.050 INFO:teuthology.orchestra.run.smithi123.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T13:38:23.052 INFO:teuthology.orchestra.run.smithi130.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T13:38:23.061 INFO:teuthology.orchestra.run.smithi130.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3291-g994e2f20-1jammy [3,287 kB] 2024-04-25T13:38:23.078 INFO:teuthology.orchestra.run.smithi123.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T13:38:23.082 INFO:teuthology.orchestra.run.smithi123.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3291-g994e2f20-1jammy [726 kB] 2024-04-25T13:38:23.086 INFO:teuthology.orchestra.run.smithi123.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T13:38:23.120 INFO:teuthology.orchestra.run.smithi123.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3291-g994e2f20-1jammy [356 kB] 2024-04-25T13:38:23.128 INFO:teuthology.orchestra.run.smithi123.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3291-g994e2f20-1jammy [32.8 kB] 2024-04-25T13:38:23.128 INFO:teuthology.orchestra.run.smithi123.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3291-g994e2f20-1jammy [180 kB] 2024-04-25T13:38:23.154 INFO:teuthology.orchestra.run.smithi123.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3291-g994e2f20-1jammy [67.1 kB] 2024-04-25T13:38:23.155 INFO:teuthology.orchestra.run.smithi123.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3291-g994e2f20-1jammy [330 kB] 2024-04-25T13:38:23.163 INFO:teuthology.orchestra.run.smithi123.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3291-g994e2f20-1jammy [7,189 kB] 2024-04-25T13:38:23.226 INFO:teuthology.orchestra.run.smithi130.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T13:38:23.235 INFO:teuthology.orchestra.run.smithi130.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T13:38:23.251 INFO:teuthology.orchestra.run.smithi123.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T13:38:23.263 INFO:teuthology.orchestra.run.smithi130.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T13:38:23.271 INFO:teuthology.orchestra.run.smithi130.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T13:38:23.274 INFO:teuthology.orchestra.run.smithi130.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3291-g994e2f20-1jammy [726 kB] 2024-04-25T13:38:23.350 INFO:teuthology.orchestra.run.smithi130.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3291-g994e2f20-1jammy [356 kB] 2024-04-25T13:38:23.362 INFO:teuthology.orchestra.run.smithi130.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3291-g994e2f20-1jammy [32.8 kB] 2024-04-25T13:38:23.364 INFO:teuthology.orchestra.run.smithi130.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3291-g994e2f20-1jammy [180 kB] 2024-04-25T13:38:23.369 INFO:teuthology.orchestra.run.smithi130.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3291-g994e2f20-1jammy [67.1 kB] 2024-04-25T13:38:23.400 INFO:teuthology.orchestra.run.smithi130.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3291-g994e2f20-1jammy [330 kB] 2024-04-25T13:38:23.411 INFO:teuthology.orchestra.run.smithi130.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3291-g994e2f20-1jammy [7,189 kB] 2024-04-25T13:38:23.435 INFO:teuthology.orchestra.run.smithi130.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T13:38:23.605 INFO:teuthology.orchestra.run.smithi123.stdout:Get:22 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3291-g994e2f20-1jammy [112 kB] 2024-04-25T13:38:23.606 INFO:teuthology.orchestra.run.smithi123.stdout:Get:23 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3291-g994e2f20-1jammy [471 kB] 2024-04-25T13:38:23.621 INFO:teuthology.orchestra.run.smithi123.stdout:Get:24 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3291-g994e2f20-1jammy [25.6 MB] 2024-04-25T13:38:23.834 INFO:teuthology.orchestra.run.smithi123.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T13:38:23.849 INFO:teuthology.orchestra.run.smithi123.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T13:38:23.865 INFO:teuthology.orchestra.run.smithi123.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T13:38:23.874 INFO:teuthology.orchestra.run.smithi123.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T13:38:23.874 INFO:teuthology.orchestra.run.smithi123.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T13:38:23.891 INFO:teuthology.orchestra.run.smithi123.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T13:38:23.928 INFO:teuthology.orchestra.run.smithi123.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T13:38:23.935 INFO:teuthology.orchestra.run.smithi130.stdout:Get:22 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3291-g994e2f20-1jammy [112 kB] 2024-04-25T13:38:23.936 INFO:teuthology.orchestra.run.smithi130.stdout:Get:23 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3291-g994e2f20-1jammy [471 kB] 2024-04-25T13:38:23.942 INFO:teuthology.orchestra.run.smithi123.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T13:38:23.946 INFO:teuthology.orchestra.run.smithi123.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T13:38:23.946 INFO:teuthology.orchestra.run.smithi123.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T13:38:23.995 INFO:teuthology.orchestra.run.smithi130.stdout:Get:24 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3291-g994e2f20-1jammy [25.6 MB] 2024-04-25T13:38:24.025 INFO:teuthology.orchestra.run.smithi130.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T13:38:24.041 INFO:teuthology.orchestra.run.smithi130.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T13:38:24.056 INFO:teuthology.orchestra.run.smithi130.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T13:38:24.065 INFO:teuthology.orchestra.run.smithi130.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T13:38:24.065 INFO:teuthology.orchestra.run.smithi130.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T13:38:24.082 INFO:teuthology.orchestra.run.smithi130.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T13:38:24.116 INFO:teuthology.orchestra.run.smithi123.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T13:38:24.119 INFO:teuthology.orchestra.run.smithi130.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T13:38:24.133 INFO:teuthology.orchestra.run.smithi130.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T13:38:24.137 INFO:teuthology.orchestra.run.smithi130.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T13:38:24.137 INFO:teuthology.orchestra.run.smithi130.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T13:38:24.198 INFO:teuthology.orchestra.run.smithi123.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T13:38:24.220 INFO:teuthology.orchestra.run.smithi123.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T13:38:24.279 INFO:teuthology.orchestra.run.smithi123.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T13:38:24.307 INFO:teuthology.orchestra.run.smithi130.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T13:38:24.323 INFO:teuthology.orchestra.run.smithi123.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T13:38:24.345 INFO:teuthology.orchestra.run.smithi123.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T13:38:24.366 INFO:teuthology.orchestra.run.smithi123.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T13:38:24.389 INFO:teuthology.orchestra.run.smithi130.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T13:38:24.412 INFO:teuthology.orchestra.run.smithi130.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T13:38:24.471 INFO:teuthology.orchestra.run.smithi130.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T13:38:24.515 INFO:teuthology.orchestra.run.smithi130.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T13:38:24.534 INFO:teuthology.orchestra.run.smithi130.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T13:38:24.539 INFO:teuthology.orchestra.run.smithi123.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T13:38:24.555 INFO:teuthology.orchestra.run.smithi123.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T13:38:24.556 INFO:teuthology.orchestra.run.smithi130.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T13:38:24.562 INFO:teuthology.orchestra.run.smithi123.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T13:38:24.567 INFO:teuthology.orchestra.run.smithi123.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T13:38:24.729 INFO:teuthology.orchestra.run.smithi130.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T13:38:24.744 INFO:teuthology.orchestra.run.smithi130.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T13:38:24.751 INFO:teuthology.orchestra.run.smithi123.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T13:38:24.751 INFO:teuthology.orchestra.run.smithi130.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T13:38:24.756 INFO:teuthology.orchestra.run.smithi130.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T13:38:24.833 INFO:teuthology.orchestra.run.smithi123.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T13:38:24.849 INFO:teuthology.orchestra.run.smithi123.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T13:38:24.940 INFO:teuthology.orchestra.run.smithi130.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T13:38:25.022 INFO:teuthology.orchestra.run.smithi130.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T13:38:25.034 INFO:teuthology.orchestra.run.smithi123.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T13:38:25.038 INFO:teuthology.orchestra.run.smithi130.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T13:38:25.084 INFO:teuthology.orchestra.run.smithi123.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T13:38:25.096 INFO:teuthology.orchestra.run.smithi123.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T13:38:25.223 INFO:teuthology.orchestra.run.smithi130.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T13:38:25.254 INFO:teuthology.orchestra.run.smithi123.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T13:38:25.254 INFO:teuthology.orchestra.run.smithi123.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T13:38:25.259 INFO:teuthology.orchestra.run.smithi123.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T13:38:25.264 INFO:teuthology.orchestra.run.smithi123.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T13:38:25.274 INFO:teuthology.orchestra.run.smithi130.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T13:38:25.278 INFO:teuthology.orchestra.run.smithi123.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T13:38:25.287 INFO:teuthology.orchestra.run.smithi130.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T13:38:25.293 INFO:teuthology.orchestra.run.smithi123.stdout:Get:57 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3291-g994e2f20-1jammy [4,917 kB] 2024-04-25T13:38:25.444 INFO:teuthology.orchestra.run.smithi130.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T13:38:25.445 INFO:teuthology.orchestra.run.smithi130.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T13:38:25.450 INFO:teuthology.orchestra.run.smithi130.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T13:38:25.454 INFO:teuthology.orchestra.run.smithi130.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T13:38:25.463 INFO:teuthology.orchestra.run.smithi123.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T13:38:25.468 INFO:teuthology.orchestra.run.smithi130.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T13:38:25.640 INFO:teuthology.orchestra.run.smithi130.stdout:Get:57 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3291-g994e2f20-1jammy [4,917 kB] 2024-04-25T13:38:25.653 INFO:teuthology.orchestra.run.smithi130.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T13:38:25.654 INFO:teuthology.orchestra.run.smithi123.stdout:Get:59 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3291-g994e2f20-1jammy [244 kB] 2024-04-25T13:38:25.667 INFO:teuthology.orchestra.run.smithi123.stdout:Get:60 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3291-g994e2f20-1jammy [125 kB] 2024-04-25T13:38:25.671 INFO:teuthology.orchestra.run.smithi123.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3291-g994e2f20-1jammy [1,542 kB] 2024-04-25T13:38:25.716 INFO:teuthology.orchestra.run.smithi123.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T13:38:25.768 INFO:teuthology.orchestra.run.smithi123.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3291-g994e2f20-1jammy [6,148 kB] 2024-04-25T13:38:25.849 INFO:teuthology.orchestra.run.smithi123.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T13:38:25.893 INFO:teuthology.orchestra.run.smithi123.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T13:38:25.917 INFO:teuthology.orchestra.run.smithi130.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T13:38:25.923 INFO:teuthology.orchestra.run.smithi130.stdout:Get:60 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3291-g994e2f20-1jammy [244 kB] 2024-04-25T13:38:25.960 INFO:teuthology.orchestra.run.smithi130.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3291-g994e2f20-1jammy [125 kB] 2024-04-25T13:38:25.964 INFO:teuthology.orchestra.run.smithi130.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3291-g994e2f20-1jammy [1,542 kB] 2024-04-25T13:38:25.983 INFO:teuthology.orchestra.run.smithi123.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T13:38:25.993 INFO:teuthology.orchestra.run.smithi123.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T13:38:26.005 INFO:teuthology.orchestra.run.smithi123.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T13:38:26.045 INFO:teuthology.orchestra.run.smithi130.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T13:38:26.048 INFO:teuthology.orchestra.run.smithi123.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T13:38:26.056 INFO:teuthology.orchestra.run.smithi130.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3291-g994e2f20-1jammy [6,148 kB] 2024-04-25T13:38:26.088 INFO:teuthology.orchestra.run.smithi130.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T13:38:26.172 INFO:teuthology.orchestra.run.smithi123.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3291-g994e2f20-1jammy [22.5 MB] 2024-04-25T13:38:26.176 INFO:teuthology.orchestra.run.smithi130.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T13:38:26.186 INFO:teuthology.orchestra.run.smithi130.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T13:38:26.198 INFO:teuthology.orchestra.run.smithi130.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T13:38:26.240 INFO:teuthology.orchestra.run.smithi130.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T13:38:26.311 INFO:teuthology.orchestra.run.smithi123.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T13:38:26.312 INFO:teuthology.orchestra.run.smithi123.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T13:38:26.313 INFO:teuthology.orchestra.run.smithi123.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T13:38:26.441 INFO:teuthology.orchestra.run.smithi130.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3291-g994e2f20-1jammy [22.5 MB] 2024-04-25T13:38:26.477 INFO:teuthology.orchestra.run.smithi123.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T13:38:26.502 INFO:teuthology.orchestra.run.smithi130.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T13:38:26.503 INFO:teuthology.orchestra.run.smithi130.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T13:38:26.504 INFO:teuthology.orchestra.run.smithi130.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T13:38:26.668 INFO:teuthology.orchestra.run.smithi130.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T13:38:26.820 INFO:teuthology.orchestra.run.smithi123.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T13:38:27.011 INFO:teuthology.orchestra.run.smithi130.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T13:38:27.220 INFO:teuthology.orchestra.run.smithi123.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T13:38:27.230 INFO:teuthology.orchestra.run.smithi123.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T13:38:27.230 INFO:teuthology.orchestra.run.smithi123.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T13:38:27.300 INFO:teuthology.orchestra.run.smithi123.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T13:38:27.300 INFO:teuthology.orchestra.run.smithi123.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T13:38:27.301 INFO:teuthology.orchestra.run.smithi123.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T13:38:27.301 INFO:teuthology.orchestra.run.smithi123.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T13:38:27.302 INFO:teuthology.orchestra.run.smithi123.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T13:38:27.303 INFO:teuthology.orchestra.run.smithi123.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T13:38:27.421 INFO:teuthology.orchestra.run.smithi130.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T13:38:27.431 INFO:teuthology.orchestra.run.smithi130.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T13:38:27.432 INFO:teuthology.orchestra.run.smithi130.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T13:38:27.467 INFO:teuthology.orchestra.run.smithi123.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T13:38:27.501 INFO:teuthology.orchestra.run.smithi130.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T13:38:27.502 INFO:teuthology.orchestra.run.smithi130.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T13:38:27.503 INFO:teuthology.orchestra.run.smithi130.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T13:38:27.503 INFO:teuthology.orchestra.run.smithi130.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T13:38:27.504 INFO:teuthology.orchestra.run.smithi130.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T13:38:27.505 INFO:teuthology.orchestra.run.smithi130.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T13:38:27.669 INFO:teuthology.orchestra.run.smithi130.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T13:38:27.674 INFO:teuthology.orchestra.run.smithi123.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T13:38:27.681 INFO:teuthology.orchestra.run.smithi123.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3291-g994e2f20-1jammy [14.1 kB] 2024-04-25T13:38:27.682 INFO:teuthology.orchestra.run.smithi123.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3291-g994e2f20-1jammy [856 kB] 2024-04-25T13:38:27.704 INFO:teuthology.orchestra.run.smithi123.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3291-g994e2f20-1jammy [2,367 kB] 2024-04-25T13:38:27.867 INFO:teuthology.orchestra.run.smithi123.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3291-g994e2f20-1jammy [791 kB] 2024-04-25T13:38:27.882 INFO:teuthology.orchestra.run.smithi130.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T13:38:27.932 INFO:teuthology.orchestra.run.smithi130.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3291-g994e2f20-1jammy [14.1 kB] 2024-04-25T13:38:27.932 INFO:teuthology.orchestra.run.smithi130.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3291-g994e2f20-1jammy [856 kB] 2024-04-25T13:38:27.933 INFO:teuthology.orchestra.run.smithi123.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3291-g994e2f20-1jammy [148 kB] 2024-04-25T13:38:27.940 INFO:teuthology.orchestra.run.smithi123.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3291-g994e2f20-1jammy [2,297 kB] 2024-04-25T13:38:28.003 INFO:teuthology.orchestra.run.smithi123.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T13:38:28.004 INFO:teuthology.orchestra.run.smithi130.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3291-g994e2f20-1jammy [2,367 kB] 2024-04-25T13:38:28.050 INFO:teuthology.orchestra.run.smithi123.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T13:38:28.075 INFO:teuthology.orchestra.run.smithi123.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3291-g994e2f20-1jammy [8,625 kB] 2024-04-25T13:38:28.077 INFO:teuthology.orchestra.run.smithi123.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T13:38:28.086 INFO:teuthology.orchestra.run.smithi123.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T13:38:28.131 INFO:teuthology.orchestra.run.smithi123.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T13:38:28.157 INFO:teuthology.orchestra.run.smithi123.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-25T13:38:28.159 INFO:teuthology.orchestra.run.smithi123.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T13:38:28.161 INFO:teuthology.orchestra.run.smithi130.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3291-g994e2f20-1jammy [791 kB] 2024-04-25T13:38:28.165 INFO:teuthology.orchestra.run.smithi123.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T13:38:28.168 INFO:teuthology.orchestra.run.smithi123.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T13:38:28.195 INFO:teuthology.orchestra.run.smithi130.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3291-g994e2f20-1jammy [148 kB] 2024-04-25T13:38:28.200 INFO:teuthology.orchestra.run.smithi130.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3291-g994e2f20-1jammy [2,297 kB] 2024-04-25T13:38:28.211 INFO:teuthology.orchestra.run.smithi130.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T13:38:28.258 INFO:teuthology.orchestra.run.smithi130.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T13:38:28.285 INFO:teuthology.orchestra.run.smithi130.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T13:38:28.294 INFO:teuthology.orchestra.run.smithi130.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T13:38:28.340 INFO:teuthology.orchestra.run.smithi130.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T13:38:28.364 INFO:teuthology.orchestra.run.smithi123.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T13:38:28.365 INFO:teuthology.orchestra.run.smithi130.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-25T13:38:28.366 INFO:teuthology.orchestra.run.smithi130.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3291-g994e2f20-1jammy [8,625 kB] 2024-04-25T13:38:28.367 INFO:teuthology.orchestra.run.smithi130.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T13:38:28.374 INFO:teuthology.orchestra.run.smithi130.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T13:38:28.377 INFO:teuthology.orchestra.run.smithi130.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T13:38:28.573 INFO:teuthology.orchestra.run.smithi130.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T13:38:28.616 INFO:teuthology.orchestra.run.smithi123.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3291-g994e2f20-1jammy [14.2 kB] 2024-04-25T13:38:28.617 INFO:teuthology.orchestra.run.smithi123.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3291-g994e2f20-1jammy [44.9 MB] 2024-04-25T13:38:28.623 INFO:teuthology.orchestra.run.smithi123.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T13:38:28.831 INFO:teuthology.orchestra.run.smithi130.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T13:38:28.887 INFO:teuthology.orchestra.run.smithi123.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T13:38:28.889 INFO:teuthology.orchestra.run.smithi123.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T13:38:28.905 INFO:teuthology.orchestra.run.smithi123.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T13:38:28.910 INFO:teuthology.orchestra.run.smithi123.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T13:38:28.948 INFO:teuthology.orchestra.run.smithi123.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T13:38:28.962 INFO:teuthology.orchestra.run.smithi123.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T13:38:28.981 INFO:teuthology.orchestra.run.smithi130.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3291-g994e2f20-1jammy [14.2 kB] 2024-04-25T13:38:28.982 INFO:teuthology.orchestra.run.smithi130.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3291-g994e2f20-1jammy [44.9 MB] 2024-04-25T13:38:29.053 INFO:teuthology.orchestra.run.smithi123.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T13:38:29.055 INFO:teuthology.orchestra.run.smithi123.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T13:38:29.056 INFO:teuthology.orchestra.run.smithi123.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T13:38:29.093 INFO:teuthology.orchestra.run.smithi130.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T13:38:29.095 INFO:teuthology.orchestra.run.smithi130.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T13:38:29.111 INFO:teuthology.orchestra.run.smithi130.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T13:38:29.116 INFO:teuthology.orchestra.run.smithi130.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T13:38:29.154 INFO:teuthology.orchestra.run.smithi130.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T13:38:29.168 INFO:teuthology.orchestra.run.smithi130.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T13:38:29.236 INFO:teuthology.orchestra.run.smithi123.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T13:38:29.258 INFO:teuthology.orchestra.run.smithi130.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T13:38:29.260 INFO:teuthology.orchestra.run.smithi130.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T13:38:29.261 INFO:teuthology.orchestra.run.smithi130.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T13:38:29.441 INFO:teuthology.orchestra.run.smithi130.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T13:38:29.500 INFO:teuthology.orchestra.run.smithi123.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T13:38:29.713 INFO:teuthology.orchestra.run.smithi130.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T13:38:31.699 INFO:teuthology.orchestra.run.smithi130.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3291-g994e2f20-1jammy [124 kB] 2024-04-25T13:38:31.700 INFO:teuthology.orchestra.run.smithi130.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3291-g994e2f20-1jammy [236 kB] 2024-04-25T13:38:31.703 INFO:teuthology.orchestra.run.smithi130.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3291-g994e2f20-1jammy [33.9 kB] 2024-04-25T13:38:31.703 INFO:teuthology.orchestra.run.smithi130.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3291-g994e2f20-1jammy [23.4 kB] 2024-04-25T13:38:31.703 INFO:teuthology.orchestra.run.smithi130.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3291-g994e2f20-1jammy [39.0 kB] 2024-04-25T13:38:31.704 INFO:teuthology.orchestra.run.smithi130.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3291-g994e2f20-1jammy [14.2 MB] 2024-04-25T13:38:31.816 INFO:teuthology.orchestra.run.smithi123.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3291-g994e2f20-1jammy [124 kB] 2024-04-25T13:38:31.817 INFO:teuthology.orchestra.run.smithi123.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3291-g994e2f20-1jammy [236 kB] 2024-04-25T13:38:31.819 INFO:teuthology.orchestra.run.smithi123.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3291-g994e2f20-1jammy [33.9 kB] 2024-04-25T13:38:31.819 INFO:teuthology.orchestra.run.smithi123.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3291-g994e2f20-1jammy [23.4 kB] 2024-04-25T13:38:31.820 INFO:teuthology.orchestra.run.smithi123.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3291-g994e2f20-1jammy [39.0 kB] 2024-04-25T13:38:31.820 INFO:teuthology.orchestra.run.smithi123.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3291-g994e2f20-1jammy [14.2 MB] 2024-04-25T13:38:32.574 INFO:teuthology.orchestra.run.smithi130.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3291-g994e2f20-1jammy [92.6 kB] 2024-04-25T13:38:32.696 INFO:teuthology.orchestra.run.smithi123.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240425.015853-debug/994e2f20102a20fa9a27966c14b625cc01884df8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3291-g994e2f20-1jammy [92.6 kB] 2024-04-25T13:38:33.205 INFO:teuthology.orchestra.run.smithi130.stdout:Fetched 175 MB in 10s (17.1 MB/s) 2024-04-25T13:38:33.329 INFO:teuthology.orchestra.run.smithi123.stdout:Fetched 175 MB in 11s (16.6 MB/s) 2024-04-25T13:38:33.345 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-25T13:38:33.411 INFO:teuthology.orchestra.run.smithi130.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-25T13:38:33.415 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-25T13:38:33.460 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-25T13:38:33.474 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-25T13:38:33.541 INFO:teuthology.orchestra.run.smithi123.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-25T13:38:33.544 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-25T13:38:33.589 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-25T13:38:33.704 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T13:38:33.717 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T13:38:33.746 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T13:38:33.892 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T13:38:33.905 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T13:38:33.942 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T13:38:34.032 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-cmd2. 2024-04-25T13:38:34.045 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-25T13:38:34.090 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-25T13:38:34.245 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-cmd2. 2024-04-25T13:38:34.258 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-25T13:38:34.303 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-25T13:38:34.451 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T13:38:34.465 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T13:38:34.551 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T13:38:34.606 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T13:38:34.619 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T13:38:34.697 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T13:38:34.930 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T13:38:34.944 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T13:38:34.995 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T13:38:35.218 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T13:38:35.232 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T13:38:35.276 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T13:38:35.458 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T13:38:35.473 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T13:38:35.515 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T13:38:35.612 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T13:38:35.627 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T13:38:35.670 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T13:38:35.977 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T13:38:35.992 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T13:38:36.043 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:38:36.124 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T13:38:36.139 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T13:38:36.182 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:38:36.430 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T13:38:36.444 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T13:38:36.480 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:38:36.518 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T13:38:36.532 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T13:38:36.577 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:38:36.824 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T13:38:36.839 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T13:38:36.882 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:38:36.907 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T13:38:36.921 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T13:38:36.965 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:38:37.252 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T13:38:37.267 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T13:38:37.310 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T13:38:37.318 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T13:38:37.332 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T13:38:37.401 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T13:38:37.638 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package librados2. 2024-04-25T13:38:37.653 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../010-librados2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:37.696 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking librados2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:37.787 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package librados2. 2024-04-25T13:38:37.802 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../010-librados2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:37.853 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking librados2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:38.099 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package librbd1. 2024-04-25T13:38:38.113 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../011-librbd1_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:38.148 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking librbd1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:38.356 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package librbd1. 2024-04-25T13:38:38.371 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../011-librbd1_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:38.423 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking librbd1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:38.601 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T13:38:38.615 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:38.659 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libcephfs2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:38.917 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T13:38:38.932 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:38.945 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-rados. 2024-04-25T13:38:38.959 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:38.975 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libcephfs2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:39.003 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-rados (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:39.270 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-rados. 2024-04-25T13:38:39.284 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:39.322 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T13:38:39.336 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-rados (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:39.337 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:39.381 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-ceph-argparse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:39.642 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T13:38:39.657 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:39.691 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-cephfs (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:39.722 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T13:38:39.737 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:39.789 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-ceph-argparse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:40.011 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T13:38:40.026 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:40.069 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:40.200 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T13:38:40.214 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:40.266 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-cephfs (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:40.453 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T13:38:40.469 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T13:38:40.580 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T13:38:40.644 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T13:38:40.658 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:40.702 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:40.832 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T13:38:40.847 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:40.891 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-rbd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:41.047 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T13:38:41.062 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T13:38:41.105 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T13:38:41.226 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T13:38:41.241 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T13:38:41.285 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T13:38:41.416 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T13:38:41.430 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:41.483 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-rbd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:41.546 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T13:38:41.560 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T13:38:41.603 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T13:38:41.894 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T13:38:41.908 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T13:38:41.923 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T13:38:41.938 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T13:38:41.960 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T13:38:42.006 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T13:38:42.288 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T13:38:42.301 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package lua5.1. 2024-04-25T13:38:42.302 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T13:38:42.316 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T13:38:42.351 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T13:38:42.371 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T13:38:42.645 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package lua-any. 2024-04-25T13:38:42.660 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-25T13:38:42.712 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T13:38:42.715 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T13:38:42.730 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T13:38:42.773 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T13:38:42.964 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package zip. 2024-04-25T13:38:42.979 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-25T13:38:43.022 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T13:38:43.169 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package lua5.1. 2024-04-25T13:38:43.183 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T13:38:43.235 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T13:38:43.367 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package unzip. 2024-04-25T13:38:43.382 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T13:38:43.425 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T13:38:43.580 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package lua-any. 2024-04-25T13:38:43.594 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-25T13:38:43.655 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T13:38:43.812 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package luarocks. 2024-04-25T13:38:43.827 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T13:38:43.862 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T13:38:43.974 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package zip. 2024-04-25T13:38:43.988 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-25T13:38:44.040 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T13:38:44.236 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package librgw2. 2024-04-25T13:38:44.250 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../027-librgw2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:44.294 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking librgw2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:44.377 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package unzip. 2024-04-25T13:38:44.391 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T13:38:44.435 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T13:38:44.822 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T13:38:44.837 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:44.880 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-rgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:44.914 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package luarocks. 2024-04-25T13:38:44.928 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T13:38:44.981 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T13:38:45.216 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T13:38:45.231 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T13:38:45.274 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T13:38:45.446 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package librgw2. 2024-04-25T13:38:45.460 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../027-librgw2_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:45.513 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking librgw2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:45.560 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T13:38:45.576 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:45.637 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libradosstriper1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:45.996 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-common. 2024-04-25T13:38:46.011 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:46.040 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T13:38:46.054 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:46.055 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:46.098 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-rgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:46.451 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T13:38:46.475 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T13:38:46.509 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T13:38:46.821 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T13:38:46.835 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:46.870 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libradosstriper1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:47.266 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-common. 2024-04-25T13:38:47.280 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:47.323 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:47.334 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-base. 2024-04-25T13:38:47.349 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:47.393 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-base (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:47.947 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T13:38:47.961 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T13:38:48.005 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T13:38:48.316 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T13:38:48.330 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T13:38:48.374 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T13:38:48.512 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-base. 2024-04-25T13:38:48.527 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:48.579 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-base (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:48.685 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T13:38:48.699 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T13:38:48.743 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T13:38:49.046 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T13:38:49.060 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T13:38:49.104 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T13:38:49.124 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T13:38:49.138 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T13:38:49.183 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T13:38:49.423 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T13:38:49.438 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T13:38:49.460 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T13:38:49.473 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T13:38:49.474 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T13:38:49.519 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T13:38:49.768 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T13:38:49.783 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T13:38:49.826 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T13:38:49.846 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T13:38:49.861 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T13:38:49.904 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T13:38:50.129 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-portend. 2024-04-25T13:38:50.143 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-25T13:38:50.203 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T13:38:50.207 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T13:38:50.222 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T13:38:50.266 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T13:38:50.506 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T13:38:50.522 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T13:38:50.581 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T13:38:50.794 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T13:38:50.809 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T13:38:50.852 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T13:38:51.078 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T13:38:51.093 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T13:38:51.128 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T13:38:51.138 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T13:38:51.153 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T13:38:51.188 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T13:38:51.465 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T13:38:51.480 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T13:38:51.491 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-portend. 2024-04-25T13:38:51.505 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-25T13:38:51.514 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T13:38:51.549 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T13:38:51.801 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T13:38:51.816 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T13:38:51.859 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T13:38:51.885 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T13:38:51.900 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T13:38:51.943 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T13:38:52.162 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T13:38:52.177 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T13:38:52.220 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T13:38:52.229 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T13:38:52.244 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T13:38:52.287 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T13:38:52.523 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-mako. 2024-04-25T13:38:52.538 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T13:38:52.581 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T13:38:52.633 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T13:38:52.648 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T13:38:52.699 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T13:38:52.909 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T13:38:52.924 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T13:38:52.984 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T13:38:53.035 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T13:38:53.050 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T13:38:53.110 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T13:38:53.287 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T13:38:53.302 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T13:38:53.346 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T13:38:53.397 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T13:38:53.411 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T13:38:53.446 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T13:38:53.640 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-webob. 2024-04-25T13:38:53.655 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T13:38:53.698 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T13:38:53.716 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-mako. 2024-04-25T13:38:53.731 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T13:38:53.774 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T13:38:54.018 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T13:38:54.033 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T13:38:54.070 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T13:38:54.077 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T13:38:54.092 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T13:38:54.159 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T13:38:54.437 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T13:38:54.452 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T13:38:54.463 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T13:38:54.478 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T13:38:54.487 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T13:38:54.521 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T13:38:54.765 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-paste. 2024-04-25T13:38:54.780 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T13:38:54.823 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T13:38:54.832 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-webob. 2024-04-25T13:38:54.847 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T13:38:55.157 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T13:38:55.869 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T13:38:55.869 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T13:38:55.884 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T13:38:55.884 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T13:38:55.929 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T13:38:55.935 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T13:38:56.230 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T13:38:56.244 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T13:38:56.290 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T13:38:56.305 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T13:38:56.320 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T13:38:56.371 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T13:38:56.599 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-paste. 2024-04-25T13:38:56.614 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T13:38:56.657 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T13:38:56.707 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T13:38:56.723 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T13:38:56.766 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T13:38:57.002 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T13:38:57.015 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T13:38:57.051 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T13:38:57.136 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T13:38:57.151 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T13:38:57.202 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T13:38:57.338 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T13:38:57.351 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T13:38:57.396 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T13:38:57.582 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T13:38:57.597 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T13:38:57.640 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T13:38:57.699 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T13:38:57.713 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T13:38:57.757 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T13:38:57.976 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-idna. 2024-04-25T13:38:57.991 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-25T13:38:58.035 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T13:38:58.092 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T13:38:58.106 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T13:38:58.151 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T13:38:58.329 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T13:38:58.343 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T13:38:58.387 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T13:38:58.498 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T13:38:58.513 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T13:38:58.556 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T13:38:58.724 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-requests. 2024-04-25T13:38:58.738 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T13:38:58.782 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T13:38:58.859 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-idna. 2024-04-25T13:38:58.873 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-25T13:38:58.909 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T13:38:59.111 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T13:38:59.125 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T13:38:59.176 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T13:38:59.195 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T13:38:59.210 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T13:38:59.253 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T13:38:59.454 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T13:38:59.470 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:38:59.513 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:59.606 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-requests. 2024-04-25T13:38:59.621 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T13:38:59.664 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T13:38:59.892 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T13:38:59.906 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:38:59.950 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:38:59.975 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T13:38:59.990 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T13:39:00.033 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T13:39:00.203 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T13:39:00.217 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T13:39:00.261 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T13:39:00.322 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T13:39:00.334 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:39:00.378 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:00.598 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T13:39:00.612 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T13:39:00.656 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T13:39:00.733 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T13:39:00.747 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:39:00.999 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:01.125 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T13:39:01.140 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:39:01.175 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:01.285 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T13:39:01.300 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T13:39:01.343 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T13:39:01.612 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T13:39:01.626 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:39:01.646 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T13:39:01.661 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T13:39:01.670 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mon (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:01.704 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T13:39:02.066 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T13:39:02.081 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:39:02.116 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:02.190 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T13:39:02.204 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:39:02.248 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-osd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:02.477 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T13:39:02.492 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:39:02.535 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mon (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:03.027 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph. 2024-04-25T13:39:03.040 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../068-ceph_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:39:03.085 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:03.097 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T13:39:03.111 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:39:03.155 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-osd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:03.404 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T13:39:03.418 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:39:03.462 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:03.782 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T13:39:03.796 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:39:03.832 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mds (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:03.925 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph. 2024-04-25T13:39:03.940 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../068-ceph_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:39:03.983 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:04.243 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package cephadm. 2024-04-25T13:39:04.257 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../071-cephadm_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:39:04.294 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T13:39:04.301 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:04.309 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:39:04.343 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:04.604 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T13:39:04.618 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T13:39:04.662 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T13:39:04.713 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T13:39:04.728 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:39:04.771 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mds (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:04.973 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T13:39:04.987 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T13:39:05.031 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T13:39:05.149 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package cephadm. 2024-04-25T13:39:05.162 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../071-cephadm_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:39:05.207 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:05.519 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T13:39:05.532 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T13:39:05.577 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T13:39:05.929 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T13:39:05.943 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T13:39:05.987 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T13:39:06.086 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-babel. 2024-04-25T13:39:06.100 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T13:39:06.136 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T13:39:06.464 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T13:39:06.477 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T13:39:06.522 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T13:39:06.842 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T13:39:06.855 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:39:06.892 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:06.909 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-babel. 2024-04-25T13:39:06.921 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T13:39:06.959 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T13:39:07.229 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T13:39:07.242 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T13:39:07.287 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T13:39:07.320 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T13:39:07.332 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T13:39:07.369 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T13:39:07.581 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-routes. 2024-04-25T13:39:07.594 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T13:39:07.656 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T13:39:07.723 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T13:39:07.735 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:39:07.772 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:07.984 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T13:39:07.998 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:39:08.042 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:08.101 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T13:39:08.115 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T13:39:08.176 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T13:39:08.478 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-routes. 2024-04-25T13:39:08.491 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T13:39:08.536 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T13:39:08.881 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T13:39:08.895 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:39:08.939 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:09.247 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T13:39:09.254 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T13:39:09.297 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T13:39:09.784 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T13:39:09.792 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T13:39:09.833 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T13:39:10.044 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T13:39:10.058 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T13:39:10.102 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T13:39:10.204 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T13:39:10.214 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T13:39:10.323 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T13:39:10.572 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T13:39:10.586 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T13:39:10.609 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T13:39:10.617 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T13:39:10.639 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T13:39:10.659 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T13:39:10.984 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T13:39:10.996 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T13:39:11.144 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T13:39:11.268 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T13:39:11.276 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:39:11.317 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:11.614 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T13:39:11.627 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T13:39:11.672 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T13:39:12.355 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T13:39:12.369 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:39:12.414 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:12.487 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T13:39:12.499 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T13:39:12.537 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T13:39:12.865 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T13:39:12.875 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T13:39:12.915 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T13:39:13.244 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T13:39:13.256 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T13:39:13.293 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T13:39:13.358 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T13:39:13.372 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T13:39:13.416 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T13:39:13.596 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T13:39:13.607 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-25T13:39:13.646 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T13:39:13.769 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T13:39:13.787 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T13:39:13.827 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T13:39:14.008 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T13:39:14.019 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T13:39:14.058 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T13:39:14.147 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T13:39:14.163 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T13:39:14.205 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T13:39:14.386 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T13:39:14.396 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T13:39:14.436 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T13:39:14.484 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T13:39:14.499 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-25T13:39:14.533 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T13:39:14.706 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T13:39:14.717 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T13:39:14.756 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T13:39:14.837 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T13:39:14.852 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T13:39:14.920 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T13:39:15.109 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T13:39:15.120 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T13:39:15.159 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T13:39:15.248 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T13:39:15.264 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T13:39:15.306 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T13:39:15.601 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T13:39:15.617 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T13:39:15.659 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T13:39:15.789 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T13:39:15.799 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:39:15.839 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:15.954 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T13:39:15.968 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T13:39:16.004 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T13:39:16.158 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T13:39:16.168 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T13:39:16.208 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T13:39:16.670 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T13:39:16.680 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T13:39:16.720 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T13:39:16.836 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T13:39:16.849 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:39:16.886 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:16.956 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package jq. 2024-04-25T13:39:16.965 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T13:39:16.997 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T13:39:17.206 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T13:39:17.218 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T13:39:17.233 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package socat. 2024-04-25T13:39:17.243 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T13:39:17.255 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T13:39:17.283 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T13:39:17.600 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T13:39:17.611 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T13:39:17.613 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T13:39:17.622 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T13:39:17.658 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T13:39:17.661 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T13:39:17.903 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package jq. 2024-04-25T13:39:17.916 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T13:39:17.961 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T13:39:17.999 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-test. 2024-04-25T13:39:18.009 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:39:18.040 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-test (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:18.213 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package socat. 2024-04-25T13:39:18.227 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T13:39:18.271 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T13:39:18.575 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T13:39:18.588 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T13:39:18.632 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T13:39:19.004 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-test. 2024-04-25T13:39:19.016 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:39:19.053 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-test (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:19.970 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T13:39:19.980 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:39:20.019 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ceph-volume (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:20.407 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-25T13:39:20.416 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:39:20.456 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking cephfs-mirror (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:20.768 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-colorama. 2024-04-25T13:39:20.778 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-25T13:39:20.817 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-25T13:39:20.991 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T13:39:21.004 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:39:21.049 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ceph-volume (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:21.070 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package cephfs-shell. 2024-04-25T13:39:21.080 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:39:21.120 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking cephfs-shell (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:21.397 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package cephfs-top. 2024-04-25T13:39:21.407 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:39:21.439 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking cephfs-top (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:21.453 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-25T13:39:21.467 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:39:21.658 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T13:39:21.668 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:39:21.708 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libcephfs-dev (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:21.708 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking cephfs-mirror (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:22.019 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T13:39:22.022 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-colorama. 2024-04-25T13:39:22.029 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T13:39:22.036 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-25T13:39:22.068 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T13:39:22.080 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-25T13:39:22.325 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package cephfs-shell. 2024-04-25T13:39:22.339 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:39:22.383 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking cephfs-shell (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:22.390 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T13:39:22.400 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T13:39:22.440 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T13:39:22.662 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package cephfs-top. 2024-04-25T13:39:22.675 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3291-g994e2f20-1jammy_all.deb ... 2024-04-25T13:39:22.719 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking cephfs-top (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:22.810 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T13:39:22.821 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T13:39:22.860 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T13:39:22.946 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T13:39:22.959 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:39:22.996 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libcephfs-dev (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:23.257 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package pkg-config. 2024-04-25T13:39:23.267 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T13:39:23.307 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T13:39:23.307 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T13:39:23.320 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T13:39:23.357 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T13:39:23.560 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T13:39:23.569 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T13:39:23.609 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T13:39:23.686 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T13:39:23.700 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T13:39:23.744 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T13:39:24.071 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T13:39:24.080 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T13:39:24.090 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T13:39:24.103 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T13:39:24.121 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T13:39:24.148 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T13:39:24.398 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T13:39:24.408 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T13:39:24.448 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T13:39:24.553 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package pkg-config. 2024-04-25T13:39:24.567 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T13:39:24.611 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T13:39:24.794 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T13:39:24.804 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T13:39:24.843 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T13:39:24.881 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T13:39:24.894 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T13:39:24.930 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T13:39:25.180 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T13:39:25.189 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T13:39:25.229 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T13:39:25.384 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T13:39:25.397 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T13:39:25.442 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T13:39:25.532 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-py. 2024-04-25T13:39:25.541 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-25T13:39:25.582 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T13:39:25.745 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T13:39:25.758 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T13:39:25.803 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T13:39:25.877 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T13:39:25.886 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T13:39:25.918 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T13:39:26.123 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T13:39:26.138 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T13:39:26.181 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T13:39:26.415 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T13:39:26.423 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T13:39:26.464 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T13:39:26.467 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T13:39:26.481 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T13:39:26.558 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T13:39:26.742 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-toml. 2024-04-25T13:39:26.752 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-25T13:39:26.784 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T13:39:26.895 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-py. 2024-04-25T13:39:26.909 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-25T13:39:26.954 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T13:39:27.053 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T13:39:27.062 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T13:39:27.112 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T13:39:27.273 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T13:39:27.287 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T13:39:27.323 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T13:39:27.475 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T13:39:27.484 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T13:39:27.523 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T13:39:27.784 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T13:39:27.788 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T13:39:27.793 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T13:39:27.801 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T13:39:27.826 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T13:39:27.851 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T13:39:28.146 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-toml. 2024-04-25T13:39:28.159 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-25T13:39:28.204 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T13:39:28.473 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T13:39:28.487 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T13:39:28.531 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T13:39:28.554 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package radosgw. 2024-04-25T13:39:28.564 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../122-radosgw_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:39:28.604 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking radosgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:28.852 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T13:39:28.865 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T13:39:28.910 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T13:39:29.213 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T13:39:29.226 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T13:39:29.262 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T13:39:29.282 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T13:39:29.292 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:39:29.332 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking rbd-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:29.622 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T13:39:29.914 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T13:39:29.949 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package radosgw. 2024-04-25T13:39:29.962 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../122-radosgw_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:39:29.999 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking radosgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:30.040 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T13:39:30.297 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T13:39:30.686 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T13:39:30.700 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3291-g994e2f20-1jammy_amd64.deb ... 2024-04-25T13:39:30.733 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T13:39:30.735 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking rbd-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:31.019 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T13:39:31.307 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T13:39:31.371 INFO:teuthology.orchestra.run.smithi130.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T13:39:31.411 INFO:teuthology.orchestra.run.smithi130.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-25T13:39:31.433 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T13:39:31.467 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:31.703 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T13:39:31.986 INFO:teuthology.orchestra.run.smithi130.stdout:Adding system user cephadm....done 2024-04-25T13:39:32.091 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T13:39:32.140 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T13:39:32.433 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T13:39:32.669 INFO:teuthology.orchestra.run.smithi123.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T13:39:32.682 INFO:teuthology.orchestra.run.smithi123.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-25T13:39:32.693 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T13:39:32.760 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:32.810 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T13:39:33.061 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T13:39:33.330 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T13:39:33.455 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T13:39:33.463 INFO:teuthology.orchestra.run.smithi123.stdout:Adding system user cephadm....done 2024-04-25T13:39:33.782 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T13:39:33.968 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T13:39:34.151 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T13:39:34.302 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T13:39:34.411 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-25T13:39:34.587 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T13:39:34.662 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T13:39:34.712 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T13:39:34.972 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T13:39:34.980 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T13:39:35.240 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T13:39:35.240 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T13:39:35.366 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T13:39:35.533 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T13:39:35.684 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T13:39:35.792 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T13:39:36.043 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-ceph-argparse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:36.053 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T13:39:36.294 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T13:39:36.321 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-25T13:39:36.420 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T13:39:36.546 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-25T13:39:36.572 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T13:39:36.831 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T13:39:36.957 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T13:39:36.990 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T13:39:37.225 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T13:39:37.250 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T13:39:37.509 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T13:39:37.637 INFO:teuthology.orchestra.run.smithi130.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T13:39:37.672 INFO:teuthology.orchestra.run.smithi130.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T13:39:37.753 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T13:39:37.777 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T13:39:37.879 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T13:39:38.045 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-ceph-argparse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:38.256 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T13:39:38.346 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T13:39:38.381 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T13:39:38.446 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T13:39:38.547 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-25T13:39:38.691 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T13:39:38.790 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T13:39:38.891 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T13:39:38.958 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T13:39:39.151 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T13:39:39.260 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T13:39:39.386 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T13:39:39.589 INFO:teuthology.orchestra.run.smithi123.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T13:39:39.640 INFO:teuthology.orchestra.run.smithi123.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T13:39:39.704 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T13:39:39.813 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T13:39:40.079 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T13:39:40.173 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T13:39:40.290 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T13:39:40.364 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T13:39:40.490 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T13:39:40.541 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T13:39:40.616 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T13:39:40.818 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T13:39:40.925 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T13:39:41.127 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T13:39:41.253 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T13:39:41.319 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T13:39:41.578 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T13:39:41.963 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T13:39:41.980 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T13:39:42.256 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T13:39:42.314 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-25T13:39:42.373 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T13:39:42.474 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T13:39:42.641 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T13:39:42.801 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T13:39:42.992 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T13:39:43.202 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T13:39:43.234 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T13:39:43.394 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:43.494 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T13:39:43.704 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T13:39:43.888 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T13:39:44.047 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T13:39:44.189 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-25T13:39:44.490 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T13:39:44.867 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T13:39:45.126 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T13:39:45.252 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:45.269 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T13:39:45.513 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:39:45.553 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T13:39:45.655 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T13:39:45.896 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T13:39:45.956 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T13:39:46.082 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T13:39:46.208 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T13:39:46.493 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T13:39:46.744 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T13:39:47.020 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:39:47.135 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T13:39:47.155 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T13:39:47.395 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:39:47.529 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T13:39:47.797 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T13:39:47.815 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T13:39:47.906 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T13:39:48.032 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T13:39:48.091 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T13:39:48.359 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T13:39:48.392 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T13:39:48.626 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T13:39:48.676 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T13:39:48.886 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:39:48.961 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T13:39:49.012 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T13:39:49.237 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T13:39:49.313 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T13:39:49.363 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T13:39:49.564 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T13:39:49.698 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T13:39:49.857 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T13:39:49.865 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T13:39:50.134 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T13:39:50.192 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T13:39:50.392 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T13:39:50.535 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T13:39:50.668 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T13:39:50.794 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T13:39:50.827 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T13:39:50.953 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T13:39:51.079 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T13:39:51.088 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T13:39:51.176 INFO:teuthology.orchestra.run.smithi130.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T13:39:51.188 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T13:39:51.415 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T13:39:51.481 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T13:39:51.532 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T13:39:51.782 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T13:39:51.942 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T13:39:52.050 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T13:39:52.176 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T13:39:52.243 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T13:39:52.327 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T13:39:52.369 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T13:39:52.415 INFO:teuthology.orchestra.run.smithi123.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T13:39:52.637 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:39:52.662 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T13:39:52.771 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T13:39:52.788 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T13:39:53.131 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T13:39:53.156 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T13:39:53.415 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T13:39:53.449 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T13:39:53.557 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T13:39:53.742 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T13:39:53.818 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T13:39:53.943 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T13:39:53.978 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T13:39:54.269 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T13:39:54.287 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T13:39:54.570 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T13:39:54.573 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T13:39:54.847 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T13:39:54.866 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T13:39:55.033 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T13:39:55.259 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T13:39:55.309 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T13:39:55.578 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T13:39:55.585 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T13:39:55.862 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T13:39:55.931 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T13:39:56.081 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up librados2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:56.232 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:56.247 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T13:39:56.384 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T13:39:56.531 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T13:39:56.803 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libcephfs2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:56.884 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T13:39:56.929 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libradosstriper1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:57.010 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up librados2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:57.055 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T13:39:57.136 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:57.262 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T13:39:57.349 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up librbd1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:57.458 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-modules-core (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:57.567 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:57.631 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libcephfs2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:57.732 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libradosstriper1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:57.776 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T13:39:57.776 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T13:39:57.867 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T13:39:58.160 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up librbd1 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:58.286 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr-modules-core (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:58.412 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:58.477 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libcephfs-dev (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:58.622 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T13:39:58.622 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T13:39:58.645 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-rados (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:58.805 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up librgw2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:58.964 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up cephfs-top (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:59.147 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T13:39:59.247 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libcephfs-dev (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:59.372 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-rados (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:59.498 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up librgw2 (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:59.624 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up cephfs-top (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:39:59.750 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T13:40:00.495 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-rbd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:00.655 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up rbd-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:00.807 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-rgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:00.957 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up python3-cephfs (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:01.046 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-rbd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:01.108 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up cephfs-shell (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:01.196 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up rbd-fuse (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:01.259 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:01.314 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-rgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:01.424 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up python3-cephfs (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:01.533 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up cephfs-shell (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:01.667 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-common (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:01.863 INFO:teuthology.orchestra.run.smithi130.stdout:Adding group ceph....done 2024-04-25T13:40:02.180 INFO:teuthology.orchestra.run.smithi130.stdout:Adding system user ceph....done 2024-04-25T13:40:02.212 INFO:teuthology.orchestra.run.smithi123.stdout:Adding group ceph....done 2024-04-25T13:40:02.376 INFO:teuthology.orchestra.run.smithi130.stdout:Setting system user ceph properties....done 2024-04-25T13:40:02.393 INFO:teuthology.orchestra.run.smithi130.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T13:40:02.533 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T13:40:02.605 INFO:teuthology.orchestra.run.smithi123.stdout:Adding system user ceph....done 2024-04-25T13:40:02.809 INFO:teuthology.orchestra.run.smithi123.stdout:Setting system user ceph properties....done 2024-04-25T13:40:02.824 INFO:teuthology.orchestra.run.smithi123.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T13:40:02.946 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T13:40:02.969 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T13:40:03.379 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T13:40:03.686 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up cephfs-mirror (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:03.911 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:40:03.912 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:40:04.062 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up cephfs-mirror (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:04.254 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:40:04.254 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T13:40:04.513 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-test (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:04.639 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up radosgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:04.888 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-test (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:05.064 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up radosgw (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:05.195 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:40:05.196 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:40:05.585 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:40:05.585 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T13:40:05.799 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-base (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:06.131 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T13:40:06.216 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-base (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:06.600 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T13:40:06.784 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mds (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:07.009 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T13:40:07.009 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T13:40:07.301 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mds (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:07.541 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T13:40:07.541 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T13:40:07.781 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:08.137 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T13:40:08.137 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T13:40:08.213 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:08.426 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T13:40:08.431 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T13:40:08.774 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-osd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:09.088 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-osd (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:09.141 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T13:40:09.141 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T13:40:09.526 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T13:40:09.526 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T13:40:09.775 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:09.927 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:10.078 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mon (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:10.217 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:10.310 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T13:40:10.310 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T13:40:10.403 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:10.640 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mon (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:10.895 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T13:40:10.895 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T13:40:10.954 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:11.097 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:11.214 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-mgr-dashboard (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:11.370 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ceph-volume (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:11.578 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr-cephadm (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:11.704 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:11.727 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T13:40:11.830 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-mgr-dashboard (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:11.844 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T13:40:11.973 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ceph-volume (19.0.0-3291-g994e2f20-1jammy) ... 2024-04-25T13:40:11.996 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T13:40:12.325 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T13:40:12.434 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T13:40:12.587 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T13:40:12.872 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T13:40:13.346 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T13:40:13.692 INFO:teuthology.orchestra.run.smithi130.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T13:40:13.697 DEBUG:teuthology.orchestra.run.smithi130:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-25T13:40:13.772 INFO:teuthology.orchestra.run.smithi130.stdout:Reading package lists... 2024-04-25T13:40:13.947 INFO:teuthology.orchestra.run.smithi130.stdout:Building dependency tree... 2024-04-25T13:40:13.948 INFO:teuthology.orchestra.run.smithi130.stdout:Reading state information... 2024-04-25T13:40:14.055 INFO:teuthology.orchestra.run.smithi123.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T13:40:14.060 DEBUG:teuthology.orchestra.run.smithi123:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-25T13:40:14.119 INFO:teuthology.orchestra.run.smithi130.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-25T13:40:14.120 INFO:teuthology.orchestra.run.smithi130.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T13:40:14.120 INFO:teuthology.orchestra.run.smithi130.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T13:40:14.120 INFO:teuthology.orchestra.run.smithi130.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:40:14.120 INFO:teuthology.orchestra.run.smithi130.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:40:14.120 INFO:teuthology.orchestra.run.smithi130.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:40:14.120 INFO:teuthology.orchestra.run.smithi130.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:40:14.121 INFO:teuthology.orchestra.run.smithi130.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T13:40:14.121 INFO:teuthology.orchestra.run.smithi130.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:40:14.121 INFO:teuthology.orchestra.run.smithi130.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:40:14.121 INFO:teuthology.orchestra.run.smithi130.stdout:The following additional packages will be installed: 2024-04-25T13:40:14.122 INFO:teuthology.orchestra.run.smithi130.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-25T13:40:14.122 INFO:teuthology.orchestra.run.smithi130.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-25T13:40:14.122 INFO:teuthology.orchestra.run.smithi130.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-25T13:40:14.122 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-25T13:40:14.123 INFO:teuthology.orchestra.run.smithi130.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T13:40:14.123 INFO:teuthology.orchestra.run.smithi130.stdout:Suggested packages: 2024-04-25T13:40:14.124 INFO:teuthology.orchestra.run.smithi130.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-25T13:40:14.124 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-25T13:40:14.124 INFO:teuthology.orchestra.run.smithi130.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-25T13:40:14.133 INFO:teuthology.orchestra.run.smithi123.stdout:Reading package lists... 2024-04-25T13:40:14.177 INFO:teuthology.orchestra.run.smithi130.stdout:The following NEW packages will be installed: 2024-04-25T13:40:14.178 INFO:teuthology.orchestra.run.smithi130.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-25T13:40:14.178 INFO:teuthology.orchestra.run.smithi130.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-25T13:40:14.178 INFO:teuthology.orchestra.run.smithi130.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-25T13:40:14.179 INFO:teuthology.orchestra.run.smithi130.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-25T13:40:14.179 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-25T13:40:14.179 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-25T13:40:14.179 INFO:teuthology.orchestra.run.smithi130.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T13:40:14.180 INFO:teuthology.orchestra.run.smithi130.stdout:The following packages will be upgraded: 2024-04-25T13:40:14.180 INFO:teuthology.orchestra.run.smithi130.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-25T13:40:14.307 INFO:teuthology.orchestra.run.smithi123.stdout:Building dependency tree... 2024-04-25T13:40:14.308 INFO:teuthology.orchestra.run.smithi123.stdout:Reading state information... 2024-04-25T13:40:14.319 INFO:teuthology.orchestra.run.smithi130.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-25T13:40:14.319 INFO:teuthology.orchestra.run.smithi130.stdout:Need to get 55.7 MB of archives. 2024-04-25T13:40:14.319 INFO:teuthology.orchestra.run.smithi130.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-25T13:40:14.319 INFO:teuthology.orchestra.run.smithi130.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-25T13:40:14.482 INFO:teuthology.orchestra.run.smithi123.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-25T13:40:14.482 INFO:teuthology.orchestra.run.smithi123.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T13:40:14.482 INFO:teuthology.orchestra.run.smithi123.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T13:40:14.482 INFO:teuthology.orchestra.run.smithi123.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T13:40:14.482 INFO:teuthology.orchestra.run.smithi123.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T13:40:14.482 INFO:teuthology.orchestra.run.smithi123.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T13:40:14.482 INFO:teuthology.orchestra.run.smithi123.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T13:40:14.483 INFO:teuthology.orchestra.run.smithi123.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T13:40:14.483 INFO:teuthology.orchestra.run.smithi123.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T13:40:14.483 INFO:teuthology.orchestra.run.smithi123.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T13:40:14.484 INFO:teuthology.orchestra.run.smithi123.stdout:The following additional packages will be installed: 2024-04-25T13:40:14.484 INFO:teuthology.orchestra.run.smithi123.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-25T13:40:14.484 INFO:teuthology.orchestra.run.smithi123.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-25T13:40:14.484 INFO:teuthology.orchestra.run.smithi123.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-25T13:40:14.485 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-25T13:40:14.485 INFO:teuthology.orchestra.run.smithi123.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T13:40:14.486 INFO:teuthology.orchestra.run.smithi123.stdout:Suggested packages: 2024-04-25T13:40:14.486 INFO:teuthology.orchestra.run.smithi123.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-25T13:40:14.486 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-25T13:40:14.486 INFO:teuthology.orchestra.run.smithi123.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-25T13:40:14.540 INFO:teuthology.orchestra.run.smithi123.stdout:The following NEW packages will be installed: 2024-04-25T13:40:14.541 INFO:teuthology.orchestra.run.smithi123.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-25T13:40:14.541 INFO:teuthology.orchestra.run.smithi123.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-25T13:40:14.542 INFO:teuthology.orchestra.run.smithi123.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-25T13:40:14.542 INFO:teuthology.orchestra.run.smithi123.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-25T13:40:14.542 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-25T13:40:14.542 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-25T13:40:14.542 INFO:teuthology.orchestra.run.smithi123.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T13:40:14.543 INFO:teuthology.orchestra.run.smithi123.stdout:The following packages will be upgraded: 2024-04-25T13:40:14.543 INFO:teuthology.orchestra.run.smithi123.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-25T13:40:14.642 INFO:teuthology.orchestra.run.smithi123.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-25T13:40:14.642 INFO:teuthology.orchestra.run.smithi123.stdout:Need to get 55.7 MB of archives. 2024-04-25T13:40:14.642 INFO:teuthology.orchestra.run.smithi123.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-25T13:40:14.642 INFO:teuthology.orchestra.run.smithi123.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-25T13:40:14.704 INFO:teuthology.orchestra.run.smithi130.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T13:40:14.718 INFO:teuthology.orchestra.run.smithi130.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T13:40:14.823 INFO:teuthology.orchestra.run.smithi130.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T13:40:14.823 INFO:teuthology.orchestra.run.smithi130.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T13:40:14.823 INFO:teuthology.orchestra.run.smithi130.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T13:40:14.837 INFO:teuthology.orchestra.run.smithi130.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-25T13:40:14.838 INFO:teuthology.orchestra.run.smithi130.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-25T13:40:14.840 INFO:teuthology.orchestra.run.smithi130.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-25T13:40:14.841 INFO:teuthology.orchestra.run.smithi130.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T13:40:14.841 INFO:teuthology.orchestra.run.smithi130.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-25T13:40:14.842 INFO:teuthology.orchestra.run.smithi130.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T13:40:14.849 INFO:teuthology.orchestra.run.smithi130.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T13:40:14.864 INFO:teuthology.orchestra.run.smithi130.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T13:40:14.865 INFO:teuthology.orchestra.run.smithi130.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-25T13:40:14.866 INFO:teuthology.orchestra.run.smithi130.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-25T13:40:15.026 INFO:teuthology.orchestra.run.smithi123.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T13:40:15.039 INFO:teuthology.orchestra.run.smithi123.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T13:40:15.154 INFO:teuthology.orchestra.run.smithi123.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T13:40:15.155 INFO:teuthology.orchestra.run.smithi123.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T13:40:15.156 INFO:teuthology.orchestra.run.smithi123.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T13:40:15.201 INFO:teuthology.orchestra.run.smithi123.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-25T13:40:15.202 INFO:teuthology.orchestra.run.smithi123.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-25T13:40:15.204 INFO:teuthology.orchestra.run.smithi123.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-25T13:40:15.205 INFO:teuthology.orchestra.run.smithi123.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T13:40:15.205 INFO:teuthology.orchestra.run.smithi123.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-25T13:40:15.207 INFO:teuthology.orchestra.run.smithi123.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T13:40:15.208 INFO:teuthology.orchestra.run.smithi123.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T13:40:15.246 INFO:teuthology.orchestra.run.smithi130.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-25T13:40:15.248 INFO:teuthology.orchestra.run.smithi130.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-25T13:40:15.248 INFO:teuthology.orchestra.run.smithi130.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-25T13:40:15.249 INFO:teuthology.orchestra.run.smithi123.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T13:40:15.250 INFO:teuthology.orchestra.run.smithi123.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-25T13:40:15.251 INFO:teuthology.orchestra.run.smithi123.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-25T13:40:15.251 INFO:teuthology.orchestra.run.smithi130.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-25T13:40:15.251 INFO:teuthology.orchestra.run.smithi130.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-25T13:40:15.257 INFO:teuthology.orchestra.run.smithi130.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-25T13:40:15.258 INFO:teuthology.orchestra.run.smithi130.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-25T13:40:15.267 INFO:teuthology.orchestra.run.smithi130.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-25T13:40:15.267 INFO:teuthology.orchestra.run.smithi130.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T13:40:15.314 INFO:teuthology.orchestra.run.smithi130.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-25T13:40:15.321 INFO:teuthology.orchestra.run.smithi130.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-25T13:40:15.334 INFO:teuthology.orchestra.run.smithi130.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-25T13:40:15.423 INFO:teuthology.orchestra.run.smithi130.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-25T13:40:15.432 INFO:teuthology.orchestra.run.smithi130.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-25T13:40:15.432 INFO:teuthology.orchestra.run.smithi130.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-25T13:40:15.433 INFO:teuthology.orchestra.run.smithi130.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-25T13:40:15.433 INFO:teuthology.orchestra.run.smithi130.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-25T13:40:15.445 INFO:teuthology.orchestra.run.smithi130.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-25T13:40:15.447 INFO:teuthology.orchestra.run.smithi130.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-25T13:40:15.829 INFO:teuthology.orchestra.run.smithi130.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-25T13:40:15.830 INFO:teuthology.orchestra.run.smithi130.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-25T13:40:15.830 INFO:teuthology.orchestra.run.smithi130.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-25T13:40:15.830 INFO:teuthology.orchestra.run.smithi130.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-25T13:40:15.830 INFO:teuthology.orchestra.run.smithi130.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-25T13:40:15.831 INFO:teuthology.orchestra.run.smithi130.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-25T13:40:15.845 INFO:teuthology.orchestra.run.smithi130.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-25T13:40:15.845 INFO:teuthology.orchestra.run.smithi130.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-25T13:40:15.854 INFO:teuthology.orchestra.run.smithi123.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-25T13:40:15.856 INFO:teuthology.orchestra.run.smithi123.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-25T13:40:15.856 INFO:teuthology.orchestra.run.smithi123.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-25T13:40:15.859 INFO:teuthology.orchestra.run.smithi123.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-25T13:40:15.859 INFO:teuthology.orchestra.run.smithi123.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-25T13:40:15.863 INFO:teuthology.orchestra.run.smithi123.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-25T13:40:15.865 INFO:teuthology.orchestra.run.smithi123.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-25T13:40:15.873 INFO:teuthology.orchestra.run.smithi123.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-25T13:40:15.873 INFO:teuthology.orchestra.run.smithi123.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T13:40:15.895 INFO:teuthology.orchestra.run.smithi123.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-25T13:40:15.895 INFO:teuthology.orchestra.run.smithi123.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-25T13:40:15.908 INFO:teuthology.orchestra.run.smithi123.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-25T13:40:15.933 INFO:teuthology.orchestra.run.smithi123.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-25T13:40:15.937 INFO:teuthology.orchestra.run.smithi123.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-25T13:40:15.938 INFO:teuthology.orchestra.run.smithi123.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-25T13:40:15.938 INFO:teuthology.orchestra.run.smithi123.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-25T13:40:15.939 INFO:teuthology.orchestra.run.smithi123.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-25T13:40:15.950 INFO:teuthology.orchestra.run.smithi123.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-25T13:40:15.955 INFO:teuthology.orchestra.run.smithi123.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-25T13:40:16.136 INFO:teuthology.orchestra.run.smithi123.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-25T13:40:16.137 INFO:teuthology.orchestra.run.smithi123.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-25T13:40:16.137 INFO:teuthology.orchestra.run.smithi123.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-25T13:40:16.137 INFO:teuthology.orchestra.run.smithi123.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-25T13:40:16.137 INFO:teuthology.orchestra.run.smithi123.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-25T13:40:16.137 INFO:teuthology.orchestra.run.smithi123.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-25T13:40:16.151 INFO:teuthology.orchestra.run.smithi123.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-25T13:40:16.151 INFO:teuthology.orchestra.run.smithi123.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-25T13:40:16.224 INFO:teuthology.orchestra.run.smithi130.stdout:Preconfiguring packages ... 2024-04-25T13:40:16.388 INFO:teuthology.orchestra.run.smithi130.stdout:Fetched 55.7 MB in 2s (33.6 MB/s) 2024-04-25T13:40:16.527 INFO:teuthology.orchestra.run.smithi123.stdout:Preconfiguring packages ... 2024-04-25T13:40:16.676 INFO:teuthology.orchestra.run.smithi123.stdout:Fetched 55.7 MB in 2s (34.8 MB/s) 2024-04-25T13:40:16.686 INFO:teuthology.orchestra.run.smithi130.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-25T13:40:16.690 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T13:40:16.837 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T13:40:16.933 INFO:teuthology.orchestra.run.smithi123.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-25T13:40:16.934 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T13:40:17.051 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T13:40:17.545 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-25T13:40:17.633 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-25T13:40:18.714 INFO:teuthology.orchestra.run.smithi130.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-25T13:40:18.740 INFO:teuthology.orchestra.run.smithi123.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-25T13:40:18.990 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package flex. 2024-04-25T13:40:19.063 INFO:teuthology.orchestra.run.smithi123.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-25T13:40:19.067 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T13:40:19.069 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package flex. 2024-04-25T13:40:19.114 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T13:40:19.140 INFO:teuthology.orchestra.run.smithi130.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140922 files and directories currently installed.) 2024-04-25T13:40:19.144 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T13:40:19.193 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T13:40:19.566 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T13:40:19.645 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T13:40:19.736 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T13:40:19.807 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T13:40:20.109 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T13:40:20.238 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T13:40:20.681 INFO:teuthology.orchestra.run.smithi123.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-25T13:40:20.684 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T13:40:20.778 INFO:teuthology.orchestra.run.smithi130.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-25T13:40:20.782 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T13:40:20.802 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T13:40:20.917 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T13:40:21.155 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T13:40:21.275 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T13:40:21.312 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T13:40:21.424 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T13:40:21.572 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T13:40:21.729 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T13:40:21.958 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package bison. 2024-04-25T13:40:22.030 INFO:teuthology.orchestra.run.smithi123.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-25T13:40:22.034 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T13:40:22.074 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package bison. 2024-04-25T13:40:22.077 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T13:40:22.148 INFO:teuthology.orchestra.run.smithi130.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140995 files and directories currently installed.) 2024-04-25T13:40:22.152 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T13:40:22.202 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T13:40:22.478 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-25T13:40:22.492 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-25T13:40:22.536 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T13:40:22.628 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-25T13:40:22.642 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-25T13:40:22.686 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T13:40:22.831 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package dump. 2024-04-25T13:40:22.845 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-25T13:40:22.889 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking dump (0.4b47-3) ... 2024-04-25T13:40:23.006 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package dump. 2024-04-25T13:40:23.020 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-25T13:40:23.072 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking dump (0.4b47-3) ... 2024-04-25T13:40:23.263 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package indent. 2024-04-25T13:40:23.278 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:40:23.377 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package indent. 2024-04-25T13:40:23.378 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T13:40:23.392 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:40:23.435 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T13:40:23.621 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T13:40:23.637 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T13:40:23.679 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T13:40:23.730 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T13:40:23.744 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T13:40:23.788 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T13:40:23.992 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-25T13:40:24.007 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-25T13:40:24.050 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T13:40:24.075 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-25T13:40:24.090 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-25T13:40:24.125 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T13:40:24.336 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T13:40:24.352 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T13:40:24.361 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T13:40:24.377 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T13:40:24.394 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T13:40:24.420 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T13:40:24.731 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T13:40:24.747 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T13:40:24.748 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T13:40:24.762 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T13:40:24.789 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T13:40:24.832 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T13:40:25.026 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T13:40:25.041 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T13:40:25.075 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T13:40:25.076 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T13:40:25.090 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T13:40:25.135 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T13:40:25.320 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libjson-perl. 2024-04-25T13:40:25.335 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-25T13:40:25.354 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libjson-perl. 2024-04-25T13:40:25.368 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-25T13:40:25.378 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-25T13:40:25.412 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-25T13:40:25.681 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-25T13:40:25.697 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-25T13:40:25.715 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-25T13:40:25.729 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-25T13:40:25.739 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T13:40:25.782 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T13:40:27.092 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-25T13:40:27.108 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T13:40:27.127 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-25T13:40:27.142 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:40:27.143 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T13:40:27.185 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:40:27.370 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-25T13:40:27.385 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T13:40:27.428 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:40:27.446 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-25T13:40:27.462 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T13:40:27.504 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:40:27.748 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-25T13:40:27.763 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T13:40:27.805 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:40:27.833 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-25T13:40:27.849 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T13:40:27.891 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:40:28.200 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-25T13:40:28.215 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-25T13:40:28.235 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-25T13:40:28.251 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-25T13:40:28.258 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T13:40:28.294 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T13:40:28.596 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-25T13:40:28.612 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T13:40:28.654 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T13:40:28.715 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-25T13:40:28.730 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T13:40:28.773 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T13:40:28.999 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-25T13:40:29.014 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:40:29.057 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:40:29.085 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-25T13:40:29.100 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:40:29.143 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:40:29.402 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-25T13:40:29.417 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:40:29.459 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:40:29.471 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-25T13:40:29.486 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:40:29.529 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:40:29.771 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-25T13:40:29.787 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:40:29.821 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:40:29.848 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-25T13:40:29.864 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:40:29.907 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:40:30.065 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T13:40:30.080 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T13:40:30.123 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T13:40:30.134 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T13:40:30.150 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T13:40:30.184 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T13:40:30.619 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-25T13:40:30.634 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-25T13:40:30.655 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-25T13:40:30.670 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-25T13:40:30.676 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T13:40:30.713 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T13:40:31.005 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package modemmanager. 2024-04-25T13:40:31.020 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T13:40:31.063 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:40:31.083 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package modemmanager. 2024-04-25T13:40:31.098 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T13:40:31.133 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:40:31.670 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package network-manager. 2024-04-25T13:40:31.686 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T13:40:31.727 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-25T13:40:31.765 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package network-manager. 2024-04-25T13:40:31.781 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T13:40:31.831 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-25T13:40:32.377 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package ppp. 2024-04-25T13:40:32.392 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-25T13:40:32.623 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package ppp. 2024-04-25T13:40:32.639 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-25T13:40:32.741 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T13:40:32.974 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T13:40:33.048 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package pptp-linux. 2024-04-25T13:40:33.062 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-25T13:40:33.106 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-25T13:40:33.311 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package pptp-linux. 2024-04-25T13:40:33.325 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-25T13:40:33.370 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-25T13:40:33.645 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-25T13:40:33.660 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-25T13:40:33.703 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-25T13:40:33.816 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-25T13:40:33.830 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-25T13:40:33.866 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-25T13:40:34.006 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-25T13:40:34.021 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-25T13:40:34.064 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking postgresql-client-common (238) ... 2024-04-25T13:40:34.152 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-25T13:40:34.167 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-25T13:40:34.210 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking postgresql-client-common (238) ... 2024-04-25T13:40:34.368 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-25T13:40:34.382 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:40:34.457 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:40:34.522 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-25T13:40:34.537 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:40:34.581 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:40:34.956 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package postgresql-common. 2024-04-25T13:40:34.970 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-25T13:40:35.031 INFO:teuthology.orchestra.run.smithi123.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-25T13:40:35.062 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking postgresql-common (238) ... 2024-04-25T13:40:35.169 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package postgresql-common. 2024-04-25T13:40:35.184 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-25T13:40:35.245 INFO:teuthology.orchestra.run.smithi130.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-25T13:40:35.276 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking postgresql-common (238) ... 2024-04-25T13:40:35.538 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package postgresql-14. 2024-04-25T13:40:35.552 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:40:35.598 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:40:35.735 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package postgresql-14. 2024-04-25T13:40:35.749 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T13:40:35.796 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:40:36.590 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package postgresql. 2024-04-25T13:40:36.605 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-25T13:40:36.648 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking postgresql (14+238) ... 2024-04-25T13:40:36.805 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package postgresql. 2024-04-25T13:40:36.820 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-25T13:40:36.863 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking postgresql (14+238) ... 2024-04-25T13:40:36.892 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package postgresql-client. 2024-04-25T13:40:36.907 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-25T13:40:36.951 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking postgresql-client (14+238) ... 2024-04-25T13:40:37.107 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package postgresql-client. 2024-04-25T13:40:37.122 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-25T13:40:37.189 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking postgresql-client (14+238) ... 2024-04-25T13:40:37.303 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-25T13:40:37.318 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-25T13:40:37.361 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-25T13:40:37.459 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-25T13:40:37.474 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-25T13:40:37.518 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-25T13:40:37.680 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package tcl8.6. 2024-04-25T13:40:37.696 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-25T13:40:37.738 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T13:40:37.929 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package tcl8.6. 2024-04-25T13:40:37.944 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-25T13:40:37.996 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T13:40:38.016 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package tcl. 2024-04-25T13:40:38.032 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-25T13:40:38.079 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-25T13:40:38.290 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package tcl. 2024-04-25T13:40:38.306 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-25T13:40:38.353 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-25T13:40:38.452 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package wpasupplicant. 2024-04-25T13:40:38.468 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-25T13:40:38.510 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T13:40:38.827 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package wpasupplicant. 2024-04-25T13:40:38.843 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-25T13:40:38.893 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T13:40:39.273 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-25T13:40:39.289 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-25T13:40:39.331 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-25T13:40:39.331 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-25T13:40:39.347 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-25T13:40:39.397 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-25T13:40:39.684 INFO:teuthology.orchestra.run.smithi123.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-25T13:40:39.700 INFO:teuthology.orchestra.run.smithi123.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-25T13:40:39.751 INFO:teuthology.orchestra.run.smithi123.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T13:40:39.809 INFO:teuthology.orchestra.run.smithi130.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-25T13:40:39.826 INFO:teuthology.orchestra.run.smithi130.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-25T13:40:39.884 INFO:teuthology.orchestra.run.smithi130.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T13:40:40.044 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up postgresql-client-common (238) ... 2024-04-25T13:40:40.195 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up postgresql-client-common (238) ... 2024-04-25T13:40:40.257 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T13:40:40.383 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T13:40:40.407 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T13:40:40.501 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:40:40.542 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T13:40:40.602 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T13:40:40.668 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:40:40.727 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T13:40:40.794 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T13:40:40.854 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:40:40.928 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T13:40:41.029 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:40:41.822 INFO:teuthology.orchestra.run.smithi123.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-25T13:40:41.909 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T13:40:41.977 INFO:teuthology.orchestra.run.smithi130.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-25T13:40:42.093 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T13:40:42.270 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T13:40:42.270 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T13:40:42.438 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T13:40:42.439 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T13:40:42.954 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T13:40:43.079 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T13:40:43.113 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T13:40:43.205 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T13:40:43.239 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T13:40:43.331 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-25T13:40:43.390 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T13:40:43.449 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T13:40:43.533 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-25T13:40:43.583 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T13:40:43.659 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T13:40:43.709 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T13:40:43.786 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T13:40:43.835 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T13:40:43.895 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T13:40:44.012 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T13:40:44.751 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T13:40:44.877 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up dump (0.4b47-3) ... 2024-04-25T13:40:44.926 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T13:40:44.964 INFO:teuthology.orchestra.run.smithi130.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-25T13:40:45.013 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:40:45.052 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up dump (0.4b47-3) ... 2024-04-25T13:40:45.138 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T13:40:45.147 INFO:teuthology.orchestra.run.smithi123.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-25T13:40:45.220 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:40:45.264 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-25T13:40:45.346 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T13:40:45.390 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-25T13:40:45.473 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-25T13:40:45.516 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T13:40:45.598 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-25T13:40:45.606 INFO:teuthology.orchestra.run.smithi130.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T13:40:45.677 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T13:40:45.716 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T13:40:45.789 INFO:teuthology.orchestra.run.smithi123.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T13:40:45.828 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T13:40:45.859 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T13:40:45.985 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T13:40:45.988 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T13:40:46.105 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:40:46.178 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T13:40:46.231 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-25T13:40:46.304 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:40:46.399 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up postgresql-client (14+238) ... 2024-04-25T13:40:46.430 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-25T13:40:46.525 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-25T13:40:46.606 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up postgresql-client (14+238) ... 2024-04-25T13:40:46.724 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-25T13:40:47.114 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:40:47.114 INFO:teuthology.orchestra.run.smithi130.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-25T13:40:47.114 INFO:teuthology.orchestra.run.smithi130.stdout:which means they are currently configured by ifupdown: 2024-04-25T13:40:47.114 INFO:teuthology.orchestra.run.smithi130.stdout:- enp3s0f1 2024-04-25T13:40:47.114 INFO:teuthology.orchestra.run.smithi130.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-25T13:40:47.114 INFO:teuthology.orchestra.run.smithi130.stdout:remove their configuration from /etc/network/interfaces. 2024-04-25T13:40:47.114 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:40:47.248 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-25T13:40:47.314 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:40:47.314 INFO:teuthology.orchestra.run.smithi123.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-25T13:40:47.314 INFO:teuthology.orchestra.run.smithi123.stdout:which means they are currently configured by ifupdown: 2024-04-25T13:40:47.314 INFO:teuthology.orchestra.run.smithi123.stdout:- enp3s0f1 2024-04-25T13:40:47.314 INFO:teuthology.orchestra.run.smithi123.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-25T13:40:47.314 INFO:teuthology.orchestra.run.smithi123.stdout:remove their configuration from /etc/network/interfaces. 2024-04-25T13:40:47.315 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:40:47.446 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-25T13:40:47.646 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-25T13:40:47.830 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-25T13:40:48.055 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-25T13:40:48.227 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-25T13:40:48.901 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:40:48.995 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T13:40:49.053 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T13:40:49.113 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T13:40:49.179 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-25T13:40:49.238 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-25T13:40:49.321 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up postgresql-common (238) ... 2024-04-25T13:40:49.364 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up postgresql-common (238) ... 2024-04-25T13:40:50.311 INFO:teuthology.orchestra.run.smithi123.stdout:Adding user postgres to group ssl-cert 2024-04-25T13:40:50.314 INFO:teuthology.orchestra.run.smithi130.stdout:Adding user postgres to group ssl-cert 2024-04-25T13:40:50.529 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:40:50.529 INFO:teuthology.orchestra.run.smithi123.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-25T13:40:50.563 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:40:50.563 INFO:teuthology.orchestra.run.smithi130.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-25T13:40:50.796 INFO:teuthology.orchestra.run.smithi123.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-25T13:40:50.796 INFO:teuthology.orchestra.run.smithi123.stdout:Removing obsolete dictionary files: 2024-04-25T13:40:50.806 INFO:teuthology.orchestra.run.smithi130.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-25T13:40:50.807 INFO:teuthology.orchestra.run.smithi130.stdout:Removing obsolete dictionary files: 2024-04-25T13:40:51.548 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-25T13:40:51.561 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-25T13:40:52.014 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:40:52.100 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T13:40:52.363 INFO:teuthology.orchestra.run.smithi123.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-25T13:40:52.383 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-25T13:40:52.436 INFO:teuthology.orchestra.run.smithi123.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-25T13:40:52.436 INFO:teuthology.orchestra.run.smithi123.stdout:This user must also own the server process. 2024-04-25T13:40:52.436 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:40:52.437 INFO:teuthology.orchestra.run.smithi123.stdout:The database cluster will be initialized with locale "en_US". 2024-04-25T13:40:52.437 INFO:teuthology.orchestra.run.smithi123.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-25T13:40:52.437 INFO:teuthology.orchestra.run.smithi123.stdout:The default text search configuration will be set to "english". 2024-04-25T13:40:52.437 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:40:52.437 INFO:teuthology.orchestra.run.smithi123.stdout:Data page checksums are disabled. 2024-04-25T13:40:52.437 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:40:52.437 INFO:teuthology.orchestra.run.smithi123.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-25T13:40:52.438 INFO:teuthology.orchestra.run.smithi123.stdout:creating subdirectories ... ok 2024-04-25T13:40:52.438 INFO:teuthology.orchestra.run.smithi123.stdout:selecting dynamic shared memory implementation ... posix 2024-04-25T13:40:52.445 INFO:teuthology.orchestra.run.smithi130.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-25T13:40:52.461 INFO:teuthology.orchestra.run.smithi123.stdout:selecting default max_connections ... 100 2024-04-25T13:40:52.482 INFO:teuthology.orchestra.run.smithi130.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-25T13:40:52.494 INFO:teuthology.orchestra.run.smithi123.stdout:selecting default shared_buffers ... 128MB 2024-04-25T13:40:52.508 INFO:teuthology.orchestra.run.smithi123.stdout:selecting default time zone ... Etc/UTC 2024-04-25T13:40:52.509 INFO:teuthology.orchestra.run.smithi123.stdout:creating configuration files ... ok 2024-04-25T13:40:52.529 INFO:teuthology.orchestra.run.smithi130.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-25T13:40:52.530 INFO:teuthology.orchestra.run.smithi130.stdout:This user must also own the server process. 2024-04-25T13:40:52.530 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:40:52.530 INFO:teuthology.orchestra.run.smithi130.stdout:The database cluster will be initialized with locale "en_US". 2024-04-25T13:40:52.530 INFO:teuthology.orchestra.run.smithi130.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-25T13:40:52.530 INFO:teuthology.orchestra.run.smithi130.stdout:The default text search configuration will be set to "english". 2024-04-25T13:40:52.530 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:40:52.530 INFO:teuthology.orchestra.run.smithi130.stdout:Data page checksums are disabled. 2024-04-25T13:40:52.530 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:40:52.530 INFO:teuthology.orchestra.run.smithi130.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-25T13:40:52.531 INFO:teuthology.orchestra.run.smithi130.stdout:creating subdirectories ... ok 2024-04-25T13:40:52.531 INFO:teuthology.orchestra.run.smithi130.stdout:selecting dynamic shared memory implementation ... posix 2024-04-25T13:40:52.555 INFO:teuthology.orchestra.run.smithi130.stdout:selecting default max_connections ... 100 2024-04-25T13:40:52.588 INFO:teuthology.orchestra.run.smithi130.stdout:selecting default shared_buffers ... 128MB 2024-04-25T13:40:52.602 INFO:teuthology.orchestra.run.smithi130.stdout:selecting default time zone ... Etc/UTC 2024-04-25T13:40:52.603 INFO:teuthology.orchestra.run.smithi130.stdout:creating configuration files ... ok 2024-04-25T13:40:52.675 INFO:teuthology.orchestra.run.smithi123.stdout:running bootstrap script ... ok 2024-04-25T13:40:52.766 INFO:teuthology.orchestra.run.smithi130.stdout:running bootstrap script ... ok 2024-04-25T13:40:53.308 INFO:teuthology.orchestra.run.smithi123.stdout:performing post-bootstrap initialization ... ok 2024-04-25T13:40:53.381 INFO:teuthology.orchestra.run.smithi130.stdout:performing post-bootstrap initialization ... ok 2024-04-25T13:40:53.858 INFO:teuthology.orchestra.run.smithi123.stdout:syncing data to disk ... ok 2024-04-25T13:40:53.933 INFO:teuthology.orchestra.run.smithi130.stdout:syncing data to disk ... ok 2024-04-25T13:40:54.384 INFO:teuthology.orchestra.run.smithi123.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-25T13:40:54.458 INFO:teuthology.orchestra.run.smithi130.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-25T13:40:57.437 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:40:57.516 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:40:57.597 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-25T13:40:57.650 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-25T13:40:57.722 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up postgresql (14+238) ... 2024-04-25T13:40:57.776 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up postgresql (14+238) ... 2024-04-25T13:40:57.848 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:40:57.877 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T13:40:57.974 INFO:teuthology.orchestra.run.smithi123.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:40:58.036 INFO:teuthology.orchestra.run.smithi130.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T13:40:58.234 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T13:40:58.234 INFO:teuthology.orchestra.run.smithi123.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T13:40:58.297 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T13:40:58.297 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T13:40:58.985 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T13:40:59.077 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-25T13:40:59.080 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T13:40:59.198 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-25T13:40:59.396 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T13:40:59.509 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T13:40:59.548 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T13:40:59.669 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T13:41:00.933 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-25T13:41:01.025 INFO:teuthology.orchestra.run.smithi123.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T13:41:01.189 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-25T13:41:01.289 INFO:teuthology.orchestra.run.smithi130.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T13:41:01.556 INFO:teuthology.orchestra.run.smithi123.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T13:41:01.563 DEBUG:teuthology.parallel:result is None 2024-04-25T13:41:01.875 INFO:teuthology.orchestra.run.smithi130.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T13:41:01.881 DEBUG:teuthology.parallel:result is None 2024-04-25T13:41:01.882 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:41:02.104 DEBUG:teuthology.orchestra.run.smithi123:> dpkg-query -W -f '${Version}' ceph 2024-04-25T13:41:02.127 INFO:teuthology.orchestra.run.smithi123.stdout:19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:41:02.127 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:41:02.128 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291-g994e2f20-1jammy is installed. 2024-04-25T13:41:02.129 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T13:41:02.365 DEBUG:teuthology.orchestra.run.smithi130:> dpkg-query -W -f '${Version}' ceph 2024-04-25T13:41:02.387 INFO:teuthology.orchestra.run.smithi130.stdout:19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:41:02.387 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3291-g994e2f20-1jammy 2024-04-25T13:41:02.387 INFO:teuthology.task.install:The correct ceph version 19.0.0-3291-g994e2f20-1jammy is installed. 2024-04-25T13:41:02.388 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T13:41:02.389 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:41:02.389 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T13:41:02.410 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:41:02.410 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T13:41:02.447 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T13:41:02.447 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:41:02.447 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T13:41:02.472 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T13:41:02.535 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:41:02.536 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T13:41:02.555 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T13:41:02.618 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T13:41:02.618 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:41:02.618 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T13:41:02.639 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T13:41:02.700 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:41:02.700 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T13:41:02.718 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T13:41:02.777 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T13:41:02.778 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:41:02.778 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T13:41:02.798 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T13:41:02.859 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:41:02.859 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T13:41:02.877 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T13:41:02.938 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T13:41:03.014 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T13:41:03.014 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 777 /var/log/ceph 2024-04-25T13:41:03.018 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 777 /var/log/ceph 2024-04-25T13:41:03.036 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T13:41:03.037 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T13:41:03.079 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T13:41:03.097 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T13:41:03.098 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T13:41:03.139 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T13:41:03.165 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T13:41:03.165 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T13:41:03.165 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T13:41:03.165 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:41:03.165 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T13:41:03.208 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T13:41:03.301 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:41:03.301 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T13:41:03.309 DEBUG:teuthology.orchestra.run.smithi130:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T13:41:03.401 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T13:41:03.401 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T13:41:03.401 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673164', 'branch': 'wip-pdonnell-testing-20240425.015853-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/mds-flush}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7673164', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240425.015853-debug'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, 'kclient': {'syntax': 'v1'}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240425.015853-debug', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 85, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1880, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'sleep_before_teardown': 0, 'subset': '178/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240425.015853-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi123.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNOtvxA9q55RkpU+SXNUJVqxo/VB8eW8qqt0QLPqz5TbfegV4iiKTMbhiPI9mjhoewluIIuvNvNAWY0/c0G5psw=', 'smithi130.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNhq2gPWHXg+AtqQOsRvglb7BOcmowkaR8qZZoJLmeEpZuQybn6Uq5xtttIgbZoVUcUDn0OOfvN6ucIECX72Cvs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_flush']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_10:00:23', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T13:41:03.402 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T13:41:03.405 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T13:41:03.447 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T13:41:03.455 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T13:41:03.506 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:41:03.506 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T13:41:03.521 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T13:41:03.521 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_1 2024-04-25T13:41:03.573 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T13:41:03.573 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:41:03.573 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 889 Links: 1 2024-04-25T13:41:03.573 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:41:03.573 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-04-25 13:34:43.910100210 +0000 2024-04-25T13:41:03.573 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-04-25 13:34:43.618102815 +0000 2024-04-25T13:41:03.573 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-04-25 13:34:43.618102815 +0000 2024-04-25T13:41:03.573 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-04-25 13:34:43.618102815 +0000 2024-04-25T13:41:03.574 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T13:41:03.634 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-04-25T13:41:03.634 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-04-25T13:41:03.634 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.00040113 s, 1.3 MB/s 2024-04-25T13:41:03.636 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T13:41:03.691 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_2 2024-04-25T13:41:03.741 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T13:41:03.741 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:41:03.741 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 905 Links: 1 2024-04-25T13:41:03.741 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:41:03.741 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-04-25 13:34:44.450095393 +0000 2024-04-25T13:41:03.741 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-04-25 13:34:44.198097641 +0000 2024-04-25T13:41:03.741 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-04-25 13:34:44.198097641 +0000 2024-04-25T13:41:03.741 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-04-25 13:34:44.198097641 +0000 2024-04-25T13:41:03.741 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T13:41:03.802 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-04-25T13:41:03.802 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-04-25T13:41:03.802 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000369602 s, 1.4 MB/s 2024-04-25T13:41:03.804 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T13:41:03.858 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_3 2024-04-25T13:41:03.913 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T13:41:03.913 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:41:03.913 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 922 Links: 1 2024-04-25T13:41:03.913 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:41:03.913 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-04-25 13:34:45.030090219 +0000 2024-04-25T13:41:03.913 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-04-25 13:34:44.766092574 +0000 2024-04-25T13:41:03.913 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-04-25 13:34:44.766092574 +0000 2024-04-25T13:41:03.913 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-04-25 13:34:44.766092574 +0000 2024-04-25T13:41:03.913 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T13:41:03.974 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-04-25T13:41:03.974 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-04-25T13:41:03.975 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000370336 s, 1.4 MB/s 2024-04-25T13:41:03.977 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T13:41:04.031 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_4 2024-04-25T13:41:04.081 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T13:41:04.081 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:41:04.081 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 941 Links: 1 2024-04-25T13:41:04.081 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:41:04.081 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-04-25 13:34:45.626084902 +0000 2024-04-25T13:41:04.081 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-04-25 13:34:45.358087293 +0000 2024-04-25T13:41:04.081 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-04-25 13:34:45.358087293 +0000 2024-04-25T13:41:04.081 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: 2024-04-25 13:34:45.358087293 +0000 2024-04-25T13:41:04.082 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T13:41:04.143 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-04-25T13:41:04.143 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-04-25T13:41:04.143 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000369438 s, 1.4 MB/s 2024-04-25T13:41:04.145 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T13:41:04.199 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T13:41:04.199 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:41:04.199 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T13:41:04.207 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T13:41:04.207 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_1 2024-04-25T13:41:04.256 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T13:41:04.256 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:41:04.256 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 6h/6d Inode: 879 Links: 1 2024-04-25T13:41:04.256 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:41:04.256 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-04-25 13:34:43.046661260 +0000 2024-04-25T13:41:04.257 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-04-25 13:34:42.754663867 +0000 2024-04-25T13:41:04.257 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-04-25 13:34:42.754663867 +0000 2024-04-25T13:41:04.257 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-04-25 13:34:42.754663867 +0000 2024-04-25T13:41:04.257 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T13:41:04.318 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-04-25T13:41:04.318 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-04-25T13:41:04.318 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000381528 s, 1.3 MB/s 2024-04-25T13:41:04.320 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T13:41:04.374 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_2 2024-04-25T13:41:04.424 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T13:41:04.424 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:41:04.424 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 6h/6d Inode: 896 Links: 1 2024-04-25T13:41:04.424 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:41:04.424 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-04-25 13:34:43.586656436 +0000 2024-04-25T13:41:04.424 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-04-25 13:34:43.346658579 +0000 2024-04-25T13:41:04.424 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-04-25 13:34:43.346658579 +0000 2024-04-25T13:41:04.424 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-04-25 13:34:43.346658579 +0000 2024-04-25T13:41:04.425 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T13:41:04.485 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-04-25T13:41:04.485 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-04-25T13:41:04.485 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000347983 s, 1.5 MB/s 2024-04-25T13:41:04.487 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T13:41:04.538 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_3 2024-04-25T13:41:04.588 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T13:41:04.588 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:41:04.588 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 6h/6d Inode: 912 Links: 1 2024-04-25T13:41:04.588 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:41:04.588 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-04-25 13:34:44.110651756 +0000 2024-04-25T13:41:04.588 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-04-25 13:34:43.874653864 +0000 2024-04-25T13:41:04.589 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-04-25 13:34:43.878653828 +0000 2024-04-25T13:41:04.589 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-04-25 13:34:43.874653864 +0000 2024-04-25T13:41:04.589 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T13:41:04.653 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-04-25T13:41:04.654 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-04-25T13:41:04.654 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000645804 s, 793 kB/s 2024-04-25T13:41:04.656 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T13:41:04.709 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_4 2024-04-25T13:41:04.764 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T13:41:04.764 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T13:41:04.764 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 6h/6d Inode: 929 Links: 1 2024-04-25T13:41:04.764 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T13:41:04.764 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-04-25 13:34:44.694646539 +0000 2024-04-25T13:41:04.764 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-04-25 13:34:44.434648862 +0000 2024-04-25T13:41:04.764 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-04-25 13:34:44.434648862 +0000 2024-04-25T13:41:04.764 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-04-25 13:34:44.434648862 +0000 2024-04-25T13:41:04.765 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T13:41:04.825 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-04-25T13:41:04.825 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-04-25T13:41:04.825 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000373174 s, 1.4 MB/s 2024-04-25T13:41:04.827 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T13:41:04.877 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T13:41:04.877 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi123.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi130.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T13:41:04.878 INFO:tasks.ceph:Generating config... 2024-04-25T13:41:04.879 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T13:41:04.879 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T13:41:04.879 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T13:41:04.879 INFO:tasks.ceph:[client] pid file = 2024-04-25T13:41:04.879 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T13:41:04.879 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T13:41:04.879 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-25T13:41:04.879 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T13:41:04.879 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T13:41:04.880 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T13:41:04.880 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T13:41:04.880 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T13:41:04.880 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T13:41:04.880 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T13:41:04.880 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T13:41:04.880 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T13:41:04.880 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T13:41:04.880 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-25T13:41:04.880 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T13:41:04.880 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T13:41:04.880 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T13:41:04.880 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T13:41:04.880 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T13:41:04.880 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-25T13:41:04.880 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T13:41:04.881 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-25T13:41:04.881 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-25T13:41:04.881 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-25T13:41:04.881 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T13:41:04.881 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T13:41:04.881 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-25T13:41:04.881 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-25T13:41:04.881 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T13:41:04.881 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T13:41:04.881 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-25T13:41:04.881 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T13:41:04.881 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T13:41:04.881 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T13:41:04.881 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T13:41:04.881 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T13:41:04.881 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T13:41:04.882 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T13:41:04.882 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T13:41:04.937 INFO:teuthology.orchestra.run.smithi123.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T13:41:04.952 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T13:41:05.009 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T13:41:05.028 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.123'), ('mon.b', '172.21.15.130'), ('mon.c', '[v2:172.21.15.130:3301,v1:172.21.15.130:6790]')] 2024-04-25T13:41:05.028 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.123,172.21.15.130,[v2:172.21.15.130:3301,v1:172.21.15.130:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T13:41:05.029 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:41:05.029 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T13:41:05.076 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.123 --add b 172.21.15.130 --addv c '[v2:172.21.15.130:3301,v1:172.21.15.130:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:41:05.172 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:41:05.172 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool: generated fsid 95274ccf-6ec8-480a-933e-b3986da91a7e 2024-04-25T13:41:05.172 INFO:teuthology.orchestra.run.smithi123.stdout:setting min_mon_release = quincy 2024-04-25T13:41:05.172 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 0 2024-04-25T13:41:05.172 INFO:teuthology.orchestra.run.smithi123.stdout:fsid 95274ccf-6ec8-480a-933e-b3986da91a7e 2024-04-25T13:41:05.172 INFO:teuthology.orchestra.run.smithi123.stdout:last_changed 2024-04-25T13:41:05.177170+0000 2024-04-25T13:41:05.172 INFO:teuthology.orchestra.run.smithi123.stdout:created 2024-04-25T13:41:05.177170+0000 2024-04-25T13:41:05.172 INFO:teuthology.orchestra.run.smithi123.stdout:min_mon_release 17 (quincy) 2024-04-25T13:41:05.172 INFO:teuthology.orchestra.run.smithi123.stdout:election_strategy: 1 2024-04-25T13:41:05.172 INFO:teuthology.orchestra.run.smithi123.stdout:0: [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon.a 2024-04-25T13:41:05.172 INFO:teuthology.orchestra.run.smithi123.stdout:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-04-25T13:41:05.173 INFO:teuthology.orchestra.run.smithi123.stdout:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2024-04-25T13:41:05.173 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T13:41:05.175 DEBUG:teuthology.orchestra.run.smithi123:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T13:41:05.184 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 95274ccf-6ec8-480a-933e-b3986da91a7e... 2024-04-25T13:41:05.184 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T13:41:05.231 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T13:41:05.269 INFO:teuthology.orchestra.run.smithi123.stdout:[global] 2024-04-25T13:41:05.269 INFO:teuthology.orchestra.run.smithi123.stdout: chdir = "" 2024-04-25T13:41:05.269 INFO:teuthology.orchestra.run.smithi123.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T13:41:05.270 INFO:teuthology.orchestra.run.smithi123.stdout: auth supported = cephx 2024-04-25T13:41:05.270 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.270 INFO:teuthology.orchestra.run.smithi123.stdout: filestore xattr use omap = true 2024-04-25T13:41:05.270 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.270 INFO:teuthology.orchestra.run.smithi123.stdout: mon clock drift allowed = 1.000 2024-04-25T13:41:05.270 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.270 INFO:teuthology.orchestra.run.smithi123.stdout: osd crush chooseleaf type = 0 2024-04-25T13:41:05.270 INFO:teuthology.orchestra.run.smithi123.stdout: auth debug = true 2024-04-25T13:41:05.270 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.270 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on old message = true 2024-04-25T13:41:05.270 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on bug = true 2024-04-25T13:41:05.271 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.271 INFO:teuthology.orchestra.run.smithi123.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T13:41:05.271 INFO:teuthology.orchestra.run.smithi123.stdout: mon pg warn max object skew = 0 2024-04-25T13:41:05.271 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.271 INFO:teuthology.orchestra.run.smithi123.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T13:41:05.271 INFO:teuthology.orchestra.run.smithi123.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T13:41:05.271 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.271 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default size = 2 2024-04-25T13:41:05.271 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.271 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow primary affinity = true 2024-04-25T13:41:05.271 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd allow pg remap = true 2024-04-25T13:41:05.271 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on legacy crush tunables = false 2024-04-25T13:41:05.271 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on crush straw calc version zero = false 2024-04-25T13:41:05.271 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on no sortbitwise = false 2024-04-25T13:41:05.271 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on osd down out interval zero = false 2024-04-25T13:41:05.272 INFO:teuthology.orchestra.run.smithi123.stdout: mon warn on too few osds = false 2024-04-25T13:41:05.272 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T13:41:05.272 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T13:41:05.272 INFO:teuthology.orchestra.run.smithi123.stdout: mon_allow_pool_size_one = true 2024-04-25T13:41:05.272 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.272 INFO:teuthology.orchestra.run.smithi123.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T13:41:05.272 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.272 INFO:teuthology.orchestra.run.smithi123.stdout: osd default data pool replay window = 5 2024-04-25T13:41:05.272 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.272 INFO:teuthology.orchestra.run.smithi123.stdout: mon allow pool delete = true 2024-04-25T13:41:05.272 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.272 INFO:teuthology.orchestra.run.smithi123.stdout: mon cluster log file level = debug 2024-04-25T13:41:05.272 INFO:teuthology.orchestra.run.smithi123.stdout: debug asserts on shutdown = true 2024-04-25T13:41:05.273 INFO:teuthology.orchestra.run.smithi123.stdout: mon health detail to clog = false 2024-04-25T13:41:05.273 INFO:teuthology.orchestra.run.smithi123.stdout: mon host = "172.21.15.123,172.21.15.130,[v2:172.21.15.130:3301,v1:172.21.15.130:6790]" 2024-04-25T13:41:05.273 INFO:teuthology.orchestra.run.smithi123.stdout: ms die on skipped message = False 2024-04-25T13:41:05.273 INFO:teuthology.orchestra.run.smithi123.stdout: fsid = 95274ccf-6ec8-480a-933e-b3986da91a7e 2024-04-25T13:41:05.273 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.273 INFO:teuthology.orchestra.run.smithi123.stdout:[osd] 2024-04-25T13:41:05.273 INFO:teuthology.orchestra.run.smithi123.stdout: osd journal size = 100 2024-04-25T13:41:05.273 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.273 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub load threshold = 5.0 2024-04-25T13:41:05.273 INFO:teuthology.orchestra.run.smithi123.stdout: osd scrub max interval = 600 2024-04-25T13:41:05.273 INFO:teuthology.orchestra.run.smithi123.stdout: osd mclock profile = high_recovery_ops 2024-04-25T13:41:05.274 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.274 INFO:teuthology.orchestra.run.smithi123.stdout: osd recover clone overlap = true 2024-04-25T13:41:05.274 INFO:teuthology.orchestra.run.smithi123.stdout: osd recovery max chunk = 1048576 2024-04-25T13:41:05.274 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.274 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug shutdown = true 2024-04-25T13:41:05.274 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug op order = true 2024-04-25T13:41:05.274 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug verify stray on activate = true 2024-04-25T13:41:05.274 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug trim objects = true 2024-04-25T13:41:05.274 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.274 INFO:teuthology.orchestra.run.smithi123.stdout: osd open classes on start = true 2024-04-25T13:41:05.274 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug pg log writeout = true 2024-04-25T13:41:05.274 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.275 INFO:teuthology.orchestra.run.smithi123.stdout: osd deep scrub update digest min age = 30 2024-04-25T13:41:05.275 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.275 INFO:teuthology.orchestra.run.smithi123.stdout: osd map max advance = 10 2024-04-25T13:41:05.275 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.275 INFO:teuthology.orchestra.run.smithi123.stdout: journal zero on create = true 2024-04-25T13:41:05.275 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.275 INFO:teuthology.orchestra.run.smithi123.stdout: filestore ondisk finisher threads = 3 2024-04-25T13:41:05.275 INFO:teuthology.orchestra.run.smithi123.stdout: filestore apply finisher threads = 3 2024-04-25T13:41:05.275 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.275 INFO:teuthology.orchestra.run.smithi123.stdout: bdev debug aio = true 2024-04-25T13:41:05.275 INFO:teuthology.orchestra.run.smithi123.stdout: osd debug misdirected ops = true 2024-04-25T13:41:05.275 INFO:teuthology.orchestra.run.smithi123.stdout: bdev async discard = True 2024-04-25T13:41:05.276 INFO:teuthology.orchestra.run.smithi123.stdout: bdev enable discard = True 2024-04-25T13:41:05.276 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore allocator = bitmap 2024-04-25T13:41:05.276 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore block size = 96636764160 2024-04-25T13:41:05.276 INFO:teuthology.orchestra.run.smithi123.stdout: bluestore fsck on mount = True 2024-04-25T13:41:05.276 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluefs = 1/20 2024-04-25T13:41:05.276 INFO:teuthology.orchestra.run.smithi123.stdout: debug bluestore = 1/20 2024-04-25T13:41:05.276 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-04-25T13:41:05.276 INFO:teuthology.orchestra.run.smithi123.stdout: debug osd = 20 2024-04-25T13:41:05.276 INFO:teuthology.orchestra.run.smithi123.stdout: debug rocksdb = 4/10 2024-04-25T13:41:05.276 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T13:41:05.276 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd full ratio = 0.9 2024-04-25T13:41:05.276 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd nearfull ratio = 0.8 2024-04-25T13:41:05.277 INFO:teuthology.orchestra.run.smithi123.stdout: osd failsafe full ratio = 0.95 2024-04-25T13:41:05.277 INFO:teuthology.orchestra.run.smithi123.stdout: osd objectstore = bluestore 2024-04-25T13:41:05.277 INFO:teuthology.orchestra.run.smithi123.stdout: osd op complaint time = 180 2024-04-25T13:41:05.277 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.277 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr] 2024-04-25T13:41:05.277 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-04-25T13:41:05.277 INFO:teuthology.orchestra.run.smithi123.stdout: debug mgr = 20 2024-04-25T13:41:05.277 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2024-04-25T13:41:05.277 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2024-04-25T13:41:05.277 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2024-04-25T13:41:05.277 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2024-04-25T13:41:05.277 INFO:teuthology.orchestra.run.smithi123.stdout: mgr/telemetry/nag = false 2024-04-25T13:41:05.278 INFO:teuthology.orchestra.run.smithi123.stdout: debug client = 20 2024-04-25T13:41:05.278 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.278 INFO:teuthology.orchestra.run.smithi123.stdout:[mon] 2024-04-25T13:41:05.278 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-04-25T13:41:05.278 INFO:teuthology.orchestra.run.smithi123.stdout: debug mon = 20 2024-04-25T13:41:05.278 INFO:teuthology.orchestra.run.smithi123.stdout: debug paxos = 20 2024-04-25T13:41:05.278 INFO:teuthology.orchestra.run.smithi123.stdout: debug auth = 20 2024-04-25T13:41:05.278 INFO:teuthology.orchestra.run.smithi123.stdout: mon data avail warn = 5 2024-04-25T13:41:05.278 INFO:teuthology.orchestra.run.smithi123.stdout: mon mgr mkfs grace = 240 2024-04-25T13:41:05.278 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min pgs per osd = 4 2024-04-25T13:41:05.278 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd reporter subtree level = osd 2024-04-25T13:41:05.278 INFO:teuthology.orchestra.run.smithi123.stdout: mon osd prime pg temp = true 2024-04-25T13:41:05.278 INFO:teuthology.orchestra.run.smithi123.stdout: mon reweight min bytes per osd = 10 2024-04-25T13:41:05.279 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.279 INFO:teuthology.orchestra.run.smithi123.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T13:41:05.279 INFO:teuthology.orchestra.run.smithi123.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T13:41:05.279 INFO:teuthology.orchestra.run.smithi123.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T13:41:05.279 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.279 INFO:teuthology.orchestra.run.smithi123.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T13:41:05.279 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T13:41:05.279 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T13:41:05.279 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.279 INFO:teuthology.orchestra.run.smithi123.stdout: # 1m isn't quite enough 2024-04-25T13:41:05.280 INFO:teuthology.orchestra.run.smithi123.stdout: mon_down_mkfs_grace = 2m 2024-04-25T13:41:05.280 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.280 INFO:teuthology.orchestra.run.smithi123.stdout: mon_warn_on_filestore_osds = false 2024-04-25T13:41:05.280 INFO:teuthology.orchestra.run.smithi123.stdout: mon down mkfs grace = 300 2024-04-25T13:41:05.280 INFO:teuthology.orchestra.run.smithi123.stdout: mon op complaint time = 120 2024-04-25T13:41:05.280 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:05.280 INFO:teuthology.orchestra.run.smithi123.stdout:[client] 2024-04-25T13:41:05.280 INFO:teuthology.orchestra.run.smithi123.stdout: rgw cache enabled = true 2024-04-25T13:41:05.280 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable ops log = true 2024-04-25T13:41:05.280 INFO:teuthology.orchestra.run.smithi123.stdout: rgw enable usage log = true 2024-04-25T13:41:05.280 INFO:teuthology.orchestra.run.smithi123.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T13:41:05.280 INFO:teuthology.orchestra.run.smithi123.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T13:41:05.280 INFO:teuthology.orchestra.run.smithi123.stdout: client mount timeout = 600 2024-04-25T13:41:05.281 INFO:teuthology.orchestra.run.smithi123.stdout: debug client = 20 2024-04-25T13:41:05.281 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-04-25T13:41:05.281 INFO:teuthology.orchestra.run.smithi123.stdout: pid file = "" 2024-04-25T13:41:05.281 INFO:teuthology.orchestra.run.smithi123.stdout: rados mon op timeout = 900 2024-04-25T13:41:05.281 INFO:teuthology.orchestra.run.smithi123.stdout: rados osd op timeout = 900 2024-04-25T13:41:05.281 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.a] 2024-04-25T13:41:05.281 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.b] 2024-04-25T13:41:05.281 INFO:teuthology.orchestra.run.smithi123.stdout:[mon.c] 2024-04-25T13:41:05.281 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.a] 2024-04-25T13:41:05.281 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.c] 2024-04-25T13:41:05.281 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.b] 2024-04-25T13:41:05.281 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.d] 2024-04-25T13:41:05.281 INFO:teuthology.orchestra.run.smithi123.stdout:[mds] 2024-04-25T13:41:05.281 INFO:teuthology.orchestra.run.smithi123.stdout: debug mds = 20 2024-04-25T13:41:05.282 INFO:teuthology.orchestra.run.smithi123.stdout: debug mds balancer = 20 2024-04-25T13:41:05.282 INFO:teuthology.orchestra.run.smithi123.stdout: debug ms = 1 2024-04-25T13:41:05.282 INFO:teuthology.orchestra.run.smithi123.stdout: mds debug frag = True 2024-04-25T13:41:05.282 INFO:teuthology.orchestra.run.smithi123.stdout: mds debug scatterstat = True 2024-04-25T13:41:05.282 INFO:teuthology.orchestra.run.smithi123.stdout: mds op complaint time = 180 2024-04-25T13:41:05.282 INFO:teuthology.orchestra.run.smithi123.stdout: mds verify scatter = True 2024-04-25T13:41:05.282 INFO:teuthology.orchestra.run.smithi123.stdout: osd op complaint time = 180 2024-04-25T13:41:05.282 INFO:teuthology.orchestra.run.smithi123.stdout: rados mon op timeout = 900 2024-04-25T13:41:05.282 INFO:teuthology.orchestra.run.smithi123.stdout: rados osd op timeout = 900 2024-04-25T13:41:05.282 INFO:teuthology.orchestra.run.smithi130.stdout:[global] 2024-04-25T13:41:05.283 INFO:teuthology.orchestra.run.smithi130.stdout: chdir = "" 2024-04-25T13:41:05.283 INFO:teuthology.orchestra.run.smithi130.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T13:41:05.283 INFO:teuthology.orchestra.run.smithi130.stdout: auth supported = cephx 2024-04-25T13:41:05.283 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.283 INFO:teuthology.orchestra.run.smithi130.stdout: filestore xattr use omap = true 2024-04-25T13:41:05.283 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.283 INFO:teuthology.orchestra.run.smithi130.stdout: mon clock drift allowed = 1.000 2024-04-25T13:41:05.283 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.283 INFO:teuthology.orchestra.run.smithi130.stdout: osd crush chooseleaf type = 0 2024-04-25T13:41:05.283 INFO:teuthology.orchestra.run.smithi130.stdout: auth debug = true 2024-04-25T13:41:05.283 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.284 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on old message = true 2024-04-25T13:41:05.284 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on bug = true 2024-04-25T13:41:05.284 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.284 INFO:teuthology.orchestra.run.smithi130.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T13:41:05.284 INFO:teuthology.orchestra.run.smithi130.stdout: mon pg warn max object skew = 0 2024-04-25T13:41:05.284 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.284 INFO:teuthology.orchestra.run.smithi130.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T13:41:05.284 INFO:teuthology.orchestra.run.smithi130.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T13:41:05.284 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.284 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default size = 2 2024-04-25T13:41:05.284 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.284 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow primary affinity = true 2024-04-25T13:41:05.284 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow pg remap = true 2024-04-25T13:41:05.285 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on legacy crush tunables = false 2024-04-25T13:41:05.285 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on crush straw calc version zero = false 2024-04-25T13:41:05.285 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on no sortbitwise = false 2024-04-25T13:41:05.285 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on osd down out interval zero = false 2024-04-25T13:41:05.285 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on too few osds = false 2024-04-25T13:41:05.285 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T13:41:05.285 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T13:41:05.285 INFO:teuthology.orchestra.run.smithi130.stdout: mon_allow_pool_size_one = true 2024-04-25T13:41:05.285 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.285 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T13:41:05.285 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.285 INFO:teuthology.orchestra.run.smithi130.stdout: osd default data pool replay window = 5 2024-04-25T13:41:05.285 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.285 INFO:teuthology.orchestra.run.smithi130.stdout: mon allow pool delete = true 2024-04-25T13:41:05.285 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.286 INFO:teuthology.orchestra.run.smithi130.stdout: mon cluster log file level = debug 2024-04-25T13:41:05.286 INFO:teuthology.orchestra.run.smithi130.stdout: debug asserts on shutdown = true 2024-04-25T13:41:05.286 INFO:teuthology.orchestra.run.smithi130.stdout: mon health detail to clog = false 2024-04-25T13:41:05.286 INFO:teuthology.orchestra.run.smithi130.stdout: mon host = "172.21.15.123,172.21.15.130,[v2:172.21.15.130:3301,v1:172.21.15.130:6790]" 2024-04-25T13:41:05.286 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on skipped message = False 2024-04-25T13:41:05.286 INFO:teuthology.orchestra.run.smithi130.stdout: fsid = 95274ccf-6ec8-480a-933e-b3986da91a7e 2024-04-25T13:41:05.286 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.286 INFO:teuthology.orchestra.run.smithi130.stdout:[osd] 2024-04-25T13:41:05.286 INFO:teuthology.orchestra.run.smithi130.stdout: osd journal size = 100 2024-04-25T13:41:05.286 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.286 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub load threshold = 5.0 2024-04-25T13:41:05.286 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub max interval = 600 2024-04-25T13:41:05.286 INFO:teuthology.orchestra.run.smithi130.stdout: osd mclock profile = high_recovery_ops 2024-04-25T13:41:05.286 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.287 INFO:teuthology.orchestra.run.smithi130.stdout: osd recover clone overlap = true 2024-04-25T13:41:05.287 INFO:teuthology.orchestra.run.smithi130.stdout: osd recovery max chunk = 1048576 2024-04-25T13:41:05.287 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.287 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug shutdown = true 2024-04-25T13:41:05.287 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug op order = true 2024-04-25T13:41:05.287 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug verify stray on activate = true 2024-04-25T13:41:05.287 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug trim objects = true 2024-04-25T13:41:05.287 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.287 INFO:teuthology.orchestra.run.smithi130.stdout: osd open classes on start = true 2024-04-25T13:41:05.287 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug pg log writeout = true 2024-04-25T13:41:05.287 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.287 INFO:teuthology.orchestra.run.smithi130.stdout: osd deep scrub update digest min age = 30 2024-04-25T13:41:05.287 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.287 INFO:teuthology.orchestra.run.smithi130.stdout: osd map max advance = 10 2024-04-25T13:41:05.288 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.288 INFO:teuthology.orchestra.run.smithi130.stdout: journal zero on create = true 2024-04-25T13:41:05.288 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.288 INFO:teuthology.orchestra.run.smithi130.stdout: filestore ondisk finisher threads = 3 2024-04-25T13:41:05.288 INFO:teuthology.orchestra.run.smithi130.stdout: filestore apply finisher threads = 3 2024-04-25T13:41:05.288 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.288 INFO:teuthology.orchestra.run.smithi130.stdout: bdev debug aio = true 2024-04-25T13:41:05.288 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug misdirected ops = true 2024-04-25T13:41:05.288 INFO:teuthology.orchestra.run.smithi130.stdout: bdev async discard = True 2024-04-25T13:41:05.288 INFO:teuthology.orchestra.run.smithi130.stdout: bdev enable discard = True 2024-04-25T13:41:05.288 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore allocator = bitmap 2024-04-25T13:41:05.288 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore block size = 96636764160 2024-04-25T13:41:05.288 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore fsck on mount = True 2024-04-25T13:41:05.288 INFO:teuthology.orchestra.run.smithi130.stdout: debug bluefs = 1/20 2024-04-25T13:41:05.289 INFO:teuthology.orchestra.run.smithi130.stdout: debug bluestore = 1/20 2024-04-25T13:41:05.289 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2024-04-25T13:41:05.289 INFO:teuthology.orchestra.run.smithi130.stdout: debug osd = 20 2024-04-25T13:41:05.289 INFO:teuthology.orchestra.run.smithi130.stdout: debug rocksdb = 4/10 2024-04-25T13:41:05.289 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T13:41:05.289 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd full ratio = 0.9 2024-04-25T13:41:05.289 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd nearfull ratio = 0.8 2024-04-25T13:41:05.289 INFO:teuthology.orchestra.run.smithi130.stdout: osd failsafe full ratio = 0.95 2024-04-25T13:41:05.289 INFO:teuthology.orchestra.run.smithi130.stdout: osd objectstore = bluestore 2024-04-25T13:41:05.289 INFO:teuthology.orchestra.run.smithi130.stdout: osd op complaint time = 180 2024-04-25T13:41:05.289 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.289 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr] 2024-04-25T13:41:05.289 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2024-04-25T13:41:05.289 INFO:teuthology.orchestra.run.smithi130.stdout: debug mgr = 20 2024-04-25T13:41:05.289 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2024-04-25T13:41:05.290 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2024-04-25T13:41:05.290 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2024-04-25T13:41:05.290 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2024-04-25T13:41:05.290 INFO:teuthology.orchestra.run.smithi130.stdout: mgr/telemetry/nag = false 2024-04-25T13:41:05.290 INFO:teuthology.orchestra.run.smithi130.stdout: debug client = 20 2024-04-25T13:41:05.290 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.290 INFO:teuthology.orchestra.run.smithi130.stdout:[mon] 2024-04-25T13:41:05.290 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2024-04-25T13:41:05.290 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2024-04-25T13:41:05.290 INFO:teuthology.orchestra.run.smithi130.stdout: debug paxos = 20 2024-04-25T13:41:05.290 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2024-04-25T13:41:05.290 INFO:teuthology.orchestra.run.smithi130.stdout: mon data avail warn = 5 2024-04-25T13:41:05.290 INFO:teuthology.orchestra.run.smithi130.stdout: mon mgr mkfs grace = 240 2024-04-25T13:41:05.290 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2024-04-25T13:41:05.291 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd reporter subtree level = osd 2024-04-25T13:41:05.291 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd prime pg temp = true 2024-04-25T13:41:05.291 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2024-04-25T13:41:05.291 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.291 INFO:teuthology.orchestra.run.smithi130.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T13:41:05.291 INFO:teuthology.orchestra.run.smithi130.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T13:41:05.291 INFO:teuthology.orchestra.run.smithi130.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T13:41:05.291 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.291 INFO:teuthology.orchestra.run.smithi130.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T13:41:05.291 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T13:41:05.291 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T13:41:05.291 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.291 INFO:teuthology.orchestra.run.smithi130.stdout: # 1m isn't quite enough 2024-04-25T13:41:05.292 INFO:teuthology.orchestra.run.smithi130.stdout: mon_down_mkfs_grace = 2m 2024-04-25T13:41:05.292 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.292 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_filestore_osds = false 2024-04-25T13:41:05.292 INFO:teuthology.orchestra.run.smithi130.stdout: mon down mkfs grace = 300 2024-04-25T13:41:05.292 INFO:teuthology.orchestra.run.smithi130.stdout: mon op complaint time = 120 2024-04-25T13:41:05.292 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-04-25T13:41:05.292 INFO:teuthology.orchestra.run.smithi130.stdout:[client] 2024-04-25T13:41:05.292 INFO:teuthology.orchestra.run.smithi130.stdout: rgw cache enabled = true 2024-04-25T13:41:05.292 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable ops log = true 2024-04-25T13:41:05.293 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable usage log = true 2024-04-25T13:41:05.293 INFO:teuthology.orchestra.run.smithi130.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T13:41:05.293 INFO:teuthology.orchestra.run.smithi130.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T13:41:05.293 INFO:teuthology.orchestra.run.smithi130.stdout: client mount timeout = 600 2024-04-25T13:41:05.293 INFO:teuthology.orchestra.run.smithi130.stdout: debug client = 20 2024-04-25T13:41:05.293 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2024-04-25T13:41:05.293 INFO:teuthology.orchestra.run.smithi130.stdout: pid file = "" 2024-04-25T13:41:05.293 INFO:teuthology.orchestra.run.smithi130.stdout: rados mon op timeout = 900 2024-04-25T13:41:05.293 INFO:teuthology.orchestra.run.smithi130.stdout: rados osd op timeout = 900 2024-04-25T13:41:05.293 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.a] 2024-04-25T13:41:05.293 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.b] 2024-04-25T13:41:05.293 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.c] 2024-04-25T13:41:05.294 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.a] 2024-04-25T13:41:05.294 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.c] 2024-04-25T13:41:05.294 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.b] 2024-04-25T13:41:05.294 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.d] 2024-04-25T13:41:05.294 INFO:teuthology.orchestra.run.smithi130.stdout:[mds] 2024-04-25T13:41:05.294 INFO:teuthology.orchestra.run.smithi130.stdout: debug mds = 20 2024-04-25T13:41:05.294 INFO:teuthology.orchestra.run.smithi130.stdout: debug mds balancer = 20 2024-04-25T13:41:05.294 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2024-04-25T13:41:05.294 INFO:teuthology.orchestra.run.smithi130.stdout: mds debug frag = True 2024-04-25T13:41:05.294 INFO:teuthology.orchestra.run.smithi130.stdout: mds debug scatterstat = True 2024-04-25T13:41:05.294 INFO:teuthology.orchestra.run.smithi130.stdout: mds op complaint time = 180 2024-04-25T13:41:05.294 INFO:teuthology.orchestra.run.smithi130.stdout: mds verify scatter = True 2024-04-25T13:41:05.294 INFO:teuthology.orchestra.run.smithi130.stdout: osd op complaint time = 180 2024-04-25T13:41:05.294 INFO:teuthology.orchestra.run.smithi130.stdout: rados mon op timeout = 900 2024-04-25T13:41:05.295 INFO:teuthology.orchestra.run.smithi130.stdout: rados osd op timeout = 900 2024-04-25T13:41:05.296 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T13:41:05.296 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T13:41:05.406 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T13:41:05.406 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:41:05.406 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T13:41:05.415 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:41:05.415 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T13:41:05.464 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi123.front.sepia.ceph.com 2024-04-25T13:41:05.464 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:41:05.464 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T13:41:05.464 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T13:41:05.538 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:41:05.538 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:41:05.587 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi130.front.sepia.ceph.com 2024-04-25T13:41:05.588 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:41:05.588 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T13:41:05.588 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T13:41:05.623 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:41:05.623 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:41:05.672 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T13:41:05.672 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T13:41:05.672 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T13:41:05.735 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T13:41:05.741 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T13:41:05.809 INFO:teuthology.orchestra.run.smithi130.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T13:41:05.832 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T13:41:05.832 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T13:41:05.895 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T13:41:05.900 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T13:41:05.920 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T13:41:06.022 INFO:teuthology.orchestra.run.smithi123.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T13:41:06.027 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-25T13:41:06.046 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T13:41:06.113 INFO:teuthology.orchestra.run.smithi130.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T13:41:06.118 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T13:41:06.138 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T13:41:06.243 INFO:teuthology.orchestra.run.smithi130.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T13:41:06.248 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-25T13:41:06.267 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T13:41:06.268 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T13:41:06.318 INFO:teuthology.orchestra.run.smithi123.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T13:41:06.336 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-25T13:41:06.386 INFO:teuthology.orchestra.run.smithi123.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-25T13:41:06.403 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-25T13:41:06.454 INFO:teuthology.orchestra.run.smithi130.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-25T13:41:06.471 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-25T13:41:06.522 INFO:teuthology.orchestra.run.smithi130.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-25T13:41:06.539 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T13:41:06.539 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi123.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi130.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T13:41:06.539 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T13:41:06.558 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T13:41:06.558 INFO:tasks.ceph:role: osd.0 2024-04-25T13:41:06.558 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi123.front.sepia.ceph.com 2024-04-25T13:41:06.558 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T13:41:06.626 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:41:06.626 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:41:06.626 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:41:06.626 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T13:41:06.626 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:41:06.626 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:41:06.627 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:41:06.627 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T13:41:06.627 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:41:06.627 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:41:07.025 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2024-04-25T13:41:07.027 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2024-04-25T13:41:07.027 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T13:41:07.126 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T13:41:07.141 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T13:41:07.142 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:41:07.143 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T13:41:07.203 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T13:41:07.203 INFO:tasks.ceph:role: osd.1 2024-04-25T13:41:07.203 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi123.front.sepia.ceph.com 2024-04-25T13:41:07.203 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T13:41:07.271 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:41:07.271 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:41:07.271 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:41:07.271 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T13:41:07.271 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:41:07.271 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:41:07.271 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:41:07.271 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T13:41:07.271 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:41:07.272 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:41:07.669 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2024-04-25T13:41:07.672 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2024-04-25T13:41:07.672 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T13:41:07.804 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T13:41:07.820 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T13:41:07.821 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:41:07.821 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T13:41:07.883 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T13:41:07.883 INFO:tasks.ceph:role: osd.2 2024-04-25T13:41:07.883 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi123.front.sepia.ceph.com 2024-04-25T13:41:07.883 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T13:41:07.954 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:41:07.955 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:41:07.955 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:41:07.955 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T13:41:07.955 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:41:07.955 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:41:07.955 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:41:07.955 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T13:41:07.955 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:41:07.955 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:41:08.377 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2024-04-25T13:41:08.380 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2024-04-25T13:41:08.380 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T13:41:08.499 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T13:41:08.515 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T13:41:08.516 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:41:08.517 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T13:41:08.580 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T13:41:08.580 INFO:tasks.ceph:role: osd.3 2024-04-25T13:41:08.580 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi123.front.sepia.ceph.com 2024-04-25T13:41:08.580 DEBUG:teuthology.orchestra.run.smithi123:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T13:41:08.648 INFO:teuthology.orchestra.run.smithi123.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:41:08.648 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:41:08.648 INFO:teuthology.orchestra.run.smithi123.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:41:08.649 INFO:teuthology.orchestra.run.smithi123.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T13:41:08.649 INFO:teuthology.orchestra.run.smithi123.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:41:08.649 INFO:teuthology.orchestra.run.smithi123.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:41:08.649 INFO:teuthology.orchestra.run.smithi123.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:41:08.649 INFO:teuthology.orchestra.run.smithi123.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T13:41:08.649 INFO:teuthology.orchestra.run.smithi123.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:41:08.649 INFO:teuthology.orchestra.run.smithi123.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:41:09.042 INFO:teuthology.orchestra.run.smithi123.stdout:Discarding blocks...Done. 2024-04-25T13:41:09.044 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi123.front.sepia.ceph.com -o noatime 2024-04-25T13:41:09.044 DEBUG:teuthology.orchestra.run.smithi123:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T13:41:09.135 DEBUG:teuthology.orchestra.run.smithi123:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T13:41:09.151 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T13:41:09.152 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:41:09.152 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:41:09.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:09.286+0000 7f7b0e48e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T13:41:09.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:09.290+0000 7f7b0e48e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T13:41:09.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:09.290+0000 7f7b0e48e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T13:41:09.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:09.290+0000 7f7b0e48e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T13:41:09.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:09.290+0000 7f7b0e48e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T13:41:09.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:09.298+0000 7f7b0e48e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T13:41:12.318 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T13:41:12.338 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:41:12.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:12.450+0000 7fee67e2b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T13:41:12.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:12.450+0000 7fee67e2b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T13:41:12.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:12.450+0000 7fee67e2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T13:41:12.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:12.450+0000 7fee67e2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T13:41:12.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:12.450+0000 7fee67e2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T13:41:12.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:12.450+0000 7fee67e2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T13:41:15.470 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T13:41:15.491 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:41:15.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:15.602+0000 7fdb3d1367c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T13:41:15.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:15.602+0000 7fdb3d1367c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T13:41:15.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:15.602+0000 7fdb3d1367c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T13:41:15.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:15.602+0000 7fdb3d1367c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T13:41:15.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:15.602+0000 7fdb3d1367c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T13:41:15.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:15.606+0000 7fdb3d1367c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T13:41:18.644 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T13:41:18.664 DEBUG:teuthology.orchestra.run.smithi123:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:41:18.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:18.766+0000 7f2dec28c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T13:41:18.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:18.766+0000 7f2dec28c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T13:41:18.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:18.766+0000 7f2dec28c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T13:41:18.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:18.766+0000 7f2dec28c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T13:41:18.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:18.766+0000 7f2dec28c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T13:41:18.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:18.770+0000 7f2dec28c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T13:41:21.840 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T13:41:21.860 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T13:41:21.882 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T13:41:21.882 INFO:tasks.ceph:role: osd.4 2024-04-25T13:41:21.882 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi130.front.sepia.ceph.com 2024-04-25T13:41:21.882 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T13:41:21.956 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:41:21.956 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:41:21.956 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:41:21.956 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T13:41:21.956 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:41:21.956 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:41:21.956 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:41:21.956 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T13:41:21.956 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:41:21.957 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:41:22.355 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-04-25T13:41:22.358 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-04-25T13:41:22.358 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T13:41:22.462 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T13:41:22.479 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T13:41:22.479 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:41:22.480 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T13:41:22.547 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T13:41:22.548 INFO:tasks.ceph:role: osd.5 2024-04-25T13:41:22.548 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi130.front.sepia.ceph.com 2024-04-25T13:41:22.548 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T13:41:22.623 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:41:22.623 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:41:22.623 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:41:22.623 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T13:41:22.623 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:41:22.623 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:41:22.623 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:41:22.623 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T13:41:22.623 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:41:22.623 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:41:23.029 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-04-25T13:41:23.032 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-04-25T13:41:23.033 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T13:41:23.161 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T13:41:23.177 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T13:41:23.178 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:41:23.178 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T13:41:23.243 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T13:41:23.243 INFO:tasks.ceph:role: osd.6 2024-04-25T13:41:23.243 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi130.front.sepia.ceph.com 2024-04-25T13:41:23.243 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T13:41:23.315 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:41:23.315 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:41:23.315 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:41:23.315 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T13:41:23.315 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:41:23.315 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:41:23.315 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:41:23.315 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T13:41:23.315 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:41:23.315 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:41:23.724 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-04-25T13:41:23.727 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-04-25T13:41:23.727 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T13:41:23.868 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T13:41:23.885 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T13:41:23.886 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:41:23.886 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T13:41:23.952 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T13:41:23.952 INFO:tasks.ceph:role: osd.7 2024-04-25T13:41:23.952 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi130.front.sepia.ceph.com 2024-04-25T13:41:23.952 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T13:41:24.027 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T13:41:24.028 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T13:41:24.028 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T13:41:24.028 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T13:41:24.028 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T13:41:24.028 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2024-04-25T13:41:24.028 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T13:41:24.028 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T13:41:24.028 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T13:41:24.028 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T13:41:24.392 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2024-04-25T13:41:24.396 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2024-04-25T13:41:24.396 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T13:41:24.484 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T13:41:24.544 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T13:41:24.544 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:41:24.545 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:41:24.678 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:24.678+0000 7f205bf0b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T13:41:24.682 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:24.682+0000 7f205bf0b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T13:41:24.683 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:24.682+0000 7f205bf0b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T13:41:24.683 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:24.682+0000 7f205bf0b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T13:41:24.683 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:24.682+0000 7f205bf0b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T13:41:24.691 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:24.690+0000 7f205bf0b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T13:41:27.766 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T13:41:27.786 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:41:27.897 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:27.898+0000 7f64ab6ea7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T13:41:27.898 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:27.898+0000 7f64ab6ea7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T13:41:27.898 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:27.898+0000 7f64ab6ea7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T13:41:27.898 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:27.898+0000 7f64ab6ea7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T13:41:27.898 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:27.898+0000 7f64ab6ea7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T13:41:27.899 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:27.898+0000 7f64ab6ea7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T13:41:30.924 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T13:41:30.944 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:41:31.052 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:31.054+0000 7f7cbf3967c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T13:41:31.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:31.054+0000 7f7cbf3967c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T13:41:31.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:31.054+0000 7f7cbf3967c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T13:41:31.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:31.054+0000 7f7cbf3967c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T13:41:31.053 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:31.054+0000 7f7cbf3967c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T13:41:31.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:31.054+0000 7f7cbf3967c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T13:41:33.403 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:41:33.407 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:41:34.084 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T13:41:34.104 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:41:34.212 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:34.214+0000 7f7006d827c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T13:41:34.213 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:34.214+0000 7f7006d827c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T13:41:34.213 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:34.214+0000 7f7006d827c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T13:41:34.213 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:34.214+0000 7f7006d827c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T13:41:34.213 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:34.214+0000 7f7006d827c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T13:41:34.215 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:34.214+0000 7f7006d827c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T13:41:37.296 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T13:41:37.316 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T13:41:37.317 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:41:37.317 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T13:41:37.339 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:41:37.339 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T13:41:37.400 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:41:37.400 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-25T13:41:37.460 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:41:37.460 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T13:41:37.520 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:41:37.520 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T13:41:37.580 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:41:37.580 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T13:41:37.647 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:41:37.647 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T13:41:37.711 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:41:37.711 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T13:41:37.732 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:41:37.732 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T13:41:37.796 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:41:37.796 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-25T13:41:37.859 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:41:37.859 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T13:41:37.923 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:41:37.923 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T13:41:37.987 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:41:37.987 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T13:41:38.051 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:41:38.052 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T13:41:38.119 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:41:38.119 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T13:41:38.129 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:41:38.129 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-25T13:41:38.180 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:41:38.180 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-25T13:41:38.189 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:41:38.189 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-25T13:41:38.239 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T13:41:38.239 DEBUG:teuthology.orchestra.run.smithi123:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T13:41:38.242 DEBUG:teuthology.orchestra.run.smithi130:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T13:41:38.287 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr.y] 2024-04-25T13:41:38.287 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBxXSpmY5kkLBAAavfr9iawJrEVad/HlzZJAg== 2024-04-25T13:41:38.288 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.a] 2024-04-25T13:41:38.288 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBxXSpmRZaqNRAASgiqTZucFo3RrAbbhKu5Pg== 2024-04-25T13:41:38.288 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.c] 2024-04-25T13:41:38.288 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQByXSpmMserARAAG6o8F9KLwRvmIElW/Rh1Dw== 2024-04-25T13:41:38.288 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.0] 2024-04-25T13:41:38.288 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQB1XSpmWEx0ERAA4Uma0pcbPw0EyMgNZU2Kig== 2024-04-25T13:41:38.288 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.1] 2024-04-25T13:41:38.288 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQB4XSpmdMsjGxAAL2JlBtPGd3atzhJd0jfy6g== 2024-04-25T13:41:38.288 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.2] 2024-04-25T13:41:38.288 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQB7XSpmQw45JBAAleUiNvgeqz+HeYPQD4GNVQ== 2024-04-25T13:41:38.288 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.3] 2024-04-25T13:41:38.288 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQB+XSpmAxMKLhAAqlfhlADFBqOKCSSOPF0sjQ== 2024-04-25T13:41:38.289 INFO:teuthology.orchestra.run.smithi123.stdout:[mgr.x] 2024-04-25T13:41:38.289 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQBxXSpmva5kMBAAgeNzDPSYDMoyKpXNtx1UMg== 2024-04-25T13:41:38.289 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.b] 2024-04-25T13:41:38.289 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQByXSpm7AzfBhAAsoGaX/CTbsr7+15VsMAsdQ== 2024-04-25T13:41:38.289 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.d] 2024-04-25T13:41:38.289 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQByXSpmxDmbDhAAWZlsPqet/ypXRBHTRAqmkw== 2024-04-25T13:41:38.289 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.4] 2024-04-25T13:41:38.289 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCEXSpmEiqMKBAArXA3ELWHvqRE2eQYRCLMQw== 2024-04-25T13:41:38.289 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.5] 2024-04-25T13:41:38.289 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCHXSpmayygNRAA2/mUoEYXZ1uyRc3cF9kj7A== 2024-04-25T13:41:38.289 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.6] 2024-04-25T13:41:38.289 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCLXSpmy21GAxAArA7CE1eY0wNRopmQ8GVtTw== 2024-04-25T13:41:38.289 INFO:teuthology.orchestra.run.smithi123.stdout:[osd.7] 2024-04-25T13:41:38.289 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQCOXSpmzoLQDBAA2lf1gfE1JeB8YngkzsC9tg== 2024-04-25T13:41:38.290 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2024-04-25T13:41:38.290 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQByXSpmo/9OExAA/kno6dfYddtdaT2e+prGDQ== 2024-04-25T13:41:38.290 INFO:teuthology.orchestra.run.smithi123.stdout:[client.2] 2024-04-25T13:41:38.290 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQByXSpmzuVXFxAAl3m6mpLW2EncYTtCXGdBnw== 2024-04-25T13:41:38.290 INFO:teuthology.orchestra.run.smithi123.stdout:[client.1] 2024-04-25T13:41:38.290 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQByXSpmN+M7GxAA4lZGIViFb/tdOzAdbUF4OQ== 2024-04-25T13:41:38.290 INFO:teuthology.orchestra.run.smithi123.stdout:[client.3] 2024-04-25T13:41:38.290 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQByXSpmFu4/HxAAk/rh3sG3egQD8F80sgGicg== 2024-04-25T13:41:38.301 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr.y] 2024-04-25T13:41:38.301 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBxXSpmY5kkLBAAavfr9iawJrEVad/HlzZJAg== 2024-04-25T13:41:38.301 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.a] 2024-04-25T13:41:38.301 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBxXSpmRZaqNRAASgiqTZucFo3RrAbbhKu5Pg== 2024-04-25T13:41:38.301 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.c] 2024-04-25T13:41:38.301 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQByXSpmMserARAAG6o8F9KLwRvmIElW/Rh1Dw== 2024-04-25T13:41:38.301 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.0] 2024-04-25T13:41:38.301 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQB1XSpmWEx0ERAA4Uma0pcbPw0EyMgNZU2Kig== 2024-04-25T13:41:38.301 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.1] 2024-04-25T13:41:38.301 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQB4XSpmdMsjGxAAL2JlBtPGd3atzhJd0jfy6g== 2024-04-25T13:41:38.302 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.2] 2024-04-25T13:41:38.302 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQB7XSpmQw45JBAAleUiNvgeqz+HeYPQD4GNVQ== 2024-04-25T13:41:38.302 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.3] 2024-04-25T13:41:38.302 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQB+XSpmAxMKLhAAqlfhlADFBqOKCSSOPF0sjQ== 2024-04-25T13:41:38.302 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr.x] 2024-04-25T13:41:38.302 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQBxXSpmva5kMBAAgeNzDPSYDMoyKpXNtx1UMg== 2024-04-25T13:41:38.302 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.b] 2024-04-25T13:41:38.302 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQByXSpm7AzfBhAAsoGaX/CTbsr7+15VsMAsdQ== 2024-04-25T13:41:38.302 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.d] 2024-04-25T13:41:38.302 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQByXSpmxDmbDhAAWZlsPqet/ypXRBHTRAqmkw== 2024-04-25T13:41:38.302 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.4] 2024-04-25T13:41:38.302 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCEXSpmEiqMKBAArXA3ELWHvqRE2eQYRCLMQw== 2024-04-25T13:41:38.302 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.5] 2024-04-25T13:41:38.303 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCHXSpmayygNRAA2/mUoEYXZ1uyRc3cF9kj7A== 2024-04-25T13:41:38.303 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.6] 2024-04-25T13:41:38.303 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCLXSpmy21GAxAArA7CE1eY0wNRopmQ8GVtTw== 2024-04-25T13:41:38.303 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.7] 2024-04-25T13:41:38.303 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQCOXSpmzoLQDBAA2lf1gfE1JeB8YngkzsC9tg== 2024-04-25T13:41:38.303 INFO:teuthology.orchestra.run.smithi130.stdout:[client.0] 2024-04-25T13:41:38.303 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQByXSpmo/9OExAA/kno6dfYddtdaT2e+prGDQ== 2024-04-25T13:41:38.303 INFO:teuthology.orchestra.run.smithi130.stdout:[client.2] 2024-04-25T13:41:38.303 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQByXSpmzuVXFxAAl3m6mpLW2EncYTtCXGdBnw== 2024-04-25T13:41:38.303 INFO:teuthology.orchestra.run.smithi130.stdout:[client.1] 2024-04-25T13:41:38.303 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQByXSpmN+M7GxAA4lZGIViFb/tdOzAdbUF4OQ== 2024-04-25T13:41:38.303 INFO:teuthology.orchestra.run.smithi130.stdout:[client.3] 2024-04-25T13:41:38.303 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQByXSpmFu4/HxAAk/rh3sG3egQD8F80sgGicg== 2024-04-25T13:41:38.304 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T13:41:38.337 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T13:41:38.415 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:41:38.418 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:41:38.487 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:41:38.490 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:41:38.556 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:41:38.559 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:41:38.622 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:41:38.625 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:41:38.688 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:41:38.692 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:41:38.754 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:41:38.757 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:41:38.820 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T13:41:38.824 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T13:41:38.887 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:41:38.893 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:41:38.959 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:41:38.962 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T13:41:39.028 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:41:39.031 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:41:39.095 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:41:39.098 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:41:39.162 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:41:39.165 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:41:39.229 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:41:39.232 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T13:41:39.298 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T13:41:39.301 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T13:41:39.368 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T13:41:39.371 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T13:41:39.438 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T13:41:39.442 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T13:41:39.509 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T13:41:39.512 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T13:41:39.579 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T13:41:39.579 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T13:41:39.598 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T13:41:39.724 DEBUG:teuthology.orchestra.run.smithi123:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T13:41:39.744 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T13:41:39.764 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T13:41:39.891 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T13:41:39.911 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T13:41:39.973 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T13:41:40.094 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T13:41:40.115 DEBUG:teuthology.orchestra.run.smithi123:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:41:40.119 DEBUG:teuthology.orchestra.run.smithi130:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T13:41:40.163 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T13:41:40.164 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T13:41:40.164 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T13:41:40.168 INFO:tasks.ceph.mon.a:Started 2024-04-25T13:41:40.168 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T13:41:40.168 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T13:41:40.210 INFO:tasks.ceph.mon.b:Started 2024-04-25T13:41:40.211 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T13:41:40.211 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T13:41:40.214 INFO:tasks.ceph.mon.c:Started 2024-04-25T13:41:40.215 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T13:41:40.215 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T13:41:40.215 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T13:41:40.219 INFO:tasks.ceph.mgr.y:Started 2024-04-25T13:41:40.219 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T13:41:40.219 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T13:41:40.223 INFO:tasks.ceph.mgr.x:Started 2024-04-25T13:41:40.223 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T13:41:40.223 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T13:41:40.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.378+0000 7fe2e8800640 1 Processor -- start 2024-04-25T13:41:40.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.378+0000 7fe2e8800640 1 -- start start 2024-04-25T13:41:40.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.378+0000 7fe2e8800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe2e00d1f20 0x7fe2e00d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:40.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.378+0000 7fe2e8800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2e00b6f40 0x7fe2e00b7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:40.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.378+0000 7fe2e8800640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2e00d0db0 con 0x7fe2e00d12b0 2024-04-25T13:41:40.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.378+0000 7fe2e8800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe2e00cfa40 con 0x7fe2e00d1f20 2024-04-25T13:41:40.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.378+0000 7fe2e8800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe2e00cf4a0 con 0x7fe2e00b6f40 2024-04-25T13:41:40.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.378+0000 7fe2e6800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2e00b6f40 0x7fe2e00b7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:40.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.378+0000 7fe2e5e00640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe2e00d12b0 0x7fe2e009caf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.123:50702/0 (socket says 172.21.15.123:50702) 2024-04-25T13:41:40.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.382+0000 7fe2e5e00640 1 -- 172.21.15.123:0/2294065517 learned_addr learned my addr 172.21.15.123:0/2294065517 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:41:40.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.382+0000 7fe2e5400640 1 --2- 172.21.15.123:0/2294065517 >> v2:172.21.15.123:3300/0 conn(0x7fe2e00d1f20 0x7fe2e00d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:40.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.382+0000 7fe2e6800640 1 -- 172.21.15.123:0/2294065517 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2e00b6f40 msgr2=0x7fe2e00b7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T13:41:40.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.382+0000 7fe2e6800640 1 -- 172.21.15.123:0/2294065517 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2e00b6f40 msgr2=0x7fe2e00b7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:41:40.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.382+0000 7fe2e6800640 1 --2- 172.21.15.123:0/2294065517 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2e00b6f40 0x7fe2e00b7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:41:40.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.382+0000 7fe2e6800640 1 --2- 172.21.15.123:0/2294065517 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2e00b6f40 0x7fe2e00b7350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T13:41:40.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.382+0000 7fe2e5400640 1 -- 172.21.15.123:0/2294065517 >> v2:172.21.15.123:3300/0 conn(0x7fe2e00d1f20 msgr2=0x7fe2e00d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T13:41:40.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.382+0000 7fe2e5400640 1 -- 172.21.15.123:0/2294065517 >> v2:172.21.15.123:3300/0 conn(0x7fe2e00d1f20 msgr2=0x7fe2e00d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T13:41:40.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.382+0000 7fe2e5400640 1 --2- 172.21.15.123:0/2294065517 >> v2:172.21.15.123:3300/0 conn(0x7fe2e00d1f20 0x7fe2e00d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T13:41:40.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.382+0000 7fe2e5400640 1 --2- 172.21.15.123:0/2294065517 >> v2:172.21.15.123:3300/0 conn(0x7fe2e00d1f20 0x7fe2e00d2330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T13:41:40.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.534+0000 7fe2e4a00640 1 -- 172.21.15.123:0/2294065517 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 570497880 0 0) 0x7fe2e00d0db0 con 0x7fe2e00d12b0 2024-04-25T13:41:40.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.534+0000 7fe2e4a00640 1 -- 172.21.15.123:0/2294065517 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2c8003530 con 0x7fe2e00d12b0 2024-04-25T13:41:40.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.550+0000 7fe2e4a00640 1 -- 172.21.15.123:0/2294065517 <== mon.1 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3007220075 0 0) 0x7fe2c8003530 con 0x7fe2e00d12b0 2024-04-25T13:41:40.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.550+0000 7fe2e4a00640 1 -- 172.21.15.123:0/2294065517 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2e00b6f40 msgr2=0x7fe2e00b7350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T13:41:40.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.550+0000 7fe2e4a00640 1 --2- 172.21.15.123:0/2294065517 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2e00b6f40 0x7fe2e00b7350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:40.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.550+0000 7fe2e4a00640 1 -- 172.21.15.123:0/2294065517 >> v2:172.21.15.123:3300/0 conn(0x7fe2e00d1f20 msgr2=0x7fe2e00d2330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T13:41:40.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.550+0000 7fe2e4a00640 1 --2- 172.21.15.123:0/2294065517 >> v2:172.21.15.123:3300/0 conn(0x7fe2e00d1f20 0x7fe2e00d2330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:40.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.550+0000 7fe2e4a00640 1 -- 172.21.15.123:0/2294065517 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e00cf6d0 con 0x7fe2e00d12b0 2024-04-25T13:41:40.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.550+0000 7fe2e4a00640 1 -- 172.21.15.123:0/2294065517 <== mon.1 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7fe2d40016d0 con 0x7fe2e00d12b0 2024-04-25T13:41:40.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.550+0000 7fe2e4a00640 1 -- 172.21.15.123:0/2294065517 >> v1:172.21.15.130:6789/0 conn(0x7fe2e00d12b0 legacy=0x7fe2e009caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:40.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.550+0000 7fe2e4a00640 1 --2- 172.21.15.123:0/2294065517 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2c8003aa0 0x7fe2c8003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:40.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.550+0000 7fe2e4a00640 1 --2- 172.21.15.123:0/2294065517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2c8004810 0x7fe2c8004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:40.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.550+0000 7fe2e4a00640 1 --2- 172.21.15.123:0/2294065517 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2e00b6f40 0x7fe2c800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:40.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.550+0000 7fe2e4a00640 1 -- 172.21.15.123:0/2294065517 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c8005500 con 0x7fe2c8004810 2024-04-25T13:41:40.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.550+0000 7fe2e4a00640 1 -- 172.21.15.123:0/2294065517 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c800bf10 con 0x7fe2c8003aa0 2024-04-25T13:41:40.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.550+0000 7fe2e4a00640 1 -- 172.21.15.123:0/2294065517 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe2c800c090 con 0x7fe2e00b6f40 2024-04-25T13:41:40.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.550+0000 7fe2e5400640 1 --2- 172.21.15.123:0/2294065517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2c8004810 0x7fe2c8004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:40.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.550+0000 7fe2e5e00640 1 --2- 172.21.15.123:0/2294065517 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2c8003aa0 0x7fe2c8003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:40.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.550+0000 7fe2e6800640 1 --2- 172.21.15.123:0/2294065517 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2e00b6f40 0x7fe2c800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:40.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.550+0000 7fe2e5400640 1 -- 172.21.15.123:0/2294065517 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2e00b6f40 msgr2=0x7fe2c800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:40.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.550+0000 7fe2e5400640 1 --2- 172.21.15.123:0/2294065517 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2e00b6f40 0x7fe2c800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:40.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.550+0000 7fe2e5400640 1 -- 172.21.15.123:0/2294065517 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2c8003aa0 msgr2=0x7fe2c8003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:40.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.550+0000 7fe2e5400640 1 --2- 172.21.15.123:0/2294065517 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2c8003aa0 0x7fe2c8003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:40.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.550+0000 7fe2e5400640 1 -- 172.21.15.123:0/2294065517 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c8003530 con 0x7fe2c8004810 2024-04-25T13:41:40.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.554+0000 7fe2e5400640 1 --2- 172.21.15.123:0/2294065517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2c8004810 0x7fe2c8004c20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe2e00690e0 tx=0x7fe2d001c660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c91ccac1dfa0a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:40.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.554+0000 7fe2e4a00640 1 -- 172.21.15.123:0/2294065517 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d00b2070 con 0x7fe2c8004810 2024-04-25T13:41:40.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.554+0000 7fe2e4a00640 1 -- 172.21.15.123:0/2294065517 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d00ad410 con 0x7fe2c8004810 2024-04-25T13:41:40.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.554+0000 7fe2e4a00640 1 -- 172.21.15.123:0/2294065517 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d000b5e0 con 0x7fe2c8004810 2024-04-25T13:41:40.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.554+0000 7fe2e8800640 1 -- 172.21.15.123:0/2294065517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2c8004810 msgr2=0x7fe2c8004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:40.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.554+0000 7fe2e8800640 1 --2- 172.21.15.123:0/2294065517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2c8004810 0x7fe2c8004c20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe2e00690e0 tx=0x7fe2d001c660 comp rx=0 tx=0).stop 2024-04-25T13:41:40.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.554+0000 7fe2e6800640 1 -- 172.21.15.123:0/2294065517 reap_dead start 2024-04-25T13:41:40.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.554+0000 7fe2e8800640 1 -- 172.21.15.123:0/2294065517 shutdown_connections 2024-04-25T13:41:40.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.554+0000 7fe2e8800640 1 -- 172.21.15.123:0/2294065517 >> 172.21.15.123:0/2294065517 conn(0x7fe2e00d0160 msgr2=0x7fe2e00d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:40.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.554+0000 7fe2e8800640 1 -- 172.21.15.123:0/2294065517 shutdown_connections 2024-04-25T13:41:40.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.554+0000 7fe2e8800640 1 -- 172.21.15.123:0/2294065517 wait complete. 2024-04-25T13:41:40.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.558+0000 7fe2e8800640 1 Processor -- start 2024-04-25T13:41:40.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.558+0000 7fe2e8800640 1 -- start start 2024-04-25T13:41:40.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.558+0000 7fe2e8800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2c8004810 0x7fe2e0200660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:40.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.558+0000 7fe2e8800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2e00b31f0 0x7fe2e00b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:40.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.558+0000 7fe2e8800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2e0165640 0x7fe2e0165a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:40.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.558+0000 7fe2e8800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e00cf030 con 0x7fe2c8004810 2024-04-25T13:41:40.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.558+0000 7fe2e8800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e00ceeb0 con 0x7fe2e00b31f0 2024-04-25T13:41:40.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.558+0000 7fe2e8800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe2e00cf1b0 con 0x7fe2e0165640 2024-04-25T13:41:40.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.558+0000 7fe2e5e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2c8004810 0x7fe2e0200660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:40.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.558+0000 7fe2e5e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2c8004810 0x7fe2e0200660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42380/0 (socket says 172.21.15.123:42380) 2024-04-25T13:41:40.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.558+0000 7fe2e5e00640 1 -- 172.21.15.123:0/42123584 learned_addr learned my addr 172.21.15.123:0/42123584 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:41:40.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.558+0000 7fe2e5400640 1 --2- 172.21.15.123:0/42123584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2e00b31f0 0x7fe2e00b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:40.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.558+0000 7fe2e6800640 1 --2- 172.21.15.123:0/42123584 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2e0165640 0x7fe2e0165a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:40.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.562+0000 7fe2e5e00640 1 -- 172.21.15.123:0/42123584 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2e0165640 msgr2=0x7fe2e0165a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:40.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.562+0000 7fe2e5e00640 1 --2- 172.21.15.123:0/42123584 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2e0165640 0x7fe2e0165a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:40.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.562+0000 7fe2e5e00640 1 -- 172.21.15.123:0/42123584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2e00b31f0 msgr2=0x7fe2e00b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:40.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.562+0000 7fe2e5e00640 1 --2- 172.21.15.123:0/42123584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2e00b31f0 0x7fe2e00b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:40.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.562+0000 7fe2e5e00640 1 -- 172.21.15.123:0/42123584 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e0165f90 con 0x7fe2c8004810 2024-04-25T13:41:40.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.562+0000 7fe2e5e00640 1 --2- 172.21.15.123:0/42123584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2c8004810 0x7fe2e0200660 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4007310 tx=0x7fe2d40077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:40.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.562+0000 7fe2da000640 1 -- 172.21.15.123:0/42123584 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d4007e00 con 0x7fe2c8004810 2024-04-25T13:41:40.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.562+0000 7fe2da000640 1 -- 172.21.15.123:0/42123584 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d4018070 con 0x7fe2c8004810 2024-04-25T13:41:40.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.562+0000 7fe2e8800640 1 -- 172.21.15.123:0/42123584 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2e00b1810 con 0x7fe2c8004810 2024-04-25T13:41:40.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.562+0000 7fe2da000640 1 -- 172.21.15.123:0/42123584 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d400fbe0 con 0x7fe2c8004810 2024-04-25T13:41:40.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.562+0000 7fe2e8800640 1 -- 172.21.15.123:0/42123584 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2e00b1dd0 con 0x7fe2c8004810 2024-04-25T13:41:40.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.562+0000 7fe2da000640 1 -- 172.21.15.123:0/42123584 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe2d401d460 con 0x7fe2c8004810 2024-04-25T13:41:40.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.562+0000 7fe2da000640 1 -- 172.21.15.123:0/42123584 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe2d40135d0 con 0x7fe2c8004810 2024-04-25T13:41:40.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.562+0000 7fe2e8800640 1 -- 172.21.15.123:0/42123584 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2e0050750 con 0x7fe2c8004810 2024-04-25T13:41:40.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.586+0000 7fe2da000640 1 -- 172.21.15.123:0/42123584 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fe2e0165f90 con 0x7fe2c8004810 2024-04-25T13:41:40.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.646+0000 7fe2e8800640 1 -- 172.21.15.123:0/42123584 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fe2e00b95a0 con 0x7fe2c8004810 2024-04-25T13:41:40.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.650+0000 7fe2da000640 1 -- 172.21.15.123:0/42123584 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fe2d400fd80 con 0x7fe2c8004810 2024-04-25T13:41:40.646 INFO:teuthology.orchestra.run.smithi123.stderr:adjusted tunables profile to default 2024-04-25T13:41:40.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.650+0000 7fe2e8800640 1 -- 172.21.15.123:0/42123584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2c8004810 msgr2=0x7fe2e0200660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:40.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.650+0000 7fe2e8800640 1 --2- 172.21.15.123:0/42123584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2c8004810 0x7fe2e0200660 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4007310 tx=0x7fe2d40077d0 comp rx=0 tx=0).stop 2024-04-25T13:41:40.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.650+0000 7fe2e8800640 1 -- 172.21.15.123:0/42123584 shutdown_connections 2024-04-25T13:41:40.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.650+0000 7fe2e8800640 1 --2- 172.21.15.123:0/42123584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2e00b31f0 0x7fe2e00b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:40.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.650+0000 7fe2e8800640 1 --2- 172.21.15.123:0/42123584 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2e0165640 0x7fe2e0165a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:40.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.650+0000 7fe2e8800640 1 --2- 172.21.15.123:0/42123584 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2c8004810 0x7fe2e0200660 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:40.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.650+0000 7fe2e8800640 1 -- 172.21.15.123:0/42123584 >> 172.21.15.123:0/42123584 conn(0x7fe2e00d0160 msgr2=0x7fe2e0068590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:40.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.650+0000 7fe2e8800640 1 -- 172.21.15.123:0/42123584 shutdown_connections 2024-04-25T13:41:40.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:40.650+0000 7fe2e8800640 1 -- 172.21.15.123:0/42123584 wait complete. 2024-04-25T13:41:40.666 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T13:41:40.667 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T13:41:40.667 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:41:40.667 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T13:41:40.686 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:41:40.686 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T13:41:40.748 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:41:40.748 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T13:41:40.755 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-25T13:41:40.754+0000 7f691a91d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T13:41:40.768 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-25T13:41:40.770+0000 7f5332ada180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T13:41:40.786 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:41:40.787 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T13:41:40.847 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:41:40.847 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T13:41:40.867 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:41:40.867 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T13:41:40.927 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:41:40.927 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T13:41:40.987 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:41:40.987 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T13:41:41.050 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new c4406d5d-054f-41e8-b66f-76fdbb8e3efa 0 2024-04-25T13:41:41.236 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.238+0000 7f5047200640 1 Processor -- start 2024-04-25T13:41:41.236 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.238+0000 7f5047200640 1 -- start start 2024-04-25T13:41:41.238 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.238+0000 7f5047200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50400b8ea0 0x7f50400b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:41.238 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.238+0000 7f5047200640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f50400cf3e0 0x7f50400d0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:41.238 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.238+0000 7f5047200640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50400ce660 con 0x7f50400cf7f0 2024-04-25T13:41:41.238 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.238+0000 7f5047200640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f50400b92b0 con 0x7f50400cf3e0 2024-04-25T13:41:41.238 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.238+0000 7f5047200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f50400ce430 con 0x7f50400b8ea0 2024-04-25T13:41:41.238 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.238+0000 7f503fe00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50400b8ea0 0x7f50400b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:41.238 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.238+0000 7f503f400640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f50400cf3e0 0x7f50400d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:41.238 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.238+0000 7f503fe00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50400b8ea0 0x7f50400b28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:34376/0 (socket says 172.21.15.130:34376) 2024-04-25T13:41:41.239 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.238+0000 7f503f400640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f50400cf3e0 0x7f50400d0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33414/0 (socket says 172.21.15.130:33414) 2024-04-25T13:41:41.239 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.238+0000 7f503fe00640 1 -- 172.21.15.130:0/1926622361 learned_addr learned my addr 172.21.15.130:0/1926622361 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-04-25T13:41:41.239 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.238+0000 7f503fe00640 1 -- 172.21.15.130:0/1926622361 >> v2:172.21.15.130:3300/0 conn(0x7f50400cf3e0 msgr2=0x7f50400d0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:41.239 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.238+0000 7f503fe00640 1 --2- 172.21.15.130:0/1926622361 >> v2:172.21.15.130:3300/0 conn(0x7f50400cf3e0 0x7f50400d0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.239 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.238+0000 7f503fe00640 1 -- 172.21.15.130:0/1926622361 >> v1:172.21.15.130:6789/0 conn(0x7f50400cf7f0 legacy=0x7f50400b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:41.239 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.238+0000 7f503fe00640 1 -- 172.21.15.130:0/1926622361 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50400b2df0 con 0x7f50400b8ea0 2024-04-25T13:41:41.239 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.238+0000 7f503f400640 1 --2- 172.21.15.130:0/1926622361 >> v2:172.21.15.130:3300/0 conn(0x7f50400cf3e0 0x7f50400d0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:41:41.241 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.242+0000 7f503fe00640 1 --2- 172.21.15.130:0/1926622361 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50400b8ea0 0x7f50400b28b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5030006fd0 tx=0x7f503001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18e0801e1274bdd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:41.242 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.242+0000 7f503ea00640 1 -- 172.21.15.130:0/1926622361 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50300ab680 con 0x7f50400b8ea0 2024-04-25T13:41:41.242 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.242+0000 7f503ea00640 1 -- 172.21.15.130:0/1926622361 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50300b0070 con 0x7f50400b8ea0 2024-04-25T13:41:41.242 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.242+0000 7f503ea00640 1 -- 172.21.15.130:0/1926622361 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50300aba40 con 0x7f50400b8ea0 2024-04-25T13:41:41.243 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.242+0000 7f5047200640 1 -- 172.21.15.130:0/1926622361 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50400b8ea0 msgr2=0x7f50400b28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:41.243 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.242+0000 7f5047200640 1 --2- 172.21.15.130:0/1926622361 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50400b8ea0 0x7f50400b28b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5030006fd0 tx=0x7f503001c480 comp rx=0 tx=0).stop 2024-04-25T13:41:41.243 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.242+0000 7f5047200640 1 -- 172.21.15.130:0/1926622361 shutdown_connections 2024-04-25T13:41:41.243 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.242+0000 7f5047200640 1 --2- 172.21.15.130:0/1926622361 >> v2:172.21.15.130:3300/0 conn(0x7f50400cf3e0 0x7f50400d0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.243 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.242+0000 7f5047200640 1 --2- 172.21.15.130:0/1926622361 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50400b8ea0 0x7f50400b28b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.243 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.242+0000 7f5047200640 1 -- 172.21.15.130:0/1926622361 >> 172.21.15.130:0/1926622361 conn(0x7f50400d36e0 msgr2=0x7f50400d3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:41.243 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.242+0000 7f5047200640 1 -- 172.21.15.130:0/1926622361 shutdown_connections 2024-04-25T13:41:41.243 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.242+0000 7f5047200640 1 -- 172.21.15.130:0/1926622361 wait complete. 2024-04-25T13:41:41.245 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.246+0000 7f5047200640 1 Processor -- start 2024-04-25T13:41:41.245 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.246+0000 7f5047200640 1 -- start start 2024-04-25T13:41:41.247 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.246+0000 7f5047200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50400b8ea0 0x7f504015d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:41.247 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.246+0000 7f5047200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50400cf3e0 0x7f5040152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:41.247 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.246+0000 7f5047200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50400cf7f0 0x7f50401573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:41.247 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.246+0000 7f5047200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f50400b8c00 con 0x7f50400b8ea0 2024-04-25T13:41:41.247 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.246+0000 7f5047200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f50400d09a0 con 0x7f50400cf7f0 2024-04-25T13:41:41.247 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.246+0000 7f5047200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f50400d2800 con 0x7f50400cf3e0 2024-04-25T13:41:41.247 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.246+0000 7f503f400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50400cf3e0 0x7f5040152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:41.247 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.246+0000 7f503f400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50400cf3e0 0x7f5040152a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:34380/0 (socket says 172.21.15.130:34380) 2024-04-25T13:41:41.248 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.246+0000 7f503f400640 1 -- 172.21.15.130:0/2739131279 learned_addr learned my addr 172.21.15.130:0/2739131279 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-04-25T13:41:41.248 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.246+0000 7f5045200640 1 --2- 172.21.15.130:0/2739131279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50400cf7f0 0x7f50401573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:41.248 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.246+0000 7f503fe00640 1 --2- 172.21.15.130:0/2739131279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50400b8ea0 0x7f504015d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:41.249 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.246+0000 7f503f400640 1 -- 172.21.15.130:0/2739131279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50400cf7f0 msgr2=0x7f50401573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:41.249 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.246+0000 7f503f400640 1 --2- 172.21.15.130:0/2739131279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50400cf7f0 0x7f50401573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.249 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.246+0000 7f503f400640 1 -- 172.21.15.130:0/2739131279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50400b8ea0 msgr2=0x7f504015d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:41.249 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.246+0000 7f503f400640 1 --2- 172.21.15.130:0/2739131279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50400b8ea0 0x7f504015d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.249 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.246+0000 7f503f400640 1 -- 172.21.15.130:0/2739131279 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5040153440 con 0x7f50400cf3e0 2024-04-25T13:41:41.249 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.250+0000 7f503f400640 1 --2- 172.21.15.130:0/2739131279 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50400cf3e0 0x7f5040152a60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f502c00e8c0 tx=0x7f502c00ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:41.249 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.250+0000 7f5037e00640 1 -- 172.21.15.130:0/2739131279 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502c017070 con 0x7f50400cf3e0 2024-04-25T13:41:41.249 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.250+0000 7f5037e00640 1 -- 172.21.15.130:0/2739131279 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f502c00c940 con 0x7f50400cf3e0 2024-04-25T13:41:41.249 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.250+0000 7f5047200640 1 -- 172.21.15.130:0/2739131279 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5040153720 con 0x7f50400cf3e0 2024-04-25T13:41:41.250 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.250+0000 7f5037e00640 1 -- 172.21.15.130:0/2739131279 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502c00cd10 con 0x7f50400cf3e0 2024-04-25T13:41:41.250 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.250+0000 7f5047200640 1 -- 172.21.15.130:0/2739131279 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f504014def0 con 0x7f50400cf3e0 2024-04-25T13:41:41.250 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.250+0000 7f5037e00640 1 -- 172.21.15.130:0/2739131279 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f502c01a070 con 0x7f50400cf3e0 2024-04-25T13:41:41.250 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.250+0000 7f5037e00640 1 -- 172.21.15.130:0/2739131279 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f502c013470 con 0x7f50400cf3e0 2024-04-25T13:41:41.250 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.250+0000 7f5047200640 1 -- 172.21.15.130:0/2739131279 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5040153190 con 0x7f50400cf3e0 2024-04-25T13:41:41.252 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.254+0000 7f5037e00640 1 -- 172.21.15.130:0/2739131279 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f502c006840 con 0x7f50400cf3e0 2024-04-25T13:41:41.268 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-25T13:41:41.270+0000 7f691a91d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T13:41:41.277 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-25T13:41:41.281+0000 7f5332ada180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T13:41:41.319 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.318+0000 7f5047200640 1 -- 172.21.15.130:0/2739131279 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c4406d5d-054f-41e8-b66f-76fdbb8e3efa", "id": 0} v 0) -- 0x7f5040050750 con 0x7f50400cf3e0 2024-04-25T13:41:41.323 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.322+0000 7f5037e00640 1 -- 172.21.15.130:0/2739131279 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c4406d5d-054f-41e8-b66f-76fdbb8e3efa", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f502c004020 con 0x7f50400cf3e0 2024-04-25T13:41:41.323 INFO:teuthology.orchestra.run.smithi130.stdout:0 2024-04-25T13:41:41.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.326+0000 7f5047200640 1 -- 172.21.15.130:0/2739131279 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50400cf3e0 msgr2=0x7f5040152a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:41.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.326+0000 7f5047200640 1 --2- 172.21.15.130:0/2739131279 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50400cf3e0 0x7f5040152a60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f502c00e8c0 tx=0x7f502c00ed80 comp rx=0 tx=0).stop 2024-04-25T13:41:41.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.326+0000 7f5047200640 1 -- 172.21.15.130:0/2739131279 shutdown_connections 2024-04-25T13:41:41.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.326+0000 7f5047200640 1 --2- 172.21.15.130:0/2739131279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50400cf7f0 0x7f50401573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.326+0000 7f5047200640 1 --2- 172.21.15.130:0/2739131279 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50400cf3e0 0x7f5040152a60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.326+0000 7f5047200640 1 --2- 172.21.15.130:0/2739131279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50400b8ea0 0x7f504015d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.324 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.326+0000 7f5047200640 1 -- 172.21.15.130:0/2739131279 >> 172.21.15.130:0/2739131279 conn(0x7f50400d36e0 msgr2=0x7f5040070d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:41.325 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.326+0000 7f5047200640 1 -- 172.21.15.130:0/2739131279 shutdown_connections 2024-04-25T13:41:41.325 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.326+0000 7f5047200640 1 -- 172.21.15.130:0/2739131279 wait complete. 2024-04-25T13:41:41.343 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new dbc93b1f-fd04-49c6-9c4d-1834d2b64b42 1 2024-04-25T13:41:41.478 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-25T13:41:41.481+0000 7f5332ada180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T13:41:41.481 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-25T13:41:41.482+0000 7f691a91d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T13:41:41.489 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.490+0000 7f5e2d400640 1 Processor -- start 2024-04-25T13:41:41.489 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.490+0000 7f5e2d400640 1 -- start start 2024-04-25T13:41:41.491 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.490+0000 7f5e2d400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e280cf3e0 0x7f5e280d0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:41.491 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.490+0000 7f5e2d400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5e280cf7f0 0x7f5e280d0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:41.491 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.490+0000 7f5e2d400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e280ce660 con 0x7f5e280b8ea0 2024-04-25T13:41:41.491 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.490+0000 7f5e2d400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5e280b92b0 con 0x7f5e280cf7f0 2024-04-25T13:41:41.491 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.490+0000 7f5e2d400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f5e280ce430 con 0x7f5e280cf3e0 2024-04-25T13:41:41.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.490+0000 7f5e1fe00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e280cf3e0 0x7f5e280d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:41.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.490+0000 7f5e26800640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f5e280b8ea0 0x7f5e280b28b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:49288/0 (socket says 172.21.15.130:49288) 2024-04-25T13:41:41.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.490+0000 7f5e26800640 1 -- 172.21.15.130:0/1891849127 learned_addr learned my addr 172.21.15.130:0/1891849127 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-04-25T13:41:41.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.494+0000 7f5e27200640 1 --2- 172.21.15.130:0/1891849127 >> v2:172.21.15.123:3300/0 conn(0x7f5e280cf7f0 0x7f5e280d0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:41.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.494+0000 7f5e1fe00640 1 -- 172.21.15.130:0/1891849127 >> v2:172.21.15.123:3300/0 conn(0x7f5e280cf7f0 msgr2=0x7f5e280d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:41.492 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.494+0000 7f5e25e00640 1 -- 172.21.15.130:0/1891849127 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2558767062 0 0) 0x7f5e280ce660 con 0x7f5e280b8ea0 2024-04-25T13:41:41.493 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.494+0000 7f5e1fe00640 1 --2- 172.21.15.130:0/1891849127 >> v2:172.21.15.123:3300/0 conn(0x7f5e280cf7f0 0x7f5e280d0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.493 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.494+0000 7f5e1fe00640 1 -- 172.21.15.130:0/1891849127 >> v1:172.21.15.130:6789/0 conn(0x7f5e280b8ea0 legacy=0x7f5e280b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:41.493 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.494+0000 7f5e1fe00640 1 -- 172.21.15.130:0/1891849127 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e280ce900 con 0x7f5e280cf3e0 2024-04-25T13:41:41.493 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.494+0000 7f5e27200640 1 --2- 172.21.15.130:0/1891849127 >> v2:172.21.15.123:3300/0 conn(0x7f5e280cf7f0 0x7f5e280d0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:41.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.494+0000 7f5e1fe00640 1 --2- 172.21.15.130:0/1891849127 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e280cf3e0 0x7f5e280d0050 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5e100097c0 tx=0x7f5e1001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef03054622961f89 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:41.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.494+0000 7f5e25e00640 1 -- 172.21.15.130:0/1891849127 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e100b1070 con 0x7f5e280cf3e0 2024-04-25T13:41:41.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.494+0000 7f5e25e00640 1 -- 172.21.15.130:0/1891849127 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e100a8050 con 0x7f5e280cf3e0 2024-04-25T13:41:41.495 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.494+0000 7f5e25e00640 1 -- 172.21.15.130:0/1891849127 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e100ac860 con 0x7f5e280cf3e0 2024-04-25T13:41:41.496 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.498+0000 7f5e2d400640 1 -- 172.21.15.130:0/1891849127 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e280cf3e0 msgr2=0x7f5e280d0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:41.496 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.498+0000 7f5e2d400640 1 --2- 172.21.15.130:0/1891849127 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e280cf3e0 0x7f5e280d0050 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5e100097c0 tx=0x7f5e1001c3e0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.496 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.498+0000 7f5e2d400640 1 -- 172.21.15.130:0/1891849127 shutdown_connections 2024-04-25T13:41:41.496 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.498+0000 7f5e2d400640 1 --2- 172.21.15.130:0/1891849127 >> v2:172.21.15.123:3300/0 conn(0x7f5e280cf7f0 0x7f5e280d0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.496 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.498+0000 7f5e2d400640 1 --2- 172.21.15.130:0/1891849127 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e280cf3e0 0x7f5e280d0050 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.496 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.498+0000 7f5e2d400640 1 -- 172.21.15.130:0/1891849127 >> 172.21.15.130:0/1891849127 conn(0x7f5e280d36e0 msgr2=0x7f5e280d3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:41.496 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.498+0000 7f5e2d400640 1 -- 172.21.15.130:0/1891849127 shutdown_connections 2024-04-25T13:41:41.496 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.498+0000 7f5e2d400640 1 -- 172.21.15.130:0/1891849127 wait complete. 2024-04-25T13:41:41.498 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.498+0000 7f5e2d400640 1 Processor -- start 2024-04-25T13:41:41.498 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.498+0000 7f5e2d400640 1 -- start start 2024-04-25T13:41:41.502 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.502+0000 7f5e2d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e280b8ea0 0x7f5e2815d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:41.502 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.502+0000 7f5e2d400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e280cf3e0 0x7f5e2815b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:41.502 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.502+0000 7f5e2d400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e280cf7f0 0x7f5e28159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:41.502 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.502+0000 7f5e2d400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2816af70 con 0x7f5e280cf7f0 2024-04-25T13:41:41.502 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.502+0000 7f5e2d400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5e280d2800 con 0x7f5e280b8ea0 2024-04-25T13:41:41.502 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.502+0000 7f5e2d400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f5e2816b0f0 con 0x7f5e280cf3e0 2024-04-25T13:41:41.502 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.502+0000 7f5e26800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e280b8ea0 0x7f5e2815d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:41.502 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.502+0000 7f5e1fe00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e280cf3e0 0x7f5e2815b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:41.502 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.502+0000 7f5e26800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e280b8ea0 0x7f5e2815d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:33430/0 (socket says 172.21.15.130:33430) 2024-04-25T13:41:41.502 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.502+0000 7f5e26800640 1 -- 172.21.15.130:0/3521909031 learned_addr learned my addr 172.21.15.130:0/3521909031 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-04-25T13:41:41.502 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.502+0000 7f5e27200640 1 --2- 172.21.15.130:0/3521909031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e280cf7f0 0x7f5e28159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:41.503 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.502+0000 7f5e26800640 1 -- 172.21.15.130:0/3521909031 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e280cf3e0 msgr2=0x7f5e2815b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:41.503 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.502+0000 7f5e26800640 1 --2- 172.21.15.130:0/3521909031 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e280cf3e0 0x7f5e2815b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.503 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.502+0000 7f5e26800640 1 -- 172.21.15.130:0/3521909031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e280cf7f0 msgr2=0x7f5e28159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:41.503 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.502+0000 7f5e26800640 1 --2- 172.21.15.130:0/3521909031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e280cf7f0 0x7f5e28159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.503 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.502+0000 7f5e26800640 1 -- 172.21.15.130:0/3521909031 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e281fd060 con 0x7f5e280b8ea0 2024-04-25T13:41:41.503 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.502+0000 7f5e26800640 1 --2- 172.21.15.130:0/3521909031 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e280b8ea0 0x7f5e2815d070 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800c3c0 tx=0x7f5e1800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:41.503 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.502+0000 7f5e1ea00640 1 -- 172.21.15.130:0/3521909031 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e18017070 con 0x7f5e280b8ea0 2024-04-25T13:41:41.503 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.502+0000 7f5e1ea00640 1 -- 172.21.15.130:0/3521909031 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e180074e0 con 0x7f5e280b8ea0 2024-04-25T13:41:41.503 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.502+0000 7f5e1ea00640 1 -- 172.21.15.130:0/3521909031 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e180059f0 con 0x7f5e280b8ea0 2024-04-25T13:41:41.503 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.502+0000 7f5e2d400640 1 -- 172.21.15.130:0/3521909031 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e281fd340 con 0x7f5e280b8ea0 2024-04-25T13:41:41.503 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.502+0000 7f5e2d400640 1 -- 172.21.15.130:0/3521909031 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e281fd900 con 0x7f5e280b8ea0 2024-04-25T13:41:41.503 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.502+0000 7f5e1ea00640 1 -- 172.21.15.130:0/3521909031 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5e1801a070 con 0x7f5e280b8ea0 2024-04-25T13:41:41.503 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.502+0000 7f5e1ea00640 1 -- 172.21.15.130:0/3521909031 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f5e180127b0 con 0x7f5e280b8ea0 2024-04-25T13:41:41.504 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.502+0000 7f5e2d400640 1 -- 172.21.15.130:0/3521909031 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e28050750 con 0x7f5e280b8ea0 2024-04-25T13:41:41.505 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.506+0000 7f5e1ea00640 1 -- 172.21.15.130:0/3521909031 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5e18021070 con 0x7f5e280b8ea0 2024-04-25T13:41:41.573 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.574+0000 7f5e2d400640 1 -- 172.21.15.130:0/3521909031 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dbc93b1f-fd04-49c6-9c4d-1834d2b64b42", "id": 1} v 0) -- 0x7f5e280d0dd0 con 0x7f5e280b8ea0 2024-04-25T13:41:41.579 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.578+0000 7f5e1ea00640 1 -- 172.21.15.130:0/3521909031 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dbc93b1f-fd04-49c6-9c4d-1834d2b64b42", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f5e18005c60 con 0x7f5e280b8ea0 2024-04-25T13:41:41.579 INFO:teuthology.orchestra.run.smithi130.stdout:1 2024-04-25T13:41:41.580 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.582+0000 7f5e2d400640 1 -- 172.21.15.130:0/3521909031 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e280b8ea0 msgr2=0x7f5e2815d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:41.580 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.582+0000 7f5e2d400640 1 --2- 172.21.15.130:0/3521909031 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e280b8ea0 0x7f5e2815d070 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800c3c0 tx=0x7f5e1800c880 comp rx=0 tx=0).stop 2024-04-25T13:41:41.581 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.582+0000 7f5e2d400640 1 -- 172.21.15.130:0/3521909031 shutdown_connections 2024-04-25T13:41:41.581 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.582+0000 7f5e2d400640 1 --2- 172.21.15.130:0/3521909031 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e280cf7f0 0x7f5e28159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.581 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.582+0000 7f5e2d400640 1 --2- 172.21.15.130:0/3521909031 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5e280cf3e0 0x7f5e2815b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.581 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.582+0000 7f5e2d400640 1 --2- 172.21.15.130:0/3521909031 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5e280b8ea0 0x7f5e2815d070 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.581 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.582+0000 7f5e2d400640 1 -- 172.21.15.130:0/3521909031 >> 172.21.15.130:0/3521909031 conn(0x7f5e280d36e0 msgr2=0x7f5e280d3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:41.581 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.582+0000 7f5e2d400640 1 -- 172.21.15.130:0/3521909031 shutdown_connections 2024-04-25T13:41:41.581 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.582+0000 7f5e2d400640 1 -- 172.21.15.130:0/3521909031 wait complete. 2024-04-25T13:41:41.599 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 3115b481-a0c8-4c65-a010-56a30eb0c9b4 2 2024-04-25T13:41:41.744 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.742+0000 7f085c200640 1 Processor -- start 2024-04-25T13:41:41.744 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.742+0000 7f085c200640 1 -- start start 2024-04-25T13:41:41.746 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.746+0000 7f085c200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08540d0670 0x7f08540b4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:41.746 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.746+0000 7f085c200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f08540d1b50 0x7f08540b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:41.747 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.746+0000 7f085c200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08540d20e0 con 0x7f085406df70 2024-04-25T13:41:41.747 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.746+0000 7f085c200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f08540ced40 con 0x7f08540d1b50 2024-04-25T13:41:41.747 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.746+0000 7f085c200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f08540d23c0 con 0x7f08540d0670 2024-04-25T13:41:41.747 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.746+0000 7f0858e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08540d0670 0x7f08540b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:41.747 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.746+0000 7f0858e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08540d0670 0x7f08540b4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:34404/0 (socket says 172.21.15.130:34404) 2024-04-25T13:41:41.747 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.746+0000 7f0858e00640 1 -- 172.21.15.130:0/3946442638 learned_addr learned my addr 172.21.15.130:0/3946442638 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-04-25T13:41:41.747 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.746+0000 7f085a200640 1 --2- 172.21.15.130:0/3946442638 >> v2:172.21.15.123:3300/0 conn(0x7f08540d1b50 0x7f08540b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:41.747 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.746+0000 7f0858e00640 1 -- 172.21.15.130:0/3946442638 >> v2:172.21.15.123:3300/0 conn(0x7f08540d1b50 msgr2=0x7f08540b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:41.749 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.746+0000 7f0858e00640 1 --2- 172.21.15.130:0/3946442638 >> v2:172.21.15.123:3300/0 conn(0x7f08540d1b50 0x7f08540b48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.749 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.746+0000 7f0858e00640 1 -- 172.21.15.130:0/3946442638 >> v1:172.21.15.123:6789/0 conn(0x7f085406df70 legacy=0x7f08540cff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:41.749 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.746+0000 7f0858e00640 1 -- 172.21.15.130:0/3946442638 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08540d26a0 con 0x7f08540d0670 2024-04-25T13:41:41.750 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.750+0000 7f0858e00640 1 --2- 172.21.15.130:0/3946442638 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08540d0670 0x7f08540b4370 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0840009870 tx=0x7f084001c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf6f3108dc3f2cde server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:41.750 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.750+0000 7f0853e00640 1 -- 172.21.15.130:0/3946442638 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08400ab5f0 con 0x7f08540d0670 2024-04-25T13:41:41.750 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.750+0000 7f0853e00640 1 -- 172.21.15.130:0/3946442638 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08400b0070 con 0x7f08540d0670 2024-04-25T13:41:41.750 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.750+0000 7f0853e00640 1 -- 172.21.15.130:0/3946442638 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08400ab9b0 con 0x7f08540d0670 2024-04-25T13:41:41.751 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.750+0000 7f085c200640 1 -- 172.21.15.130:0/3946442638 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08540d0670 msgr2=0x7f08540b4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:41.751 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.750+0000 7f085c200640 1 --2- 172.21.15.130:0/3946442638 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08540d0670 0x7f08540b4370 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0840009870 tx=0x7f084001c520 comp rx=0 tx=0).stop 2024-04-25T13:41:41.751 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.750+0000 7f085c200640 1 -- 172.21.15.130:0/3946442638 shutdown_connections 2024-04-25T13:41:41.751 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.750+0000 7f085c200640 1 --2- 172.21.15.130:0/3946442638 >> v2:172.21.15.123:3300/0 conn(0x7f08540d1b50 0x7f08540b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.751 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.750+0000 7f085c200640 1 --2- 172.21.15.130:0/3946442638 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08540d0670 0x7f08540b4370 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.751 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.750+0000 7f085c200640 1 -- 172.21.15.130:0/3946442638 >> 172.21.15.130:0/3946442638 conn(0x7f08540d36e0 msgr2=0x7f08540d3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:41.751 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.750+0000 7f085c200640 1 -- 172.21.15.130:0/3946442638 shutdown_connections 2024-04-25T13:41:41.751 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.750+0000 7f085c200640 1 -- 172.21.15.130:0/3946442638 wait complete. 2024-04-25T13:41:41.752 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.754+0000 7f085c200640 1 Processor -- start 2024-04-25T13:41:41.752 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.754+0000 7f085c200640 1 -- start start 2024-04-25T13:41:41.755 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.754+0000 7f085c200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f085406df70 0x7f0854163000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:41.755 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.754+0000 7f085c200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08540d1b50 0x7f0854160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:41.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.754+0000 7f085c200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0854161020 0x7f0854161430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:41.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.754+0000 7f085c200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f08540b4f70 con 0x7f0854161020 2024-04-25T13:41:41.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.754+0000 7f085c200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f08540b4df0 con 0x7f08540d1b50 2024-04-25T13:41:41.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.754+0000 7f085c200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f08540ce540 con 0x7f085406df70 2024-04-25T13:41:41.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.754+0000 7f0859800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f085406df70 0x7f0854163000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:41.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.754+0000 7f0859800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f085406df70 0x7f0854163000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:34420/0 (socket says 172.21.15.130:34420) 2024-04-25T13:41:41.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.754+0000 7f0859800640 1 -- 172.21.15.130:0/3647604784 learned_addr learned my addr 172.21.15.130:0/3647604784 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-04-25T13:41:41.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.754+0000 7f0858e00640 1 --2- 172.21.15.130:0/3647604784 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08540d1b50 0x7f0854160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:41.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.754+0000 7f085a200640 1 --2- 172.21.15.130:0/3647604784 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0854161020 0x7f0854161430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:41.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.754+0000 7f0859800640 1 -- 172.21.15.130:0/3647604784 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08540d1b50 msgr2=0x7f0854160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:41.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.754+0000 7f0859800640 1 --2- 172.21.15.130:0/3647604784 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08540d1b50 0x7f0854160ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.754+0000 7f0859800640 1 -- 172.21.15.130:0/3647604784 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0854161020 msgr2=0x7f0854161430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:41.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.754+0000 7f0859800640 1 --2- 172.21.15.130:0/3647604784 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0854161020 0x7f0854161430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.756 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.754+0000 7f0859800640 1 -- 172.21.15.130:0/3647604784 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0854161ac0 con 0x7f085406df70 2024-04-25T13:41:41.757 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.754+0000 7f0859800640 1 --2- 172.21.15.130:0/3647604784 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f085406df70 0x7f0854163000 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f084800b420 tx=0x7f084800b8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:41.757 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.754+0000 7f0851600640 1 -- 172.21.15.130:0/3647604784 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0848011830 con 0x7f085406df70 2024-04-25T13:41:41.757 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.754+0000 7f0851600640 1 -- 172.21.15.130:0/3647604784 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0848016070 con 0x7f085406df70 2024-04-25T13:41:41.757 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.754+0000 7f085c200640 1 -- 172.21.15.130:0/3647604784 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0854161da0 con 0x7f085406df70 2024-04-25T13:41:41.757 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.754+0000 7f0851600640 1 -- 172.21.15.130:0/3647604784 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0848011c30 con 0x7f085406df70 2024-04-25T13:41:41.757 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.754+0000 7f085c200640 1 -- 172.21.15.130:0/3647604784 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f08540cb240 con 0x7f085406df70 2024-04-25T13:41:41.757 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.754+0000 7f0851600640 1 -- 172.21.15.130:0/3647604784 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f084801a7a0 con 0x7f085406df70 2024-04-25T13:41:41.757 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.754+0000 7f0851600640 1 -- 172.21.15.130:0/3647604784 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f0848019370 con 0x7f085406df70 2024-04-25T13:41:41.757 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.758+0000 7f085c200640 1 -- 172.21.15.130:0/3647604784 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0854050750 con 0x7f085406df70 2024-04-25T13:41:41.759 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.758+0000 7f0851600640 1 -- 172.21.15.130:0/3647604784 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f0848011dd0 con 0x7f085406df70 2024-04-25T13:41:41.825 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.826+0000 7f085c200640 1 -- 172.21.15.130:0/3647604784 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3115b481-a0c8-4c65-a010-56a30eb0c9b4", "id": 2} v 0) -- 0x7f08540b9210 con 0x7f085406df70 2024-04-25T13:41:41.832 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.834+0000 7f0851600640 1 -- 172.21.15.130:0/3647604784 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3115b481-a0c8-4c65-a010-56a30eb0c9b4", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f084801ad80 con 0x7f085406df70 2024-04-25T13:41:41.832 INFO:teuthology.orchestra.run.smithi130.stdout:2 2024-04-25T13:41:41.833 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.834+0000 7f085c200640 1 -- 172.21.15.130:0/3647604784 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f085406df70 msgr2=0x7f0854163000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:41.834 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.834+0000 7f085c200640 1 --2- 172.21.15.130:0/3647604784 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f085406df70 0x7f0854163000 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f084800b420 tx=0x7f084800b8e0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.834 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.834+0000 7f085c200640 1 -- 172.21.15.130:0/3647604784 shutdown_connections 2024-04-25T13:41:41.834 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.834+0000 7f085c200640 1 --2- 172.21.15.130:0/3647604784 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08540d1b50 0x7f0854160ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.834 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.834+0000 7f085c200640 1 --2- 172.21.15.130:0/3647604784 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0854161020 0x7f0854161430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.834 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.834+0000 7f085c200640 1 --2- 172.21.15.130:0/3647604784 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f085406df70 0x7f0854163000 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:41.834 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.834+0000 7f085c200640 1 -- 172.21.15.130:0/3647604784 >> 172.21.15.130:0/3647604784 conn(0x7f08540d36e0 msgr2=0x7f08540cff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:41.834 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.834+0000 7f085c200640 1 -- 172.21.15.130:0/3647604784 shutdown_connections 2024-04-25T13:41:41.834 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.834+0000 7f085c200640 1 -- 172.21.15.130:0/3647604784 wait complete. 2024-04-25T13:41:41.853 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new f55746b8-e797-4bbf-afa5-9a160ab4678c 3 2024-04-25T13:41:42.000 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.998+0000 7f15e1400640 1 Processor -- start 2024-04-25T13:41:42.000 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:41.998+0000 7f15e1400640 1 -- start start 2024-04-25T13:41:42.001 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.002+0000 7f15e1400640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f15dc0b8760 0x7f15dc0b7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:42.002 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.002+0000 7f15e1400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f15dc0d1e90 0x7f15dc168470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:42.002 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.002+0000 7f15e1400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15dc0d22a0 con 0x7f15dc0d1370 2024-04-25T13:41:42.002 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.002+0000 7f15e1400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f15dc09cfd0 con 0x7f15dc0d1e90 2024-04-25T13:41:42.002 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.002+0000 7f15e1400640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f15dc0b8b70 con 0x7f15dc0b8760 2024-04-25T13:41:42.002 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.002+0000 7f15da800640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f15dc0b8760 0x7f15dc0b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:42.002 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.002+0000 7f15da800640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f15dc0b8760 0x7f15dc0b7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43602/0 (socket says 172.21.15.130:43602) 2024-04-25T13:41:42.002 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.002+0000 7f15da800640 1 -- 172.21.15.130:0/1828542573 learned_addr learned my addr 172.21.15.130:0/1828542573 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-04-25T13:41:42.002 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.002+0000 7f15db200640 1 --2- 172.21.15.130:0/1828542573 >> v2:172.21.15.123:3300/0 conn(0x7f15dc0d1e90 0x7f15dc168470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:42.003 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.002+0000 7f15da800640 1 -- 172.21.15.130:0/1828542573 >> v2:172.21.15.123:3300/0 conn(0x7f15dc0d1e90 msgr2=0x7f15dc168470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:42.003 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.002+0000 7f15da800640 1 --2- 172.21.15.130:0/1828542573 >> v2:172.21.15.123:3300/0 conn(0x7f15dc0d1e90 0x7f15dc168470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.003 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.002+0000 7f15da800640 1 -- 172.21.15.130:0/1828542573 >> v1:172.21.15.130:6789/0 conn(0x7f15dc0d1370 legacy=0x7f15dc0d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:42.003 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.002+0000 7f15da800640 1 -- 172.21.15.130:0/1828542573 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15dc0b8f70 con 0x7f15dc0b8760 2024-04-25T13:41:42.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.006+0000 7f15da800640 1 --2- 172.21.15.130:0/1828542573 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15dc0b8760 0x7f15dc0b7000 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f15dc0d1160 tx=0x7f15cc01c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b76a5f8a73a646dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:42.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.006+0000 7f15d9400640 1 -- 172.21.15.130:0/1828542573 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc0ab610 con 0x7f15dc0b8760 2024-04-25T13:41:42.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.006+0000 7f15d9400640 1 -- 172.21.15.130:0/1828542573 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15cc0b0070 con 0x7f15dc0b8760 2024-04-25T13:41:42.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.006+0000 7f15d9400640 1 -- 172.21.15.130:0/1828542573 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc0ab9d0 con 0x7f15dc0b8760 2024-04-25T13:41:42.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.006+0000 7f15e1400640 1 -- 172.21.15.130:0/1828542573 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15dc0b8760 msgr2=0x7f15dc0b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:42.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.006+0000 7f15e1400640 1 --2- 172.21.15.130:0/1828542573 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15dc0b8760 0x7f15dc0b7000 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f15dc0d1160 tx=0x7f15cc01c520 comp rx=0 tx=0).stop 2024-04-25T13:41:42.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.006+0000 7f15e1400640 1 -- 172.21.15.130:0/1828542573 shutdown_connections 2024-04-25T13:41:42.006 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.006+0000 7f15e1400640 1 --2- 172.21.15.130:0/1828542573 >> v2:172.21.15.123:3300/0 conn(0x7f15dc0d1e90 0x7f15dc168470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.006+0000 7f15e1400640 1 --2- 172.21.15.130:0/1828542573 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15dc0b8760 0x7f15dc0b7000 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.006+0000 7f15e1400640 1 -- 172.21.15.130:0/1828542573 >> 172.21.15.130:0/1828542573 conn(0x7f15dc0d0220 msgr2=0x7f15dc0d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:42.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.006+0000 7f15e1400640 1 -- 172.21.15.130:0/1828542573 shutdown_connections 2024-04-25T13:41:42.007 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.006+0000 7f15e1400640 1 -- 172.21.15.130:0/1828542573 wait complete. 2024-04-25T13:41:42.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.010+0000 7f15e1400640 1 Processor -- start 2024-04-25T13:41:42.008 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.010+0000 7f15e1400640 1 -- start start 2024-04-25T13:41:42.012 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.010+0000 7f15e1400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15dc0b8760 0x7f15dc162840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:42.012 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.010+0000 7f15e1400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15dc0d1370 0x7f15dc0a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:42.012 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.010+0000 7f15e1400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15dc0d1e90 0x7f15dc0cca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:42.012 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.010+0000 7f15e1400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc0cf740 con 0x7f15dc0d1e90 2024-04-25T13:41:42.012 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.010+0000 7f15e1400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc0cff40 con 0x7f15dc0d1370 2024-04-25T13:41:42.012 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.010+0000 7f15e1400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f15dc0b7540 con 0x7f15dc0b8760 2024-04-25T13:41:42.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.010+0000 7f15da800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15dc0b8760 0x7f15dc162840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:42.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.010+0000 7f15d9e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15dc0d1370 0x7f15dc0a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:42.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.010+0000 7f15da800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15dc0b8760 0x7f15dc162840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:58390/0 (socket says 172.21.15.130:58390) 2024-04-25T13:41:42.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.010+0000 7f15da800640 1 -- 172.21.15.130:0/2960046597 learned_addr learned my addr 172.21.15.130:0/2960046597 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-04-25T13:41:42.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.010+0000 7f15db200640 1 --2- 172.21.15.130:0/2960046597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15dc0d1e90 0x7f15dc0cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:42.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.010+0000 7f15da800640 1 -- 172.21.15.130:0/2960046597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15dc0d1370 msgr2=0x7f15dc0a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:42.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.010+0000 7f15da800640 1 --2- 172.21.15.130:0/2960046597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15dc0d1370 0x7f15dc0a0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.010+0000 7f15da800640 1 -- 172.21.15.130:0/2960046597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15dc0d1e90 msgr2=0x7f15dc0cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:42.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.010+0000 7f15da800640 1 --2- 172.21.15.130:0/2960046597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15dc0d1e90 0x7f15dc0cca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.010+0000 7f15da800640 1 -- 172.21.15.130:0/2960046597 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15dc0c9330 con 0x7f15dc0b8760 2024-04-25T13:41:42.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.010+0000 7f15d9e00640 1 --2- 172.21.15.130:0/2960046597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15dc0d1370 0x7f15dc0a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:41:42.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.010+0000 7f15da800640 1 --2- 172.21.15.130:0/2960046597 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15dc0b8760 0x7f15dc162840 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f15cc01a150 tx=0x7f15cc0192c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:42.013 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.010+0000 7f15d2a00640 1 -- 172.21.15.130:0/2960046597 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc0039f0 con 0x7f15dc0b8760 2024-04-25T13:41:42.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.014+0000 7f15d2a00640 1 -- 172.21.15.130:0/2960046597 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15cc003b90 con 0x7f15dc0b8760 2024-04-25T13:41:42.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.014+0000 7f15d2a00640 1 -- 172.21.15.130:0/2960046597 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc0059a0 con 0x7f15dc0b8760 2024-04-25T13:41:42.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.014+0000 7f15e1400640 1 -- 172.21.15.130:0/2960046597 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15dc163160 con 0x7f15dc0b8760 2024-04-25T13:41:42.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.014+0000 7f15e1400640 1 -- 172.21.15.130:0/2960046597 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f15dc0c8850 con 0x7f15dc0b8760 2024-04-25T13:41:42.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.014+0000 7f15d2a00640 1 -- 172.21.15.130:0/2960046597 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f15cc0bf020 con 0x7f15dc0b8760 2024-04-25T13:41:42.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.014+0000 7f15d2a00640 1 -- 172.21.15.130:0/2960046597 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f15cc0abb20 con 0x7f15dc0b8760 2024-04-25T13:41:42.014 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.014+0000 7f15e1400640 1 -- 172.21.15.130:0/2960046597 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15dc0d2ef0 con 0x7f15dc0b8760 2024-04-25T13:41:42.017 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.018+0000 7f15d2a00640 1 -- 172.21.15.130:0/2960046597 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f15dc0d2ef0 con 0x7f15dc0b8760 2024-04-25T13:41:42.083 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.082+0000 7f15e1400640 1 -- 172.21.15.130:0/2960046597 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f55746b8-e797-4bbf-afa5-9a160ab4678c", "id": 3} v 0) -- 0x7f15dc050750 con 0x7f15dc0b8760 2024-04-25T13:41:42.088 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.090+0000 7f15d2a00640 1 -- 172.21.15.130:0/2960046597 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f55746b8-e797-4bbf-afa5-9a160ab4678c", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f15cc0a8050 con 0x7f15dc0b8760 2024-04-25T13:41:42.089 INFO:teuthology.orchestra.run.smithi130.stdout:3 2024-04-25T13:41:42.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.090+0000 7f15e1400640 1 -- 172.21.15.130:0/2960046597 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15dc0b8760 msgr2=0x7f15dc162840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:42.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.090+0000 7f15e1400640 1 --2- 172.21.15.130:0/2960046597 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15dc0b8760 0x7f15dc162840 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f15cc01a150 tx=0x7f15cc0192c0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.090+0000 7f15e1400640 1 -- 172.21.15.130:0/2960046597 shutdown_connections 2024-04-25T13:41:42.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.090+0000 7f15e1400640 1 --2- 172.21.15.130:0/2960046597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15dc0d1370 0x7f15dc0a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.090+0000 7f15e1400640 1 --2- 172.21.15.130:0/2960046597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f15dc0d1e90 0x7f15dc0cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.090+0000 7f15e1400640 1 --2- 172.21.15.130:0/2960046597 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15dc0b8760 0x7f15dc162840 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.090+0000 7f15e1400640 1 -- 172.21.15.130:0/2960046597 >> 172.21.15.130:0/2960046597 conn(0x7f15dc0d0220 msgr2=0x7f15dc0ceea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:42.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.090+0000 7f15e1400640 1 -- 172.21.15.130:0/2960046597 shutdown_connections 2024-04-25T13:41:42.090 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.090+0000 7f15e1400640 1 -- 172.21.15.130:0/2960046597 wait complete. 2024-04-25T13:41:42.092 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-25T13:41:42.093+0000 7f5332ada180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T13:41:42.108 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 634fe1b1-3507-437a-a936-4eeee37d72b8 4 2024-04-25T13:41:42.145 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-25T13:41:42.146+0000 7f691a91d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T13:41:42.155 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-25T13:41:42.157+0000 7f5332ada180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T13:41:42.211 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-25T13:41:42.210+0000 7f691a91d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T13:41:42.215 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-25T13:41:42.217+0000 7f5332ada180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T13:41:42.256 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.258+0000 7f2ef9400640 1 Processor -- start 2024-04-25T13:41:42.256 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.258+0000 7f2ef9400640 1 -- start start 2024-04-25T13:41:42.258 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.258+0000 7f2ef9400640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2ef40d0760 0x7f2ef40b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:42.258 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.258+0000 7f2ef9400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ef40ce660 con 0x7f2ef40b8ea0 2024-04-25T13:41:42.258 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.258+0000 7f2ef9400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ef40ce900 con 0x7f2ef40cf3e0 2024-04-25T13:41:42.258 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.258+0000 7f2ef9400640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f2ef40b92b0 con 0x7f2ef40d0760 2024-04-25T13:41:42.258 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.258+0000 7f2ef3200640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2ef40d0760 0x7f2ef40b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:42.258 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.258+0000 7f2ef3200640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2ef40d0760 0x7f2ef40b3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43614/0 (socket says 172.21.15.130:43614) 2024-04-25T13:41:42.258 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.258+0000 7f2ef3200640 1 -- 172.21.15.130:0/3206872621 learned_addr learned my addr 172.21.15.130:0/3206872621 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-04-25T13:41:42.258 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.258+0000 7f2ef1e00640 1 --1- 172.21.15.130:0/3206872621 >> v1:172.21.15.130:6789/0 conn(0x7f2ef40cf3e0 0x7f2ef40d0050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:33762/0 (socket says 172.21.15.130:33762) 2024-04-25T13:41:42.259 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.258+0000 7f2ef3200640 1 -- 172.21.15.130:0/3206872621 >> v1:172.21.15.130:6789/0 conn(0x7f2ef40cf3e0 legacy=0x7f2ef40d0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:42.259 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.258+0000 7f2ef3200640 1 -- 172.21.15.130:0/3206872621 >> v1:172.21.15.123:6789/0 conn(0x7f2ef40b8ea0 legacy=0x7f2ef40b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:42.259 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.258+0000 7f2ef3200640 1 -- 172.21.15.130:0/3206872621 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef40cebe0 con 0x7f2ef40d0760 2024-04-25T13:41:42.261 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.262+0000 7f2ef3200640 1 --2- 172.21.15.130:0/3206872621 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef40d0760 0x7f2ef40b3040 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009e50 tx=0x7f2eec01d400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e532434cf8fb987e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:42.261 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.262+0000 7f2ef1400640 1 -- 172.21.15.130:0/3206872621 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec0a5770 con 0x7f2ef40d0760 2024-04-25T13:41:42.262 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.262+0000 7f2ef1400640 1 -- 172.21.15.130:0/3206872621 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eec0a5910 con 0x7f2ef40d0760 2024-04-25T13:41:42.262 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.262+0000 7f2ef1400640 1 -- 172.21.15.130:0/3206872621 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec0a5ce0 con 0x7f2ef40d0760 2024-04-25T13:41:42.262 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.262+0000 7f2ef9400640 1 -- 172.21.15.130:0/3206872621 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef40d0760 msgr2=0x7f2ef40b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:42.263 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.262+0000 7f2ef9400640 1 --2- 172.21.15.130:0/3206872621 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef40d0760 0x7f2ef40b3040 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009e50 tx=0x7f2eec01d400 comp rx=0 tx=0).stop 2024-04-25T13:41:42.263 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.262+0000 7f2ef9400640 1 -- 172.21.15.130:0/3206872621 shutdown_connections 2024-04-25T13:41:42.263 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.262+0000 7f2ef9400640 1 --2- 172.21.15.130:0/3206872621 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef40d0760 0x7f2ef40b3040 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.263 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.262+0000 7f2ef9400640 1 -- 172.21.15.130:0/3206872621 >> 172.21.15.130:0/3206872621 conn(0x7f2ef40d36e0 msgr2=0x7f2ef40d3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:42.263 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.262+0000 7f2ef9400640 1 -- 172.21.15.130:0/3206872621 shutdown_connections 2024-04-25T13:41:42.263 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.262+0000 7f2ef9400640 1 -- 172.21.15.130:0/3206872621 wait complete. 2024-04-25T13:41:42.265 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.266+0000 7f2ef9400640 1 Processor -- start 2024-04-25T13:41:42.265 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.266+0000 7f2ef9400640 1 -- start start 2024-04-25T13:41:42.267 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.266+0000 7f2ef9400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef40b8ea0 0x7f2ef4168c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:42.267 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.266+0000 7f2ef9400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ef40cf3e0 0x7f2ef41fd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:42.268 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.266+0000 7f2ef9400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ef415a9b0 0x7f2ef41fd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:42.268 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.266+0000 7f2ef9400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef416c790 con 0x7f2ef40cf3e0 2024-04-25T13:41:42.268 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.266+0000 7f2ef9400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef40b3990 con 0x7f2ef40b8ea0 2024-04-25T13:41:42.268 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.266+0000 7f2ef9400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2ef416c910 con 0x7f2ef415a9b0 2024-04-25T13:41:42.268 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.266+0000 7f2ef2800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef40b8ea0 0x7f2ef4168c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:42.268 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.266+0000 7f2ef3200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ef415a9b0 0x7f2ef41fd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:42.268 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.266+0000 7f2ef2800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef40b8ea0 0x7f2ef4168c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43624/0 (socket says 172.21.15.130:43624) 2024-04-25T13:41:42.268 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.266+0000 7f2ef2800640 1 -- 172.21.15.130:0/1112235547 learned_addr learned my addr 172.21.15.130:0/1112235547 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-04-25T13:41:42.268 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.266+0000 7f2ef1e00640 1 --2- 172.21.15.130:0/1112235547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ef40cf3e0 0x7f2ef41fd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:42.268 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.266+0000 7f2ef2800640 1 -- 172.21.15.130:0/1112235547 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ef415a9b0 msgr2=0x7f2ef41fd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:42.268 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.266+0000 7f2ef2800640 1 --2- 172.21.15.130:0/1112235547 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ef415a9b0 0x7f2ef41fd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.268 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.266+0000 7f2ef2800640 1 -- 172.21.15.130:0/1112235547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ef40cf3e0 msgr2=0x7f2ef41fd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:42.268 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.266+0000 7f2ef2800640 1 --2- 172.21.15.130:0/1112235547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ef40cf3e0 0x7f2ef41fd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.266+0000 7f2ef2800640 1 -- 172.21.15.130:0/1112235547 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef40b1e30 con 0x7f2ef40b8ea0 2024-04-25T13:41:42.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.266+0000 7f2ef3200640 1 --2- 172.21.15.130:0/1112235547 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ef415a9b0 0x7f2ef41fd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:41:42.269 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.270+0000 7f2ef2800640 1 --2- 172.21.15.130:0/1112235547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef40b8ea0 0x7f2ef4168c50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2ee400c3f0 tx=0x7f2ee400c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:42.270 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.270+0000 7f2eeaa00640 1 -- 172.21.15.130:0/1112235547 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee40052d0 con 0x7f2ef40b8ea0 2024-04-25T13:41:42.270 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.270+0000 7f2eeaa00640 1 -- 172.21.15.130:0/1112235547 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ee40054b0 con 0x7f2ef40b8ea0 2024-04-25T13:41:42.270 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.270+0000 7f2eeaa00640 1 -- 172.21.15.130:0/1112235547 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4006a70 con 0x7f2ef40b8ea0 2024-04-25T13:41:42.270 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.270+0000 7f2ef9400640 1 -- 172.21.15.130:0/1112235547 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ef4169190 con 0x7f2ef40b8ea0 2024-04-25T13:41:42.270 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.270+0000 7f2ef9400640 1 -- 172.21.15.130:0/1112235547 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ef40b23b0 con 0x7f2ef40b8ea0 2024-04-25T13:41:42.270 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.270+0000 7f2eeaa00640 1 -- 172.21.15.130:0/1112235547 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2ee4006c10 con 0x7f2ef40b8ea0 2024-04-25T13:41:42.270 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.270+0000 7f2eeaa00640 1 -- 172.21.15.130:0/1112235547 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f2ee4007020 con 0x7f2ef40b8ea0 2024-04-25T13:41:42.270 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.270+0000 7f2ef9400640 1 -- 172.21.15.130:0/1112235547 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ef4050750 con 0x7f2ef40b8ea0 2024-04-25T13:41:42.272 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.274+0000 7f2eeaa00640 1 -- 172.21.15.130:0/1112235547 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f2ee40072f0 con 0x7f2ef40b8ea0 2024-04-25T13:41:42.275 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-25T13:41:42.274+0000 7f691a91d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T13:41:42.304 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-25T13:41:42.305+0000 7f5332ada180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T13:41:42.339 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.338+0000 7f2ef9400640 1 -- 172.21.15.130:0/1112235547 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd new", "uuid": "634fe1b1-3507-437a-a936-4eeee37d72b8", "id": 4} v 0) -- 0x7f2ef40d0dd0 con 0x7f2ef40b8ea0 2024-04-25T13:41:42.343 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.342+0000 7f2eeaa00640 1 -- 172.21.15.130:0/1112235547 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "634fe1b1-3507-437a-a936-4eeee37d72b8", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f2ee40074d0 con 0x7f2ef40b8ea0 2024-04-25T13:41:42.343 INFO:teuthology.orchestra.run.smithi130.stdout:4 2024-04-25T13:41:42.345 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.346+0000 7f2ef9400640 1 -- 172.21.15.130:0/1112235547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef40b8ea0 msgr2=0x7f2ef4168c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:42.345 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.346+0000 7f2ef9400640 1 --2- 172.21.15.130:0/1112235547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef40b8ea0 0x7f2ef4168c50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2ee400c3f0 tx=0x7f2ee400c7f0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.345 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.346+0000 7f2ef9400640 1 -- 172.21.15.130:0/1112235547 shutdown_connections 2024-04-25T13:41:42.345 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.346+0000 7f2ef9400640 1 --2- 172.21.15.130:0/1112235547 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ef415a9b0 0x7f2ef41fd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.346 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.346+0000 7f2ef9400640 1 --2- 172.21.15.130:0/1112235547 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ef40cf3e0 0x7f2ef41fd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.346 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.346+0000 7f2ef9400640 1 --2- 172.21.15.130:0/1112235547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ef40b8ea0 0x7f2ef4168c50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.346 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.346+0000 7f2ef9400640 1 -- 172.21.15.130:0/1112235547 >> 172.21.15.130:0/1112235547 conn(0x7f2ef40d36e0 msgr2=0x7f2ef415c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:42.346 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.346+0000 7f2ef9400640 1 -- 172.21.15.130:0/1112235547 shutdown_connections 2024-04-25T13:41:42.346 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.346+0000 7f2ef9400640 1 -- 172.21.15.130:0/1112235547 wait complete. 2024-04-25T13:41:42.364 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 6155b831-3bd9-4215-8cf0-8984cb006819 5 2024-04-25T13:41:42.365 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-25T13:41:42.369+0000 7f5332ada180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T13:41:42.367 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-25T13:41:42.366+0000 7f691a91d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T13:41:42.434 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-25T13:41:42.434+0000 7f691a91d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T13:41:42.453 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-25T13:41:42.453+0000 7f5332ada180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T13:41:42.513 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.514+0000 7f5646c00640 1 Processor -- start 2024-04-25T13:41:42.513 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.514+0000 7f5646c00640 1 -- start start 2024-04-25T13:41:42.514 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.514+0000 7f5646c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f56400d1040 0x7f56400d4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:42.515 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.514+0000 7f5646c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56401608d0 con 0x7f56400d42a0 2024-04-25T13:41:42.515 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.514+0000 7f5646c00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5640160bb0 con 0x7f56400d5f60 2024-04-25T13:41:42.515 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.514+0000 7f5646c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5640161450 con 0x7f56400d1040 2024-04-25T13:41:42.515 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.514+0000 7f5644c00640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f56400d5f60 0x7f5640163dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:33778/0 (socket says 172.21.15.130:33778) 2024-04-25T13:41:42.515 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.514+0000 7f5644c00640 1 -- 172.21.15.130:0/1127786273 learned_addr learned my addr 172.21.15.130:0/1127786273 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-04-25T13:41:42.515 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.514+0000 7f563fe00640 1 --2- 172.21.15.130:0/1127786273 >> v2:172.21.15.123:3300/0 conn(0x7f56400d1040 0x7f56400d4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:42.516 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.514+0000 7f563ea00640 1 -- 172.21.15.130:0/1127786273 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3110670173 0 0) 0x7f56401608d0 con 0x7f56400d42a0 2024-04-25T13:41:42.517 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.514+0000 7f563ea00640 1 -- 172.21.15.130:0/1127786273 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5624003530 con 0x7f56400d42a0 2024-04-25T13:41:42.517 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.514+0000 7f563ea00640 1 -- 172.21.15.130:0/1127786273 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1614433881 0 0) 0x7f5640160bb0 con 0x7f56400d5f60 2024-04-25T13:41:42.517 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.514+0000 7f563ea00640 1 -- 172.21.15.130:0/1127786273 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56401608d0 con 0x7f56400d5f60 2024-04-25T13:41:42.517 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.514+0000 7f563fe00640 1 -- 172.21.15.130:0/1127786273 >> v1:172.21.15.130:6789/0 conn(0x7f56400d5f60 legacy=0x7f5640163dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:42.517 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.514+0000 7f563fe00640 1 -- 172.21.15.130:0/1127786273 >> v1:172.21.15.123:6789/0 conn(0x7f56400d42a0 legacy=0x7f56400d5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:42.517 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.514+0000 7f563fe00640 1 -- 172.21.15.130:0/1127786273 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5640160e90 con 0x7f56400d1040 2024-04-25T13:41:42.517 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-25T13:41:42.517+0000 7f5332ada180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T13:41:42.518 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.518+0000 7f563fe00640 1 --2- 172.21.15.130:0/1127786273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56400d1040 0x7f56400d4e40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f56300097c0 tx=0x7f563001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112c7056b455932 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:42.519 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.518+0000 7f563ea00640 1 -- 172.21.15.130:0/1127786273 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56300b0070 con 0x7f56400d1040 2024-04-25T13:41:42.519 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.518+0000 7f563ea00640 1 -- 172.21.15.130:0/1127786273 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56300ab600 con 0x7f56400d1040 2024-04-25T13:41:42.519 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.518+0000 7f563ea00640 1 -- 172.21.15.130:0/1127786273 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56300ab9d0 con 0x7f56400d1040 2024-04-25T13:41:42.520 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.518+0000 7f5646c00640 1 -- 172.21.15.130:0/1127786273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56400d1040 msgr2=0x7f56400d4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:42.520 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.518+0000 7f5646c00640 1 --2- 172.21.15.130:0/1127786273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56400d1040 0x7f56400d4e40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f56300097c0 tx=0x7f563001c410 comp rx=0 tx=0).stop 2024-04-25T13:41:42.520 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.518+0000 7f5646c00640 1 -- 172.21.15.130:0/1127786273 shutdown_connections 2024-04-25T13:41:42.520 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.518+0000 7f5646c00640 1 --2- 172.21.15.130:0/1127786273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56400d1040 0x7f56400d4e40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.520 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.518+0000 7f5646c00640 1 -- 172.21.15.130:0/1127786273 >> 172.21.15.130:0/1127786273 conn(0x7f564006d920 msgr2=0x7f564006dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:42.520 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.522+0000 7f5646c00640 1 -- 172.21.15.130:0/1127786273 shutdown_connections 2024-04-25T13:41:42.521 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.522+0000 7f5646c00640 1 -- 172.21.15.130:0/1127786273 wait complete. 2024-04-25T13:41:42.522 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.522+0000 7f5646c00640 1 Processor -- start 2024-04-25T13:41:42.522 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.522+0000 7f5646c00640 1 -- start start 2024-04-25T13:41:42.524 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.522+0000 7f5646c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f56400d1040 0x7f564014b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:42.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.522+0000 7f5646c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56400d42a0 0x7f5640154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:42.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.522+0000 7f5646c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5640154960 0x7f5640150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:42.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.522+0000 7f5646c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f56400d4830 con 0x7f56400d42a0 2024-04-25T13:41:42.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.522+0000 7f5646c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f56400d46b0 con 0x7f5640154960 2024-04-25T13:41:42.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.522+0000 7f5646c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f5640160520 con 0x7f56400d1040 2024-04-25T13:41:42.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.522+0000 7f563fe00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f56400d1040 0x7f564014b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:42.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.522+0000 7f563fe00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f56400d1040 0x7f564014b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:58416/0 (socket says 172.21.15.130:58416) 2024-04-25T13:41:42.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.522+0000 7f563fe00640 1 -- 172.21.15.130:0/3133768725 learned_addr learned my addr 172.21.15.130:0/3133768725 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-04-25T13:41:42.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.526+0000 7f5644c00640 1 --2- 172.21.15.130:0/3133768725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5640154960 0x7f5640150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:42.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.526+0000 7f563f400640 1 --2- 172.21.15.130:0/3133768725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56400d42a0 0x7f5640154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:42.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.526+0000 7f563fe00640 1 -- 172.21.15.130:0/3133768725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5640154960 msgr2=0x7f5640150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:42.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.526+0000 7f563fe00640 1 --2- 172.21.15.130:0/3133768725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5640154960 0x7f5640150760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.525 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.526+0000 7f563fe00640 1 -- 172.21.15.130:0/3133768725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56400d42a0 msgr2=0x7f5640154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:42.526 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.526+0000 7f563fe00640 1 --2- 172.21.15.130:0/3133768725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56400d42a0 0x7f5640154420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.526 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.526+0000 7f563fe00640 1 -- 172.21.15.130:0/3133768725 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5640154d70 con 0x7f56400d1040 2024-04-25T13:41:42.526 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.526+0000 7f5644c00640 1 --2- 172.21.15.130:0/3133768725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5640154960 0x7f5640150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:41:42.526 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.526+0000 7f563fe00640 1 --2- 172.21.15.130:0/3133768725 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f56400d1040 0x7f564014b4f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f56300ae040 tx=0x7f563001ac50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:42.527 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.526+0000 7f5637e00640 1 -- 172.21.15.130:0/3133768725 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56300b0050 con 0x7f56400d1040 2024-04-25T13:41:42.527 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.526+0000 7f5646c00640 1 -- 172.21.15.130:0/3133768725 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f564014bf00 con 0x7f56400d1040 2024-04-25T13:41:42.527 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.526+0000 7f5646c00640 1 -- 172.21.15.130:0/3133768725 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f56401552d0 con 0x7f56400d1040 2024-04-25T13:41:42.527 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.526+0000 7f5637e00640 1 -- 172.21.15.130:0/3133768725 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56300bc070 con 0x7f56400d1040 2024-04-25T13:41:42.527 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.526+0000 7f5637e00640 1 -- 172.21.15.130:0/3133768725 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630006e20 con 0x7f56400d1040 2024-04-25T13:41:42.527 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.526+0000 7f5637e00640 1 -- 172.21.15.130:0/3133768725 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f56300b5830 con 0x7f56400d1040 2024-04-25T13:41:42.527 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.526+0000 7f5637e00640 1 -- 172.21.15.130:0/3133768725 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f56300b7450 con 0x7f56400d1040 2024-04-25T13:41:42.527 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.526+0000 7f5646c00640 1 -- 172.21.15.130:0/3133768725 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56180052a0 con 0x7f56400d1040 2024-04-25T13:41:42.530 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-25T13:41:42.530+0000 7f691a91d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T13:41:42.533 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.534+0000 7f5637e00640 1 -- 172.21.15.130:0/3133768725 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5640154d70 con 0x7f56400d1040 2024-04-25T13:41:42.596 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-25T13:41:42.598+0000 7f691a91d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T13:41:42.600 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.602+0000 7f5646c00640 1 -- 172.21.15.130:0/3133768725 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6155b831-3bd9-4215-8cf0-8984cb006819", "id": 5} v 0) -- 0x7f5618005590 con 0x7f56400d1040 2024-04-25T13:41:42.608 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.610+0000 7f5637e00640 1 -- 172.21.15.130:0/3133768725 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6155b831-3bd9-4215-8cf0-8984cb006819", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f5630016090 con 0x7f56400d1040 2024-04-25T13:41:42.608 INFO:teuthology.orchestra.run.smithi130.stdout:5 2024-04-25T13:41:42.609 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.610+0000 7f5646c00640 1 -- 172.21.15.130:0/3133768725 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f56400d1040 msgr2=0x7f564014b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:42.609 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.610+0000 7f5646c00640 1 --2- 172.21.15.130:0/3133768725 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f56400d1040 0x7f564014b4f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f56300ae040 tx=0x7f563001ac50 comp rx=0 tx=0).stop 2024-04-25T13:41:42.609 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.610+0000 7f5646c00640 1 -- 172.21.15.130:0/3133768725 shutdown_connections 2024-04-25T13:41:42.610 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.610+0000 7f5646c00640 1 --2- 172.21.15.130:0/3133768725 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5640154960 0x7f5640150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.610 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.610+0000 7f5646c00640 1 --2- 172.21.15.130:0/3133768725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f56400d42a0 0x7f5640154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.610 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.610+0000 7f5646c00640 1 --2- 172.21.15.130:0/3133768725 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f56400d1040 0x7f564014b4f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.610 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.610+0000 7f5646c00640 1 -- 172.21.15.130:0/3133768725 >> 172.21.15.130:0/3133768725 conn(0x7f564006d920 msgr2=0x7f56400ba8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:42.610 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.610+0000 7f5646c00640 1 -- 172.21.15.130:0/3133768725 shutdown_connections 2024-04-25T13:41:42.610 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.610+0000 7f5646c00640 1 -- 172.21.15.130:0/3133768725 wait complete. 2024-04-25T13:41:42.628 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 080c6ed4-1240-4af2-8628-ba91344bc1c3 6 2024-04-25T13:41:42.683 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-25T13:41:42.685+0000 7f5332ada180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T13:41:42.754 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-25T13:41:42.757+0000 7f5332ada180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T13:41:42.769 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-25T13:41:42.770+0000 7f691a91d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T13:41:42.773 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.774+0000 7f7877600640 1 Processor -- start 2024-04-25T13:41:42.773 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.774+0000 7f7877600640 1 -- start start 2024-04-25T13:41:42.775 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.774+0000 7f7877600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78700b7860 0x7f787006c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:42.775 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.774+0000 7f7877600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78700cfeb0 con 0x7f787006cbb0 2024-04-25T13:41:42.775 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.774+0000 7f7877600640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78700b8150 con 0x7f787006cfc0 2024-04-25T13:41:42.775 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.774+0000 7f7877600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f78700cea10 con 0x7f78700b7860 2024-04-25T13:41:42.775 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.774+0000 7f7874c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78700b7860 0x7f787006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:42.775 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.774+0000 7f7875600640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f787006cfc0 0x7f78700b25a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:33790/0 (socket says 172.21.15.130:33790) 2024-04-25T13:41:42.775 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.774+0000 7f7875600640 1 -- 172.21.15.130:0/1021088707 learned_addr learned my addr 172.21.15.130:0/1021088707 (peer_addr_for_me v1:172.21.15.130:0/0) 2024-04-25T13:41:42.776 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.774+0000 7f7874c00640 1 -- 172.21.15.130:0/1021088707 >> v1:172.21.15.130:6789/0 conn(0x7f787006cfc0 legacy=0x7f78700b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:42.776 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.774+0000 7f7874c00640 1 -- 172.21.15.130:0/1021088707 >> v1:172.21.15.123:6789/0 conn(0x7f787006cbb0 legacy=0x7f78700b1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:42.776 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.774+0000 7f7874c00640 1 -- 172.21.15.130:0/1021088707 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78700b2cb0 con 0x7f78700b7860 2024-04-25T13:41:42.778 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.778+0000 7f7874c00640 1 --2- 172.21.15.130:0/1021088707 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78700b7860 0x7f787006c670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f78640097d0 tx=0x7f786401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e705800b18206349 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:42.778 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.778+0000 7f786f400640 1 -- 172.21.15.130:0/1021088707 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78640ab5f0 con 0x7f78700b7860 2024-04-25T13:41:42.779 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.778+0000 7f786f400640 1 -- 172.21.15.130:0/1021088707 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78640b0070 con 0x7f78700b7860 2024-04-25T13:41:42.779 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.778+0000 7f786f400640 1 -- 172.21.15.130:0/1021088707 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78640ab9b0 con 0x7f78700b7860 2024-04-25T13:41:42.779 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.778+0000 7f7877600640 1 -- 172.21.15.130:0/1021088707 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78700b7860 msgr2=0x7f787006c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:42.780 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.778+0000 7f7877600640 1 --2- 172.21.15.130:0/1021088707 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78700b7860 0x7f787006c670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f78640097d0 tx=0x7f786401c4e0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.780 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.778+0000 7f7877600640 1 -- 172.21.15.130:0/1021088707 shutdown_connections 2024-04-25T13:41:42.780 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.778+0000 7f7877600640 1 --2- 172.21.15.130:0/1021088707 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78700b7860 0x7f787006c670 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.780 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.778+0000 7f7877600640 1 -- 172.21.15.130:0/1021088707 >> 172.21.15.130:0/1021088707 conn(0x7f78700d25f0 msgr2=0x7f78700d2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:42.780 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.782+0000 7f7877600640 1 -- 172.21.15.130:0/1021088707 shutdown_connections 2024-04-25T13:41:42.780 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.782+0000 7f7877600640 1 -- 172.21.15.130:0/1021088707 wait complete. 2024-04-25T13:41:42.782 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.782+0000 7f7877600640 1 Processor -- start 2024-04-25T13:41:42.782 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.782+0000 7f7877600640 1 -- start start 2024-04-25T13:41:42.784 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.782+0000 7f7877600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f787006cbb0 0x7f787015abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:42.784 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.782+0000 7f7877600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f787006cfc0 0x7f7870156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:42.784 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.782+0000 7f7877600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78700b7860 0x7f787015b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:42.784 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.782+0000 7f7877600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f78700d31f0 con 0x7f787006cfc0 2024-04-25T13:41:42.785 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.782+0000 7f7877600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f78700b5440 con 0x7f78700b7860 2024-04-25T13:41:42.785 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.782+0000 7f7877600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f78700d3370 con 0x7f787006cbb0 2024-04-25T13:41:42.785 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.782+0000 7f7874c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f787006cbb0 0x7f787015abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:42.785 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.786+0000 7f7874c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f787006cbb0 0x7f787015abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:58432/0 (socket says 172.21.15.130:58432) 2024-04-25T13:41:42.785 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.786+0000 7f7874c00640 1 -- 172.21.15.130:0/544347432 learned_addr learned my addr 172.21.15.130:0/544347432 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-04-25T13:41:42.785 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.786+0000 7f7875600640 1 --2- 172.21.15.130:0/544347432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78700b7860 0x7f787015b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:42.785 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.786+0000 7f786fe00640 1 --2- 172.21.15.130:0/544347432 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f787006cfc0 0x7f7870156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:42.785 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.786+0000 7f7874c00640 1 -- 172.21.15.130:0/544347432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78700b7860 msgr2=0x7f787015b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:42.785 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.786+0000 7f7874c00640 1 --2- 172.21.15.130:0/544347432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78700b7860 0x7f787015b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.785 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.786+0000 7f7874c00640 1 -- 172.21.15.130:0/544347432 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f787006cfc0 msgr2=0x7f7870156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:42.785 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.786+0000 7f7874c00640 1 --2- 172.21.15.130:0/544347432 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f787006cfc0 0x7f7870156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.785 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.786+0000 7f7874c00640 1 -- 172.21.15.130:0/544347432 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7870157460 con 0x7f787006cbb0 2024-04-25T13:41:42.785 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.786+0000 7f7874c00640 1 --2- 172.21.15.130:0/544347432 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f787006cbb0 0x7f787015abb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f78640ad040 tx=0x7f7864019280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:42.786 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.786+0000 7f786cc00640 1 -- 172.21.15.130:0/544347432 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78640b4c80 con 0x7f787006cbb0 2024-04-25T13:41:42.786 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.786+0000 7f786cc00640 1 -- 172.21.15.130:0/544347432 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78640b4e20 con 0x7f787006cbb0 2024-04-25T13:41:42.787 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.786+0000 7f7877600640 1 -- 172.21.15.130:0/544347432 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7870157730 con 0x7f787006cbb0 2024-04-25T13:41:42.787 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.786+0000 7f786cc00640 1 -- 172.21.15.130:0/544347432 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78640bf690 con 0x7f787006cbb0 2024-04-25T13:41:42.787 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.786+0000 7f7877600640 1 -- 172.21.15.130:0/544347432 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7870157cf0 con 0x7f787006cbb0 2024-04-25T13:41:42.787 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.786+0000 7f786cc00640 1 -- 172.21.15.130:0/544347432 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f78640bfbc0 con 0x7f787006cbb0 2024-04-25T13:41:42.787 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.786+0000 7f786cc00640 1 -- 172.21.15.130:0/544347432 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f78640c8d50 con 0x7f787006cbb0 2024-04-25T13:41:42.787 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.786+0000 7f7877600640 1 -- 172.21.15.130:0/544347432 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7870050750 con 0x7f787006cbb0 2024-04-25T13:41:42.788 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.790+0000 7f786cc00640 1 -- 172.21.15.130:0/544347432 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f78640160d0 con 0x7f787006cbb0 2024-04-25T13:41:42.843 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-25T13:41:42.842+0000 7f691a91d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T13:41:42.854 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.854+0000 7f7877600640 1 -- 172.21.15.130:0/544347432 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd new", "uuid": "080c6ed4-1240-4af2-8628-ba91344bc1c3", "id": 6} v 0) -- 0x7f787015b320 con 0x7f787006cbb0 2024-04-25T13:41:42.863 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.862+0000 7f786cc00640 1 -- 172.21.15.130:0/544347432 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "080c6ed4-1240-4af2-8628-ba91344bc1c3", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f78640c83f0 con 0x7f787006cbb0 2024-04-25T13:41:42.863 INFO:teuthology.orchestra.run.smithi130.stdout:6 2024-04-25T13:41:42.864 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.866+0000 7f7877600640 1 -- 172.21.15.130:0/544347432 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f787006cbb0 msgr2=0x7f787015abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:42.864 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.866+0000 7f7877600640 1 --2- 172.21.15.130:0/544347432 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f787006cbb0 0x7f787015abb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f78640ad040 tx=0x7f7864019280 comp rx=0 tx=0).stop 2024-04-25T13:41:42.865 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.866+0000 7f7877600640 1 -- 172.21.15.130:0/544347432 shutdown_connections 2024-04-25T13:41:42.865 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.866+0000 7f7877600640 1 --2- 172.21.15.130:0/544347432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78700b7860 0x7f787015b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.865 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.866+0000 7f7877600640 1 --2- 172.21.15.130:0/544347432 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f787006cfc0 0x7f7870156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.865 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.866+0000 7f7877600640 1 --2- 172.21.15.130:0/544347432 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f787006cbb0 0x7f787015abb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:42.865 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.866+0000 7f7877600640 1 -- 172.21.15.130:0/544347432 >> 172.21.15.130:0/544347432 conn(0x7f78700d25f0 msgr2=0x7f7870071510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:42.865 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.866+0000 7f7877600640 1 -- 172.21.15.130:0/544347432 shutdown_connections 2024-04-25T13:41:42.865 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:42.866+0000 7f7877600640 1 -- 172.21.15.130:0/544347432 wait complete. 2024-04-25T13:41:42.883 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 34f0d920-69ff-49f0-8124-590397369d4d 7 2024-04-25T13:41:43.028 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.030+0000 7f81eaa00640 1 Processor -- start 2024-04-25T13:41:43.028 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.030+0000 7f81eaa00640 1 -- start start 2024-04-25T13:41:43.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.030+0000 7f81eaa00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f81e40d1e90 0x7f81e40d22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:43.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.030+0000 7f81eaa00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f81e40d27e0 0x7f81e40ce540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:43.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.030+0000 7f81eaa00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81e40b4570 con 0x7f81e40b3a50 2024-04-25T13:41:43.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.030+0000 7f81eaa00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f81e40c6f10 con 0x7f81e40d27e0 2024-04-25T13:41:43.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.030+0000 7f81eaa00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f81e40b89a0 con 0x7f81e40d1e90 2024-04-25T13:41:43.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.030+0000 7f81dbe00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f81e40d1e90 0x7f81e40d22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:43.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.030+0000 7f81dbe00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f81e40d1e90 0x7f81e40d22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43650/0 (socket says 172.21.15.130:43650) 2024-04-25T13:41:43.030 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.030+0000 7f81dbe00640 1 -- 172.21.15.130:0/3534309509 learned_addr learned my addr 172.21.15.130:0/3534309509 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-04-25T13:41:43.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.030+0000 7f81e8a00640 1 --2- 172.21.15.130:0/3534309509 >> v2:172.21.15.123:3300/0 conn(0x7f81e40d27e0 0x7f81e40ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:43.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.030+0000 7f81dbe00640 1 -- 172.21.15.130:0/3534309509 >> v2:172.21.15.123:3300/0 conn(0x7f81e40d27e0 msgr2=0x7f81e40ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:43.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.030+0000 7f81dbe00640 1 --2- 172.21.15.130:0/3534309509 >> v2:172.21.15.123:3300/0 conn(0x7f81e40d27e0 0x7f81e40ce540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.030+0000 7f81dbe00640 1 -- 172.21.15.130:0/3534309509 >> v1:172.21.15.123:6789/0 conn(0x7f81e40b3a50 legacy=0x7f81e40b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:43.031 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.030+0000 7f81dbe00640 1 -- 172.21.15.130:0/3534309509 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e40b8ff0 con 0x7f81e40d1e90 2024-04-25T13:41:43.033 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.034+0000 7f81dbe00640 1 --2- 172.21.15.130:0/3534309509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81e40d1e90 0x7f81e40d22a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f81e4073b00 tx=0x7f81cc01c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87aa36ba51375677 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:43.034 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.034+0000 7f81e3400640 1 -- 172.21.15.130:0/3534309509 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0b0070 con 0x7f81e40d1e90 2024-04-25T13:41:43.034 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.034+0000 7f81e3400640 1 -- 172.21.15.130:0/3534309509 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81cc0ab600 con 0x7f81e40d1e90 2024-04-25T13:41:43.034 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.034+0000 7f81e3400640 1 -- 172.21.15.130:0/3534309509 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0ab9d0 con 0x7f81e40d1e90 2024-04-25T13:41:43.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.034+0000 7f81eaa00640 1 -- 172.21.15.130:0/3534309509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81e40d1e90 msgr2=0x7f81e40d22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:43.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.034+0000 7f81eaa00640 1 --2- 172.21.15.130:0/3534309509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81e40d1e90 0x7f81e40d22a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f81e4073b00 tx=0x7f81cc01c490 comp rx=0 tx=0).stop 2024-04-25T13:41:43.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.034+0000 7f81eaa00640 1 -- 172.21.15.130:0/3534309509 shutdown_connections 2024-04-25T13:41:43.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.034+0000 7f81eaa00640 1 --2- 172.21.15.130:0/3534309509 >> v2:172.21.15.123:3300/0 conn(0x7f81e40d27e0 0x7f81e40ce540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.034+0000 7f81eaa00640 1 --2- 172.21.15.130:0/3534309509 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81e40d1e90 0x7f81e40d22a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.034+0000 7f81eaa00640 1 -- 172.21.15.130:0/3534309509 >> 172.21.15.130:0/3534309509 conn(0x7f81e40b51d0 msgr2=0x7f81e40b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:43.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.034+0000 7f81eaa00640 1 -- 172.21.15.130:0/3534309509 shutdown_connections 2024-04-25T13:41:43.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.034+0000 7f81eaa00640 1 -- 172.21.15.130:0/3534309509 wait complete. 2024-04-25T13:41:43.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.038+0000 7f81eaa00640 1 Processor -- start 2024-04-25T13:41:43.037 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.038+0000 7f81eaa00640 1 -- start start 2024-04-25T13:41:43.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.038+0000 7f81eaa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81e40b3a50 0x7f81e40c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:43.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.038+0000 7f81eaa00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f81e40d1e90 0x7f81e4150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:43.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.038+0000 7f81eaa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81e40d27e0 0x7f81e4070de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:43.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.038+0000 7f81eaa00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f81e40cf4e0 con 0x7f81e40d27e0 2024-04-25T13:41:43.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.038+0000 7f81eaa00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f81e40d1980 con 0x7f81e40b3a50 2024-04-25T13:41:43.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.038+0000 7f81eaa00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f81e40cf660 con 0x7f81e40d1e90 2024-04-25T13:41:43.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.038+0000 7f81e3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81e40b3a50 0x7f81e40c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:43.040 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.038+0000 7f81e3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81e40b3a50 0x7f81e40c7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:43662/0 (socket says 172.21.15.130:43662) 2024-04-25T13:41:43.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.038+0000 7f81e3e00640 1 -- 172.21.15.130:0/38866708 learned_addr learned my addr 172.21.15.130:0/38866708 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-04-25T13:41:43.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.038+0000 7f81dbe00640 1 --2- 172.21.15.130:0/38866708 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f81e40d1e90 0x7f81e4150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:43.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.038+0000 7f81e8a00640 1 --2- 172.21.15.130:0/38866708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81e40d27e0 0x7f81e4070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:43.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.038+0000 7f81e3e00640 1 -- 172.21.15.130:0/38866708 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f81e40d1e90 msgr2=0x7f81e4150eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:43.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.038+0000 7f81e3e00640 1 --2- 172.21.15.130:0/38866708 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f81e40d1e90 0x7f81e4150eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.038+0000 7f81e3e00640 1 -- 172.21.15.130:0/38866708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81e40d27e0 msgr2=0x7f81e4070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:43.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.038+0000 7f81e3e00640 1 --2- 172.21.15.130:0/38866708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81e40d27e0 0x7f81e4070de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.038+0000 7f81e3e00640 1 -- 172.21.15.130:0/38866708 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e4154320 con 0x7f81e40b3a50 2024-04-25T13:41:43.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.038+0000 7f81dbe00640 1 --2- 172.21.15.130:0/38866708 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f81e40d1e90 0x7f81e4150eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:41:43.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.038+0000 7f81e3e00640 1 --2- 172.21.15.130:0/38866708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81e40b3a50 0x7f81e40c7090 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f81d400c440 tx=0x7f81d400c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:43.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.042+0000 7f81e0c00640 1 -- 172.21.15.130:0/38866708 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d40052d0 con 0x7f81e40b3a50 2024-04-25T13:41:43.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.042+0000 7f81e0c00640 1 -- 172.21.15.130:0/38866708 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81d4005490 con 0x7f81e40b3a50 2024-04-25T13:41:43.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.042+0000 7f81e0c00640 1 -- 172.21.15.130:0/38866708 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d4006a70 con 0x7f81e40b3a50 2024-04-25T13:41:43.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.042+0000 7f81eaa00640 1 -- 172.21.15.130:0/38866708 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81e4154890 con 0x7f81e40b3a50 2024-04-25T13:41:43.042 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.042+0000 7f81eaa00640 1 -- 172.21.15.130:0/38866708 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81e41545b0 con 0x7f81e40b3a50 2024-04-25T13:41:43.042 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.042+0000 7f81e0c00640 1 -- 172.21.15.130:0/38866708 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f81d4006cd0 con 0x7f81e40b3a50 2024-04-25T13:41:43.042 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.042+0000 7f81e0c00640 1 -- 172.21.15.130:0/38866708 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f81d4011bf0 con 0x7f81e40b3a50 2024-04-25T13:41:43.042 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.042+0000 7f81eaa00640 1 -- 172.21.15.130:0/38866708 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81e4050750 con 0x7f81e40b3a50 2024-04-25T13:41:43.048 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.050+0000 7f81e0c00640 1 -- 172.21.15.130:0/38866708 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f81d4003650 con 0x7f81e40b3a50 2024-04-25T13:41:43.115 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.114+0000 7f81eaa00640 1 -- 172.21.15.130:0/38866708 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd new", "uuid": "34f0d920-69ff-49f0-8124-590397369d4d", "id": 7} v 0) -- 0x7f81e4168460 con 0x7f81e40b3a50 2024-04-25T13:41:43.125 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.126+0000 7f81e0c00640 1 -- 172.21.15.130:0/38866708 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "34f0d920-69ff-49f0-8124-590397369d4d", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f81d4003a60 con 0x7f81e40b3a50 2024-04-25T13:41:43.125 INFO:teuthology.orchestra.run.smithi130.stdout:7 2024-04-25T13:41:43.126 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.126+0000 7f81eaa00640 1 -- 172.21.15.130:0/38866708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81e40b3a50 msgr2=0x7f81e40c7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:43.126 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.126+0000 7f81eaa00640 1 --2- 172.21.15.130:0/38866708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81e40b3a50 0x7f81e40c7090 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f81d400c440 tx=0x7f81d400c900 comp rx=0 tx=0).stop 2024-04-25T13:41:43.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.126+0000 7f81eaa00640 1 -- 172.21.15.130:0/38866708 shutdown_connections 2024-04-25T13:41:43.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.126+0000 7f81eaa00640 1 --2- 172.21.15.130:0/38866708 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f81e40d27e0 0x7f81e4070de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.126+0000 7f81eaa00640 1 --2- 172.21.15.130:0/38866708 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f81e40d1e90 0x7f81e4150eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.126+0000 7f81eaa00640 1 --2- 172.21.15.130:0/38866708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81e40b3a50 0x7f81e40c7090 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.126+0000 7f81eaa00640 1 -- 172.21.15.130:0/38866708 >> 172.21.15.130:0/38866708 conn(0x7f81e40b51d0 msgr2=0x7f81e40b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:43.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.126+0000 7f81eaa00640 1 -- 172.21.15.130:0/38866708 shutdown_connections 2024-04-25T13:41:43.127 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:41:43.126+0000 7f81eaa00640 1 -- 172.21.15.130:0/38866708 wait complete. 2024-04-25T13:41:43.145 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T13:41:43.145 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T13:41:43.148 INFO:tasks.ceph.osd.0:Started 2024-04-25T13:41:43.148 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T13:41:43.148 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T13:41:43.151 INFO:tasks.ceph.osd.1:Started 2024-04-25T13:41:43.151 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T13:41:43.151 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T13:41:43.154 INFO:tasks.ceph.osd.2:Started 2024-04-25T13:41:43.154 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T13:41:43.154 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T13:41:43.157 INFO:tasks.ceph.osd.3:Started 2024-04-25T13:41:43.157 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T13:41:43.157 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-25T13:41:43.160 INFO:tasks.ceph.osd.4:Started 2024-04-25T13:41:43.160 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T13:41:43.160 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-25T13:41:43.163 INFO:tasks.ceph.osd.5:Started 2024-04-25T13:41:43.163 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T13:41:43.163 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-25T13:41:43.166 INFO:tasks.ceph.osd.6:Started 2024-04-25T13:41:43.166 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T13:41:43.166 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-25T13:41:43.169 INFO:tasks.ceph.osd.7:Started 2024-04-25T13:41:43.170 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:41:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.361+0000 7f99f7c00640 1 Processor -- start 2024-04-25T13:41:43.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.361+0000 7f99f7c00640 1 -- start start 2024-04-25T13:41:43.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.365+0000 7f99f7c00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f99f01623e0 0x7f99f006c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:43.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.365+0000 7f99f7c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99f006cbb0 0x7f99f00b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:43.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.365+0000 7f99f7c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f99f00b3900 0x7f99f00b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:43.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.365+0000 7f99f7c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f99f0161f50 con 0x7f99f00b3900 2024-04-25T13:41:43.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.365+0000 7f99f7c00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f99f00b3d10 con 0x7f99f01623e0 2024-04-25T13:41:43.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.365+0000 7f99f7c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f99f006d060 con 0x7f99f006cbb0 2024-04-25T13:41:43.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.365+0000 7f99f5c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f99f00b3900 0x7f99f00b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:43.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.365+0000 7f99f5c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f99f00b3900 0x7f99f00b1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42416/0 (socket says 172.21.15.123:42416) 2024-04-25T13:41:43.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.365+0000 7f99f5c00640 1 -- 172.21.15.123:0/3956988637 learned_addr learned my addr 172.21.15.123:0/3956988637 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:41:43.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.365+0000 7f99f5200640 1 --2- 172.21.15.123:0/3956988637 >> v2:172.21.15.130:3300/0 conn(0x7f99f01623e0 0x7f99f006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:43.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.365+0000 7f99e7e00640 1 --2- 172.21.15.123:0/3956988637 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99f006cbb0 0x7f99f00b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:43.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.365+0000 7f99f5c00640 1 -- 172.21.15.123:0/3956988637 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99f006cbb0 msgr2=0x7f99f00b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:43.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.365+0000 7f99f5c00640 1 --2- 172.21.15.123:0/3956988637 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99f006cbb0 0x7f99f00b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.365+0000 7f99f5c00640 1 -- 172.21.15.123:0/3956988637 >> v2:172.21.15.130:3300/0 conn(0x7f99f01623e0 msgr2=0x7f99f006c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:43.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.365+0000 7f99f5c00640 1 --2- 172.21.15.123:0/3956988637 >> v2:172.21.15.130:3300/0 conn(0x7f99f01623e0 0x7f99f006c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.365+0000 7f99f5c00640 1 -- 172.21.15.123:0/3956988637 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f006d300 con 0x7f99f00b3900 2024-04-25T13:41:43.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.369+0000 7f99f5c00640 1 --2- 172.21.15.123:0/3956988637 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99f00b3900 0x7f99f00b1df0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f99f00cef90 tx=0x7f99e801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f603b9a10520e78 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:43.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.369+0000 7f99efe00640 1 -- 172.21.15.123:0/3956988637 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e80a5760 con 0x7f99f00b3900 2024-04-25T13:41:43.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.369+0000 7f99efe00640 1 -- 172.21.15.123:0/3956988637 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99e80a5900 con 0x7f99f00b3900 2024-04-25T13:41:43.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.369+0000 7f99efe00640 1 -- 172.21.15.123:0/3956988637 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e80a5cd0 con 0x7f99f00b3900 2024-04-25T13:41:43.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.369+0000 7f99f7c00640 1 -- 172.21.15.123:0/3956988637 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99f00b3900 msgr2=0x7f99f00b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:43.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.369+0000 7f99f7c00640 1 --2- 172.21.15.123:0/3956988637 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99f00b3900 0x7f99f00b1df0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f99f00cef90 tx=0x7f99e801c9f0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.369+0000 7f99f7c00640 1 -- 172.21.15.123:0/3956988637 shutdown_connections 2024-04-25T13:41:43.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.369+0000 7f99f7c00640 1 --2- 172.21.15.123:0/3956988637 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99f00b3900 0x7f99f00b1df0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.369+0000 7f99f7c00640 1 --2- 172.21.15.123:0/3956988637 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99f006cbb0 0x7f99f00b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.369+0000 7f99f7c00640 1 --2- 172.21.15.123:0/3956988637 >> v2:172.21.15.130:3300/0 conn(0x7f99f01623e0 0x7f99f006c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.369+0000 7f99f7c00640 1 -- 172.21.15.123:0/3956988637 >> 172.21.15.123:0/3956988637 conn(0x7f99f00d25b0 msgr2=0x7f99f00d29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:43.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.369+0000 7f99f7c00640 1 -- 172.21.15.123:0/3956988637 shutdown_connections 2024-04-25T13:41:43.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.369+0000 7f99f7c00640 1 -- 172.21.15.123:0/3956988637 wait complete. 2024-04-25T13:41:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.369+0000 7f99f7c00640 1 Processor -- start 2024-04-25T13:41:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.373+0000 7f99f7c00640 1 -- start start 2024-04-25T13:41:43.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.373+0000 7f99f7c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99f006cbb0 0x7f99f00d0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:43.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.373+0000 7f99f7c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99f00b3900 0x7f99f0156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:43.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.373+0000 7f99f7c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99f01623e0 0x7f99f00d0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:43.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.373+0000 7f99f7c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f99f00d3410 con 0x7f99f00b3900 2024-04-25T13:41:43.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.373+0000 7f99f7c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f99f00d3290 con 0x7f99f01623e0 2024-04-25T13:41:43.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.373+0000 7f99f7c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f99f00cefc0 con 0x7f99f006cbb0 2024-04-25T13:41:43.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.373+0000 7f99e7e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99f00b3900 0x7f99f0156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:43.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.373+0000 7f99e7e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99f00b3900 0x7f99f0156d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42422/0 (socket says 172.21.15.123:42422) 2024-04-25T13:41:43.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.373+0000 7f99f5200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99f006cbb0 0x7f99f00d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:43.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.373+0000 7f99e7e00640 1 -- 172.21.15.123:0/3684339796 learned_addr learned my addr 172.21.15.123:0/3684339796 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:41:43.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.373+0000 7f99f5c00640 1 --2- 172.21.15.123:0/3684339796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99f01623e0 0x7f99f00d0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.373+0000 7f99e7e00640 1 -- 172.21.15.123:0/3684339796 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99f006cbb0 msgr2=0x7f99f00d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.373+0000 7f99e7e00640 1 --2- 172.21.15.123:0/3684339796 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99f006cbb0 0x7f99f00d0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.373+0000 7f99e7e00640 1 -- 172.21.15.123:0/3684339796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99f01623e0 msgr2=0x7f99f00d0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.373+0000 7f99e7e00640 1 --2- 172.21.15.123:0/3684339796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99f01623e0 0x7f99f00d0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.373+0000 7f99e7e00640 1 -- 172.21.15.123:0/3684339796 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f0157240 con 0x7f99f00b3900 2024-04-25T13:41:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.373+0000 7f99e7e00640 1 --2- 172.21.15.123:0/3684339796 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99f00b3900 0x7f99f0156d00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f99d800e840 tx=0x7f99d800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.373+0000 7f99ed600640 1 -- 172.21.15.123:0/3684339796 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d8017070 con 0x7f99f00b3900 2024-04-25T13:41:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.373+0000 7f99ed600640 1 -- 172.21.15.123:0/3684339796 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d8004020 con 0x7f99f00b3900 2024-04-25T13:41:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.373+0000 7f99ed600640 1 -- 172.21.15.123:0/3684339796 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d8004430 con 0x7f99f00b3900 2024-04-25T13:41:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.373+0000 7f99f7c00640 1 -- 172.21.15.123:0/3684339796 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99f00d1450 con 0x7f99f00b3900 2024-04-25T13:41:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.373+0000 7f99f7c00640 1 -- 172.21.15.123:0/3684339796 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99f00d1bb0 con 0x7f99f00b3900 2024-04-25T13:41:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.373+0000 7f99ed600640 1 -- 172.21.15.123:0/3684339796 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f99d80059a0 con 0x7f99f00b3900 2024-04-25T13:41:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.373+0000 7f99ed600640 1 -- 172.21.15.123:0/3684339796 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f99d8005c90 con 0x7f99f00b3900 2024-04-25T13:41:43.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.373+0000 7f99f7c00640 1 -- 172.21.15.123:0/3684339796 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99f00507c0 con 0x7f99f00b3900 2024-04-25T13:41:43.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.377+0000 7f99ed600640 1 -- 172.21.15.123:0/3684339796 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f99d800c730 con 0x7f99f00b3900 2024-04-25T13:41:43.443 INFO:tasks.ceph.mgr.y.smithi123.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T13:41:43.443 INFO:tasks.ceph.mgr.y.smithi123.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T13:41:43.443 INFO:tasks.ceph.mgr.y.smithi123.stderr: from numpy import show_config as show_numpy_config 2024-04-25T13:41:43.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.449+0000 7f99f7c00640 1 -- 172.21.15.123:0/3684339796 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99f00c5a60 con 0x7f99f00b3900 2024-04-25T13:41:43.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.449+0000 7f99ed600640 1 -- 172.21.15.123:0/3684339796 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f99d800c910 con 0x7f99f00b3900 2024-04-25T13:41:43.446 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:43.446 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":10,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:41:43.121218+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:41:43.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.449+0000 7f99f7c00640 1 -- 172.21.15.123:0/3684339796 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99f00b3900 msgr2=0x7f99f0156d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:43.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.449+0000 7f99f7c00640 1 --2- 172.21.15.123:0/3684339796 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99f00b3900 0x7f99f0156d00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f99d800e840 tx=0x7f99d800ed00 comp rx=0 tx=0).stop 2024-04-25T13:41:43.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.449+0000 7f99f7c00640 1 -- 172.21.15.123:0/3684339796 shutdown_connections 2024-04-25T13:41:43.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.449+0000 7f99f7c00640 1 --2- 172.21.15.123:0/3684339796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99f01623e0 0x7f99f00d0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.449+0000 7f99f7c00640 1 --2- 172.21.15.123:0/3684339796 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99f00b3900 0x7f99f0156d00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.449+0000 7f99f7c00640 1 --2- 172.21.15.123:0/3684339796 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99f006cbb0 0x7f99f00d0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:43.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.449+0000 7f99f7c00640 1 -- 172.21.15.123:0/3684339796 >> 172.21.15.123:0/3684339796 conn(0x7f99f00d25b0 msgr2=0x7f99f01574a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:43.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.449+0000 7f99f7c00640 1 -- 172.21.15.123:0/3684339796 shutdown_connections 2024-04-25T13:41:43.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:43.449+0000 7f99f7c00640 1 -- 172.21.15.123:0/3684339796 wait complete. 2024-04-25T13:41:43.468 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T13:41:43.468 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T13:41:43.510 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-25T13:41:43.513+0000 7f5332ada180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T13:41:43.534 INFO:tasks.ceph.mgr.x.smithi130.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T13:41:43.534 INFO:tasks.ceph.mgr.x.smithi130.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T13:41:43.534 INFO:tasks.ceph.mgr.x.smithi130.stderr: from numpy import show_config as show_numpy_config 2024-04-25T13:41:43.578 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-25T13:41:43.578+0000 7f691a91d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T13:41:43.663 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-25T13:41:43.665+0000 7f5332ada180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:41:43.725 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-25T13:41:43.726+0000 7f691a91d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:41:43.786 INFO:tasks.ceph.osd.1.smithi123.stderr:2024-04-25T13:41:43.789+0000 7f904582b7c0 -1 Falling back to public interface 2024-04-25T13:41:43.810 INFO:tasks.ceph.osd.0.smithi123.stderr:2024-04-25T13:41:43.813+0000 7f63ce8c17c0 -1 Falling back to public interface 2024-04-25T13:41:43.838 INFO:tasks.ceph.osd.3.smithi123.stderr:2024-04-25T13:41:43.841+0000 7fa700ca97c0 -1 Falling back to public interface 2024-04-25T13:41:43.840 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-25T13:41:43.841+0000 7f5332ada180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T13:41:43.850 INFO:tasks.ceph.osd.2.smithi123.stderr:2024-04-25T13:41:43.853+0000 7f4789d0b7c0 -1 Falling back to public interface 2024-04-25T13:41:43.873 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-04-25T13:41:43.874+0000 7f44162f97c0 -1 Falling back to public interface 2024-04-25T13:41:43.873 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-04-25T13:41:43.874+0000 7f45b768e7c0 -1 Falling back to public interface 2024-04-25T13:41:43.874 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-04-25T13:41:43.874+0000 7f45b6200640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-04-25T13:41:43.874 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-04-25T13:41:43.874+0000 7f45b6200640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6809/0: (98) Address already in use 2024-04-25T13:41:43.905 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-04-25T13:41:43.906+0000 7f9632e627c0 -1 Falling back to public interface 2024-04-25T13:41:43.905 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-25T13:41:43.906+0000 7f691a91d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T13:41:43.909 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-04-25T13:41:43.910+0000 7f4ed496e7c0 -1 Falling back to public interface 2024-04-25T13:41:43.914 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-25T13:41:43.917+0000 7f5332ada180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T13:41:43.979 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-25T13:41:43.978+0000 7f691a91d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T13:41:44.063 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-25T13:41:44.065+0000 7f5332ada180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:41:44.128 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-25T13:41:44.130+0000 7f691a91d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T13:41:44.273 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T13:41:44.410 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.413+0000 7fbae9600640 1 Processor -- start 2024-04-25T13:41:44.411 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.413+0000 7fbae9600640 1 -- start start 2024-04-25T13:41:44.412 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.413+0000 7fbae9600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbae406f9b0 0x7fbae406fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:44.412 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.413+0000 7fbae9600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbae40b45a0 0x7fbae40b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:44.413 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.413+0000 7fbae9600640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbae4070300 con 0x7fbae40b6260 2024-04-25T13:41:44.413 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.413+0000 7fbae9600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fbae415d200 con 0x7fbae40b45a0 2024-04-25T13:41:44.413 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.413+0000 7fbae9600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fbae415d4a0 con 0x7fbae406f9b0 2024-04-25T13:41:44.413 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.413+0000 7fbae3400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbae40b45a0 0x7fbae40b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:44.413 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.413+0000 7fbae3400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fbae40b45a0 0x7fbae40b49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42428/0 (socket says 172.21.15.123:42428) 2024-04-25T13:41:44.413 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.413+0000 7fbae3400640 1 -- 172.21.15.123:0/725409628 learned_addr learned my addr 172.21.15.123:0/725409628 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:41:44.413 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.413+0000 7fbadbe00640 1 --2- 172.21.15.123:0/725409628 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbae406f9b0 0x7fbae406fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:44.413 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.413+0000 7fbae3400640 1 -- 172.21.15.123:0/725409628 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbae406f9b0 msgr2=0x7fbae406fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:44.414 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.413+0000 7fbae3400640 1 --2- 172.21.15.123:0/725409628 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbae406f9b0 0x7fbae406fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:44.414 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.417+0000 7fbae3400640 1 -- 172.21.15.123:0/725409628 >> v1:172.21.15.130:6789/0 conn(0x7fbae40b6260 legacy=0x7fbae40cec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:44.414 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.413+0000 7fbae2000640 1 -- 172.21.15.123:0/725409628 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1837188128 0 0) 0x7fbad4001120 con 0x7fbae40b6260 2024-04-25T13:41:44.414 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.417+0000 7fbae3400640 1 -- 172.21.15.123:0/725409628 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae415d780 con 0x7fbae40b45a0 2024-04-25T13:41:44.416 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.417+0000 7fbae3400640 1 --2- 172.21.15.123:0/725409628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbae40b45a0 0x7fbae40b49b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbadc009e50 tx=0x7fbadc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975a2ab3e3ecdad3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:44.416 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.417+0000 7fbae2000640 1 -- 172.21.15.123:0/725409628 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbadc0a5700 con 0x7fbae40b45a0 2024-04-25T13:41:44.416 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.417+0000 7fbae2000640 1 -- 172.21.15.123:0/725409628 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbadc0a58a0 con 0x7fbae40b45a0 2024-04-25T13:41:44.416 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.417+0000 7fbae2000640 1 -- 172.21.15.123:0/725409628 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbadc0a5c70 con 0x7fbae40b45a0 2024-04-25T13:41:44.417 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.417+0000 7fbae9600640 1 -- 172.21.15.123:0/725409628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbae40b45a0 msgr2=0x7fbae40b49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:44.417 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.417+0000 7fbae9600640 1 --2- 172.21.15.123:0/725409628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbae40b45a0 0x7fbae40b49b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbadc009e50 tx=0x7fbadc01c910 comp rx=0 tx=0).stop 2024-04-25T13:41:44.417 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.421+0000 7fbae9600640 1 -- 172.21.15.123:0/725409628 shutdown_connections 2024-04-25T13:41:44.417 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.421+0000 7fbae9600640 1 --2- 172.21.15.123:0/725409628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbae40b45a0 0x7fbae40b49b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:44.419 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.421+0000 7fbae9600640 1 --2- 172.21.15.123:0/725409628 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbae406f9b0 0x7fbae406fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:44.419 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.421+0000 7fbae9600640 1 -- 172.21.15.123:0/725409628 >> 172.21.15.123:0/725409628 conn(0x7fbae40b3a00 msgr2=0x7fbae406c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:44.419 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.421+0000 7fbae9600640 1 -- 172.21.15.123:0/725409628 shutdown_connections 2024-04-25T13:41:44.419 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.421+0000 7fbae9600640 1 -- 172.21.15.123:0/725409628 wait complete. 2024-04-25T13:41:44.420 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.421+0000 7fbae9600640 1 Processor -- start 2024-04-25T13:41:44.420 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.421+0000 7fbae9600640 1 -- start start 2024-04-25T13:41:44.422 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.421+0000 7fbae9600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbae406f9b0 0x7fbae4154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:44.422 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.425+0000 7fbae9600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbae40b45a0 0x7fbae41654b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:44.422 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.425+0000 7fbae9600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbae40b6260 0x7fbae41659f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:44.422 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.425+0000 7fbae9600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbae4167bf0 con 0x7fbae40b6260 2024-04-25T13:41:44.422 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.425+0000 7fbae9600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbae4167a70 con 0x7fbae406f9b0 2024-04-25T13:41:44.422 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.425+0000 7fbae9600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fbae4167d70 con 0x7fbae40b45a0 2024-04-25T13:41:44.423 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.425+0000 7fbae3400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbae40b6260 0x7fbae41659f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:44.423 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.425+0000 7fbadbe00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbae40b45a0 0x7fbae41654b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:44.423 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.425+0000 7fbae2a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbae406f9b0 0x7fbae4154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:44.423 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.425+0000 7fbae3400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbae40b6260 0x7fbae41659f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42430/0 (socket says 172.21.15.123:42430) 2024-04-25T13:41:44.423 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.425+0000 7fbae3400640 1 -- 172.21.15.123:0/2527821373 learned_addr learned my addr 172.21.15.123:0/2527821373 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:41:44.423 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.425+0000 7fbadbe00640 1 -- 172.21.15.123:0/2527821373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbae406f9b0 msgr2=0x7fbae4154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:44.423 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.425+0000 7fbadbe00640 1 --2- 172.21.15.123:0/2527821373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbae406f9b0 0x7fbae4154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:44.423 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.425+0000 7fbadbe00640 1 -- 172.21.15.123:0/2527821373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbae40b6260 msgr2=0x7fbae41659f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:44.423 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.425+0000 7fbadbe00640 1 --2- 172.21.15.123:0/2527821373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbae40b6260 0x7fbae41659f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:44.423 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.425+0000 7fbadbe00640 1 -- 172.21.15.123:0/2527821373 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae415a660 con 0x7fbae40b45a0 2024-04-25T13:41:44.423 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.425+0000 7fbadbe00640 1 --2- 172.21.15.123:0/2527821373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbae40b45a0 0x7fbae41654b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbacc00e870 tx=0x7fbacc00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:44.424 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.425+0000 7fbadaa00640 1 -- 172.21.15.123:0/2527821373 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc017070 con 0x7fbae40b45a0 2024-04-25T13:41:44.424 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.425+0000 7fbadaa00640 1 -- 172.21.15.123:0/2527821373 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbacc00ee60 con 0x7fbae40b45a0 2024-04-25T13:41:44.424 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.425+0000 7fbadaa00640 1 -- 172.21.15.123:0/2527821373 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc00cb60 con 0x7fbae40b45a0 2024-04-25T13:41:44.424 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.425+0000 7fbae9600640 1 -- 172.21.15.123:0/2527821373 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbae415a940 con 0x7fbae40b45a0 2024-04-25T13:41:44.424 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.425+0000 7fbae9600640 1 -- 172.21.15.123:0/2527821373 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbae415af00 con 0x7fbae40b45a0 2024-04-25T13:41:44.425 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.425+0000 7fbadaa00640 1 -- 172.21.15.123:0/2527821373 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbacc01a070 con 0x7fbae40b45a0 2024-04-25T13:41:44.425 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.425+0000 7fbadaa00640 1 -- 172.21.15.123:0/2527821373 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fbacc00cd00 con 0x7fbae40b45a0 2024-04-25T13:41:44.425 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.425+0000 7fbae9600640 1 -- 172.21.15.123:0/2527821373 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbae4050750 con 0x7fbae40b45a0 2024-04-25T13:41:44.426 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.429+0000 7fbadaa00640 1 -- 172.21.15.123:0/2527821373 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fbacc013470 con 0x7fbae40b45a0 2024-04-25T13:41:44.499 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.501+0000 7fbae9600640 1 -- 172.21.15.123:0/2527821373 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbae406d2d0 con 0x7fbae40b45a0 2024-04-25T13:41:44.499 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.501+0000 7fbadaa00640 1 -- 172.21.15.123:0/2527821373 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fbacc013650 con 0x7fbae40b45a0 2024-04-25T13:41:44.500 INFO:teuthology.misc.health.smithi123.stdout: 2024-04-25T13:41:44.500 INFO:teuthology.misc.health.smithi123.stdout:{"epoch":10,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:41:43.121218+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:41:44.501 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.501+0000 7fbae9600640 1 -- 172.21.15.123:0/2527821373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbae40b45a0 msgr2=0x7fbae41654b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:44.501 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.501+0000 7fbae9600640 1 --2- 172.21.15.123:0/2527821373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbae40b45a0 0x7fbae41654b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbacc00e870 tx=0x7fbacc00ed30 comp rx=0 tx=0).stop 2024-04-25T13:41:44.501 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.501+0000 7fbae9600640 1 -- 172.21.15.123:0/2527821373 shutdown_connections 2024-04-25T13:41:44.501 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.501+0000 7fbae9600640 1 --2- 172.21.15.123:0/2527821373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbae40b6260 0x7fbae41659f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:44.501 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.501+0000 7fbae9600640 1 --2- 172.21.15.123:0/2527821373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbae40b45a0 0x7fbae41654b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:44.501 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.501+0000 7fbae9600640 1 --2- 172.21.15.123:0/2527821373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbae406f9b0 0x7fbae4154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:44.501 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.501+0000 7fbae9600640 1 -- 172.21.15.123:0/2527821373 >> 172.21.15.123:0/2527821373 conn(0x7fbae40b3a00 msgr2=0x7fbae40b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:44.501 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.501+0000 7fbae9600640 1 -- 172.21.15.123:0/2527821373 shutdown_connections 2024-04-25T13:41:44.501 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:44.501+0000 7fbae9600640 1 -- 172.21.15.123:0/2527821373 wait complete. 2024-04-25T13:41:44.518 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T13:41:44.780 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-25T13:41:44.781+0000 7f5332ada180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T13:41:44.825 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-25T13:41:44.826+0000 7f691a91d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T13:41:44.868 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-25T13:41:44.869+0000 7f5332ada180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T13:41:44.912 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-25T13:41:44.914+0000 7f691a91d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T13:41:45.070 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-25T13:41:45.073+0000 7f5332ada180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T13:41:45.113 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-25T13:41:45.114+0000 7f691a91d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T13:41:45.156 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-25T13:41:45.157+0000 7f5332ada180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T13:41:45.199 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-25T13:41:45.198+0000 7f691a91d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T13:41:45.484 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-25T13:41:45.485+0000 7f5332ada180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T13:41:45.527 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-25T13:41:45.525+0000 7f691a91d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T13:41:45.555 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-25T13:41:45.557+0000 7f5332ada180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T13:41:45.602 INFO:tasks.ceph.mgr.x.smithi130.stderr:2024-04-25T13:41:45.601+0000 7f691a91d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T13:41:46.579 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-25T13:41:46.581+0000 7f52d7e00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T13:41:46.579 INFO:tasks.ceph.mgr.y.smithi123.stderr:2024-04-25T13:41:46.581+0000 7f52d7e00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T13:41:47.671 INFO:tasks.ceph.osd.1.smithi123.stderr:2024-04-25T13:41:47.673+0000 7f904582b7c0 -1 osd.1 0 log_to_monitors true 2024-04-25T13:41:47.739 INFO:tasks.ceph.osd.0.smithi123.stderr:2024-04-25T13:41:47.741+0000 7f63ce8c17c0 -1 osd.0 0 log_to_monitors true 2024-04-25T13:41:47.778 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-04-25T13:41:47.777+0000 7f45b768e7c0 -1 osd.6 0 log_to_monitors true 2024-04-25T13:41:47.811 INFO:tasks.ceph.osd.2.smithi123.stderr:2024-04-25T13:41:47.813+0000 7f4789d0b7c0 -1 osd.2 0 log_to_monitors true 2024-04-25T13:41:47.882 INFO:tasks.ceph.osd.3.smithi123.stderr:2024-04-25T13:41:47.885+0000 7fa700ca97c0 -1 osd.3 0 log_to_monitors true 2024-04-25T13:41:47.976 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-04-25T13:41:47.977+0000 7f9632e627c0 -1 osd.7 0 log_to_monitors true 2024-04-25T13:41:48.137 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-04-25T13:41:48.137+0000 7f44162f97c0 -1 osd.5 0 log_to_monitors true 2024-04-25T13:41:48.158 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-04-25T13:41:48.157+0000 7f4ed496e7c0 -1 osd.4 0 log_to_monitors true 2024-04-25T13:41:51.325 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T13:41:51.553 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.552+0000 7f74fa800640 1 Processor -- start 2024-04-25T13:41:51.553 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.552+0000 7f74fa800640 1 -- start start 2024-04-25T13:41:51.555 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.556+0000 7f74fa800640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f74f4142200 0x7f74f40ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:51.556 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.556+0000 7f74fa800640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74f4070150 con 0x7f74f4160520 2024-04-25T13:41:51.556 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.556+0000 7f74fa800640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74f4160930 con 0x7f74f415fa00 2024-04-25T13:41:51.556 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.556+0000 7f74fa800640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f74f40d0c90 con 0x7f74f4142200 2024-04-25T13:41:51.556 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.556+0000 7f74f3e00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f74f4160520 0x7f74f4166b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41502/0 (socket says 172.21.15.123:41502) 2024-04-25T13:41:51.556 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.556+0000 7f74f3e00640 1 -- 172.21.15.123:0/4015010896 learned_addr learned my addr 172.21.15.123:0/4015010896 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:41:51.556 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.556+0000 7f74f3400640 1 --2- 172.21.15.123:0/4015010896 >> v2:172.21.15.130:3300/0 conn(0x7f74f4142200 0x7f74f40ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:51.556 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.556+0000 7f74f3400640 1 -- 172.21.15.123:0/4015010896 >> v1:172.21.15.130:6789/0 conn(0x7f74f415fa00 legacy=0x7f74f415fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:51.557 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.556+0000 7f74f3400640 1 -- 172.21.15.123:0/4015010896 >> v1:172.21.15.123:6789/0 conn(0x7f74f4160520 legacy=0x7f74f4166b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:51.557 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.556+0000 7f74f3400640 1 -- 172.21.15.123:0/4015010896 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f40d0f70 con 0x7f74f4142200 2024-04-25T13:41:51.562 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.564+0000 7f74f3400640 1 --2- 172.21.15.123:0/4015010896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74f4142200 0x7f74f40ce020 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f74dc00a960 tx=0x7f74dc01d870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f733d694fbd8161 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:51.562 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.564+0000 7f74f2000640 1 -- 172.21.15.123:0/4015010896 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74dc0b3070 con 0x7f74f4142200 2024-04-25T13:41:51.562 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.564+0000 7f74f2000640 1 -- 172.21.15.123:0/4015010896 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74dc0a6790 con 0x7f74f4142200 2024-04-25T13:41:51.563 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.564+0000 7f74f2000640 1 -- 172.21.15.123:0/4015010896 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74dc00b040 con 0x7f74f4142200 2024-04-25T13:41:51.564 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.564+0000 7f74fa800640 1 -- 172.21.15.123:0/4015010896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74f4142200 msgr2=0x7f74f40ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:51.564 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.564+0000 7f74fa800640 1 --2- 172.21.15.123:0/4015010896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74f4142200 0x7f74f40ce020 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f74dc00a960 tx=0x7f74dc01d870 comp rx=0 tx=0).stop 2024-04-25T13:41:51.564 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.564+0000 7f74fa800640 1 -- 172.21.15.123:0/4015010896 shutdown_connections 2024-04-25T13:41:51.564 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.564+0000 7f74fa800640 1 --2- 172.21.15.123:0/4015010896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74f4142200 0x7f74f40ce020 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:51.564 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.564+0000 7f74fa800640 1 -- 172.21.15.123:0/4015010896 >> 172.21.15.123:0/4015010896 conn(0x7f74f40b3a00 msgr2=0x7f74f406c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:51.564 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.564+0000 7f74fa800640 1 -- 172.21.15.123:0/4015010896 shutdown_connections 2024-04-25T13:41:51.564 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.564+0000 7f74fa800640 1 -- 172.21.15.123:0/4015010896 wait complete. 2024-04-25T13:41:51.567 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.568+0000 7f74fa800640 1 Processor -- start 2024-04-25T13:41:51.568 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.568+0000 7f74fa800640 1 -- start start 2024-04-25T13:41:51.571 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.572+0000 7f74fa800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74f4142200 0x7f74f4155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:51.571 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.572+0000 7f74fa800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74f415fa00 0x7f74f40af280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:51.571 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.572+0000 7f74fa800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74f4160520 0x7f74f4144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:51.571 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.572+0000 7f74fa800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f74f40b48b0 con 0x7f74f415fa00 2024-04-25T13:41:51.571 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.572+0000 7f74fa800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f74f40d1250 con 0x7f74f4142200 2024-04-25T13:41:51.571 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.572+0000 7f74fa800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f74f41457f0 con 0x7f74f4160520 2024-04-25T13:41:51.572 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.572+0000 7f74f3400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74f4142200 0x7f74f4155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:51.572 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.572+0000 7f74f2a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74f415fa00 0x7f74f40af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:51.572 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.572+0000 7f74f2a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74f415fa00 0x7f74f40af280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45942/0 (socket says 172.21.15.123:45942) 2024-04-25T13:41:51.572 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.572+0000 7f74f2a00640 1 -- 172.21.15.123:0/3530047522 learned_addr learned my addr 172.21.15.123:0/3530047522 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:41:51.572 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.572+0000 7f74f3e00640 1 --2- 172.21.15.123:0/3530047522 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74f4160520 0x7f74f4144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:51.572 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.572+0000 7f74f2a00640 1 -- 172.21.15.123:0/3530047522 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74f4160520 msgr2=0x7f74f4144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:51.573 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.572+0000 7f74f2a00640 1 --2- 172.21.15.123:0/3530047522 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74f4160520 0x7f74f4144cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:51.573 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.572+0000 7f74f2a00640 1 -- 172.21.15.123:0/3530047522 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74f4142200 msgr2=0x7f74f4155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:51.573 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.572+0000 7f74f2a00640 1 --2- 172.21.15.123:0/3530047522 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74f4142200 0x7f74f4155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:51.573 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.572+0000 7f74f2a00640 1 -- 172.21.15.123:0/3530047522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f40afc60 con 0x7f74f415fa00 2024-04-25T13:41:51.573 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.572+0000 7f74f3400640 1 --2- 172.21.15.123:0/3530047522 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74f4142200 0x7f74f4155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:41:51.573 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.572+0000 7f74f2a00640 1 --2- 172.21.15.123:0/3530047522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74f415fa00 0x7f74f40af280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f74e400c3f0 tx=0x7f74e400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:51.574 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.572+0000 7f74eb400640 1 -- 172.21.15.123:0/3530047522 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e4017070 con 0x7f74f415fa00 2024-04-25T13:41:51.574 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.572+0000 7f74eb400640 1 -- 172.21.15.123:0/3530047522 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74e40052d0 con 0x7f74f415fa00 2024-04-25T13:41:51.574 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.572+0000 7f74eb400640 1 -- 172.21.15.123:0/3530047522 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e4003840 con 0x7f74f415fa00 2024-04-25T13:41:51.574 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.572+0000 7f74fa800640 1 -- 172.21.15.123:0/3530047522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74f40aff40 con 0x7f74f415fa00 2024-04-25T13:41:51.574 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.572+0000 7f74fa800640 1 -- 172.21.15.123:0/3530047522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74f40b6570 con 0x7f74f415fa00 2024-04-25T13:41:51.575 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.576+0000 7f74fa800640 1 -- 172.21.15.123:0/3530047522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74f40af9d0 con 0x7f74f415fa00 2024-04-25T13:41:51.576 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.576+0000 7f74eb400640 1 -- 172.21.15.123:0/3530047522 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 4) ==== 93151+0+0 (secure 0 0 0) 0x7f74e401a070 con 0x7f74f415fa00 2024-04-25T13:41:51.578 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.580+0000 7f74eb400640 1 --2- 172.21.15.123:0/3530047522 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f74d006f3c0 0x7f74d00718d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:51.578 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.580+0000 7f74eb400640 1 -- 172.21.15.123:0/3530047522 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f74e408db00 con 0x7f74f415fa00 2024-04-25T13:41:51.581 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.580+0000 7f74f3400640 1 --2- 172.21.15.123:0/3530047522 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f74d006f3c0 0x7f74d00718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:51.583 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.584+0000 7f74f3400640 1 --2- 172.21.15.123:0/3530047522 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f74d006f3c0 0x7f74d00718d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0b0000 tx=0x7f74dc0a8070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:51.585 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.584+0000 7f74eb400640 1 -- 172.21.15.123:0/3530047522 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f74e4021020 con 0x7f74f415fa00 2024-04-25T13:41:51.898 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.896+0000 7f74fa800640 1 -- 172.21.15.123:0/3530047522 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f74f4050750 con 0x7f74f415fa00 2024-04-25T13:41:51.900 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.900+0000 7f74eb400640 1 -- 172.21.15.123:0/3530047522 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f74e4005480 con 0x7f74f415fa00 2024-04-25T13:41:51.904 INFO:teuthology.misc.health.smithi123.stdout: 2024-04-25T13:41:51.904 INFO:teuthology.misc.health.smithi123.stdout:{"epoch":12,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:41:49.587729+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:41:51.906 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.908+0000 7f74fa800640 1 -- 172.21.15.123:0/3530047522 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f74d006f3c0 msgr2=0x7f74d00718d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:51.906 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.908+0000 7f74fa800640 1 --2- 172.21.15.123:0/3530047522 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f74d006f3c0 0x7f74d00718d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f74dc0b0000 tx=0x7f74dc0a8070 comp rx=0 tx=0).stop 2024-04-25T13:41:51.907 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.908+0000 7f74fa800640 1 -- 172.21.15.123:0/3530047522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74f415fa00 msgr2=0x7f74f40af280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:51.907 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.908+0000 7f74fa800640 1 --2- 172.21.15.123:0/3530047522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74f415fa00 0x7f74f40af280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f74e400c3f0 tx=0x7f74e400c8b0 comp rx=0 tx=0).stop 2024-04-25T13:41:51.907 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.908+0000 7f74fa800640 1 -- 172.21.15.123:0/3530047522 shutdown_connections 2024-04-25T13:41:51.907 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.908+0000 7f74fa800640 1 --2- 172.21.15.123:0/3530047522 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f74d006f3c0 0x7f74d00718d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:51.907 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.908+0000 7f74fa800640 1 --2- 172.21.15.123:0/3530047522 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74f4160520 0x7f74f4144cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:51.908 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.908+0000 7f74fa800640 1 --2- 172.21.15.123:0/3530047522 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74f415fa00 0x7f74f40af280 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:51.908 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.908+0000 7f74fa800640 1 --2- 172.21.15.123:0/3530047522 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74f4142200 0x7f74f4155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:51.908 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.908+0000 7f74fa800640 1 -- 172.21.15.123:0/3530047522 >> 172.21.15.123:0/3530047522 conn(0x7f74f40b3a00 msgr2=0x7f74f4155f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:51.908 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.908+0000 7f74fa800640 1 -- 172.21.15.123:0/3530047522 shutdown_connections 2024-04-25T13:41:51.908 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:51.908+0000 7f74fa800640 1 -- 172.21.15.123:0/3530047522 wait complete. 2024-04-25T13:41:51.908 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-04-25T13:41:51.905+0000 7f4ecf800640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T13:41:51.912 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-04-25T13:41:51.913+0000 7f4411200640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T13:41:51.922 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-04-25T13:41:51.921+0000 7f45b2600640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T13:41:51.935 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T13:41:51.941 INFO:tasks.ceph.osd.4.smithi130.stderr:2024-04-25T13:41:51.941+0000 7f4ec5800640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:41:51.946 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-04-25T13:41:51.945+0000 7f962de00640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T13:41:51.949 INFO:tasks.ceph.osd.5.smithi130.stderr:2024-04-25T13:41:51.949+0000 7f4407200640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:41:51.949 INFO:tasks.ceph.osd.6.smithi130.stderr:2024-04-25T13:41:51.949+0000 7f45a8600640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:41:51.971 INFO:tasks.ceph.osd.3.smithi123.stderr:2024-04-25T13:41:51.972+0000 7fa6fbc00640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T13:41:51.985 INFO:tasks.ceph.osd.7.smithi130.stderr:2024-04-25T13:41:51.985+0000 7f9623e00640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:41:52.004 INFO:tasks.ceph.osd.3.smithi123.stderr:2024-04-25T13:41:52.004+0000 7fa6f1c00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:41:52.030 INFO:tasks.ceph.osd.1.smithi123.stderr:2024-04-25T13:41:52.028+0000 7f903fc00640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T13:41:52.043 INFO:tasks.ceph.osd.2.smithi123.stderr:2024-04-25T13:41:52.044+0000 7f4784c00640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T13:41:52.059 INFO:tasks.ceph.osd.1.smithi123.stderr:2024-04-25T13:41:52.060+0000 7f9035c00640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:41:52.059 INFO:tasks.ceph.osd.0.smithi123.stderr:2024-04-25T13:41:52.060+0000 7f63c9800640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T13:41:52.071 INFO:tasks.ceph.osd.2.smithi123.stderr:2024-04-25T13:41:52.072+0000 7f477ac00640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:41:52.107 INFO:tasks.ceph.osd.0.smithi123.stderr:2024-04-25T13:41:52.108+0000 7f63bf800640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T13:41:58.741 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T13:41:58.881 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.879+0000 7f694fa00640 1 Processor -- start 2024-04-25T13:41:58.882 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.879+0000 7f694fa00640 1 -- start start 2024-04-25T13:41:58.883 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.883+0000 7f694fa00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f69480b6260 0x7f69480cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:58.883 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.883+0000 7f694fa00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f694815d200 con 0x7f694806f9b0 2024-04-25T13:41:58.883 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.883+0000 7f694fa00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f694815d4a0 con 0x7f69480b45a0 2024-04-25T13:41:58.884 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.883+0000 7f694fa00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f694815d780 con 0x7f69480b6260 2024-04-25T13:41:58.884 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.883+0000 7f694d000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f69480b6260 0x7f69480cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:58.884 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.883+0000 7f694d000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f69480b6260 0x7f69480cec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45962/0 (socket says 172.21.15.123:45962) 2024-04-25T13:41:58.884 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.883+0000 7f694d000640 1 -- 172.21.15.123:0/4291676676 learned_addr learned my addr 172.21.15.123:0/4291676676 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:41:58.884 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.883+0000 7f694d000640 1 -- 172.21.15.123:0/4291676676 >> v1:172.21.15.130:6789/0 conn(0x7f69480b45a0 legacy=0x7f69480b49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:58.884 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.883+0000 7f694d000640 1 -- 172.21.15.123:0/4291676676 >> v1:172.21.15.123:6789/0 conn(0x7f694806f9b0 legacy=0x7f694806fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:58.885 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.883+0000 7f694d000640 1 -- 172.21.15.123:0/4291676676 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f694815da60 con 0x7f69480b6260 2024-04-25T13:41:58.885 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.883+0000 7f6947e00640 1 -- 172.21.15.123:0/4291676676 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3257595922 0 0) 0x7f694815d200 con 0x7f694806f9b0 2024-04-25T13:41:58.887 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.887+0000 7f694d000640 1 --2- 172.21.15.123:0/4291676676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69480b6260 0x7f69480cec30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6938009870 tx=0x7f693801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd9f1c87db9b3ab8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:58.887 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.887+0000 7f6947e00640 1 -- 172.21.15.123:0/4291676676 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69380ab430 con 0x7f69480b6260 2024-04-25T13:41:58.887 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.887+0000 7f6947e00640 1 -- 172.21.15.123:0/4291676676 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69380b0070 con 0x7f69480b6260 2024-04-25T13:41:58.887 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.887+0000 7f6947e00640 1 -- 172.21.15.123:0/4291676676 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69380ab7f0 con 0x7f69480b6260 2024-04-25T13:41:58.888 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.887+0000 7f694fa00640 1 -- 172.21.15.123:0/4291676676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69480b6260 msgr2=0x7f69480cec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:58.888 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.887+0000 7f694fa00640 1 --2- 172.21.15.123:0/4291676676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69480b6260 0x7f69480cec30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6938009870 tx=0x7f693801c450 comp rx=0 tx=0).stop 2024-04-25T13:41:58.888 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.887+0000 7f694fa00640 1 -- 172.21.15.123:0/4291676676 shutdown_connections 2024-04-25T13:41:58.888 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.887+0000 7f694fa00640 1 --2- 172.21.15.123:0/4291676676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69480b6260 0x7f69480cec30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:58.888 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.887+0000 7f694fa00640 1 -- 172.21.15.123:0/4291676676 >> 172.21.15.123:0/4291676676 conn(0x7f69480b3a00 msgr2=0x7f694806c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:58.889 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.887+0000 7f694fa00640 1 -- 172.21.15.123:0/4291676676 shutdown_connections 2024-04-25T13:41:58.889 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.887+0000 7f694fa00640 1 -- 172.21.15.123:0/4291676676 wait complete. 2024-04-25T13:41:58.890 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.887+0000 7f694fa00640 1 Processor -- start 2024-04-25T13:41:58.890 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.887+0000 7f694fa00640 1 -- start start 2024-04-25T13:41:58.892 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.891+0000 7f694fa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f694806f9b0 0x7f694814de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:58.892 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.891+0000 7f694fa00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69480b45a0 0x7f6948153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:58.893 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.891+0000 7f694fa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69480b6260 0x7f6948153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:58.893 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.891+0000 7f694fa00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f694815df80 con 0x7f694806f9b0 2024-04-25T13:41:58.893 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.891+0000 7f694fa00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f694816b6b0 con 0x7f69480b6260 2024-04-25T13:41:58.893 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.891+0000 7f694fa00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f6948152e00 con 0x7f69480b45a0 2024-04-25T13:41:58.893 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.891+0000 7f694d000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f694806f9b0 0x7f694814de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:58.893 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.891+0000 7f694d000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f694806f9b0 0x7f694814de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45972/0 (socket says 172.21.15.123:45972) 2024-04-25T13:41:58.893 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.891+0000 7f694d000640 1 -- 172.21.15.123:0/2559391193 learned_addr learned my addr 172.21.15.123:0/2559391193 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:41:58.893 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.891+0000 7f694d000640 1 -- 172.21.15.123:0/2559391193 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69480b45a0 msgr2=0x7f6948153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:58.893 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.891+0000 7f694d000640 1 --2- 172.21.15.123:0/2559391193 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69480b45a0 0x7f6948153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:58.893 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.891+0000 7f694d000640 1 -- 172.21.15.123:0/2559391193 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69480b6260 msgr2=0x7f6948153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:58.893 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.891+0000 7f694d000640 1 --2- 172.21.15.123:0/2559391193 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69480b6260 0x7f6948153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:58.893 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.891+0000 7f694d000640 1 -- 172.21.15.123:0/2559391193 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6948150990 con 0x7f694806f9b0 2024-04-25T13:41:58.893 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.891+0000 7f694d000640 1 --2- 172.21.15.123:0/2559391193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f694806f9b0 0x7f694814de00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6938009870 tx=0x7f693801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:58.894 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.891+0000 7f6945600640 1 -- 172.21.15.123:0/2559391193 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69380ba070 con 0x7f694806f9b0 2024-04-25T13:41:58.894 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.891+0000 7f6945600640 1 -- 172.21.15.123:0/2559391193 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69380abce0 con 0x7f694806f9b0 2024-04-25T13:41:58.894 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.891+0000 7f6945600640 1 -- 172.21.15.123:0/2559391193 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6938004220 con 0x7f694806f9b0 2024-04-25T13:41:58.894 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.891+0000 7f694fa00640 1 -- 172.21.15.123:0/2559391193 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6948150c70 con 0x7f694806f9b0 2024-04-25T13:41:58.895 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.891+0000 7f694fa00640 1 -- 172.21.15.123:0/2559391193 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6948151230 con 0x7f694806f9b0 2024-04-25T13:41:58.895 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.891+0000 7f694fa00640 1 -- 172.21.15.123:0/2559391193 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6948050750 con 0x7f694806f9b0 2024-04-25T13:41:58.895 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.895+0000 7f6945600640 1 -- 172.21.15.123:0/2559391193 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6938003620 con 0x7f694806f9b0 2024-04-25T13:41:58.896 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.895+0000 7f6945600640 1 --2- 172.21.15.123:0/2559391193 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f692406f400 0x7f6924071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:58.896 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.895+0000 7f6945600640 1 -- 172.21.15.123:0/2559391193 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f69380a8020 con 0x7f694806f9b0 2024-04-25T13:41:58.896 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.895+0000 7f693fe00640 1 --2- 172.21.15.123:0/2559391193 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f692406f400 0x7f6924071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:58.896 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.895+0000 7f693fe00640 1 --2- 172.21.15.123:0/2559391193 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f692406f400 0x7f6924071910 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6930007fd0 tx=0x7f6930007960 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:58.901 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:58.899+0000 7f6945600640 1 -- 172.21.15.123:0/2559391193 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f693812d070 con 0x7f694806f9b0 2024-04-25T13:41:59.059 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:59.059+0000 7f694fa00640 1 -- 172.21.15.123:0/2559391193 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f694815bbe0 con 0x7f694806f9b0 2024-04-25T13:41:59.060 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:59.059+0000 7f6945600640 1 -- 172.21.15.123:0/2559391193 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12908 (secure 0 0 0) 0x7f69380160d0 con 0x7f694806f9b0 2024-04-25T13:41:59.061 INFO:teuthology.misc.health.smithi123.stdout: 2024-04-25T13:41:59.061 INFO:teuthology.misc.health.smithi123.stdout:{"epoch":17,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:41:56.961733+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:41:59.063 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:59.059+0000 7f694fa00640 1 -- 172.21.15.123:0/2559391193 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f692406f400 msgr2=0x7f6924071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:59.063 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:59.059+0000 7f694fa00640 1 --2- 172.21.15.123:0/2559391193 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f692406f400 0x7f6924071910 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6930007fd0 tx=0x7f6930007960 comp rx=0 tx=0).stop 2024-04-25T13:41:59.063 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:59.059+0000 7f694fa00640 1 -- 172.21.15.123:0/2559391193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f694806f9b0 msgr2=0x7f694814de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:59.063 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:59.059+0000 7f694fa00640 1 --2- 172.21.15.123:0/2559391193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f694806f9b0 0x7f694814de00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6938009870 tx=0x7f693801ac90 comp rx=0 tx=0).stop 2024-04-25T13:41:59.063 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:59.059+0000 7f694fa00640 1 -- 172.21.15.123:0/2559391193 shutdown_connections 2024-04-25T13:41:59.063 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:59.059+0000 7f694fa00640 1 --2- 172.21.15.123:0/2559391193 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69480b6260 0x7f6948153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.063 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:59.059+0000 7f694fa00640 1 --2- 172.21.15.123:0/2559391193 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f692406f400 0x7f6924071910 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.063 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:59.059+0000 7f694fa00640 1 --2- 172.21.15.123:0/2559391193 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69480b45a0 0x7f6948153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.063 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:59.059+0000 7f694fa00640 1 --2- 172.21.15.123:0/2559391193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f694806f9b0 0x7f694814de00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.063 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:59.059+0000 7f694fa00640 1 -- 172.21.15.123:0/2559391193 >> 172.21.15.123:0/2559391193 conn(0x7f69480b3a00 msgr2=0x7f6948160670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:59.064 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:59.063+0000 7f694fa00640 1 -- 172.21.15.123:0/2559391193 shutdown_connections 2024-04-25T13:41:59.064 INFO:teuthology.misc.health.smithi123.stderr:2024-04-25T13:41:59.063+0000 7f694fa00640 1 -- 172.21.15.123:0/2559391193 wait complete. 2024-04-25T13:41:59.080 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T13:41:59.080 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T13:41:59.081 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T13:41:59.081 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T13:41:59.084 INFO:tasks.ceph.mds.a:Started 2024-04-25T13:41:59.084 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T13:41:59.084 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T13:41:59.087 INFO:tasks.ceph.mds.c:Started 2024-04-25T13:41:59.087 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T13:41:59.087 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T13:41:59.091 INFO:tasks.ceph.mds.b:Started 2024-04-25T13:41:59.091 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T13:41:59.091 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T13:41:59.094 INFO:tasks.ceph.mds.d:Started 2024-04-25T13:41:59.095 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T13:41:59.095 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:41:59.198 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-04-25T13:41:59.199 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-04-25T13:41:59.200 INFO:tasks.ceph.mds.a.smithi123.stderr:2024-04-25T13:41:59.199+0000 7f3571400640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-04-25T13:41:59.230 INFO:tasks.ceph.mds.b.smithi130.stdout:starting mds.b at 2024-04-25T13:41:59.230 INFO:tasks.ceph.mds.d.smithi130.stdout:starting mds.d at 2024-04-25T13:41:59.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.251+0000 7f7f20000640 1 Processor -- start 2024-04-25T13:41:59.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.251+0000 7f7f20000640 1 -- start start 2024-04-25T13:41:59.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.251+0000 7f7f20000640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7f180d30a0 0x7f7f180b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:59.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.251+0000 7f7f20000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f180b2e20 con 0x7f7f180ce9d0 2024-04-25T13:41:59.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.251+0000 7f7f20000640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f180b2580 con 0x7f7f1806c670 2024-04-25T13:41:59.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.251+0000 7f7f20000640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f7f180b2320 con 0x7f7f180d30a0 2024-04-25T13:41:59.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.251+0000 7f7f1e000640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7f180ce9d0 0x7f7f180cede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41532/0 (socket says 172.21.15.123:41532) 2024-04-25T13:41:59.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.251+0000 7f7f1e000640 1 -- 172.21.15.123:0/3111633636 learned_addr learned my addr 172.21.15.123:0/3111633636 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:41:59.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.251+0000 7f7f1d600640 1 --2- 172.21.15.123:0/3111633636 >> v2:172.21.15.130:3300/0 conn(0x7f7f180d30a0 0x7f7f180b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:59.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.251+0000 7f7f17e00640 1 -- 172.21.15.123:0/3111633636 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2731711883 0 0) 0x7f7f180b2e20 con 0x7f7f180ce9d0 2024-04-25T13:41:59.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.255+0000 7f7f17e00640 1 -- 172.21.15.123:0/3111633636 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f00003530 con 0x7f7f180ce9d0 2024-04-25T13:41:59.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.255+0000 7f7f1d600640 1 -- 172.21.15.123:0/3111633636 >> v1:172.21.15.130:6789/0 conn(0x7f7f1806c670 legacy=0x7f7f1806ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:59.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.255+0000 7f7f1d600640 1 -- 172.21.15.123:0/3111633636 >> v1:172.21.15.123:6789/0 conn(0x7f7f180ce9d0 legacy=0x7f7f180cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:59.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.255+0000 7f7f1d600640 1 -- 172.21.15.123:0/3111633636 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f180b2860 con 0x7f7f180d30a0 2024-04-25T13:41:59.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.255+0000 7f7f1d600640 1 --2- 172.21.15.123:0/3111633636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f180d30a0 0x7f7f180b1de0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c0097a0 tx=0x7f7f0c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea5b95051bbe64f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:59.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.255+0000 7f7f17e00640 1 -- 172.21.15.123:0/3111633636 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c0b0070 con 0x7f7f180d30a0 2024-04-25T13:41:59.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.255+0000 7f7f17e00640 1 -- 172.21.15.123:0/3111633636 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f0c0ab600 con 0x7f7f180d30a0 2024-04-25T13:41:59.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.255+0000 7f7f17e00640 1 -- 172.21.15.123:0/3111633636 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f180cfd00 con 0x7f7f180d30a0 2024-04-25T13:41:59.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.259+0000 7f7f20000640 1 -- 172.21.15.123:0/3111633636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f180d30a0 msgr2=0x7f7f180b1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:59.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.259+0000 7f7f20000640 1 --2- 172.21.15.123:0/3111633636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f180d30a0 0x7f7f180b1de0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c0097a0 tx=0x7f7f0c01c480 comp rx=0 tx=0).stop 2024-04-25T13:41:59.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.259+0000 7f7f20000640 1 -- 172.21.15.123:0/3111633636 shutdown_connections 2024-04-25T13:41:59.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.259+0000 7f7f20000640 1 --2- 172.21.15.123:0/3111633636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f180d30a0 0x7f7f180b1de0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.259+0000 7f7f20000640 1 -- 172.21.15.123:0/3111633636 >> 172.21.15.123:0/3111633636 conn(0x7f7f180d2580 msgr2=0x7f7f180d2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:59.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.259+0000 7f7f20000640 1 -- 172.21.15.123:0/3111633636 shutdown_connections 2024-04-25T13:41:59.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.259+0000 7f7f20000640 1 -- 172.21.15.123:0/3111633636 wait complete. 2024-04-25T13:41:59.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.259+0000 7f7f20000640 1 Processor -- start 2024-04-25T13:41:59.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.259+0000 7f7f20000640 1 -- start start 2024-04-25T13:41:59.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.263+0000 7f7f20000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f1806c670 0x7f7f181542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:59.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.263+0000 7f7f20000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f180ce9d0 0x7f7f180b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:59.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.263+0000 7f7f20000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f180d30a0 0x7f7f180b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:59.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.263+0000 7f7f20000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1816bd90 con 0x7f7f1806c670 2024-04-25T13:41:59.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.263+0000 7f7f20000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7f1816bc10 con 0x7f7f180d30a0 2024-04-25T13:41:59.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.263+0000 7f7f20000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7f1816bf10 con 0x7f7f180ce9d0 2024-04-25T13:41:59.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.263+0000 7f7f1d600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f1806c670 0x7f7f181542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:59.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.263+0000 7f7f1d600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f1806c670 0x7f7f181542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45988/0 (socket says 172.21.15.123:45988) 2024-04-25T13:41:59.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.263+0000 7f7f1d600640 1 -- 172.21.15.123:0/3926384898 learned_addr learned my addr 172.21.15.123:0/3926384898 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:41:59.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.263+0000 7f7f1cc00640 1 --2- 172.21.15.123:0/3926384898 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f180ce9d0 0x7f7f180b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:59.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.263+0000 7f7f1e000640 1 --2- 172.21.15.123:0/3926384898 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f180d30a0 0x7f7f180b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:59.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.263+0000 7f7f1d600640 1 -- 172.21.15.123:0/3926384898 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f180ce9d0 msgr2=0x7f7f180b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:59.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.263+0000 7f7f1d600640 1 --2- 172.21.15.123:0/3926384898 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f180ce9d0 0x7f7f180b3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.263+0000 7f7f1d600640 1 -- 172.21.15.123:0/3926384898 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f180d30a0 msgr2=0x7f7f180b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:59.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.263+0000 7f7f1d600640 1 --2- 172.21.15.123:0/3926384898 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f180d30a0 0x7f7f180b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.263+0000 7f7f1d600640 1 -- 172.21.15.123:0/3926384898 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f180d01f0 con 0x7f7f1806c670 2024-04-25T13:41:59.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.263+0000 7f7f1e000640 1 --2- 172.21.15.123:0/3926384898 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f180d30a0 0x7f7f180b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:41:59.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.263+0000 7f7f1d600640 1 --2- 172.21.15.123:0/3926384898 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f1806c670 0x7f7f181542a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c0ae040 tx=0x7f7f0c01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:59.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.263+0000 7f7f15600640 1 -- 172.21.15.123:0/3926384898 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c0bb020 con 0x7f7f1806c670 2024-04-25T13:41:59.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.263+0000 7f7f15600640 1 -- 172.21.15.123:0/3926384898 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f0c0b1040 con 0x7f7f1806c670 2024-04-25T13:41:59.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.263+0000 7f7f15600640 1 -- 172.21.15.123:0/3926384898 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c0b0050 con 0x7f7f1806c670 2024-04-25T13:41:59.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.263+0000 7f7f20000640 1 -- 172.21.15.123:0/3926384898 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f180d04d0 con 0x7f7f1806c670 2024-04-25T13:41:59.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.263+0000 7f7f20000640 1 -- 172.21.15.123:0/3926384898 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f180d0a90 con 0x7f7f1806c670 2024-04-25T13:41:59.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.263+0000 7f7f20000640 1 -- 172.21.15.123:0/3926384898 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f180507c0 con 0x7f7f1806c670 2024-04-25T13:41:59.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.263+0000 7f7f15600640 1 -- 172.21.15.123:0/3926384898 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7f0c0be070 con 0x7f7f1806c670 2024-04-25T13:41:59.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.267+0000 7f7f15600640 1 --2- 172.21.15.123:0/3926384898 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f7ef806f430 0x7f7ef8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:59.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.267+0000 7f7f15600640 1 -- 172.21.15.123:0/3926384898 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f7f0c128540 con 0x7f7f1806c670 2024-04-25T13:41:59.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.267+0000 7f7f1cc00640 1 --2- 172.21.15.123:0/3926384898 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f7ef806f430 0x7f7ef8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:59.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.267+0000 7f7f1cc00640 1 --2- 172.21.15.123:0/3926384898 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f7ef806f430 0x7f7ef8071940 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7f180b4cf0 tx=0x7f7f04009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:59.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.271+0000 7f7f15600640 1 -- 172.21.15.123:0/3926384898 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7f0c016070 con 0x7f7f1806c670 2024-04-25T13:41:59.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.427+0000 7f7f20000640 1 -- 172.21.15.123:0/3926384898 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7f1806ec00 con 0x7f7f1806c670 2024-04-25T13:41:59.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.427+0000 7f7f15600640 1 -- 172.21.15.123:0/3926384898 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12908 (secure 0 0 0) 0x7f7f0c0f5780 con 0x7f7f1806c670 2024-04-25T13:41:59.430 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:41:59.430 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":17,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:41:56.961733+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:41:59.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.431+0000 7f7f20000640 1 -- 172.21.15.123:0/3926384898 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f7ef806f430 msgr2=0x7f7ef8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:59.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.431+0000 7f7f20000640 1 --2- 172.21.15.123:0/3926384898 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f7ef806f430 0x7f7ef8071940 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7f180b4cf0 tx=0x7f7f04009040 comp rx=0 tx=0).stop 2024-04-25T13:41:59.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.431+0000 7f7f20000640 1 -- 172.21.15.123:0/3926384898 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f1806c670 msgr2=0x7f7f181542a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:59.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.431+0000 7f7f20000640 1 --2- 172.21.15.123:0/3926384898 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f1806c670 0x7f7f181542a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c0ae040 tx=0x7f7f0c01acc0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.431+0000 7f7f20000640 1 -- 172.21.15.123:0/3926384898 shutdown_connections 2024-04-25T13:41:59.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.431+0000 7f7f20000640 1 --2- 172.21.15.123:0/3926384898 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f180d30a0 0x7f7f180b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.431+0000 7f7f20000640 1 --2- 172.21.15.123:0/3926384898 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f7ef806f430 0x7f7ef8071940 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.431+0000 7f7f20000640 1 --2- 172.21.15.123:0/3926384898 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7f180ce9d0 0x7f7f180b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.431+0000 7f7f20000640 1 --2- 172.21.15.123:0/3926384898 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7f1806c670 0x7f7f181542a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.431+0000 7f7f20000640 1 -- 172.21.15.123:0/3926384898 >> 172.21.15.123:0/3926384898 conn(0x7f7f180d2580 msgr2=0x7f7f1815f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:59.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.431+0000 7f7f20000640 1 -- 172.21.15.123:0/3926384898 shutdown_connections 2024-04-25T13:41:59.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.431+0000 7f7f20000640 1 -- 172.21.15.123:0/3926384898 wait complete. 2024-04-25T13:41:59.451 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:41:53.602480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:41:59.452 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:41:59.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.599+0000 7f5336a00640 1 Processor -- start 2024-04-25T13:41:59.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.599+0000 7f5336a00640 1 -- start start 2024-04-25T13:41:59.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.603+0000 7f5336a00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f53300d0710 0x7f53300ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:59.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.603+0000 7f5336a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53300d24a0 con 0x7f53300d4140 2024-04-25T13:41:59.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.603+0000 7f5336a00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53300d2780 con 0x7f53300ce690 2024-04-25T13:41:59.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.603+0000 7f5336a00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f53300d2a60 con 0x7f53300d0710 2024-04-25T13:41:59.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.603+0000 7f5335600640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f53300d4140 0x7f53300d0000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:41542/0 (socket says 172.21.15.123:41542) 2024-04-25T13:41:59.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.603+0000 7f5335600640 1 -- 172.21.15.123:0/1629963852 learned_addr learned my addr 172.21.15.123:0/1629963852 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:41:59.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.603+0000 7f5334c00640 1 --2- 172.21.15.123:0/1629963852 >> v2:172.21.15.130:3300/0 conn(0x7f53300d0710 0x7f53300ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:59.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.603+0000 7f532fe00640 1 -- 172.21.15.123:0/1629963852 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2886687717 0 0) 0x7f53300d24a0 con 0x7f53300d4140 2024-04-25T13:41:59.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.603+0000 7f532fe00640 1 -- 172.21.15.123:0/1629963852 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5318003530 con 0x7f53300d4140 2024-04-25T13:41:59.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.603+0000 7f5334c00640 1 -- 172.21.15.123:0/1629963852 >> v1:172.21.15.130:6789/0 conn(0x7f53300ce690 legacy=0x7f53300ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:59.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.603+0000 7f532fe00640 1 -- 172.21.15.123:0/1629963852 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3436498212 0 0) 0x7f53300d2780 con 0x7f53300ce690 2024-04-25T13:41:59.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.603+0000 7f5334c00640 1 -- 172.21.15.123:0/1629963852 >> v1:172.21.15.123:6789/0 conn(0x7f53300d4140 legacy=0x7f53300d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:59.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.603+0000 7f5334c00640 1 -- 172.21.15.123:0/1629963852 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53300d2d40 con 0x7f53300d0710 2024-04-25T13:41:59.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.607+0000 7f5334c00640 1 --2- 172.21.15.123:0/1629963852 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53300d0710 0x7f53300ce150 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f531c0097c0 tx=0x7f531c01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9651976e3415b72d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:59.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.607+0000 7f532fe00640 1 -- 172.21.15.123:0/1629963852 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531c0b0070 con 0x7f53300d0710 2024-04-25T13:41:59.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.607+0000 7f532fe00640 1 -- 172.21.15.123:0/1629963852 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f531c0ab600 con 0x7f53300d0710 2024-04-25T13:41:59.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.607+0000 7f532fe00640 1 -- 172.21.15.123:0/1629963852 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f531c0ab9d0 con 0x7f53300d0710 2024-04-25T13:41:59.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.607+0000 7f5336a00640 1 -- 172.21.15.123:0/1629963852 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53300d0710 msgr2=0x7f53300ce150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:59.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.607+0000 7f5336a00640 1 --2- 172.21.15.123:0/1629963852 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53300d0710 0x7f53300ce150 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f531c0097c0 tx=0x7f531c01c380 comp rx=0 tx=0).stop 2024-04-25T13:41:59.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.607+0000 7f5336a00640 1 -- 172.21.15.123:0/1629963852 shutdown_connections 2024-04-25T13:41:59.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.607+0000 7f5336a00640 1 --2- 172.21.15.123:0/1629963852 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53300d0710 0x7f53300ce150 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.607+0000 7f5336a00640 1 -- 172.21.15.123:0/1629963852 >> 172.21.15.123:0/1629963852 conn(0x7f53300d3620 msgr2=0x7f53300d3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:59.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.607+0000 7f5336a00640 1 -- 172.21.15.123:0/1629963852 shutdown_connections 2024-04-25T13:41:59.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.607+0000 7f5336a00640 1 -- 172.21.15.123:0/1629963852 wait complete. 2024-04-25T13:41:59.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.607+0000 7f5336a00640 1 Processor -- start 2024-04-25T13:41:59.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.611+0000 7f5336a00640 1 -- start start 2024-04-25T13:41:59.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.611+0000 7f5336a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53300ce690 0x7f53300cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:59.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.611+0000 7f5336a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f53300d4140 0x7f53300b7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:59.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.611+0000 7f5336a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53300c9a00 0x7f53300cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:59.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.611+0000 7f5336a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f533016e800 con 0x7f53300ce690 2024-04-25T13:41:59.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.611+0000 7f5336a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f533016e680 con 0x7f53300c9a00 2024-04-25T13:41:59.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.611+0000 7f5336a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f533016e980 con 0x7f53300d4140 2024-04-25T13:41:59.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.611+0000 7f5335600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53300ce690 0x7f53300cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:59.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.611+0000 7f5335600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53300ce690 0x7f53300cb1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45994/0 (socket says 172.21.15.123:45994) 2024-04-25T13:41:59.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.611+0000 7f5335600640 1 -- 172.21.15.123:0/2100760726 learned_addr learned my addr 172.21.15.123:0/2100760726 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:41:59.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.611+0000 7f5334c00640 1 --2- 172.21.15.123:0/2100760726 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f53300d4140 0x7f53300b7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:59.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.611+0000 7f5336000640 1 --2- 172.21.15.123:0/2100760726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53300c9a00 0x7f53300cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:59.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.611+0000 7f5335600640 1 -- 172.21.15.123:0/2100760726 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f53300d4140 msgr2=0x7f53300b7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:59.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.611+0000 7f5335600640 1 --2- 172.21.15.123:0/2100760726 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f53300d4140 0x7f53300b7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.611+0000 7f5335600640 1 -- 172.21.15.123:0/2100760726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53300c9a00 msgr2=0x7f53300cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:59.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.611+0000 7f5335600640 1 --2- 172.21.15.123:0/2100760726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53300c9a00 0x7f53300cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.611+0000 7f5335600640 1 -- 172.21.15.123:0/2100760726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53300cc090 con 0x7f53300ce690 2024-04-25T13:41:59.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.611+0000 7f5336000640 1 --2- 172.21.15.123:0/2100760726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53300c9a00 0x7f53300cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:41:59.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.611+0000 7f5335600640 1 --2- 172.21.15.123:0/2100760726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53300ce690 0x7f53300cb1d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f532400caa0 tx=0x7f532400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:59.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.611+0000 7f532d600640 1 -- 172.21.15.123:0/2100760726 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5324017070 con 0x7f53300ce690 2024-04-25T13:41:59.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.611+0000 7f532d600640 1 -- 172.21.15.123:0/2100760726 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f532400ac00 con 0x7f53300ce690 2024-04-25T13:41:59.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.611+0000 7f5336a00640 1 -- 172.21.15.123:0/2100760726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53300cbad0 con 0x7f53300ce690 2024-04-25T13:41:59.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.611+0000 7f532d600640 1 -- 172.21.15.123:0/2100760726 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5324012400 con 0x7f53300ce690 2024-04-25T13:41:59.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.611+0000 7f5336a00640 1 -- 172.21.15.123:0/2100760726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5330154b90 con 0x7f53300ce690 2024-04-25T13:41:59.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.611+0000 7f5336a00640 1 -- 172.21.15.123:0/2100760726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5330050750 con 0x7f53300ce690 2024-04-25T13:41:59.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.615+0000 7f532d600640 1 -- 172.21.15.123:0/2100760726 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f532401a070 con 0x7f53300ce690 2024-04-25T13:41:59.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.615+0000 7f532d600640 1 --2- 172.21.15.123:0/2100760726 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f531006f400 0x7f5310071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:59.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.615+0000 7f532d600640 1 -- 172.21.15.123:0/2100760726 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f532408ec90 con 0x7f53300ce690 2024-04-25T13:41:59.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.615+0000 7f5334c00640 1 --2- 172.21.15.123:0/2100760726 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f531006f400 0x7f5310071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:59.617 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.615+0000 7f5334c00640 1 --2- 172.21.15.123:0/2100760726 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f531006f400 0x7f5310071910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f531c0ad000 tx=0x7f531c0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:59.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.619+0000 7f532d600640 1 -- 172.21.15.123:0/2100760726 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f532405b870 con 0x7f53300ce690 2024-04-25T13:41:59.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.779+0000 7f5336a00640 1 -- 172.21.15.123:0/2100760726 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5330158210 con 0x7f53300ce690 2024-04-25T13:41:59.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.779+0000 7f532d600640 1 -- 172.21.15.123:0/2100760726 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f532405fb70 con 0x7f53300ce690 2024-04-25T13:41:59.780 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-04-25T13:41:59.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.779+0000 7f5336a00640 1 -- 172.21.15.123:0/2100760726 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f531006f400 msgr2=0x7f5310071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:59.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.779+0000 7f5336a00640 1 --2- 172.21.15.123:0/2100760726 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f531006f400 0x7f5310071910 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f531c0ad000 tx=0x7f531c0a6000 comp rx=0 tx=0).stop 2024-04-25T13:41:59.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.779+0000 7f5336a00640 1 -- 172.21.15.123:0/2100760726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53300ce690 msgr2=0x7f53300cb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:59.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.779+0000 7f5336a00640 1 --2- 172.21.15.123:0/2100760726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53300ce690 0x7f53300cb1d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f532400caa0 tx=0x7f532400cf60 comp rx=0 tx=0).stop 2024-04-25T13:41:59.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.779+0000 7f5336a00640 1 -- 172.21.15.123:0/2100760726 shutdown_connections 2024-04-25T13:41:59.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.779+0000 7f5336a00640 1 --2- 172.21.15.123:0/2100760726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53300c9a00 0x7f53300cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.779+0000 7f5336a00640 1 --2- 172.21.15.123:0/2100760726 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f531006f400 0x7f5310071910 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.779+0000 7f5336a00640 1 --2- 172.21.15.123:0/2100760726 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f53300d4140 0x7f53300b7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.779+0000 7f5336a00640 1 --2- 172.21.15.123:0/2100760726 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53300ce690 0x7f53300cb1d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.779+0000 7f5336a00640 1 -- 172.21.15.123:0/2100760726 >> 172.21.15.123:0/2100760726 conn(0x7f53300d3620 msgr2=0x7f53300b4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:59.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.779+0000 7f5336a00640 1 -- 172.21.15.123:0/2100760726 shutdown_connections 2024-04-25T13:41:59.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.779+0000 7f5336a00640 1 -- 172.21.15.123:0/2100760726 wait complete. 2024-04-25T13:41:59.801 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:41:59.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.947+0000 7fdd54a00640 1 Processor -- start 2024-04-25T13:41:59.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.947+0000 7fdd54a00640 1 -- start start 2024-04-25T13:41:59.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.947+0000 7fdd54a00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdd500ce2e0 0x7fdd500ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:59.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.947+0000 7fdd54a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd500b27b0 con 0x7fdd501623a0 2024-04-25T13:41:59.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.947+0000 7fdd54a00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd500b8e80 con 0x7fdd500cec30 2024-04-25T13:41:59.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.947+0000 7fdd54a00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fdd500d16b0 con 0x7fdd500ce2e0 2024-04-25T13:41:59.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.947+0000 7fdd4de00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fdd501623a0 0x7fdd501627b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59172/0 (socket says 172.21.15.123:59172) 2024-04-25T13:41:59.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.947+0000 7fdd4de00640 1 -- 172.21.15.123:0/850811911 learned_addr learned my addr 172.21.15.123:0/850811911 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:41:59.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.947+0000 7fdd4d400640 1 --2- 172.21.15.123:0/850811911 >> v2:172.21.15.130:3300/0 conn(0x7fdd500ce2e0 0x7fdd500ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:59.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.947+0000 7fdd4ca00640 1 -- 172.21.15.123:0/850811911 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 385004079 0 0) 0x7fdd500b27b0 con 0x7fdd501623a0 2024-04-25T13:41:59.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.947+0000 7fdd4ca00640 1 -- 172.21.15.123:0/850811911 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd34003530 con 0x7fdd501623a0 2024-04-25T13:41:59.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.947+0000 7fdd4ca00640 1 -- 172.21.15.123:0/850811911 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2857385112 0 0) 0x7fdd34003530 con 0x7fdd501623a0 2024-04-25T13:41:59.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.947+0000 7fdd4ca00640 1 -- 172.21.15.123:0/850811911 >> v2:172.21.15.130:3300/0 conn(0x7fdd500ce2e0 msgr2=0x7fdd500ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:59.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.947+0000 7fdd4ca00640 1 --2- 172.21.15.123:0/850811911 >> v2:172.21.15.130:3300/0 conn(0x7fdd500ce2e0 0x7fdd500ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.947+0000 7fdd4ca00640 1 -- 172.21.15.123:0/850811911 >> v1:172.21.15.130:6789/0 conn(0x7fdd500cec30 legacy=0x7fdd500cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:59.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.947+0000 7fdd4ca00640 1 -- 172.21.15.123:0/850811911 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd500d1340 con 0x7fdd501623a0 2024-04-25T13:41:59.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.947+0000 7fdd4ca00640 1 -- 172.21.15.123:0/850811911 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7fdd40001680 con 0x7fdd501623a0 2024-04-25T13:41:59.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.947+0000 7fdd4ca00640 1 -- 172.21.15.123:0/850811911 >> v1:172.21.15.123:6789/0 conn(0x7fdd501623a0 legacy=0x7fdd501627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:59.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.947+0000 7fdd4ca00640 1 --2- 172.21.15.123:0/850811911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd34003a30 0x7fdd34003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:59.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.947+0000 7fdd4ca00640 1 --2- 172.21.15.123:0/850811911 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd34004810 0x7fdd34004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:59.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.947+0000 7fdd4ca00640 1 --2- 172.21.15.123:0/850811911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd340051d0 0x7fdd3400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:59.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.947+0000 7fdd4ca00640 1 -- 172.21.15.123:0/850811911 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdd500d16b0 con 0x7fdd34003a30 2024-04-25T13:41:59.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.947+0000 7fdd4ca00640 1 -- 172.21.15.123:0/850811911 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3400c170 con 0x7fdd340051d0 2024-04-25T13:41:59.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.947+0000 7fdd4ca00640 1 -- 172.21.15.123:0/850811911 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fdd3400c370 con 0x7fdd34004810 2024-04-25T13:41:59.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.947+0000 7fdd4de00640 1 --2- 172.21.15.123:0/850811911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd34003a30 0x7fdd34003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:59.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.947+0000 7fdd4d400640 1 --2- 172.21.15.123:0/850811911 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd34004810 0x7fdd34004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:59.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.947+0000 7fdd4e800640 1 --2- 172.21.15.123:0/850811911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd340051d0 0x7fdd3400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:59.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.951+0000 7fdd4de00640 1 -- 172.21.15.123:0/850811911 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd34004810 msgr2=0x7fdd34004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:59.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.951+0000 7fdd4de00640 1 --2- 172.21.15.123:0/850811911 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd34004810 0x7fdd34004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.951+0000 7fdd4de00640 1 -- 172.21.15.123:0/850811911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd340051d0 msgr2=0x7fdd3400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:41:59.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.951+0000 7fdd4de00640 1 --2- 172.21.15.123:0/850811911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd340051d0 0x7fdd3400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.951+0000 7fdd4de00640 1 -- 172.21.15.123:0/850811911 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd34003530 con 0x7fdd34003a30 2024-04-25T13:41:59.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.951+0000 7fdd4e800640 1 -- 172.21.15.123:0/850811911 reap_dead start 2024-04-25T13:41:59.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.951+0000 7fdd4de00640 1 --2- 172.21.15.123:0/850811911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd34003a30 0x7fdd34003e80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdd50051150 tx=0x7fdd4001cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb7921f92d918ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:59.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.951+0000 7fdd4ca00640 1 -- 172.21.15.123:0/850811911 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd40007d40 con 0x7fdd34003a30 2024-04-25T13:41:59.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.951+0000 7fdd4ca00640 1 -- 172.21.15.123:0/850811911 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd400a9070 con 0x7fdd34003a30 2024-04-25T13:41:59.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.951+0000 7fdd4ca00640 1 -- 172.21.15.123:0/850811911 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd40005d80 con 0x7fdd34003a30 2024-04-25T13:41:59.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.951+0000 7fdd54a00640 1 -- 172.21.15.123:0/850811911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd34003a30 msgr2=0x7fdd34003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:59.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.951+0000 7fdd54a00640 1 --2- 172.21.15.123:0/850811911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd34003a30 0x7fdd34003e80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdd50051150 tx=0x7fdd4001cb20 comp rx=0 tx=0).stop 2024-04-25T13:41:59.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.955+0000 7fdd54a00640 1 -- 172.21.15.123:0/850811911 shutdown_connections 2024-04-25T13:41:59.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.955+0000 7fdd54a00640 1 --2- 172.21.15.123:0/850811911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd34003a30 0x7fdd34003e80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.955+0000 7fdd54a00640 1 -- 172.21.15.123:0/850811911 >> 172.21.15.123:0/850811911 conn(0x7fdd500d0150 msgr2=0x7fdd500d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:41:59.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.955+0000 7fdd54a00640 1 -- 172.21.15.123:0/850811911 shutdown_connections 2024-04-25T13:41:59.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.955+0000 7fdd54a00640 1 -- 172.21.15.123:0/850811911 wait complete. 2024-04-25T13:41:59.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.955+0000 7fdd54a00640 1 Processor -- start 2024-04-25T13:41:59.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.955+0000 7fdd54a00640 1 -- start start 2024-04-25T13:41:59.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.955+0000 7fdd54a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd34003a30 0x7fdd50160160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:59.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.955+0000 7fdd54a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd5014eeb0 0x7fdd50070e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:59.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.955+0000 7fdd54a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd5014f2c0 0x7fdd50071370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:59.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.955+0000 7fdd54a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdd500b88d0 con 0x7fdd5014f2c0 2024-04-25T13:41:59.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.955+0000 7fdd54a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdd500b2a20 con 0x7fdd5014eeb0 2024-04-25T13:41:59.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.955+0000 7fdd54a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fdd500b8a50 con 0x7fdd34003a30 2024-04-25T13:41:59.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.959+0000 7fdd4e800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd5014f2c0 0x7fdd50071370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:59.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.959+0000 7fdd4e800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd5014f2c0 0x7fdd50071370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48144/0 (socket says 172.21.15.123:48144) 2024-04-25T13:41:59.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.959+0000 7fdd4e800640 1 -- 172.21.15.123:0/1823835700 learned_addr learned my addr 172.21.15.123:0/1823835700 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:41:59.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.959+0000 7fdd4de00640 1 --2- 172.21.15.123:0/1823835700 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd34003a30 0x7fdd50160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:59.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.959+0000 7fdd4d400640 1 --2- 172.21.15.123:0/1823835700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd5014eeb0 0x7fdd50070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:59.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.959+0000 7fdd4e800640 1 -- 172.21.15.123:0/1823835700 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd34003a30 msgr2=0x7fdd50160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:59.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.959+0000 7fdd4e800640 1 --2- 172.21.15.123:0/1823835700 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd34003a30 0x7fdd50160160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.959+0000 7fdd4e800640 1 -- 172.21.15.123:0/1823835700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd5014eeb0 msgr2=0x7fdd50070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:41:59.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.959+0000 7fdd4e800640 1 --2- 172.21.15.123:0/1823835700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd5014eeb0 0x7fdd50070e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:41:59.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.959+0000 7fdd4e800640 1 -- 172.21.15.123:0/1823835700 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd501606a0 con 0x7fdd5014f2c0 2024-04-25T13:41:59.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.959+0000 7fdd4d400640 1 --2- 172.21.15.123:0/1823835700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd5014eeb0 0x7fdd50070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:41:59.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.959+0000 7fdd4e800640 1 --2- 172.21.15.123:0/1823835700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd5014f2c0 0x7fdd50071370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdd48007fd0 tx=0x7fdd4800ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:59.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.959+0000 7fdd46000640 1 -- 172.21.15.123:0/1823835700 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd4801a070 con 0x7fdd5014f2c0 2024-04-25T13:41:59.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.959+0000 7fdd46000640 1 -- 172.21.15.123:0/1823835700 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd48006e30 con 0x7fdd5014f2c0 2024-04-25T13:41:59.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.959+0000 7fdd46000640 1 -- 172.21.15.123:0/1823835700 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48003b80 con 0x7fdd5014f2c0 2024-04-25T13:41:59.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.959+0000 7fdd54a00640 1 -- 172.21.15.123:0/1823835700 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd5015ed00 con 0x7fdd5014f2c0 2024-04-25T13:41:59.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.959+0000 7fdd54a00640 1 -- 172.21.15.123:0/1823835700 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd5015f2c0 con 0x7fdd5014f2c0 2024-04-25T13:41:59.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.959+0000 7fdd54a00640 1 -- 172.21.15.123:0/1823835700 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd500507c0 con 0x7fdd5014f2c0 2024-04-25T13:41:59.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.959+0000 7fdd46000640 1 -- 172.21.15.123:0/1823835700 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fdd4800d710 con 0x7fdd5014f2c0 2024-04-25T13:41:59.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.963+0000 7fdd46000640 1 --2- 172.21.15.123:0/1823835700 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdd3006f430 0x7fdd30071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:41:59.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.963+0000 7fdd46000640 1 -- 172.21.15.123:0/1823835700 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fdd4808e860 con 0x7fdd5014f2c0 2024-04-25T13:41:59.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.963+0000 7fdd4de00640 1 --2- 172.21.15.123:0/1823835700 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdd3006f430 0x7fdd30071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:41:59.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.963+0000 7fdd4de00640 1 --2- 172.21.15.123:0/1823835700 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdd3006f430 0x7fdd30071940 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdd400ab000 tx=0x7fdd400b0040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:41:59.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:41:59.967+0000 7fdd46000640 1 -- 172.21.15.123:0/1823835700 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdd4805baa0 con 0x7fdd5014f2c0 2024-04-25T13:42:00.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:00.159+0000 7fdd54a00640 1 -- 172.21.15.123:0/1823835700 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd50161f40 con 0x7fdd5014f2c0 2024-04-25T13:42:00.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:00.159+0000 7fdd46000640 1 -- 172.21.15.123:0/1823835700 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7fdd4805b3a0 con 0x7fdd5014f2c0 2024-04-25T13:42:00.160 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:00.160 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6836/1018722177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1018722177},{"type":"v1","addr":"172.21.15.123:6836","nonce":1018722177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T13:42:00.160 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 2 2024-04-25T13:42:00.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:00.159+0000 7fdd54a00640 1 -- 172.21.15.123:0/1823835700 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdd3006f430 msgr2=0x7fdd30071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:00.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:00.159+0000 7fdd54a00640 1 --2- 172.21.15.123:0/1823835700 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdd3006f430 0x7fdd30071940 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdd400ab000 tx=0x7fdd400b0040 comp rx=0 tx=0).stop 2024-04-25T13:42:00.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:00.159+0000 7fdd54a00640 1 -- 172.21.15.123:0/1823835700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd5014f2c0 msgr2=0x7fdd50071370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:00.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:00.159+0000 7fdd54a00640 1 --2- 172.21.15.123:0/1823835700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd5014f2c0 0x7fdd50071370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdd48007fd0 tx=0x7fdd4800ff70 comp rx=0 tx=0).stop 2024-04-25T13:42:00.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:00.159+0000 7fdd54a00640 1 -- 172.21.15.123:0/1823835700 shutdown_connections 2024-04-25T13:42:00.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:00.159+0000 7fdd54a00640 1 --2- 172.21.15.123:0/1823835700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd5014eeb0 0x7fdd50070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:00.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:00.159+0000 7fdd54a00640 1 --2- 172.21.15.123:0/1823835700 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdd3006f430 0x7fdd30071940 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:00.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:00.159+0000 7fdd54a00640 1 --2- 172.21.15.123:0/1823835700 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdd5014f2c0 0x7fdd50071370 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:00.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:00.159+0000 7fdd54a00640 1 --2- 172.21.15.123:0/1823835700 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd34003a30 0x7fdd50160160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:00.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:00.159+0000 7fdd54a00640 1 -- 172.21.15.123:0/1823835700 >> 172.21.15.123:0/1823835700 conn(0x7fdd500d0150 msgr2=0x7fdd500b75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:00.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:00.159+0000 7fdd54a00640 1 -- 172.21.15.123:0/1823835700 shutdown_connections 2024-04-25T13:42:00.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:00.159+0000 7fdd54a00640 1 -- 172.21.15.123:0/1823835700 wait complete. 2024-04-25T13:42:02.182 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:42:02.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.335+0000 7f5020400640 1 Processor -- start 2024-04-25T13:42:02.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.335+0000 7f5020400640 1 -- start start 2024-04-25T13:42:02.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.339+0000 7f5020400640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f50180b6970 0x7f50180b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:02.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.339+0000 7f5020400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f50180cd8e0 0x7f50180cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:02.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.339+0000 7f5020400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50180b72c0 con 0x7f50181474f0 2024-04-25T13:42:02.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.339+0000 7f5020400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f50180d0d10 con 0x7f50180cd8e0 2024-04-25T13:42:02.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.339+0000 7f5020400640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f5018073400 con 0x7f50180b6970 2024-04-25T13:42:02.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.339+0000 7f501da00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f50181474f0 0x7f501815eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59182/0 (socket says 172.21.15.123:59182) 2024-04-25T13:42:02.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.339+0000 7f501e400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f50180cd8e0 0x7f50180cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:02.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.339+0000 7f501da00640 1 -- 172.21.15.123:0/2949340848 learned_addr learned my addr 172.21.15.123:0/2949340848 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:02.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.339+0000 7f501d000640 1 --2- 172.21.15.123:0/2949340848 >> v2:172.21.15.130:3300/0 conn(0x7f50180b6970 0x7f50180b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:02.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.339+0000 7f501e400640 1 -- 172.21.15.123:0/2949340848 >> v2:172.21.15.130:3300/0 conn(0x7f50180b6970 msgr2=0x7f50180b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:02.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.339+0000 7f501e400640 1 --2- 172.21.15.123:0/2949340848 >> v2:172.21.15.130:3300/0 conn(0x7f50180b6970 0x7f50180b6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.339+0000 7f501e400640 1 -- 172.21.15.123:0/2949340848 >> v1:172.21.15.123:6789/0 conn(0x7f50181474f0 legacy=0x7f501815eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:02.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.339+0000 7f501e400640 1 -- 172.21.15.123:0/2949340848 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50180736e0 con 0x7f50180cd8e0 2024-04-25T13:42:02.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.343+0000 7f501e400640 1 --2- 172.21.15.123:0/2949340848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50180cd8e0 0x7f50180cdcf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5018074e10 tx=0x7f501001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7715fad02bb4f42b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:02.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.343+0000 7f5017e00640 1 -- 172.21.15.123:0/2949340848 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50100ab5f0 con 0x7f50180cd8e0 2024-04-25T13:42:02.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.343+0000 7f5017e00640 1 -- 172.21.15.123:0/2949340848 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50100b0070 con 0x7f50180cd8e0 2024-04-25T13:42:02.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.343+0000 7f5017e00640 1 -- 172.21.15.123:0/2949340848 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50100ab9b0 con 0x7f50180cd8e0 2024-04-25T13:42:02.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.343+0000 7f5020400640 1 -- 172.21.15.123:0/2949340848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50180cd8e0 msgr2=0x7f50180cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:02.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.343+0000 7f5020400640 1 --2- 172.21.15.123:0/2949340848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50180cd8e0 0x7f50180cdcf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5018074e10 tx=0x7f501001c3f0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.343+0000 7f5020400640 1 -- 172.21.15.123:0/2949340848 shutdown_connections 2024-04-25T13:42:02.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.343+0000 7f5020400640 1 --2- 172.21.15.123:0/2949340848 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50180cd8e0 0x7f50180cdcf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.343+0000 7f5020400640 1 --2- 172.21.15.123:0/2949340848 >> v2:172.21.15.130:3300/0 conn(0x7f50180b6970 0x7f50180b6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.343+0000 7f5020400640 1 -- 172.21.15.123:0/2949340848 >> 172.21.15.123:0/2949340848 conn(0x7f501806d210 msgr2=0x7f501806ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:02.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.343+0000 7f5020400640 1 -- 172.21.15.123:0/2949340848 shutdown_connections 2024-04-25T13:42:02.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.343+0000 7f5020400640 1 -- 172.21.15.123:0/2949340848 wait complete. 2024-04-25T13:42:02.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.343+0000 7f5020400640 1 Processor -- start 2024-04-25T13:42:02.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.343+0000 7f5020400640 1 -- start start 2024-04-25T13:42:02.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.347+0000 7f5020400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50180b6970 0x7f501813d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:02.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.347+0000 7f5020400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50180cd8e0 0x7f5018140b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:02.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.347+0000 7f5020400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50181474f0 0x7f5018141040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:02.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.347+0000 7f5020400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f501816a750 con 0x7f50181474f0 2024-04-25T13:42:02.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.347+0000 7f5020400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f50180744a0 con 0x7f50180b6970 2024-04-25T13:42:02.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.347+0000 7f5020400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f501816a8d0 con 0x7f50180cd8e0 2024-04-25T13:42:02.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.347+0000 7f501e400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50181474f0 0x7f5018141040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:02.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.347+0000 7f501e400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50181474f0 0x7f5018141040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48170/0 (socket says 172.21.15.123:48170) 2024-04-25T13:42:02.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.347+0000 7f501e400640 1 -- 172.21.15.123:0/3492511426 learned_addr learned my addr 172.21.15.123:0/3492511426 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:02.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.347+0000 7f501d000640 1 --2- 172.21.15.123:0/3492511426 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50180cd8e0 0x7f5018140b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:02.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.347+0000 7f501da00640 1 --2- 172.21.15.123:0/3492511426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50180b6970 0x7f501813d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:02.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.347+0000 7f501e400640 1 -- 172.21.15.123:0/3492511426 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50180cd8e0 msgr2=0x7f5018140b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:02.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.347+0000 7f501e400640 1 --2- 172.21.15.123:0/3492511426 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50180cd8e0 0x7f5018140b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.347+0000 7f501e400640 1 -- 172.21.15.123:0/3492511426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50180b6970 msgr2=0x7f501813d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:02.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.347+0000 7f501e400640 1 --2- 172.21.15.123:0/3492511426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50180b6970 0x7f501813d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.347+0000 7f501e400640 1 -- 172.21.15.123:0/3492511426 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50181418a0 con 0x7f50181474f0 2024-04-25T13:42:02.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.347+0000 7f501e400640 1 --2- 172.21.15.123:0/3492511426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50181474f0 0x7f5018141040 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f501001a080 tx=0x7f501001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:02.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.347+0000 7f5015600640 1 -- 172.21.15.123:0/3492511426 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50100bf410 con 0x7f50181474f0 2024-04-25T13:42:02.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.347+0000 7f5015600640 1 -- 172.21.15.123:0/3492511426 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50100bf5b0 con 0x7f50181474f0 2024-04-25T13:42:02.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.347+0000 7f5015600640 1 -- 172.21.15.123:0/3492511426 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50100bf9a0 con 0x7f50181474f0 2024-04-25T13:42:02.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.347+0000 7f5020400640 1 -- 172.21.15.123:0/3492511426 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5018141b80 con 0x7f50181474f0 2024-04-25T13:42:02.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.347+0000 7f5020400640 1 -- 172.21.15.123:0/3492511426 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50180b4c50 con 0x7f50181474f0 2024-04-25T13:42:02.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.347+0000 7f5020400640 1 -- 172.21.15.123:0/3492511426 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50181415f0 con 0x7f50181474f0 2024-04-25T13:42:02.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.351+0000 7f5015600640 1 -- 172.21.15.123:0/3492511426 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f50100bd020 con 0x7f50181474f0 2024-04-25T13:42:02.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.351+0000 7f5015600640 1 --2- 172.21.15.123:0/3492511426 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4ff806f430 0x7f4ff8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:02.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.351+0000 7f5015600640 1 -- 172.21.15.123:0/3492511426 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f5010129310 con 0x7f50181474f0 2024-04-25T13:42:02.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.351+0000 7f501da00640 1 --2- 172.21.15.123:0/3492511426 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4ff806f430 0x7f4ff8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:02.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.351+0000 7f501da00640 1 --2- 172.21.15.123:0/3492511426 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4ff806f430 0x7f4ff8071940 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f500c0012f0 tx=0x7f500c0019a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:02.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.355+0000 7f5015600640 1 -- 172.21.15.123:0/3492511426 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5010016070 con 0x7f50181474f0 2024-04-25T13:42:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.547+0000 7f5020400640 1 -- 172.21.15.123:0/3492511426 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50180b4760 con 0x7f50181474f0 2024-04-25T13:42:02.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.547+0000 7f5015600640 1 -- 172.21.15.123:0/3492511426 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3870 (secure 0 0 0) 0x7f50100f5e60 con 0x7f50181474f0 2024-04-25T13:42:02.549 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:02.549 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6836/1018722177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1018722177},{"type":"v1","addr":"172.21.15.123:6836","nonce":1018722177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/606716425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":606716425},{"type":"v1","addr":"172.21.15.123:6837","nonce":606716425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/466677289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":466677289},{"type":"v1","addr":"172.21.15.130:6835","nonce":466677289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/1645626215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1645626215},{"type":"v1","addr":"172.21.15.130:6834","nonce":1645626215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T13:42:02.549 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 3 2024-04-25T13:42:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.547+0000 7f5020400640 1 -- 172.21.15.123:0/3492511426 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4ff806f430 msgr2=0x7f4ff8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.547+0000 7f5020400640 1 --2- 172.21.15.123:0/3492511426 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4ff806f430 0x7f4ff8071940 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f500c0012f0 tx=0x7f500c0019a0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.547+0000 7f5020400640 1 -- 172.21.15.123:0/3492511426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50181474f0 msgr2=0x7f5018141040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.547+0000 7f5020400640 1 --2- 172.21.15.123:0/3492511426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50181474f0 0x7f5018141040 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f501001a080 tx=0x7f501001ac90 comp rx=0 tx=0).stop 2024-04-25T13:42:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.547+0000 7f5020400640 1 -- 172.21.15.123:0/3492511426 shutdown_connections 2024-04-25T13:42:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.547+0000 7f5020400640 1 --2- 172.21.15.123:0/3492511426 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4ff806f430 0x7f4ff8071940 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.547+0000 7f5020400640 1 --2- 172.21.15.123:0/3492511426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50181474f0 0x7f5018141040 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.547+0000 7f5020400640 1 --2- 172.21.15.123:0/3492511426 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50180cd8e0 0x7f5018140b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.547+0000 7f5020400640 1 --2- 172.21.15.123:0/3492511426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50180b6970 0x7f501813d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.547+0000 7f5020400640 1 -- 172.21.15.123:0/3492511426 >> 172.21.15.123:0/3492511426 conn(0x7f501806d210 msgr2=0x7f50180747c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.551+0000 7f5020400640 1 -- 172.21.15.123:0/3492511426 shutdown_connections 2024-04-25T13:42:02.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.551+0000 7f5020400640 1 -- 172.21.15.123:0/3492511426 wait complete. 2024-04-25T13:42:02.570 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:02.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.715+0000 7fcaa4a00640 1 Processor -- start 2024-04-25T13:42:02.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.715+0000 7fcaa4a00640 1 -- start start 2024-04-25T13:42:02.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.715+0000 7fcaa4a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcaa00b3a00 0x7fcaa00b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:02.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.715+0000 7fcaa4a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaa0074440 con 0x7fcaa015fef0 2024-04-25T13:42:02.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.715+0000 7fcaa4a00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaa0163b60 con 0x7fcaa00cd850 2024-04-25T13:42:02.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.715+0000 7fcaa4a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fcaa0163910 con 0x7fcaa00b3a00 2024-04-25T13:42:02.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.715+0000 7fca9de00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fcaa015fef0 0x7fcaa00b32f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:59192/0 (socket says 172.21.15.123:59192) 2024-04-25T13:42:02.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.715+0000 7fca9de00640 1 -- 172.21.15.123:0/2523077861 learned_addr learned my addr 172.21.15.123:0/2523077861 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:02.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.715+0000 7fca95400640 1 --2- 172.21.15.123:0/2523077861 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcaa00b3a00 0x7fcaa00b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:02.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.715+0000 7fca9d400640 1 -- 172.21.15.123:0/2523077861 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3237754457 0 0) 0x7fcaa0074440 con 0x7fcaa015fef0 2024-04-25T13:42:02.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.715+0000 7fca9d400640 1 -- 172.21.15.123:0/2523077861 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca84003530 con 0x7fcaa015fef0 2024-04-25T13:42:02.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.715+0000 7fca9d400640 1 -- 172.21.15.123:0/2523077861 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1613722109 0 0) 0x7fcaa0163b60 con 0x7fcaa00cd850 2024-04-25T13:42:02.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.715+0000 7fca9d400640 1 -- 172.21.15.123:0/2523077861 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcaa0074440 con 0x7fcaa00cd850 2024-04-25T13:42:02.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.715+0000 7fca95400640 1 -- 172.21.15.123:0/2523077861 >> v1:172.21.15.130:6789/0 conn(0x7fcaa00cd850 legacy=0x7fcaa00b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:02.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.715+0000 7fca95400640 1 -- 172.21.15.123:0/2523077861 >> v1:172.21.15.123:6789/0 conn(0x7fcaa015fef0 legacy=0x7fcaa00b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:02.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.715+0000 7fca95400640 1 -- 172.21.15.123:0/2523077861 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa0163e40 con 0x7fcaa00b3a00 2024-04-25T13:42:02.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.719+0000 7fca95400640 1 --2- 172.21.15.123:0/2523077861 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcaa00b3a00 0x7fcaa00b55c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fca880097f0 tx=0x7fca8801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d488dc3178671e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:02.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.719+0000 7fca9d400640 1 -- 172.21.15.123:0/2523077861 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca880b0070 con 0x7fcaa00b3a00 2024-04-25T13:42:02.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.719+0000 7fca9d400640 1 -- 172.21.15.123:0/2523077861 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca880ab600 con 0x7fcaa00b3a00 2024-04-25T13:42:02.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.719+0000 7fca9d400640 1 -- 172.21.15.123:0/2523077861 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca880ab9b0 con 0x7fcaa00b3a00 2024-04-25T13:42:02.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.719+0000 7fcaa4a00640 1 -- 172.21.15.123:0/2523077861 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcaa00b3a00 msgr2=0x7fcaa00b55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:02.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.719+0000 7fcaa4a00640 1 --2- 172.21.15.123:0/2523077861 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcaa00b3a00 0x7fcaa00b55c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fca880097f0 tx=0x7fca8801c450 comp rx=0 tx=0).stop 2024-04-25T13:42:02.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.719+0000 7fcaa4a00640 1 -- 172.21.15.123:0/2523077861 shutdown_connections 2024-04-25T13:42:02.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.719+0000 7fcaa4a00640 1 --2- 172.21.15.123:0/2523077861 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcaa00b3a00 0x7fcaa00b55c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.719+0000 7fcaa4a00640 1 -- 172.21.15.123:0/2523077861 >> 172.21.15.123:0/2523077861 conn(0x7fcaa006d210 msgr2=0x7fcaa006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:02.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.719+0000 7fcaa4a00640 1 -- 172.21.15.123:0/2523077861 shutdown_connections 2024-04-25T13:42:02.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.719+0000 7fcaa4a00640 1 -- 172.21.15.123:0/2523077861 wait complete. 2024-04-25T13:42:02.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.723+0000 7fcaa4a00640 1 Processor -- start 2024-04-25T13:42:02.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.723+0000 7fcaa4a00640 1 -- start start 2024-04-25T13:42:02.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.723+0000 7fcaa4a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcaa00cd850 0x7fcaa015e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:02.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.723+0000 7fcaa4a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaa015fef0 0x7fcaa015acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:02.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.723+0000 7fcaa4a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcaa015ec70 0x7fcaa013ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:02.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.723+0000 7fcaa4a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa00b6620 con 0x7fcaa015fef0 2024-04-25T13:42:02.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.723+0000 7fcaa4a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa0164850 con 0x7fcaa00cd850 2024-04-25T13:42:02.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.723+0000 7fcaa4a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fcaa016e8e0 con 0x7fcaa015ec70 2024-04-25T13:42:02.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.723+0000 7fca95400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaa015fef0 0x7fcaa015acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:02.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.723+0000 7fca95400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaa015fef0 0x7fcaa015acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48184/0 (socket says 172.21.15.123:48184) 2024-04-25T13:42:02.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.727+0000 7fca95400640 1 -- 172.21.15.123:0/3758054352 learned_addr learned my addr 172.21.15.123:0/3758054352 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:02.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.727+0000 7fca9de00640 1 --2- 172.21.15.123:0/3758054352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcaa00cd850 0x7fcaa015e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:02.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.727+0000 7fca9e800640 1 --2- 172.21.15.123:0/3758054352 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcaa015ec70 0x7fcaa013ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:02.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.727+0000 7fca95400640 1 -- 172.21.15.123:0/3758054352 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcaa015ec70 msgr2=0x7fcaa013ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:02.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.727+0000 7fca95400640 1 --2- 172.21.15.123:0/3758054352 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcaa015ec70 0x7fcaa013ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.727+0000 7fca95400640 1 -- 172.21.15.123:0/3758054352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcaa00cd850 msgr2=0x7fcaa015e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:02.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.727+0000 7fca95400640 1 --2- 172.21.15.123:0/3758054352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcaa00cd850 0x7fcaa015e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.727+0000 7fca95400640 1 -- 172.21.15.123:0/3758054352 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa015d140 con 0x7fcaa015fef0 2024-04-25T13:42:02.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.727+0000 7fca95400640 1 --2- 172.21.15.123:0/3758054352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaa015fef0 0x7fcaa015acc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fca880ae040 tx=0x7fca880191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:02.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.727+0000 7fca96a00640 1 -- 172.21.15.123:0/3758054352 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca880b0040 con 0x7fcaa015fef0 2024-04-25T13:42:02.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.727+0000 7fca96a00640 1 -- 172.21.15.123:0/3758054352 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca880b9070 con 0x7fcaa015fef0 2024-04-25T13:42:02.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.727+0000 7fca96a00640 1 -- 172.21.15.123:0/3758054352 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca880ab9b0 con 0x7fcaa015fef0 2024-04-25T13:42:02.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.727+0000 7fcaa4a00640 1 -- 172.21.15.123:0/3758054352 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa015d420 con 0x7fcaa015fef0 2024-04-25T13:42:02.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.727+0000 7fcaa4a00640 1 -- 172.21.15.123:0/3758054352 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa015d9e0 con 0x7fcaa015fef0 2024-04-25T13:42:02.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.727+0000 7fcaa4a00640 1 -- 172.21.15.123:0/3758054352 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaa00507c0 con 0x7fcaa015fef0 2024-04-25T13:42:02.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.727+0000 7fca96a00640 1 -- 172.21.15.123:0/3758054352 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fca880abb50 con 0x7fcaa015fef0 2024-04-25T13:42:02.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.731+0000 7fca96a00640 1 --2- 172.21.15.123:0/3758054352 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fca7c06f400 0x7fca7c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:02.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.731+0000 7fca96a00640 1 -- 172.21.15.123:0/3758054352 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fca88128a70 con 0x7fcaa015fef0 2024-04-25T13:42:02.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.731+0000 7fca9de00640 1 --2- 172.21.15.123:0/3758054352 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fca7c06f400 0x7fca7c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:02.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.731+0000 7fca9de00640 1 --2- 172.21.15.123:0/3758054352 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fca7c06f400 0x7fca7c071910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fca900012f0 tx=0x7fca90009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:02.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.735+0000 7fca96a00640 1 -- 172.21.15.123:0/3758054352 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fca880160d0 con 0x7fcaa015fef0 2024-04-25T13:42:02.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.887+0000 7fcaa4a00640 1 -- 172.21.15.123:0/3758054352 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcaa01623a0 con 0x7fcaa015fef0 2024-04-25T13:42:02.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.891+0000 7fca96a00640 1 -- 172.21.15.123:0/3758054352 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12908 (secure 0 0 0) 0x7fca880f5c10 con 0x7fcaa015fef0 2024-04-25T13:42:02.891 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:02.892 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":17,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:41:56.961733+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:02.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.891+0000 7fcaa4a00640 1 -- 172.21.15.123:0/3758054352 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fca7c06f400 msgr2=0x7fca7c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:02.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.891+0000 7fcaa4a00640 1 --2- 172.21.15.123:0/3758054352 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fca7c06f400 0x7fca7c071910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fca900012f0 tx=0x7fca90009040 comp rx=0 tx=0).stop 2024-04-25T13:42:02.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.891+0000 7fcaa4a00640 1 -- 172.21.15.123:0/3758054352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaa015fef0 msgr2=0x7fcaa015acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:02.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.891+0000 7fcaa4a00640 1 --2- 172.21.15.123:0/3758054352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaa015fef0 0x7fcaa015acc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fca880ae040 tx=0x7fca880191f0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.891+0000 7fcaa4a00640 1 -- 172.21.15.123:0/3758054352 shutdown_connections 2024-04-25T13:42:02.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.891+0000 7fcaa4a00640 1 --2- 172.21.15.123:0/3758054352 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fca7c06f400 0x7fca7c071910 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.891+0000 7fcaa4a00640 1 --2- 172.21.15.123:0/3758054352 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcaa015ec70 0x7fcaa013ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.891+0000 7fcaa4a00640 1 --2- 172.21.15.123:0/3758054352 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcaa015fef0 0x7fcaa015acc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.891+0000 7fcaa4a00640 1 --2- 172.21.15.123:0/3758054352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcaa00cd850 0x7fcaa015e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:02.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.891+0000 7fcaa4a00640 1 -- 172.21.15.123:0/3758054352 >> 172.21.15.123:0/3758054352 conn(0x7fcaa006d210 msgr2=0x7fcaa00b2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:02.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.891+0000 7fcaa4a00640 1 -- 172.21.15.123:0/3758054352 shutdown_connections 2024-04-25T13:42:02.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:02.891+0000 7fcaa4a00640 1 -- 172.21.15.123:0/3758054352 wait complete. 2024-04-25T13:42:02.913 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:41:53.602480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:42:02.913 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:42:03.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.063+0000 7fc66d600640 1 Processor -- start 2024-04-25T13:42:03.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.063+0000 7fc66d600640 1 -- start start 2024-04-25T13:42:03.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.063+0000 7fc66d600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc66806c670 0x7fc66806ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:03.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.063+0000 7fc66d600640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc6680d2840 0x7fc6680d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:03.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.063+0000 7fc66d600640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc66806cfc0 con 0x7fc668073c70 2024-04-25T13:42:03.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.063+0000 7fc66d600640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fc668074080 con 0x7fc6680d2840 2024-04-25T13:42:03.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.063+0000 7fc66d600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc66815e2c0 con 0x7fc66806c670 2024-04-25T13:42:03.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.063+0000 7fc667400640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc6680d2840 0x7fc6680d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:03.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.063+0000 7fc666000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc66806c670 0x7fc66806ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:03.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.063+0000 7fc667400640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc6680d2840 0x7fc6680d2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:33000/0 (socket says 172.21.15.123:33000) 2024-04-25T13:42:03.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.063+0000 7fc667400640 1 -- 172.21.15.123:0/2085606481 learned_addr learned my addr 172.21.15.123:0/2085606481 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:03.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.063+0000 7fc666a00640 1 --1- 172.21.15.123:0/2085606481 >> v1:172.21.15.130:6789/0 conn(0x7fc668073c70 0x7fc6680b1770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.123:46380/0 (socket says 172.21.15.123:46380) 2024-04-25T13:42:03.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.063+0000 7fc667400640 1 -- 172.21.15.123:0/2085606481 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc66806c670 msgr2=0x7fc66806ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:03.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.063+0000 7fc667400640 1 --2- 172.21.15.123:0/2085606481 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc66806c670 0x7fc66806ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:03.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.063+0000 7fc667400640 1 -- 172.21.15.123:0/2085606481 >> v1:172.21.15.130:6789/0 conn(0x7fc668073c70 legacy=0x7fc6680b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:03.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.063+0000 7fc667400640 1 -- 172.21.15.123:0/2085606481 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66815e580 con 0x7fc6680d2840 2024-04-25T13:42:03.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.067+0000 7fc667400640 1 --2- 172.21.15.123:0/2085606481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6680d2840 0x7fc6680d2c50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc660009e50 tx=0x7fc66001ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f1204a77397d2e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:03.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.067+0000 7fc665600640 1 -- 172.21.15.123:0/2085606481 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6600a57f0 con 0x7fc6680d2840 2024-04-25T13:42:03.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.067+0000 7fc665600640 1 -- 172.21.15.123:0/2085606481 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6600a5990 con 0x7fc6680d2840 2024-04-25T13:42:03.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.067+0000 7fc665600640 1 -- 172.21.15.123:0/2085606481 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6600a5d60 con 0x7fc6680d2840 2024-04-25T13:42:03.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.067+0000 7fc66d600640 1 -- 172.21.15.123:0/2085606481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6680d2840 msgr2=0x7fc6680d2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:03.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.067+0000 7fc66d600640 1 --2- 172.21.15.123:0/2085606481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6680d2840 0x7fc6680d2c50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc660009e50 tx=0x7fc66001ca30 comp rx=0 tx=0).stop 2024-04-25T13:42:03.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.067+0000 7fc66d600640 1 -- 172.21.15.123:0/2085606481 shutdown_connections 2024-04-25T13:42:03.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.067+0000 7fc66d600640 1 --2- 172.21.15.123:0/2085606481 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6680d2840 0x7fc6680d2c50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:03.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.067+0000 7fc66d600640 1 --2- 172.21.15.123:0/2085606481 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc66806c670 0x7fc66806ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:03.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.067+0000 7fc66d600640 1 -- 172.21.15.123:0/2085606481 >> 172.21.15.123:0/2085606481 conn(0x7fc66806e120 msgr2=0x7fc6680b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:03.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.067+0000 7fc66d600640 1 -- 172.21.15.123:0/2085606481 shutdown_connections 2024-04-25T13:42:03.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.071+0000 7fc66d600640 1 -- 172.21.15.123:0/2085606481 wait complete. 2024-04-25T13:42:03.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.071+0000 7fc66d600640 1 Processor -- start 2024-04-25T13:42:03.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.071+0000 7fc66d600640 1 -- start start 2024-04-25T13:42:03.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.071+0000 7fc66d600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc66806c670 0x7fc6680d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:03.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.071+0000 7fc66d600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc668073c70 0x7fc6680d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:03.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.071+0000 7fc66d600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6680d2840 0x7fc6681fbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:03.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.071+0000 7fc66d600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc6680b1e80 con 0x7fc6680d2840 2024-04-25T13:42:03.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.071+0000 7fc66d600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc66815f190 con 0x7fc668073c70 2024-04-25T13:42:03.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.071+0000 7fc66d600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc6680b2000 con 0x7fc66806c670 2024-04-25T13:42:03.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.075+0000 7fc667400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6680d2840 0x7fc6681fbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:03.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.075+0000 7fc667400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6680d2840 0x7fc6681fbbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48192/0 (socket says 172.21.15.123:48192) 2024-04-25T13:42:03.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.075+0000 7fc667400640 1 -- 172.21.15.123:0/3300346937 learned_addr learned my addr 172.21.15.123:0/3300346937 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:03.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.075+0000 7fc666a00640 1 --2- 172.21.15.123:0/3300346937 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc66806c670 0x7fc6680d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:03.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.075+0000 7fc666000640 1 --2- 172.21.15.123:0/3300346937 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc668073c70 0x7fc6680d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:03.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.075+0000 7fc667400640 1 -- 172.21.15.123:0/3300346937 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc66806c670 msgr2=0x7fc6680d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:03.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.075+0000 7fc667400640 1 --2- 172.21.15.123:0/3300346937 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc66806c670 0x7fc6680d14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:03.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.075+0000 7fc667400640 1 -- 172.21.15.123:0/3300346937 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc668073c70 msgr2=0x7fc6680d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:03.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.075+0000 7fc667400640 1 --2- 172.21.15.123:0/3300346937 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc668073c70 0x7fc6680d19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:03.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.075+0000 7fc667400640 1 -- 172.21.15.123:0/3300346937 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc668146a90 con 0x7fc6680d2840 2024-04-25T13:42:03.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.075+0000 7fc666000640 1 --2- 172.21.15.123:0/3300346937 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc668073c70 0x7fc6680d19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:03.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.075+0000 7fc667400640 1 --2- 172.21.15.123:0/3300346937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6680d2840 0x7fc6681fbbd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc660009e50 tx=0x7fc6600197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:03.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.075+0000 7fc65ea00640 1 -- 172.21.15.123:0/3300346937 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6600b8670 con 0x7fc6680d2840 2024-04-25T13:42:03.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.075+0000 7fc65ea00640 1 -- 172.21.15.123:0/3300346937 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6600be070 con 0x7fc6680d2840 2024-04-25T13:42:03.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.075+0000 7fc66d600640 1 -- 172.21.15.123:0/3300346937 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc668146d70 con 0x7fc6680d2840 2024-04-25T13:42:03.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.075+0000 7fc65ea00640 1 -- 172.21.15.123:0/3300346937 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6600b8a70 con 0x7fc6680d2840 2024-04-25T13:42:03.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.075+0000 7fc66d600640 1 -- 172.21.15.123:0/3300346937 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc668147330 con 0x7fc6680d2840 2024-04-25T13:42:03.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.075+0000 7fc66d600640 1 -- 172.21.15.123:0/3300346937 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc668050750 con 0x7fc6680d2840 2024-04-25T13:42:03.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.075+0000 7fc65ea00640 1 -- 172.21.15.123:0/3300346937 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc6600b8c10 con 0x7fc6680d2840 2024-04-25T13:42:03.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.079+0000 7fc65ea00640 1 --2- 172.21.15.123:0/3300346937 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fc64806f400 0x7fc648071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:03.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.079+0000 7fc65ea00640 1 -- 172.21.15.123:0/3300346937 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fc660129fa0 con 0x7fc6680d2840 2024-04-25T13:42:03.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.079+0000 7fc666a00640 1 --2- 172.21.15.123:0/3300346937 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fc64806f400 0x7fc648071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:03.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.079+0000 7fc666a00640 1 --2- 172.21.15.123:0/3300346937 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fc64806f400 0x7fc648071910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc658000f70 tx=0x7fc658007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:03.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.083+0000 7fc65ea00640 1 -- 172.21.15.123:0/3300346937 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc660016620 con 0x7fc6680d2840 2024-04-25T13:42:03.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.239+0000 7fc66d600640 1 -- 172.21.15.123:0/3300346937 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc66806edc0 con 0x7fc6680d2840 2024-04-25T13:42:03.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.239+0000 7fc65ea00640 1 -- 172.21.15.123:0/3300346937 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7fc6600a5960 con 0x7fc6680d2840 2024-04-25T13:42:03.242 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-04-25T13:42:03.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.243+0000 7fc66d600640 1 -- 172.21.15.123:0/3300346937 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fc64806f400 msgr2=0x7fc648071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:03.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.243+0000 7fc66d600640 1 --2- 172.21.15.123:0/3300346937 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fc64806f400 0x7fc648071910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc658000f70 tx=0x7fc658007e90 comp rx=0 tx=0).stop 2024-04-25T13:42:03.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.243+0000 7fc66d600640 1 -- 172.21.15.123:0/3300346937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6680d2840 msgr2=0x7fc6681fbbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:03.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.243+0000 7fc66d600640 1 --2- 172.21.15.123:0/3300346937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6680d2840 0x7fc6681fbbd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc660009e50 tx=0x7fc6600197d0 comp rx=0 tx=0).stop 2024-04-25T13:42:03.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.243+0000 7fc66d600640 1 -- 172.21.15.123:0/3300346937 shutdown_connections 2024-04-25T13:42:03.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.243+0000 7fc66d600640 1 --2- 172.21.15.123:0/3300346937 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc668073c70 0x7fc6680d19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:03.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.243+0000 7fc66d600640 1 --2- 172.21.15.123:0/3300346937 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fc64806f400 0x7fc648071910 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:03.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.243+0000 7fc66d600640 1 --2- 172.21.15.123:0/3300346937 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6680d2840 0x7fc6681fbbd0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:03.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.243+0000 7fc66d600640 1 --2- 172.21.15.123:0/3300346937 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc66806c670 0x7fc6680d14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:03.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.243+0000 7fc66d600640 1 -- 172.21.15.123:0/3300346937 >> 172.21.15.123:0/3300346937 conn(0x7fc66806e120 msgr2=0x7fc6680b4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:03.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.243+0000 7fc66d600640 1 -- 172.21.15.123:0/3300346937 shutdown_connections 2024-04-25T13:42:03.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.243+0000 7fc66d600640 1 -- 172.21.15.123:0/3300346937 wait complete. 2024-04-25T13:42:03.263 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T13:42:03.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.407+0000 7fb656400640 1 Processor -- start 2024-04-25T13:42:03.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.407+0000 7fb656400640 1 -- start start 2024-04-25T13:42:03.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.411+0000 7fb656400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb65006e9a0 0x7fb650164490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:03.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.411+0000 7fb656400640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb650164de0 0x7fb6500b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:03.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.411+0000 7fb656400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb65009cc20 con 0x7fb6501649d0 2024-04-25T13:42:03.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.411+0000 7fb656400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb65009cf50 con 0x7fb65006e9a0 2024-04-25T13:42:03.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.411+0000 7fb656400640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fb6500d2d20 con 0x7fb650164de0 2024-04-25T13:42:03.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.411+0000 7fb64f400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb65006e9a0 0x7fb650164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:03.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.411+0000 7fb64f400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb65006e9a0 0x7fb650164490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48198/0 (socket says 172.21.15.123:48198) 2024-04-25T13:42:03.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.411+0000 7fb64f400640 1 -- 172.21.15.123:0/4130385112 learned_addr learned my addr 172.21.15.123:0/4130385112 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:03.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.411+0000 7fb64fe00640 1 --2- 172.21.15.123:0/4130385112 >> v2:172.21.15.130:3300/0 conn(0x7fb650164de0 0x7fb6500b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:03.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.411+0000 7fb64f400640 1 -- 172.21.15.123:0/4130385112 >> v2:172.21.15.130:3300/0 conn(0x7fb650164de0 msgr2=0x7fb6500b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:03.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.411+0000 7fb64f400640 1 --2- 172.21.15.123:0/4130385112 >> v2:172.21.15.130:3300/0 conn(0x7fb650164de0 0x7fb6500b4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:03.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.411+0000 7fb64f400640 1 -- 172.21.15.123:0/4130385112 >> v1:172.21.15.130:6789/0 conn(0x7fb6501649d0 legacy=0x7fb6500b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:03.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.411+0000 7fb64f400640 1 -- 172.21.15.123:0/4130385112 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb65006d940 con 0x7fb65006e9a0 2024-04-25T13:42:03.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.415+0000 7fb64f400640 1 --2- 172.21.15.123:0/4130385112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb65006e9a0 0x7fb650164490 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb65009d0d0 tx=0x7fb64001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ace4357ec3056d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:03.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.415+0000 7fb64ea00640 1 -- 172.21.15.123:0/4130385112 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6400b1070 con 0x7fb65006e9a0 2024-04-25T13:42:03.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.415+0000 7fb64ea00640 1 -- 172.21.15.123:0/4130385112 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6400ac630 con 0x7fb65006e9a0 2024-04-25T13:42:03.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.415+0000 7fb64ea00640 1 -- 172.21.15.123:0/4130385112 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6400a8050 con 0x7fb65006e9a0 2024-04-25T13:42:03.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.415+0000 7fb656400640 1 -- 172.21.15.123:0/4130385112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb65006e9a0 msgr2=0x7fb650164490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:03.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.415+0000 7fb656400640 1 --2- 172.21.15.123:0/4130385112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb65006e9a0 0x7fb650164490 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb65009d0d0 tx=0x7fb64001c4c0 comp rx=0 tx=0).stop 2024-04-25T13:42:03.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.415+0000 7fb656400640 1 -- 172.21.15.123:0/4130385112 shutdown_connections 2024-04-25T13:42:03.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.415+0000 7fb656400640 1 --2- 172.21.15.123:0/4130385112 >> v2:172.21.15.130:3300/0 conn(0x7fb650164de0 0x7fb6500b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:03.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.415+0000 7fb656400640 1 --2- 172.21.15.123:0/4130385112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb65006e9a0 0x7fb650164490 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:03.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.415+0000 7fb656400640 1 -- 172.21.15.123:0/4130385112 >> 172.21.15.123:0/4130385112 conn(0x7fb6500d01e0 msgr2=0x7fb6500d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:03.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.415+0000 7fb656400640 1 -- 172.21.15.123:0/4130385112 shutdown_connections 2024-04-25T13:42:03.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.415+0000 7fb656400640 1 -- 172.21.15.123:0/4130385112 wait complete. 2024-04-25T13:42:03.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.415+0000 7fb656400640 1 Processor -- start 2024-04-25T13:42:03.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.415+0000 7fb656400640 1 -- start start 2024-04-25T13:42:03.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.419+0000 7fb656400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb65006e9a0 0x7fb65015cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:03.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.419+0000 7fb656400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6501649d0 0x7fb6500b83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:03.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.419+0000 7fb656400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb650164de0 0x7fb6500ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:03.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.419+0000 7fb656400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb6501651f0 con 0x7fb65006e9a0 2024-04-25T13:42:03.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.419+0000 7fb656400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb6500d0fe0 con 0x7fb6501649d0 2024-04-25T13:42:03.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.419+0000 7fb656400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb6500d1160 con 0x7fb650164de0 2024-04-25T13:42:03.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.419+0000 7fb64f400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb65006e9a0 0x7fb65015cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:03.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.419+0000 7fb64f400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb65006e9a0 0x7fb65015cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48206/0 (socket says 172.21.15.123:48206) 2024-04-25T13:42:03.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.419+0000 7fb64f400640 1 -- 172.21.15.123:0/686995295 learned_addr learned my addr 172.21.15.123:0/686995295 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:03.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.419+0000 7fb64fe00640 1 --2- 172.21.15.123:0/686995295 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb650164de0 0x7fb6500ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:03.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.419+0000 7fb646a00640 1 --2- 172.21.15.123:0/686995295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6501649d0 0x7fb6500b83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:03.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.419+0000 7fb64f400640 1 -- 172.21.15.123:0/686995295 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb650164de0 msgr2=0x7fb6500ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:03.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.419+0000 7fb64f400640 1 --2- 172.21.15.123:0/686995295 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb650164de0 0x7fb6500ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:03.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.419+0000 7fb64f400640 1 -- 172.21.15.123:0/686995295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6501649d0 msgr2=0x7fb6500b83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:03.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.419+0000 7fb64f400640 1 --2- 172.21.15.123:0/686995295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6501649d0 0x7fb6500b83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:03.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.419+0000 7fb64f400640 1 -- 172.21.15.123:0/686995295 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb65015e810 con 0x7fb65006e9a0 2024-04-25T13:42:03.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.419+0000 7fb64fe00640 1 --2- 172.21.15.123:0/686995295 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb650164de0 0x7fb6500ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:03.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.419+0000 7fb646a00640 1 --2- 172.21.15.123:0/686995295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6501649d0 0x7fb6500b83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:03.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.419+0000 7fb64f400640 1 --2- 172.21.15.123:0/686995295 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb65006e9a0 0x7fb65015cc40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb64001c9a0 tx=0x7fb640019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:03.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.419+0000 7fb647e00640 1 -- 172.21.15.123:0/686995295 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6400b1040 con 0x7fb65006e9a0 2024-04-25T13:42:03.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.419+0000 7fb647e00640 1 -- 172.21.15.123:0/686995295 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb640005ba0 con 0x7fb65006e9a0 2024-04-25T13:42:03.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.419+0000 7fb647e00640 1 -- 172.21.15.123:0/686995295 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6400a8040 con 0x7fb65006e9a0 2024-04-25T13:42:03.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.419+0000 7fb656400640 1 -- 172.21.15.123:0/686995295 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb65015d180 con 0x7fb65006e9a0 2024-04-25T13:42:03.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.419+0000 7fb656400640 1 -- 172.21.15.123:0/686995295 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb65015da50 con 0x7fb65006e9a0 2024-04-25T13:42:03.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.419+0000 7fb656400640 1 -- 172.21.15.123:0/686995295 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6500507c0 con 0x7fb65006e9a0 2024-04-25T13:42:03.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.423+0000 7fb647e00640 1 -- 172.21.15.123:0/686995295 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb6400bc060 con 0x7fb65006e9a0 2024-04-25T13:42:03.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.423+0000 7fb647e00640 1 --2- 172.21.15.123:0/686995295 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb62c06f400 0x7fb62c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:03.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.423+0000 7fb647e00640 1 -- 172.21.15.123:0/686995295 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fb640127f20 con 0x7fb65006e9a0 2024-04-25T13:42:03.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.423+0000 7fb646a00640 1 --2- 172.21.15.123:0/686995295 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb62c06f400 0x7fb62c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:03.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.423+0000 7fb646a00640 1 --2- 172.21.15.123:0/686995295 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb62c06f400 0x7fb62c071910 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb65016b700 tx=0x7fb638008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:03.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.427+0000 7fb647e00640 1 -- 172.21.15.123:0/686995295 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb6400160b0 con 0x7fb65006e9a0 2024-04-25T13:42:03.481 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:42:03.485 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:42:03.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.587+0000 7fb656400640 1 -- 172.21.15.123:0/686995295 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb6500cd520 con 0x7fb65006e9a0 2024-04-25T13:42:03.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.587+0000 7fb647e00640 1 -- 172.21.15.123:0/686995295 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7fb6400f50c0 con 0x7fb65006e9a0 2024-04-25T13:42:03.590 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:03.590 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-04-25T13:42:03.590 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:42:03.591 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2024-04-25T13:42:03.591 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2024-04-25T13:42:03.591 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:03.591 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-04-25T13:42:03.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.591+0000 7fb656400640 1 -- 172.21.15.123:0/686995295 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb62c06f400 msgr2=0x7fb62c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:03.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.591+0000 7fb656400640 1 --2- 172.21.15.123:0/686995295 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb62c06f400 0x7fb62c071910 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb65016b700 tx=0x7fb638008040 comp rx=0 tx=0).stop 2024-04-25T13:42:03.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.591+0000 7fb656400640 1 -- 172.21.15.123:0/686995295 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb65006e9a0 msgr2=0x7fb65015cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:03.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.591+0000 7fb656400640 1 --2- 172.21.15.123:0/686995295 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb65006e9a0 0x7fb65015cc40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb64001c9a0 tx=0x7fb640019260 comp rx=0 tx=0).stop 2024-04-25T13:42:03.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.591+0000 7fb656400640 1 -- 172.21.15.123:0/686995295 shutdown_connections 2024-04-25T13:42:03.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.591+0000 7fb656400640 1 --2- 172.21.15.123:0/686995295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6501649d0 0x7fb6500b83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:03.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.591+0000 7fb656400640 1 --2- 172.21.15.123:0/686995295 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb62c06f400 0x7fb62c071910 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:03.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.591+0000 7fb656400640 1 --2- 172.21.15.123:0/686995295 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb650164de0 0x7fb6500ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:03.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.591+0000 7fb656400640 1 --2- 172.21.15.123:0/686995295 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb65006e9a0 0x7fb65015cc40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:03.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.591+0000 7fb656400640 1 -- 172.21.15.123:0/686995295 >> 172.21.15.123:0/686995295 conn(0x7fb6500d01e0 msgr2=0x7fb650164280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:03.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.591+0000 7fb656400640 1 -- 172.21.15.123:0/686995295 shutdown_connections 2024-04-25T13:42:03.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.591+0000 7fb656400640 1 -- 172.21.15.123:0/686995295 wait complete. 2024-04-25T13:42:03.612 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T13:42:03.612 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T13:42:03.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.759+0000 7f2e87400640 1 Processor -- start 2024-04-25T13:42:03.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.759+0000 7f2e87400640 1 -- start start 2024-04-25T13:42:03.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.763+0000 7f2e87400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2e800af020 0x7f2e801633b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:03.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.763+0000 7f2e87400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2e80070640 0x7f2e801639b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:03.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.763+0000 7f2e87400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e8006c670 con 0x7f2e8006fb20 2024-04-25T13:42:03.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.763+0000 7f2e87400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f2e800b5b50 con 0x7f2e800af020 2024-04-25T13:42:03.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.763+0000 7f2e87400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2e800b5e30 con 0x7f2e80070640 2024-04-25T13:42:03.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.763+0000 7f2e84a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2e800af020 0x7f2e801633b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:03.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.763+0000 7f2e84a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2e800af020 0x7f2e801633b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48218/0 (socket says 172.21.15.123:48218) 2024-04-25T13:42:03.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.763+0000 7f2e84a00640 1 -- 172.21.15.123:0/3630879258 learned_addr learned my addr 172.21.15.123:0/3630879258 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:03.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.763+0000 7f2e85400640 1 --2- 172.21.15.123:0/3630879258 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2e80070640 0x7f2e801639b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:03.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.763+0000 7f2e84a00640 1 -- 172.21.15.123:0/3630879258 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2e80070640 msgr2=0x7f2e801639b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:03.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.763+0000 7f2e84a00640 1 --2- 172.21.15.123:0/3630879258 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2e80070640 0x7f2e801639b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:03.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.763+0000 7f2e84a00640 1 -- 172.21.15.123:0/3630879258 >> v1:172.21.15.130:6789/0 conn(0x7f2e8006fb20 legacy=0x7f2e8006ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:03.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.763+0000 7f2e84a00640 1 -- 172.21.15.123:0/3630879258 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8006c930 con 0x7f2e800af020 2024-04-25T13:42:03.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.767+0000 7f2e84a00640 1 --2- 172.21.15.123:0/3630879258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e800af020 0x7f2e801633b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2e70009870 tx=0x7f2e7001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d0a4ae1294fc53 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:03.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.767+0000 7f2e7f400640 1 -- 172.21.15.123:0/3630879258 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e700a7070 con 0x7f2e800af020 2024-04-25T13:42:03.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.767+0000 7f2e7f400640 1 -- 172.21.15.123:0/3630879258 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e700b0070 con 0x7f2e800af020 2024-04-25T13:42:03.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.767+0000 7f2e7f400640 1 -- 172.21.15.123:0/3630879258 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e700ab890 con 0x7f2e800af020 2024-04-25T13:42:03.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.767+0000 7f2e87400640 1 -- 172.21.15.123:0/3630879258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e800af020 msgr2=0x7f2e801633b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:03.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.767+0000 7f2e87400640 1 --2- 172.21.15.123:0/3630879258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e800af020 0x7f2e801633b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2e70009870 tx=0x7f2e7001c560 comp rx=0 tx=0).stop 2024-04-25T13:42:03.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.767+0000 7f2e87400640 1 -- 172.21.15.123:0/3630879258 shutdown_connections 2024-04-25T13:42:03.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.767+0000 7f2e87400640 1 --2- 172.21.15.123:0/3630879258 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2e80070640 0x7f2e801639b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:03.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.767+0000 7f2e87400640 1 --2- 172.21.15.123:0/3630879258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e800af020 0x7f2e801633b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:03.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.767+0000 7f2e87400640 1 -- 172.21.15.123:0/3630879258 >> 172.21.15.123:0/3630879258 conn(0x7f2e800d1fa0 msgr2=0x7f2e800d23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:03.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.767+0000 7f2e87400640 1 -- 172.21.15.123:0/3630879258 shutdown_connections 2024-04-25T13:42:03.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.767+0000 7f2e87400640 1 -- 172.21.15.123:0/3630879258 wait complete. 2024-04-25T13:42:03.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.771+0000 7f2e87400640 1 Processor -- start 2024-04-25T13:42:03.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.771+0000 7f2e87400640 1 -- start start 2024-04-25T13:42:03.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.771+0000 7f2e87400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e8006fb20 0x7f2e80164ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:03.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.771+0000 7f2e87400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2e80070640 0x7f2e80155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:03.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.771+0000 7f2e87400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e800af020 0x7f2e800ce870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:03.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.771+0000 7f2e87400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8016d0e0 con 0x7f2e800af020 2024-04-25T13:42:03.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.771+0000 7f2e87400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8016cf60 con 0x7f2e8006fb20 2024-04-25T13:42:03.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.771+0000 7f2e87400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2e8016d260 con 0x7f2e80070640 2024-04-25T13:42:03.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.771+0000 7f2e85400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e800af020 0x7f2e800ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:03.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.771+0000 7f2e85400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e800af020 0x7f2e800ce870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48230/0 (socket says 172.21.15.123:48230) 2024-04-25T13:42:03.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.771+0000 7f2e85400640 1 -- 172.21.15.123:0/3226955004 learned_addr learned my addr 172.21.15.123:0/3226955004 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:03.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.771+0000 7f2e7fe00640 1 --2- 172.21.15.123:0/3226955004 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2e80070640 0x7f2e80155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:03.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.771+0000 7f2e84a00640 1 --2- 172.21.15.123:0/3226955004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e8006fb20 0x7f2e80164ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:03.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.771+0000 7f2e85400640 1 -- 172.21.15.123:0/3226955004 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2e80070640 msgr2=0x7f2e80155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:03.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.771+0000 7f2e85400640 1 --2- 172.21.15.123:0/3226955004 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2e80070640 0x7f2e80155360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:03.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.771+0000 7f2e85400640 1 -- 172.21.15.123:0/3226955004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e8006fb20 msgr2=0x7f2e80164ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:03.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.771+0000 7f2e85400640 1 --2- 172.21.15.123:0/3226955004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e8006fb20 0x7f2e80164ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:03.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.771+0000 7f2e85400640 1 -- 172.21.15.123:0/3226955004 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e80165020 con 0x7f2e800af020 2024-04-25T13:42:03.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.771+0000 7f2e85400640 1 --2- 172.21.15.123:0/3226955004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e800af020 0x7f2e800ce870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2e7800ebe0 tx=0x7f2e7800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:03.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.771+0000 7f2e7cc00640 1 -- 172.21.15.123:0/3226955004 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e78018020 con 0x7f2e800af020 2024-04-25T13:42:03.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.771+0000 7f2e7cc00640 1 -- 172.21.15.123:0/3226955004 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e7800cd40 con 0x7f2e800af020 2024-04-25T13:42:03.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.771+0000 7f2e7cc00640 1 -- 172.21.15.123:0/3226955004 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e780146c0 con 0x7f2e800af020 2024-04-25T13:42:03.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.771+0000 7f2e87400640 1 -- 172.21.15.123:0/3226955004 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e8015eac0 con 0x7f2e800af020 2024-04-25T13:42:03.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.771+0000 7f2e87400640 1 -- 172.21.15.123:0/3226955004 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e8015f080 con 0x7f2e800af020 2024-04-25T13:42:03.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.775+0000 7f2e87400640 1 -- 172.21.15.123:0/3226955004 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e800cf380 con 0x7f2e800af020 2024-04-25T13:42:03.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.775+0000 7f2e7cc00640 1 -- 172.21.15.123:0/3226955004 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2e7801b020 con 0x7f2e800af020 2024-04-25T13:42:03.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.775+0000 7f2e7cc00640 1 --2- 172.21.15.123:0/3226955004 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f2e6006f430 0x7f2e60071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:03.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.775+0000 7f2e7cc00640 1 -- 172.21.15.123:0/3226955004 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f2e7808fb20 con 0x7f2e800af020 2024-04-25T13:42:03.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.775+0000 7f2e84a00640 1 --2- 172.21.15.123:0/3226955004 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f2e6006f430 0x7f2e60071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:03.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.775+0000 7f2e84a00640 1 --2- 172.21.15.123:0/3226955004 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f2e6006f430 0x7f2e60071940 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2e700af000 tx=0x7f2e700a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:03.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.779+0000 7f2e7cc00640 1 -- 172.21.15.123:0/3226955004 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2e78022030 con 0x7f2e800af020 2024-04-25T13:42:03.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:03.935+0000 7f2e87400640 1 -- 172.21.15.123:0/3226955004 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f2e8006a210 con 0x7f2e800af020 2024-04-25T13:42:04.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.379+0000 7f2e7cc00640 1 -- 172.21.15.123:0/3226955004 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f2e78010040 con 0x7f2e800af020 2024-04-25T13:42:04.381 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2024-04-25T13:42:04.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.383+0000 7f2e87400640 1 -- 172.21.15.123:0/3226955004 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f2e6006f430 msgr2=0x7f2e60071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:04.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.383+0000 7f2e87400640 1 --2- 172.21.15.123:0/3226955004 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f2e6006f430 0x7f2e60071940 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2e700af000 tx=0x7f2e700a7000 comp rx=0 tx=0).stop 2024-04-25T13:42:04.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.383+0000 7f2e87400640 1 -- 172.21.15.123:0/3226955004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e800af020 msgr2=0x7f2e800ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:04.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.383+0000 7f2e87400640 1 --2- 172.21.15.123:0/3226955004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e800af020 0x7f2e800ce870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2e7800ebe0 tx=0x7f2e7800c490 comp rx=0 tx=0).stop 2024-04-25T13:42:04.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.383+0000 7f2e87400640 1 -- 172.21.15.123:0/3226955004 shutdown_connections 2024-04-25T13:42:04.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.383+0000 7f2e87400640 1 --2- 172.21.15.123:0/3226955004 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f2e6006f430 0x7f2e60071940 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:04.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.383+0000 7f2e87400640 1 --2- 172.21.15.123:0/3226955004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e800af020 0x7f2e800ce870 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:04.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.383+0000 7f2e87400640 1 --2- 172.21.15.123:0/3226955004 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2e80070640 0x7f2e80155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:04.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.383+0000 7f2e87400640 1 --2- 172.21.15.123:0/3226955004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e8006fb20 0x7f2e80164ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:04.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.383+0000 7f2e87400640 1 -- 172.21.15.123:0/3226955004 >> 172.21.15.123:0/3226955004 conn(0x7f2e800d1fa0 msgr2=0x7f2e800b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:04.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.383+0000 7f2e87400640 1 -- 172.21.15.123:0/3226955004 shutdown_connections 2024-04-25T13:42:04.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.383+0000 7f2e87400640 1 -- 172.21.15.123:0/3226955004 wait complete. 2024-04-25T13:42:04.412 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T13:42:04.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.563+0000 7f77e9400640 1 Processor -- start 2024-04-25T13:42:04.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.567+0000 7f77e9400640 1 -- start start 2024-04-25T13:42:04.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.567+0000 7f77e9400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f77e40b2810 0x7f77e40d1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:04.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.567+0000 7f77e9400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77e40d1c40 0x7f77e4164250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:04.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.567+0000 7f77e9400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77e40b3b90 con 0x7f77e40b2c20 2024-04-25T13:42:04.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.567+0000 7f77e9400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f77e41602b0 con 0x7f77e40b2810 2024-04-25T13:42:04.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.567+0000 7f77e9400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f77e40b1d30 con 0x7f77e40d1c40 2024-04-25T13:42:04.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.567+0000 7f77e3e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f77e40b2810 0x7f77e40d1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:04.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.567+0000 7f77e3e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f77e40b2810 0x7f77e40d1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48242/0 (socket says 172.21.15.123:48242) 2024-04-25T13:42:04.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.567+0000 7f77e3e00640 1 -- 172.21.15.123:0/480172537 learned_addr learned my addr 172.21.15.123:0/480172537 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:04.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.567+0000 7f77e8a00640 1 --2- 172.21.15.123:0/480172537 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77e40d1c40 0x7f77e4164250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:04.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.567+0000 7f77e3e00640 1 -- 172.21.15.123:0/480172537 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77e40d1c40 msgr2=0x7f77e4164250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:04.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.567+0000 7f77e3e00640 1 --2- 172.21.15.123:0/480172537 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77e40d1c40 0x7f77e4164250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:04.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.567+0000 7f77e3e00640 1 -- 172.21.15.123:0/480172537 >> v1:172.21.15.130:6789/0 conn(0x7f77e40b2c20 legacy=0x7f77e4163b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:04.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.567+0000 7f77e3e00640 1 -- 172.21.15.123:0/480172537 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e40b2010 con 0x7f77e40b2810 2024-04-25T13:42:04.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.567+0000 7f77e8a00640 1 --2- 172.21.15.123:0/480172537 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77e40d1c40 0x7f77e4164250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:04.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.571+0000 7f77e3e00640 1 --2- 172.21.15.123:0/480172537 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77e40b2810 0x7f77e40d1700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f77d4009870 tx=0x7f77d401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8fe32770d504658 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:04.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.571+0000 7f77e2a00640 1 -- 172.21.15.123:0/480172537 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d40ab5f0 con 0x7f77e40b2810 2024-04-25T13:42:04.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.571+0000 7f77e2a00640 1 -- 172.21.15.123:0/480172537 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77d40b0070 con 0x7f77e40b2810 2024-04-25T13:42:04.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.571+0000 7f77e2a00640 1 -- 172.21.15.123:0/480172537 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d40ab9b0 con 0x7f77e40b2810 2024-04-25T13:42:04.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.571+0000 7f77e9400640 1 -- 172.21.15.123:0/480172537 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77e40b2810 msgr2=0x7f77e40d1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:04.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.571+0000 7f77e9400640 1 --2- 172.21.15.123:0/480172537 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77e40b2810 0x7f77e40d1700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f77d4009870 tx=0x7f77d401c520 comp rx=0 tx=0).stop 2024-04-25T13:42:04.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.571+0000 7f77e9400640 1 -- 172.21.15.123:0/480172537 shutdown_connections 2024-04-25T13:42:04.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.571+0000 7f77e9400640 1 --2- 172.21.15.123:0/480172537 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77e40d1c40 0x7f77e4164250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:04.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.571+0000 7f77e9400640 1 --2- 172.21.15.123:0/480172537 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77e40b2810 0x7f77e40d1700 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:04.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.571+0000 7f77e9400640 1 -- 172.21.15.123:0/480172537 >> 172.21.15.123:0/480172537 conn(0x7f77e40b3f80 msgr2=0x7f77e40b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:04.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.571+0000 7f77e9400640 1 -- 172.21.15.123:0/480172537 shutdown_connections 2024-04-25T13:42:04.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.571+0000 7f77e9400640 1 -- 172.21.15.123:0/480172537 wait complete. 2024-04-25T13:42:04.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.575+0000 7f77e9400640 1 Processor -- start 2024-04-25T13:42:04.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.575+0000 7f77e9400640 1 -- start start 2024-04-25T13:42:04.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.575+0000 7f77e9400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77e40b2810 0x7f77e40c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:04.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.575+0000 7f77e9400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77e40b2c20 0x7f77e4160e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:04.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.575+0000 7f77e9400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77e40d1c40 0x7f77e41fc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:04.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.575+0000 7f77e9400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f77e40cef60 con 0x7f77e40b2c20 2024-04-25T13:42:04.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.575+0000 7f77e9400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f77e40cede0 con 0x7f77e40b2810 2024-04-25T13:42:04.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.575+0000 7f77e9400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f77e40cf0e0 con 0x7f77e40d1c40 2024-04-25T13:42:04.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.575+0000 7f77e3400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77e40b2c20 0x7f77e4160e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:04.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.575+0000 7f77e3400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77e40b2c20 0x7f77e4160e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48258/0 (socket says 172.21.15.123:48258) 2024-04-25T13:42:04.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.575+0000 7f77e3400640 1 -- 172.21.15.123:0/1659110695 learned_addr learned my addr 172.21.15.123:0/1659110695 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:04.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.575+0000 7f77e8a00640 1 --2- 172.21.15.123:0/1659110695 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77e40d1c40 0x7f77e41fc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:04.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.575+0000 7f77e3e00640 1 --2- 172.21.15.123:0/1659110695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77e40b2810 0x7f77e40c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:04.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.575+0000 7f77e3400640 1 -- 172.21.15.123:0/1659110695 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77e40d1c40 msgr2=0x7f77e41fc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:04.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.575+0000 7f77e3400640 1 --2- 172.21.15.123:0/1659110695 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77e40d1c40 0x7f77e41fc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:04.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.575+0000 7f77e3400640 1 -- 172.21.15.123:0/1659110695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77e40b2810 msgr2=0x7f77e40c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:04.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.575+0000 7f77e3400640 1 --2- 172.21.15.123:0/1659110695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77e40b2810 0x7f77e40c7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:04.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.575+0000 7f77e3400640 1 -- 172.21.15.123:0/1659110695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77e4161640 con 0x7f77e40b2c20 2024-04-25T13:42:04.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.575+0000 7f77e3400640 1 --2- 172.21.15.123:0/1659110695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77e40b2c20 0x7f77e4160e40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f77d000b410 tx=0x7f77d000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:04.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.575+0000 7f77dbe00640 1 -- 172.21.15.123:0/1659110695 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d0015030 con 0x7f77e40b2c20 2024-04-25T13:42:04.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.579+0000 7f77dbe00640 1 -- 172.21.15.123:0/1659110695 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77d0004020 con 0x7f77e40b2c20 2024-04-25T13:42:04.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.579+0000 7f77dbe00640 1 -- 172.21.15.123:0/1659110695 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d0004450 con 0x7f77e40b2c20 2024-04-25T13:42:04.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.579+0000 7f77e9400640 1 -- 172.21.15.123:0/1659110695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77e4161920 con 0x7f77e40b2c20 2024-04-25T13:42:04.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.579+0000 7f77e9400640 1 -- 172.21.15.123:0/1659110695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77e4161ee0 con 0x7f77e40b2c20 2024-04-25T13:42:04.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.579+0000 7f77e9400640 1 -- 172.21.15.123:0/1659110695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77e4050750 con 0x7f77e40b2c20 2024-04-25T13:42:04.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.579+0000 7f77dbe00640 1 -- 172.21.15.123:0/1659110695 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f77d0018070 con 0x7f77e40b2c20 2024-04-25T13:42:04.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.579+0000 7f77dbe00640 1 --2- 172.21.15.123:0/1659110695 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f77c406f430 0x7f77c4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:04.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.579+0000 7f77dbe00640 1 -- 172.21.15.123:0/1659110695 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f77d008eb60 con 0x7f77e40b2c20 2024-04-25T13:42:04.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.579+0000 7f77e3e00640 1 --2- 172.21.15.123:0/1659110695 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f77c406f430 0x7f77c4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:04.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.583+0000 7f77e3e00640 1 --2- 172.21.15.123:0/1659110695 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f77c406f430 0x7f77c4071940 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f77d40af000 tx=0x7f77d40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:04.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.587+0000 7f77dbe00640 1 -- 172.21.15.123:0/1659110695 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f77d005b5e0 con 0x7f77e40b2c20 2024-04-25T13:42:04.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:04.743+0000 7f77e9400640 1 -- 172.21.15.123:0/1659110695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f77e40b82f0 con 0x7f77e40b2c20 2024-04-25T13:42:05.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.387+0000 7f77dbe00640 1 -- 172.21.15.123:0/1659110695 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7f77d005f8e0 con 0x7f77e40b2c20 2024-04-25T13:42:05.389 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2024-04-25T13:42:05.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.391+0000 7f77e9400640 1 -- 172.21.15.123:0/1659110695 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f77c406f430 msgr2=0x7f77c4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:05.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.391+0000 7f77e9400640 1 --2- 172.21.15.123:0/1659110695 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f77c406f430 0x7f77c4071940 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f77d40af000 tx=0x7f77d40a7000 comp rx=0 tx=0).stop 2024-04-25T13:42:05.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.391+0000 7f77e9400640 1 -- 172.21.15.123:0/1659110695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77e40b2c20 msgr2=0x7f77e4160e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:05.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.391+0000 7f77e9400640 1 --2- 172.21.15.123:0/1659110695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77e40b2c20 0x7f77e4160e40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f77d000b410 tx=0x7f77d000b8d0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.391+0000 7f77e9400640 1 -- 172.21.15.123:0/1659110695 shutdown_connections 2024-04-25T13:42:05.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.391+0000 7f77e9400640 1 --2- 172.21.15.123:0/1659110695 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f77c406f430 0x7f77c4071940 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.391+0000 7f77e9400640 1 --2- 172.21.15.123:0/1659110695 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77e40d1c40 0x7f77e41fc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.391+0000 7f77e9400640 1 --2- 172.21.15.123:0/1659110695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f77e40b2c20 0x7f77e4160e40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.391+0000 7f77e9400640 1 --2- 172.21.15.123:0/1659110695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77e40b2810 0x7f77e40c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.391+0000 7f77e9400640 1 -- 172.21.15.123:0/1659110695 >> 172.21.15.123:0/1659110695 conn(0x7f77e40b3f80 msgr2=0x7f77e406c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:05.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.391+0000 7f77e9400640 1 -- 172.21.15.123:0/1659110695 shutdown_connections 2024-04-25T13:42:05.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.391+0000 7f77e9400640 1 -- 172.21.15.123:0/1659110695 wait complete. 2024-04-25T13:42:05.443 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T13:42:05.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.591+0000 7ff55f200640 1 Processor -- start 2024-04-25T13:42:05.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.595+0000 7ff55f200640 1 -- start start 2024-04-25T13:42:05.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.595+0000 7ff55f200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff5600ce750 0x7ff5600b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:05.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.595+0000 7ff55f200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff5600b5910 0x7ff5600cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.595+0000 7ff55f200640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5600b3db0 con 0x7ff5600b5d20 2024-04-25T13:42:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.595+0000 7ff55f200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff5600b7f90 con 0x7ff5600b5910 2024-04-25T13:42:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.595+0000 7ff55f200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff5600cfe30 con 0x7ff5600ce750 2024-04-25T13:42:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.595+0000 7ff55d400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff5600b5910 0x7ff5600cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.595+0000 7ff55d400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff5600b5910 0x7ff5600cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48272/0 (socket says 172.21.15.123:48272) 2024-04-25T13:42:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.595+0000 7ff55d400640 1 -- 172.21.15.123:0/2576437210 learned_addr learned my addr 172.21.15.123:0/2576437210 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.595+0000 7ff55de00640 1 --2- 172.21.15.123:0/2576437210 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff5600ce750 0x7ff5600b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.595+0000 7ff55d400640 1 -- 172.21.15.123:0/2576437210 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff5600ce750 msgr2=0x7ff5600b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.595+0000 7ff55d400640 1 --2- 172.21.15.123:0/2576437210 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff5600ce750 0x7ff5600b53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.595+0000 7ff55d400640 1 -- 172.21.15.123:0/2576437210 >> v1:172.21.15.130:6789/0 conn(0x7ff5600b5d20 legacy=0x7ff5600cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:05.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.595+0000 7ff55d400640 1 -- 172.21.15.123:0/2576437210 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5600b3ad0 con 0x7ff5600b5910 2024-04-25T13:42:05.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.599+0000 7ff55d400640 1 --2- 172.21.15.123:0/2576437210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5600b5910 0x7ff5600cf1e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff54c009870 tx=0x7ff54c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed1de30ad5f698f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:05.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.599+0000 7ff55ca00640 1 -- 172.21.15.123:0/2576437210 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54c0ab650 con 0x7ff5600b5910 2024-04-25T13:42:05.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.599+0000 7ff55ca00640 1 -- 172.21.15.123:0/2576437210 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff54c0b0070 con 0x7ff5600b5910 2024-04-25T13:42:05.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.599+0000 7ff55ca00640 1 -- 172.21.15.123:0/2576437210 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54c0aba10 con 0x7ff5600b5910 2024-04-25T13:42:05.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.599+0000 7ff55f200640 1 -- 172.21.15.123:0/2576437210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5600b5910 msgr2=0x7ff5600cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:05.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.599+0000 7ff55f200640 1 --2- 172.21.15.123:0/2576437210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5600b5910 0x7ff5600cf1e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff54c009870 tx=0x7ff54c01c560 comp rx=0 tx=0).stop 2024-04-25T13:42:05.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.599+0000 7ff55f200640 1 -- 172.21.15.123:0/2576437210 shutdown_connections 2024-04-25T13:42:05.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.599+0000 7ff55f200640 1 --2- 172.21.15.123:0/2576437210 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5600b5910 0x7ff5600cf1e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.599+0000 7ff55f200640 1 --2- 172.21.15.123:0/2576437210 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff5600ce750 0x7ff5600b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.599+0000 7ff55f200640 1 -- 172.21.15.123:0/2576437210 >> 172.21.15.123:0/2576437210 conn(0x7ff5600d2580 msgr2=0x7ff5600d2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:05.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.599+0000 7ff55f200640 1 -- 172.21.15.123:0/2576437210 shutdown_connections 2024-04-25T13:42:05.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.599+0000 7ff55f200640 1 -- 172.21.15.123:0/2576437210 wait complete. 2024-04-25T13:42:05.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.603+0000 7ff55f200640 1 Processor -- start 2024-04-25T13:42:05.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.603+0000 7ff55f200640 1 -- start start 2024-04-25T13:42:05.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.603+0000 7ff55f200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5600b5910 0x7ff5601f7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:05.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.603+0000 7ff55f200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5600b5d20 0x7ff560157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:05.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.603+0000 7ff55f200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff5600ce750 0x7ff5600b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:05.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.603+0000 7ff55f200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff5601617b0 con 0x7ff5600b5d20 2024-04-25T13:42:05.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.603+0000 7ff55f200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff5600ceb60 con 0x7ff5600b5910 2024-04-25T13:42:05.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.603+0000 7ff55f200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff560161930 con 0x7ff5600ce750 2024-04-25T13:42:05.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.603+0000 7ff55d400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5600b5d20 0x7ff560157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:05.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.603+0000 7ff55de00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5600b5910 0x7ff5601f7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:05.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.603+0000 7ff55de00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5600b5910 0x7ff5601f7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:33042/0 (socket says 172.21.15.123:33042) 2024-04-25T13:42:05.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.603+0000 7ff55de00640 1 -- 172.21.15.123:0/1286016231 learned_addr learned my addr 172.21.15.123:0/1286016231 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:05.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.603+0000 7ff55e800640 1 --2- 172.21.15.123:0/1286016231 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff5600ce750 0x7ff5600b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:05.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.603+0000 7ff55d400640 1 -- 172.21.15.123:0/1286016231 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff5600ce750 msgr2=0x7ff5600b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:05.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.603+0000 7ff55d400640 1 --2- 172.21.15.123:0/1286016231 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff5600ce750 0x7ff5600b1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.603+0000 7ff55d400640 1 -- 172.21.15.123:0/1286016231 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5600b5910 msgr2=0x7ff5601f7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:05.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.603+0000 7ff55d400640 1 --2- 172.21.15.123:0/1286016231 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5600b5910 0x7ff5601f7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:05.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.603+0000 7ff55d400640 1 -- 172.21.15.123:0/1286016231 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5601584e0 con 0x7ff5600b5d20 2024-04-25T13:42:05.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.603+0000 7ff55d400640 1 --2- 172.21.15.123:0/1286016231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5600b5d20 0x7ff560157fa0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff54c0ac000 tx=0x7ff54c01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:05.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.603+0000 7ff556000640 1 -- 172.21.15.123:0/1286016231 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54c0be5f0 con 0x7ff5600b5d20 2024-04-25T13:42:05.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.603+0000 7ff556000640 1 -- 172.21.15.123:0/1286016231 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff54c0be7b0 con 0x7ff5600b5d20 2024-04-25T13:42:05.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.603+0000 7ff55f200640 1 -- 172.21.15.123:0/1286016231 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5601f7d90 con 0x7ff5600b5d20 2024-04-25T13:42:05.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.603+0000 7ff556000640 1 -- 172.21.15.123:0/1286016231 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff54c0beba0 con 0x7ff5600b5d20 2024-04-25T13:42:05.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.607+0000 7ff55f200640 1 -- 172.21.15.123:0/1286016231 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5601f8350 con 0x7ff5600b5d20 2024-04-25T13:42:05.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.607+0000 7ff55f200640 1 -- 172.21.15.123:0/1286016231 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5601f7b00 con 0x7ff5600b5d20 2024-04-25T13:42:05.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.607+0000 7ff556000640 1 -- 172.21.15.123:0/1286016231 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff54c0c9470 con 0x7ff5600b5d20 2024-04-25T13:42:05.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.607+0000 7ff556000640 1 --2- 172.21.15.123:0/1286016231 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff54006f400 0x7ff540071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:05.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.607+0000 7ff556000640 1 -- 172.21.15.123:0/1286016231 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7ff54c12a250 con 0x7ff5600b5d20 2024-04-25T13:42:05.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.607+0000 7ff55de00640 1 --2- 172.21.15.123:0/1286016231 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff54006f400 0x7ff540071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:05.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.611+0000 7ff55de00640 1 --2- 172.21.15.123:0/1286016231 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff54006f400 0x7ff540071910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff550007a40 tx=0x7ff550008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:05.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.611+0000 7ff556000640 1 -- 172.21.15.123:0/1286016231 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff54c0c4060 con 0x7ff5600b5d20 2024-04-25T13:42:05.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:05.803+0000 7ff55f200640 1 -- 172.21.15.123:0/1286016231 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff560050750 con 0x7ff5600b5d20 2024-04-25T13:42:06.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.391+0000 7ff556000640 1 -- 172.21.15.123:0/1286016231 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7ff54c0ff030 con 0x7ff5600b5d20 2024-04-25T13:42:06.391 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T13:42:06.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.391+0000 7ff55f200640 1 -- 172.21.15.123:0/1286016231 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff54006f400 msgr2=0x7ff540071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:06.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.391+0000 7ff55f200640 1 --2- 172.21.15.123:0/1286016231 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff54006f400 0x7ff540071910 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff550007a40 tx=0x7ff550008040 comp rx=0 tx=0).stop 2024-04-25T13:42:06.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.391+0000 7ff55f200640 1 -- 172.21.15.123:0/1286016231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5600b5d20 msgr2=0x7ff560157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:06.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.391+0000 7ff55f200640 1 --2- 172.21.15.123:0/1286016231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5600b5d20 0x7ff560157fa0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff54c0ac000 tx=0x7ff54c01ada0 comp rx=0 tx=0).stop 2024-04-25T13:42:06.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.391+0000 7ff55f200640 1 -- 172.21.15.123:0/1286016231 shutdown_connections 2024-04-25T13:42:06.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.391+0000 7ff55f200640 1 --2- 172.21.15.123:0/1286016231 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff54006f400 0x7ff540071910 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:06.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.391+0000 7ff55f200640 1 --2- 172.21.15.123:0/1286016231 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff5600ce750 0x7ff5600b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:06.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.391+0000 7ff55f200640 1 --2- 172.21.15.123:0/1286016231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5600b5d20 0x7ff560157fa0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:06.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.391+0000 7ff55f200640 1 --2- 172.21.15.123:0/1286016231 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5600b5910 0x7ff5601f7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:06.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.391+0000 7ff55f200640 1 -- 172.21.15.123:0/1286016231 >> 172.21.15.123:0/1286016231 conn(0x7ff5600d2580 msgr2=0x7ff5600d0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:06.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.391+0000 7ff55f200640 1 -- 172.21.15.123:0/1286016231 shutdown_connections 2024-04-25T13:42:06.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.391+0000 7ff55f200640 1 -- 172.21.15.123:0/1286016231 wait complete. 2024-04-25T13:42:06.449 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:06.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.595+0000 7fde5bc00640 1 Processor -- start 2024-04-25T13:42:06.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.595+0000 7fde5bc00640 1 -- start start 2024-04-25T13:42:06.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.595+0000 7fde5bc00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fde540d0f80 0x7fde54160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:06.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.595+0000 7fde5bc00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde540b32f0 0x7fde540b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:06.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.595+0000 7fde5bc00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde540b3c40 con 0x7fde54073be0 2024-04-25T13:42:06.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.595+0000 7fde5bc00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fde5415cfe0 con 0x7fde540d0f80 2024-04-25T13:42:06.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.595+0000 7fde5bc00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fde54161520 con 0x7fde540b32f0 2024-04-25T13:42:06.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.595+0000 7fde59200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fde540d0f80 0x7fde54160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:06.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.595+0000 7fde59200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fde540d0f80 0x7fde54160fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48288/0 (socket says 172.21.15.123:48288) 2024-04-25T13:42:06.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.595+0000 7fde59200640 1 -- 172.21.15.123:0/2782056540 learned_addr learned my addr 172.21.15.123:0/2782056540 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:06.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.599+0000 7fde53e00640 1 --2- 172.21.15.123:0/2782056540 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde540b32f0 0x7fde540b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:06.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.599+0000 7fde59200640 1 -- 172.21.15.123:0/2782056540 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde540b32f0 msgr2=0x7fde540b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:06.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.599+0000 7fde59200640 1 --2- 172.21.15.123:0/2782056540 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde540b32f0 0x7fde540b3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:06.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.599+0000 7fde59200640 1 -- 172.21.15.123:0/2782056540 >> v1:172.21.15.130:6789/0 conn(0x7fde54073be0 legacy=0x7fde54073ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:06.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.599+0000 7fde59200640 1 -- 172.21.15.123:0/2782056540 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5415d240 con 0x7fde540d0f80 2024-04-25T13:42:06.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.599+0000 7fde59200640 1 --2- 172.21.15.123:0/2782056540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde540d0f80 0x7fde54160fe0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fde44009e80 tx=0x7fde4401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b77a1b5285ba7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:06.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.599+0000 7fde53400640 1 -- 172.21.15.123:0/2782056540 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde440a5810 con 0x7fde540d0f80 2024-04-25T13:42:06.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.599+0000 7fde53400640 1 -- 172.21.15.123:0/2782056540 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde440a59b0 con 0x7fde540d0f80 2024-04-25T13:42:06.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.599+0000 7fde53400640 1 -- 172.21.15.123:0/2782056540 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde440a5d80 con 0x7fde540d0f80 2024-04-25T13:42:06.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.603+0000 7fde5bc00640 1 -- 172.21.15.123:0/2782056540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde540d0f80 msgr2=0x7fde54160fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:06.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.603+0000 7fde5bc00640 1 --2- 172.21.15.123:0/2782056540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde540d0f80 0x7fde54160fe0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fde44009e80 tx=0x7fde4401c950 comp rx=0 tx=0).stop 2024-04-25T13:42:06.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.603+0000 7fde5bc00640 1 -- 172.21.15.123:0/2782056540 shutdown_connections 2024-04-25T13:42:06.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.603+0000 7fde5bc00640 1 --2- 172.21.15.123:0/2782056540 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde540b32f0 0x7fde540b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:06.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.603+0000 7fde5bc00640 1 --2- 172.21.15.123:0/2782056540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde540d0f80 0x7fde54160fe0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:06.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.603+0000 7fde5bc00640 1 -- 172.21.15.123:0/2782056540 >> 172.21.15.123:0/2782056540 conn(0x7fde5406d210 msgr2=0x7fde5406ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:06.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.603+0000 7fde5bc00640 1 -- 172.21.15.123:0/2782056540 shutdown_connections 2024-04-25T13:42:06.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.603+0000 7fde5bc00640 1 -- 172.21.15.123:0/2782056540 wait complete. 2024-04-25T13:42:06.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.603+0000 7fde5bc00640 1 Processor -- start 2024-04-25T13:42:06.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.603+0000 7fde5bc00640 1 -- start start 2024-04-25T13:42:06.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.607+0000 7fde5bc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde54073be0 0x7fde54147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:06.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.607+0000 7fde5bc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde540b32f0 0x7fde540b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:06.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.607+0000 7fde5bc00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde540d0f80 0x7fde540b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:06.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.607+0000 7fde5bc00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fde540b6020 con 0x7fde54073be0 2024-04-25T13:42:06.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.607+0000 7fde5bc00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fde5415ddc0 con 0x7fde540b32f0 2024-04-25T13:42:06.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.607+0000 7fde5bc00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fde540b6470 con 0x7fde540d0f80 2024-04-25T13:42:06.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.607+0000 7fde59200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde54073be0 0x7fde54147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:06.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.607+0000 7fde59200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde54073be0 0x7fde54147520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48290/0 (socket says 172.21.15.123:48290) 2024-04-25T13:42:06.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.607+0000 7fde59200640 1 -- 172.21.15.123:0/4256875437 learned_addr learned my addr 172.21.15.123:0/4256875437 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:06.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.607+0000 7fde53e00640 1 --2- 172.21.15.123:0/4256875437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde540b32f0 0x7fde540b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:06.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.607+0000 7fde59c00640 1 --2- 172.21.15.123:0/4256875437 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde540d0f80 0x7fde540b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:06.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.607+0000 7fde59200640 1 -- 172.21.15.123:0/4256875437 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde540d0f80 msgr2=0x7fde540b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:06.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.607+0000 7fde59200640 1 --2- 172.21.15.123:0/4256875437 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde540d0f80 0x7fde540b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:06.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.607+0000 7fde59200640 1 -- 172.21.15.123:0/4256875437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde540b32f0 msgr2=0x7fde540b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:06.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.607+0000 7fde59200640 1 --2- 172.21.15.123:0/4256875437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde540b32f0 0x7fde540b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:06.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.607+0000 7fde59200640 1 -- 172.21.15.123:0/4256875437 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5415c280 con 0x7fde54073be0 2024-04-25T13:42:06.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.607+0000 7fde53e00640 1 --2- 172.21.15.123:0/4256875437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde540b32f0 0x7fde540b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:06.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.607+0000 7fde59200640 1 --2- 172.21.15.123:0/4256875437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde54073be0 0x7fde54147520 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fde440af040 tx=0x7fde440196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:06.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.607+0000 7fde50c00640 1 -- 172.21.15.123:0/4256875437 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde440bc020 con 0x7fde54073be0 2024-04-25T13:42:06.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.607+0000 7fde50c00640 1 -- 172.21.15.123:0/4256875437 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde440b8670 con 0x7fde54073be0 2024-04-25T13:42:06.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.607+0000 7fde5bc00640 1 -- 172.21.15.123:0/4256875437 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde5415c560 con 0x7fde54073be0 2024-04-25T13:42:06.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.607+0000 7fde50c00640 1 -- 172.21.15.123:0/4256875437 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde440b8a40 con 0x7fde54073be0 2024-04-25T13:42:06.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.607+0000 7fde5bc00640 1 -- 172.21.15.123:0/4256875437 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde54153850 con 0x7fde54073be0 2024-04-25T13:42:06.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.607+0000 7fde5bc00640 1 -- 172.21.15.123:0/4256875437 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde540507c0 con 0x7fde54073be0 2024-04-25T13:42:06.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.607+0000 7fde50c00640 1 -- 172.21.15.123:0/4256875437 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fde440bf020 con 0x7fde54073be0 2024-04-25T13:42:06.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.611+0000 7fde50c00640 1 --2- 172.21.15.123:0/4256875437 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fde3406f430 0x7fde34071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:06.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.611+0000 7fde50c00640 1 -- 172.21.15.123:0/4256875437 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fde4412a080 con 0x7fde54073be0 2024-04-25T13:42:06.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.611+0000 7fde53e00640 1 --2- 172.21.15.123:0/4256875437 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fde3406f430 0x7fde34071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:06.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.611+0000 7fde53e00640 1 --2- 172.21.15.123:0/4256875437 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fde3406f430 0x7fde34071940 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fde5414ea90 tx=0x7fde40008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:06.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.615+0000 7fde50c00640 1 -- 172.21.15.123:0/4256875437 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fde440c6070 con 0x7fde54073be0 2024-04-25T13:42:06.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.775+0000 7fde5bc00640 1 -- 172.21.15.123:0/4256875437 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde54153a80 con 0x7fde54073be0 2024-04-25T13:42:06.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.775+0000 7fde50c00640 1 -- 172.21.15.123:0/4256875437 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16642 (secure 0 0 0) 0x7fde44016600 con 0x7fde54073be0 2024-04-25T13:42:06.779 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:06.779 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":20,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:42:05.806940+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:03.949161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:04.755682+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:06.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.779+0000 7fde5bc00640 1 -- 172.21.15.123:0/4256875437 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fde3406f430 msgr2=0x7fde34071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:06.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.779+0000 7fde5bc00640 1 --2- 172.21.15.123:0/4256875437 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fde3406f430 0x7fde34071940 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fde5414ea90 tx=0x7fde40008040 comp rx=0 tx=0).stop 2024-04-25T13:42:06.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.779+0000 7fde5bc00640 1 -- 172.21.15.123:0/4256875437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde54073be0 msgr2=0x7fde54147520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:06.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.779+0000 7fde5bc00640 1 --2- 172.21.15.123:0/4256875437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde54073be0 0x7fde54147520 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fde440af040 tx=0x7fde440196f0 comp rx=0 tx=0).stop 2024-04-25T13:42:06.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.779+0000 7fde5bc00640 1 -- 172.21.15.123:0/4256875437 shutdown_connections 2024-04-25T13:42:06.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.779+0000 7fde5bc00640 1 --2- 172.21.15.123:0/4256875437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde540b32f0 0x7fde540b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:06.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.779+0000 7fde5bc00640 1 --2- 172.21.15.123:0/4256875437 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fde3406f430 0x7fde34071940 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:06.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.779+0000 7fde5bc00640 1 --2- 172.21.15.123:0/4256875437 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde540d0f80 0x7fde540b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:06.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.779+0000 7fde5bc00640 1 --2- 172.21.15.123:0/4256875437 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde54073be0 0x7fde54147520 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:06.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.779+0000 7fde5bc00640 1 -- 172.21.15.123:0/4256875437 >> 172.21.15.123:0/4256875437 conn(0x7fde5406d210 msgr2=0x7fde54073ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:06.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.779+0000 7fde5bc00640 1 -- 172.21.15.123:0/4256875437 shutdown_connections 2024-04-25T13:42:06.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.779+0000 7fde5bc00640 1 -- 172.21.15.123:0/4256875437 wait complete. 2024-04-25T13:42:06.800 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:06.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.943+0000 7f5ae2800640 1 Processor -- start 2024-04-25T13:42:06.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.943+0000 7f5ae2800640 1 -- start start 2024-04-25T13:42:06.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.947+0000 7f5ae2800640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5adc0d0f80 0x7f5adc160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:06.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.947+0000 7f5ae2800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5adc0b32f0 0x7f5adc0b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:06.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.947+0000 7f5ae2800640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5adc0b3c40 con 0x7f5adc073be0 2024-04-25T13:42:06.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.947+0000 7f5ae2800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5adc15cfe0 con 0x7f5adc0b32f0 2024-04-25T13:42:06.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.947+0000 7f5ae2800640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f5adc161520 con 0x7f5adc0d0f80 2024-04-25T13:42:06.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.947+0000 7f5ad2a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5adc0b32f0 0x7f5adc0b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:06.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.947+0000 7f5ad2a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5adc0b32f0 0x7f5adc0b3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48302/0 (socket says 172.21.15.123:48302) 2024-04-25T13:42:06.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.947+0000 7f5ad2a00640 1 -- 172.21.15.123:0/562320603 learned_addr learned my addr 172.21.15.123:0/562320603 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:06.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.947+0000 7f5adb400640 1 --2- 172.21.15.123:0/562320603 >> v2:172.21.15.130:3300/0 conn(0x7f5adc0d0f80 0x7f5adc160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:06.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.947+0000 7f5ad2a00640 1 -- 172.21.15.123:0/562320603 >> v2:172.21.15.130:3300/0 conn(0x7f5adc0d0f80 msgr2=0x7f5adc160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:06.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.947+0000 7f5ad2a00640 1 --2- 172.21.15.123:0/562320603 >> v2:172.21.15.130:3300/0 conn(0x7f5adc0d0f80 0x7f5adc160fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:06.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.947+0000 7f5ad2a00640 1 -- 172.21.15.123:0/562320603 >> v1:172.21.15.130:6789/0 conn(0x7f5adc073be0 legacy=0x7f5adc073ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:06.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.947+0000 7f5ad2a00640 1 -- 172.21.15.123:0/562320603 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5adc15d240 con 0x7f5adc0b32f0 2024-04-25T13:42:06.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.947+0000 7f5adb400640 1 --2- 172.21.15.123:0/562320603 >> v2:172.21.15.130:3300/0 conn(0x7f5adc0d0f80 0x7f5adc160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:06.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.951+0000 7f5ad2a00640 1 --2- 172.21.15.123:0/562320603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5adc0b32f0 0x7f5adc0b3700 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5adc070e80 tx=0x7f5ac401c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc5125d5f609972 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:06.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.951+0000 7f5adaa00640 1 -- 172.21.15.123:0/562320603 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac40b0070 con 0x7f5adc0b32f0 2024-04-25T13:42:06.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.951+0000 7f5adaa00640 1 -- 172.21.15.123:0/562320603 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac40ab600 con 0x7f5adc0b32f0 2024-04-25T13:42:06.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.951+0000 7f5adaa00640 1 -- 172.21.15.123:0/562320603 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac40ab9d0 con 0x7f5adc0b32f0 2024-04-25T13:42:06.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.951+0000 7f5ae2800640 1 -- 172.21.15.123:0/562320603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5adc0b32f0 msgr2=0x7f5adc0b3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:06.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.951+0000 7f5ae2800640 1 --2- 172.21.15.123:0/562320603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5adc0b32f0 0x7f5adc0b3700 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5adc070e80 tx=0x7f5ac401c240 comp rx=0 tx=0).stop 2024-04-25T13:42:06.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.951+0000 7f5ae2800640 1 -- 172.21.15.123:0/562320603 shutdown_connections 2024-04-25T13:42:06.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.951+0000 7f5ae2800640 1 --2- 172.21.15.123:0/562320603 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5adc0b32f0 0x7f5adc0b3700 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:06.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.951+0000 7f5ae2800640 1 --2- 172.21.15.123:0/562320603 >> v2:172.21.15.130:3300/0 conn(0x7f5adc0d0f80 0x7f5adc160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:06.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.951+0000 7f5ae2800640 1 -- 172.21.15.123:0/562320603 >> 172.21.15.123:0/562320603 conn(0x7f5adc06d210 msgr2=0x7f5adc06ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:06.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.951+0000 7f5ae2800640 1 -- 172.21.15.123:0/562320603 shutdown_connections 2024-04-25T13:42:06.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.951+0000 7f5ae2800640 1 -- 172.21.15.123:0/562320603 wait complete. 2024-04-25T13:42:06.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.951+0000 7f5ae2800640 1 Processor -- start 2024-04-25T13:42:06.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.955+0000 7f5ae2800640 1 -- start start 2024-04-25T13:42:06.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.955+0000 7f5ae2800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5adc073be0 0x7f5adc165b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:06.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.955+0000 7f5ae2800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5adc0b32f0 0x7f5adc1421f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:06.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.955+0000 7f5ae2800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5adc0d0f80 0x7f5adc155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:06.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.955+0000 7f5ae2800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5adc0b6020 con 0x7f5adc0d0f80 2024-04-25T13:42:06.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.955+0000 7f5ae2800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5adc15ddc0 con 0x7f5adc073be0 2024-04-25T13:42:06.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.955+0000 7f5ae2800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f5adc0b6470 con 0x7f5adc0b32f0 2024-04-25T13:42:06.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.955+0000 7f5adbe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5adc0d0f80 0x7f5adc155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:06.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.955+0000 7f5adbe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5adc0d0f80 0x7f5adc155790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48304/0 (socket says 172.21.15.123:48304) 2024-04-25T13:42:06.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.955+0000 7f5adbe00640 1 -- 172.21.15.123:0/3497593221 learned_addr learned my addr 172.21.15.123:0/3497593221 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:06.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.955+0000 7f5adb400640 1 --2- 172.21.15.123:0/3497593221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5adc073be0 0x7f5adc165b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:06.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.955+0000 7f5ad2a00640 1 --2- 172.21.15.123:0/3497593221 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5adc0b32f0 0x7f5adc1421f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:06.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.955+0000 7f5adbe00640 1 -- 172.21.15.123:0/3497593221 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5adc0b32f0 msgr2=0x7f5adc1421f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:06.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.955+0000 7f5adbe00640 1 --2- 172.21.15.123:0/3497593221 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5adc0b32f0 0x7f5adc1421f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:06.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.955+0000 7f5adbe00640 1 -- 172.21.15.123:0/3497593221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5adc073be0 msgr2=0x7f5adc165b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:06.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.955+0000 7f5adbe00640 1 --2- 172.21.15.123:0/3497593221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5adc073be0 0x7f5adc165b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:06.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.955+0000 7f5adbe00640 1 -- 172.21.15.123:0/3497593221 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5adc1664b0 con 0x7f5adc0d0f80 2024-04-25T13:42:06.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.955+0000 7f5adbe00640 1 --2- 172.21.15.123:0/3497593221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5adc0d0f80 0x7f5adc155790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5ad400b9c0 tx=0x7f5ad400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:06.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.955+0000 7f5ad3e00640 1 -- 172.21.15.123:0/3497593221 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4019070 con 0x7f5adc0d0f80 2024-04-25T13:42:06.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.955+0000 7f5ad3e00640 1 -- 172.21.15.123:0/3497593221 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ad400cba0 con 0x7f5adc0d0f80 2024-04-25T13:42:06.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.955+0000 7f5ae2800640 1 -- 172.21.15.123:0/3497593221 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5adc166790 con 0x7f5adc0d0f80 2024-04-25T13:42:06.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.955+0000 7f5ad3e00640 1 -- 172.21.15.123:0/3497593221 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4014440 con 0x7f5adc0d0f80 2024-04-25T13:42:06.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.955+0000 7f5ae2800640 1 -- 172.21.15.123:0/3497593221 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5adc158ae0 con 0x7f5adc0d0f80 2024-04-25T13:42:06.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.959+0000 7f5ae2800640 1 -- 172.21.15.123:0/3497593221 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5adc0507c0 con 0x7f5adc0d0f80 2024-04-25T13:42:06.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.959+0000 7f5ad3e00640 1 -- 172.21.15.123:0/3497593221 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5ad401c070 con 0x7f5adc0d0f80 2024-04-25T13:42:06.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.959+0000 7f5ad3e00640 1 --2- 172.21.15.123:0/3497593221 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5ab806f430 0x7f5ab8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:06.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.959+0000 7f5ad3e00640 1 -- 172.21.15.123:0/3497593221 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5ad408efb0 con 0x7f5adc0d0f80 2024-04-25T13:42:06.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.959+0000 7f5adb400640 1 --2- 172.21.15.123:0/3497593221 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5ab806f430 0x7f5ab8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:06.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.959+0000 7f5adb400640 1 --2- 172.21.15.123:0/3497593221 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5ab806f430 0x7f5ab8071940 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5adc070fa0 tx=0x7f5acc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:06.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:06.963+0000 7f5ad3e00640 1 -- 172.21.15.123:0/3497593221 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5ad405b840 con 0x7f5adc0d0f80 2024-04-25T13:42:07.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.127+0000 7f5ae2800640 1 -- 172.21.15.123:0/3497593221 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5adc06eeb0 con 0x7f5adc0d0f80 2024-04-25T13:42:07.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.127+0000 7f5ad3e00640 1 -- 172.21.15.123:0/3497593221 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16642 (secure 0 0 0) 0x7f5ad405fb40 con 0x7f5adc0d0f80 2024-04-25T13:42:07.130 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:07.130 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":20,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:42:05.806940+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:03.949161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:04.755682+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:07.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.131+0000 7f5ae2800640 1 -- 172.21.15.123:0/3497593221 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5ab806f430 msgr2=0x7f5ab8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:07.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.131+0000 7f5ae2800640 1 --2- 172.21.15.123:0/3497593221 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5ab806f430 0x7f5ab8071940 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5adc070fa0 tx=0x7f5acc008040 comp rx=0 tx=0).stop 2024-04-25T13:42:07.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.131+0000 7f5ae2800640 1 -- 172.21.15.123:0/3497593221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5adc0d0f80 msgr2=0x7f5adc155790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:07.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.131+0000 7f5ae2800640 1 --2- 172.21.15.123:0/3497593221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5adc0d0f80 0x7f5adc155790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5ad400b9c0 tx=0x7f5ad400be80 comp rx=0 tx=0).stop 2024-04-25T13:42:07.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.131+0000 7f5ae2800640 1 -- 172.21.15.123:0/3497593221 shutdown_connections 2024-04-25T13:42:07.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.131+0000 7f5ae2800640 1 --2- 172.21.15.123:0/3497593221 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5ab806f430 0x7f5ab8071940 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:07.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.131+0000 7f5ae2800640 1 --2- 172.21.15.123:0/3497593221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5adc0d0f80 0x7f5adc155790 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:07.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.131+0000 7f5ae2800640 1 --2- 172.21.15.123:0/3497593221 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5adc0b32f0 0x7f5adc1421f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:07.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.131+0000 7f5ae2800640 1 --2- 172.21.15.123:0/3497593221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5adc073be0 0x7f5adc165b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:07.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.131+0000 7f5ae2800640 1 -- 172.21.15.123:0/3497593221 >> 172.21.15.123:0/3497593221 conn(0x7f5adc06d210 msgr2=0x7f5adc156b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:07.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.131+0000 7f5ae2800640 1 -- 172.21.15.123:0/3497593221 shutdown_connections 2024-04-25T13:42:07.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.131+0000 7f5ae2800640 1 -- 172.21.15.123:0/3497593221 wait complete. 2024-04-25T13:42:07.152 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T13:42:07.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.299+0000 7fa562200640 1 Processor -- start 2024-04-25T13:42:07.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.299+0000 7fa562200640 1 -- start start 2024-04-25T13:42:07.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.299+0000 7fa562200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa55c0b3870 0x7fa55c0b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:07.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.299+0000 7fa562200640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa55c072af0 0x7fa55c072f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:07.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.299+0000 7fa562200640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa55c0b41c0 con 0x7fa55c1571b0 2024-04-25T13:42:07.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.299+0000 7fa562200640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fa55c0cdee0 con 0x7fa55c072af0 2024-04-25T13:42:07.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.299+0000 7fa562200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa55c15d570 con 0x7fa55c0b3870 2024-04-25T13:42:07.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.299+0000 7fa55be00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa55c072af0 0x7fa55c072f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:07.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.299+0000 7fa552a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa55c0b3870 0x7fa55c0b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:07.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.299+0000 7fa55be00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa55c072af0 0x7fa55c072f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:33080/0 (socket says 172.21.15.123:33080) 2024-04-25T13:42:07.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.299+0000 7fa55be00640 1 -- 172.21.15.123:0/636395613 learned_addr learned my addr 172.21.15.123:0/636395613 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:07.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.299+0000 7fa552a00640 1 -- 172.21.15.123:0/636395613 >> v2:172.21.15.130:3300/0 conn(0x7fa55c072af0 msgr2=0x7fa55c072f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:07.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.299+0000 7fa552a00640 1 --2- 172.21.15.123:0/636395613 >> v2:172.21.15.130:3300/0 conn(0x7fa55c072af0 0x7fa55c072f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:07.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.299+0000 7fa552a00640 1 -- 172.21.15.123:0/636395613 >> v1:172.21.15.130:6789/0 conn(0x7fa55c1571b0 legacy=0x7fa55c0cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:07.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.299+0000 7fa552a00640 1 -- 172.21.15.123:0/636395613 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55c15d850 con 0x7fa55c0b3870 2024-04-25T13:42:07.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.299+0000 7fa55aa00640 1 -- 172.21.15.123:0/636395613 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2977543640 0 0) 0x7fa54c001120 con 0x7fa55c1571b0 2024-04-25T13:42:07.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.299+0000 7fa55be00640 1 --2- 172.21.15.123:0/636395613 >> v2:172.21.15.130:3300/0 conn(0x7fa55c072af0 0x7fa55c072f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:07.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.303+0000 7fa552a00640 1 --2- 172.21.15.123:0/636395613 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa55c0b3870 0x7fa55c0b3c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa5440097c0 tx=0x7fa54401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c54d6358a2385bf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:07.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.303+0000 7fa55aa00640 1 -- 172.21.15.123:0/636395613 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5440aa5f0 con 0x7fa55c0b3870 2024-04-25T13:42:07.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.303+0000 7fa55aa00640 1 -- 172.21.15.123:0/636395613 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5440af070 con 0x7fa55c0b3870 2024-04-25T13:42:07.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.303+0000 7fa55aa00640 1 -- 172.21.15.123:0/636395613 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5440aa9b0 con 0x7fa55c0b3870 2024-04-25T13:42:07.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.303+0000 7fa562200640 1 -- 172.21.15.123:0/636395613 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa55c0b3870 msgr2=0x7fa55c0b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:07.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.303+0000 7fa562200640 1 --2- 172.21.15.123:0/636395613 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa55c0b3870 0x7fa55c0b3c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa5440097c0 tx=0x7fa54401c470 comp rx=0 tx=0).stop 2024-04-25T13:42:07.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.303+0000 7fa562200640 1 -- 172.21.15.123:0/636395613 shutdown_connections 2024-04-25T13:42:07.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.303+0000 7fa562200640 1 --2- 172.21.15.123:0/636395613 >> v2:172.21.15.130:3300/0 conn(0x7fa55c072af0 0x7fa55c072f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:07.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.303+0000 7fa562200640 1 --2- 172.21.15.123:0/636395613 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa55c0b3870 0x7fa55c0b3c80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:07.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.303+0000 7fa562200640 1 -- 172.21.15.123:0/636395613 >> 172.21.15.123:0/636395613 conn(0x7fa55c06ca70 msgr2=0x7fa55c06ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:07.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.307+0000 7fa562200640 1 -- 172.21.15.123:0/636395613 shutdown_connections 2024-04-25T13:42:07.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.307+0000 7fa562200640 1 -- 172.21.15.123:0/636395613 wait complete. 2024-04-25T13:42:07.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.307+0000 7fa562200640 1 Processor -- start 2024-04-25T13:42:07.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.307+0000 7fa562200640 1 -- start start 2024-04-25T13:42:07.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.307+0000 7fa562200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa55c072af0 0x7fa55c14f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:07.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.307+0000 7fa562200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa55c0b3870 0x7fa55c14f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:07.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.307+0000 7fa562200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa55c1571b0 0x7fa55c168060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:07.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.307+0000 7fa562200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c157740 con 0x7fa55c0b3870 2024-04-25T13:42:07.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.307+0000 7fa562200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa55c1575c0 con 0x7fa55c072af0 2024-04-25T13:42:07.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.307+0000 7fa562200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa55c073850 con 0x7fa55c1571b0 2024-04-25T13:42:07.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.307+0000 7fa552a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa55c0b3870 0x7fa55c14f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:07.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.311+0000 7fa552a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa55c0b3870 0x7fa55c14f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48318/0 (socket says 172.21.15.123:48318) 2024-04-25T13:42:07.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.311+0000 7fa552a00640 1 -- 172.21.15.123:0/1440400488 learned_addr learned my addr 172.21.15.123:0/1440400488 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:07.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.311+0000 7fa55be00640 1 --2- 172.21.15.123:0/1440400488 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa55c1571b0 0x7fa55c168060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:07.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.311+0000 7fa55b400640 1 --2- 172.21.15.123:0/1440400488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa55c072af0 0x7fa55c14f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:07.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.311+0000 7fa552a00640 1 -- 172.21.15.123:0/1440400488 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa55c1571b0 msgr2=0x7fa55c168060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:07.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.311+0000 7fa552a00640 1 --2- 172.21.15.123:0/1440400488 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa55c1571b0 0x7fa55c168060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:07.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.311+0000 7fa552a00640 1 -- 172.21.15.123:0/1440400488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa55c072af0 msgr2=0x7fa55c14f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:07.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.311+0000 7fa552a00640 1 --2- 172.21.15.123:0/1440400488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa55c072af0 0x7fa55c14f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:07.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.311+0000 7fa552a00640 1 -- 172.21.15.123:0/1440400488 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55c14e350 con 0x7fa55c0b3870 2024-04-25T13:42:07.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.311+0000 7fa55b400640 1 --2- 172.21.15.123:0/1440400488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa55c072af0 0x7fa55c14f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:07.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.311+0000 7fa552a00640 1 --2- 172.21.15.123:0/1440400488 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa55c0b3870 0x7fa55c14f930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa54401a0a0 tx=0x7fa54401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:07.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.311+0000 7fa553e00640 1 -- 172.21.15.123:0/1440400488 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5440be610 con 0x7fa55c0b3870 2024-04-25T13:42:07.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.311+0000 7fa553e00640 1 -- 172.21.15.123:0/1440400488 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5440be7d0 con 0x7fa55c0b3870 2024-04-25T13:42:07.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.311+0000 7fa553e00640 1 -- 172.21.15.123:0/1440400488 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5440bebc0 con 0x7fa55c0b3870 2024-04-25T13:42:07.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.311+0000 7fa562200640 1 -- 172.21.15.123:0/1440400488 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa55c14e630 con 0x7fa55c0b3870 2024-04-25T13:42:07.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.311+0000 7fa562200640 1 -- 172.21.15.123:0/1440400488 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa55c14ebf0 con 0x7fa55c0b3870 2024-04-25T13:42:07.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.311+0000 7fa562200640 1 -- 172.21.15.123:0/1440400488 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa55c150ff0 con 0x7fa55c0b3870 2024-04-25T13:42:07.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.311+0000 7fa553e00640 1 -- 172.21.15.123:0/1440400488 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa5440bc020 con 0x7fa55c0b3870 2024-04-25T13:42:07.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.315+0000 7fa553e00640 1 --2- 172.21.15.123:0/1440400488 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa53806f400 0x7fa538071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:07.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.315+0000 7fa553e00640 1 -- 172.21.15.123:0/1440400488 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa544129520 con 0x7fa55c0b3870 2024-04-25T13:42:07.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.315+0000 7fa55b400640 1 --2- 172.21.15.123:0/1440400488 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa53806f400 0x7fa538071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:07.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.315+0000 7fa55b400640 1 --2- 172.21.15.123:0/1440400488 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa53806f400 0x7fa538071910 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa54c000f70 tx=0x7fa54c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:07.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.319+0000 7fa553e00640 1 -- 172.21.15.123:0/1440400488 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa5440c5030 con 0x7fa55c0b3870 2024-04-25T13:42:07.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:07.511+0000 7fa562200640 1 -- 172.21.15.123:0/1440400488 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa55c050750 con 0x7fa55c0b3870 2024-04-25T13:42:08.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.411+0000 7fa553e00640 1 -- 172.21.15.123:0/1440400488 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fa544016090 con 0x7fa55c0b3870 2024-04-25T13:42:08.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.415+0000 7fa562200640 1 -- 172.21.15.123:0/1440400488 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa53806f400 msgr2=0x7fa538071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:08.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.415+0000 7fa562200640 1 --2- 172.21.15.123:0/1440400488 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa53806f400 0x7fa538071910 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa54c000f70 tx=0x7fa54c009040 comp rx=0 tx=0).stop 2024-04-25T13:42:08.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.415+0000 7fa562200640 1 -- 172.21.15.123:0/1440400488 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa55c0b3870 msgr2=0x7fa55c14f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:08.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.415+0000 7fa562200640 1 --2- 172.21.15.123:0/1440400488 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa55c0b3870 0x7fa55c14f930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa54401a0a0 tx=0x7fa54401acb0 comp rx=0 tx=0).stop 2024-04-25T13:42:08.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.415+0000 7fa562200640 1 -- 172.21.15.123:0/1440400488 shutdown_connections 2024-04-25T13:42:08.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.415+0000 7fa562200640 1 --2- 172.21.15.123:0/1440400488 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa53806f400 0x7fa538071910 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:08.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.415+0000 7fa562200640 1 --2- 172.21.15.123:0/1440400488 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa55c1571b0 0x7fa55c168060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:08.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.415+0000 7fa562200640 1 --2- 172.21.15.123:0/1440400488 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa55c0b3870 0x7fa55c14f930 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:08.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.415+0000 7fa562200640 1 --2- 172.21.15.123:0/1440400488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa55c072af0 0x7fa55c14f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:08.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.415+0000 7fa562200640 1 -- 172.21.15.123:0/1440400488 >> 172.21.15.123:0/1440400488 conn(0x7fa55c06ca70 msgr2=0x7fa55c0ceaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:08.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.415+0000 7fa562200640 1 -- 172.21.15.123:0/1440400488 shutdown_connections 2024-04-25T13:42:08.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.415+0000 7fa562200640 1 -- 172.21.15.123:0/1440400488 wait complete. 2024-04-25T13:42:08.441 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T13:42:08.442 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T13:42:08.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.591+0000 7fb8dfe00640 1 Processor -- start 2024-04-25T13:42:08.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.591+0000 7fb8dfe00640 1 -- start start 2024-04-25T13:42:08.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.595+0000 7fb8dfe00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb8e015cb70 0x7fb8e00b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:08.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.595+0000 7fb8dfe00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb8e006f330 0x7fb8e006f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:08.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.595+0000 7fb8dfe00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb8e00b4430 0x7fb8e00b4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:08.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.595+0000 7fb8dfe00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb8e00b5f20 con 0x7fb8e00b4430 2024-04-25T13:42:08.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.595+0000 7fb8dfe00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fb8e006eea0 con 0x7fb8e015cb70 2024-04-25T13:42:08.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.595+0000 7fb8dfe00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb8e00b4d80 con 0x7fb8e006f330 2024-04-25T13:42:08.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.595+0000 7fb8df400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb8e00b4430 0x7fb8e00b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:08.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.595+0000 7fb8df400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb8e00b4430 0x7fb8e00b4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48328/0 (socket says 172.21.15.123:48328) 2024-04-25T13:42:08.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.595+0000 7fb8df400640 1 -- 172.21.15.123:0/1819174864 learned_addr learned my addr 172.21.15.123:0/1819174864 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:08.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.595+0000 7fb8dea00640 1 --2- 172.21.15.123:0/1819174864 >> v2:172.21.15.130:3300/0 conn(0x7fb8e015cb70 0x7fb8e00b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:08.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.595+0000 7fb8d6000640 1 --2- 172.21.15.123:0/1819174864 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb8e006f330 0x7fb8e006f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:08.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.595+0000 7fb8df400640 1 -- 172.21.15.123:0/1819174864 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb8e006f330 msgr2=0x7fb8e006f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:08.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.595+0000 7fb8df400640 1 --2- 172.21.15.123:0/1819174864 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb8e006f330 0x7fb8e006f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:08.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.595+0000 7fb8df400640 1 -- 172.21.15.123:0/1819174864 >> v2:172.21.15.130:3300/0 conn(0x7fb8e015cb70 msgr2=0x7fb8e00b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:08.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.595+0000 7fb8df400640 1 --2- 172.21.15.123:0/1819174864 >> v2:172.21.15.130:3300/0 conn(0x7fb8e015cb70 0x7fb8e00b60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:08.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.595+0000 7fb8df400640 1 -- 172.21.15.123:0/1819174864 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e00d18f0 con 0x7fb8e00b4430 2024-04-25T13:42:08.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.599+0000 7fb8df400640 1 --2- 172.21.15.123:0/1819174864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8e00b4430 0x7fb8e00b4840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb8e00d23b0 tx=0x7fb8d801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e636364ac9778f4f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:08.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.599+0000 7fb8de000640 1 -- 172.21.15.123:0/1819174864 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d80a5750 con 0x7fb8e00b4430 2024-04-25T13:42:08.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.599+0000 7fb8de000640 1 -- 172.21.15.123:0/1819174864 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8d80a58f0 con 0x7fb8e00b4430 2024-04-25T13:42:08.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.599+0000 7fb8de000640 1 -- 172.21.15.123:0/1819174864 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d80a5cc0 con 0x7fb8e00b4430 2024-04-25T13:42:08.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.599+0000 7fb8dfe00640 1 -- 172.21.15.123:0/1819174864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8e00b4430 msgr2=0x7fb8e00b4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:08.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.599+0000 7fb8dfe00640 1 --2- 172.21.15.123:0/1819174864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8e00b4430 0x7fb8e00b4840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb8e00d23b0 tx=0x7fb8d801c9c0 comp rx=0 tx=0).stop 2024-04-25T13:42:08.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.599+0000 7fb8dfe00640 1 -- 172.21.15.123:0/1819174864 shutdown_connections 2024-04-25T13:42:08.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.599+0000 7fb8dfe00640 1 --2- 172.21.15.123:0/1819174864 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8e00b4430 0x7fb8e00b4840 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:08.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.599+0000 7fb8dfe00640 1 --2- 172.21.15.123:0/1819174864 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb8e006f330 0x7fb8e006f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:08.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.599+0000 7fb8dfe00640 1 --2- 172.21.15.123:0/1819174864 >> v2:172.21.15.130:3300/0 conn(0x7fb8e015cb70 0x7fb8e00b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:08.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.599+0000 7fb8dfe00640 1 -- 172.21.15.123:0/1819174864 >> 172.21.15.123:0/1819174864 conn(0x7fb8e006c840 msgr2=0x7fb8e006cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:08.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.599+0000 7fb8dfe00640 1 -- 172.21.15.123:0/1819174864 shutdown_connections 2024-04-25T13:42:08.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.599+0000 7fb8dfe00640 1 -- 172.21.15.123:0/1819174864 wait complete. 2024-04-25T13:42:08.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.603+0000 7fb8dfe00640 1 Processor -- start 2024-04-25T13:42:08.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.603+0000 7fb8dfe00640 1 -- start start 2024-04-25T13:42:08.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.603+0000 7fb8dfe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8e006f330 0x7fb8e014a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:08.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.603+0000 7fb8dfe00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb8e00b4430 0x7fb8e01fcaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:08.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.603+0000 7fb8dfe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8e015cb70 0x7fb8e01fcfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:08.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.603+0000 7fb8dfe00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e00d1eb0 con 0x7fb8e015cb70 2024-04-25T13:42:08.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.603+0000 7fb8dfe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e00b6620 con 0x7fb8e006f330 2024-04-25T13:42:08.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.603+0000 7fb8dfe00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb8e0160740 con 0x7fb8e00b4430 2024-04-25T13:42:08.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.603+0000 7fb8df400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8e015cb70 0x7fb8e01fcfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:08.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.603+0000 7fb8df400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8e015cb70 0x7fb8e01fcfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48342/0 (socket says 172.21.15.123:48342) 2024-04-25T13:42:08.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.603+0000 7fb8df400640 1 -- 172.21.15.123:0/3572019606 learned_addr learned my addr 172.21.15.123:0/3572019606 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:08.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.603+0000 7fb8dea00640 1 --2- 172.21.15.123:0/3572019606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8e006f330 0x7fb8e014a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:08.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.603+0000 7fb8d6000640 1 --2- 172.21.15.123:0/3572019606 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb8e00b4430 0x7fb8e01fcaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:08.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.603+0000 7fb8df400640 1 -- 172.21.15.123:0/3572019606 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb8e00b4430 msgr2=0x7fb8e01fcaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:08.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.603+0000 7fb8df400640 1 --2- 172.21.15.123:0/3572019606 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb8e00b4430 0x7fb8e01fcaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:08.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.603+0000 7fb8df400640 1 -- 172.21.15.123:0/3572019606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8e006f330 msgr2=0x7fb8e014a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:08.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.603+0000 7fb8df400640 1 --2- 172.21.15.123:0/3572019606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8e006f330 0x7fb8e014a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:08.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.603+0000 7fb8df400640 1 -- 172.21.15.123:0/3572019606 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e014b260 con 0x7fb8e015cb70 2024-04-25T13:42:08.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.603+0000 7fb8d6000640 1 --2- 172.21.15.123:0/3572019606 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb8e00b4430 0x7fb8e01fcaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:08.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.603+0000 7fb8dea00640 1 --2- 172.21.15.123:0/3572019606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8e006f330 0x7fb8e014a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:08.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.603+0000 7fb8df400640 1 --2- 172.21.15.123:0/3572019606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8e015cb70 0x7fb8e01fcfe0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb8d80af040 tx=0x7fb8d8019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:08.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.607+0000 7fb8d7400640 1 -- 172.21.15.123:0/3572019606 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d80b8670 con 0x7fb8e015cb70 2024-04-25T13:42:08.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.607+0000 7fb8d7400640 1 -- 172.21.15.123:0/3572019606 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8d80be070 con 0x7fb8e015cb70 2024-04-25T13:42:08.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.607+0000 7fb8d7400640 1 -- 172.21.15.123:0/3572019606 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d80b8a90 con 0x7fb8e015cb70 2024-04-25T13:42:08.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.607+0000 7fb8dfe00640 1 -- 172.21.15.123:0/3572019606 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e014b540 con 0x7fb8e015cb70 2024-04-25T13:42:08.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.607+0000 7fb8dfe00640 1 -- 172.21.15.123:0/3572019606 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8e014ad20 con 0x7fb8e015cb70 2024-04-25T13:42:08.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.607+0000 7fb8dfe00640 1 -- 172.21.15.123:0/3572019606 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8e0050750 con 0x7fb8e015cb70 2024-04-25T13:42:08.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.607+0000 7fb8d7400640 1 -- 172.21.15.123:0/3572019606 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb8d80b8c30 con 0x7fb8e015cb70 2024-04-25T13:42:08.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.607+0000 7fb8d7400640 1 --2- 172.21.15.123:0/3572019606 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb8bc06f400 0x7fb8bc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:08.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.607+0000 7fb8d7400640 1 -- 172.21.15.123:0/3572019606 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb8d812a4a0 con 0x7fb8e015cb70 2024-04-25T13:42:08.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.607+0000 7fb8dea00640 1 --2- 172.21.15.123:0/3572019606 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb8bc06f400 0x7fb8bc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:08.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.611+0000 7fb8dea00640 1 --2- 172.21.15.123:0/3572019606 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb8bc06f400 0x7fb8bc071910 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000b9f0 tx=0x7fb8d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:08.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.611+0000 7fb8d7400640 1 -- 172.21.15.123:0/3572019606 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb8d80165e0 con 0x7fb8e015cb70 2024-04-25T13:42:08.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:08.803+0000 7fb8dfe00640 1 -- 172.21.15.123:0/3572019606 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb8e0070220 con 0x7fb8e015cb70 2024-04-25T13:42:09.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.419+0000 7fb8d7400640 1 -- 172.21.15.123:0/3572019606 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7fb8d80f7390 con 0x7fb8e015cb70 2024-04-25T13:42:09.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.423+0000 7fb8dfe00640 1 -- 172.21.15.123:0/3572019606 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb8bc06f400 msgr2=0x7fb8bc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:09.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.423+0000 7fb8dfe00640 1 --2- 172.21.15.123:0/3572019606 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb8bc06f400 0x7fb8bc071910 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000b9f0 tx=0x7fb8d0008040 comp rx=0 tx=0).stop 2024-04-25T13:42:09.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.423+0000 7fb8dfe00640 1 -- 172.21.15.123:0/3572019606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8e015cb70 msgr2=0x7fb8e01fcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:09.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.423+0000 7fb8dfe00640 1 --2- 172.21.15.123:0/3572019606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8e015cb70 0x7fb8e01fcfe0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb8d80af040 tx=0x7fb8d8019760 comp rx=0 tx=0).stop 2024-04-25T13:42:09.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.423+0000 7fb8dfe00640 1 -- 172.21.15.123:0/3572019606 shutdown_connections 2024-04-25T13:42:09.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.423+0000 7fb8dfe00640 1 --2- 172.21.15.123:0/3572019606 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb8bc06f400 0x7fb8bc071910 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:09.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.423+0000 7fb8dfe00640 1 --2- 172.21.15.123:0/3572019606 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb8e015cb70 0x7fb8e01fcfe0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:09.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.423+0000 7fb8dfe00640 1 --2- 172.21.15.123:0/3572019606 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb8e00b4430 0x7fb8e01fcaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:09.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.423+0000 7fb8dfe00640 1 --2- 172.21.15.123:0/3572019606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8e006f330 0x7fb8e014a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:09.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.423+0000 7fb8dfe00640 1 -- 172.21.15.123:0/3572019606 >> 172.21.15.123:0/3572019606 conn(0x7fb8e006c840 msgr2=0x7fb8e015d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:09.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.423+0000 7fb8dfe00640 1 -- 172.21.15.123:0/3572019606 shutdown_connections 2024-04-25T13:42:09.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.423+0000 7fb8dfe00640 1 -- 172.21.15.123:0/3572019606 wait complete. 2024-04-25T13:42:09.444 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T13:42:09.444 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:42:09.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.591+0000 7f2d27e00640 1 Processor -- start 2024-04-25T13:42:09.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.591+0000 7f2d27e00640 1 -- start start 2024-04-25T13:42:09.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.591+0000 7f2d27e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2d2806dcb0 0x7f2d2809caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:09.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.591+0000 7f2d27e00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2d2806e800 0x7f2d280b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:09.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.591+0000 7f2d27e00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d280d2eb0 con 0x7f2d2806e3f0 2024-04-25T13:42:09.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.591+0000 7f2d27e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f2d2809cfe0 con 0x7f2d2806dcb0 2024-04-25T13:42:09.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.591+0000 7f2d27e00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f2d280b91b0 con 0x7f2d2806e800 2024-04-25T13:42:09.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.591+0000 7f2d26a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2d2806dcb0 0x7f2d2809caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:09.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.591+0000 7f2d26a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2d2806dcb0 0x7f2d2809caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48356/0 (socket says 172.21.15.123:48356) 2024-04-25T13:42:09.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.591+0000 7f2d26a00640 1 -- 172.21.15.123:0/3066062267 learned_addr learned my addr 172.21.15.123:0/3066062267 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:09.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.591+0000 7f2d27400640 1 --2- 172.21.15.123:0/3066062267 >> v2:172.21.15.130:3300/0 conn(0x7f2d2806e800 0x7f2d280b75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:09.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.591+0000 7f2d26a00640 1 -- 172.21.15.123:0/3066062267 >> v2:172.21.15.130:3300/0 conn(0x7f2d2806e800 msgr2=0x7f2d280b75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:09.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.591+0000 7f2d26a00640 1 --2- 172.21.15.123:0/3066062267 >> v2:172.21.15.130:3300/0 conn(0x7f2d2806e800 0x7f2d280b75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:09.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.591+0000 7f2d26a00640 1 -- 172.21.15.123:0/3066062267 >> v1:172.21.15.130:6789/0 conn(0x7f2d2806e3f0 legacy=0x7f2d280b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:09.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.591+0000 7f2d26a00640 1 -- 172.21.15.123:0/3066062267 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d280b8a70 con 0x7f2d2806dcb0 2024-04-25T13:42:09.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.595+0000 7f2d26a00640 1 --2- 172.21.15.123:0/3066062267 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d2806dcb0 0x7f2d2809caa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2d280b9330 tx=0x7f2d1801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22046e881a03c9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:09.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.595+0000 7f2d26000640 1 -- 172.21.15.123:0/3066062267 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d180b0070 con 0x7f2d2806dcb0 2024-04-25T13:42:09.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.595+0000 7f2d26000640 1 -- 172.21.15.123:0/3066062267 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d180ab600 con 0x7f2d2806dcb0 2024-04-25T13:42:09.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.595+0000 7f2d26000640 1 -- 172.21.15.123:0/3066062267 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d180ab9d0 con 0x7f2d2806dcb0 2024-04-25T13:42:09.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.595+0000 7f2d27e00640 1 -- 172.21.15.123:0/3066062267 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d2806dcb0 msgr2=0x7f2d2809caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:09.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.595+0000 7f2d27e00640 1 --2- 172.21.15.123:0/3066062267 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d2806dcb0 0x7f2d2809caa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2d280b9330 tx=0x7f2d1801c430 comp rx=0 tx=0).stop 2024-04-25T13:42:09.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.595+0000 7f2d27e00640 1 -- 172.21.15.123:0/3066062267 shutdown_connections 2024-04-25T13:42:09.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.595+0000 7f2d27e00640 1 --2- 172.21.15.123:0/3066062267 >> v2:172.21.15.130:3300/0 conn(0x7f2d2806e800 0x7f2d280b75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:09.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.595+0000 7f2d27e00640 1 --2- 172.21.15.123:0/3066062267 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d2806dcb0 0x7f2d2809caa0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:09.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.595+0000 7f2d27e00640 1 -- 172.21.15.123:0/3066062267 >> 172.21.15.123:0/3066062267 conn(0x7f2d280d00c0 msgr2=0x7f2d280d04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:09.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.595+0000 7f2d27e00640 1 -- 172.21.15.123:0/3066062267 shutdown_connections 2024-04-25T13:42:09.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.595+0000 7f2d27e00640 1 -- 172.21.15.123:0/3066062267 wait complete. 2024-04-25T13:42:09.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.599+0000 7f2d27e00640 1 Processor -- start 2024-04-25T13:42:09.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.599+0000 7f2d27e00640 1 -- start start 2024-04-25T13:42:09.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.599+0000 7f2d27e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d2806dcb0 0x7f2d28153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:09.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.599+0000 7f2d27e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d2806e3f0 0x7f2d280b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:09.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.599+0000 7f2d27e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d2806e800 0x7f2d2809fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:09.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.599+0000 7f2d27e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2d280d2230 con 0x7f2d2806e3f0 2024-04-25T13:42:09.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.599+0000 7f2d27e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2d280b7af0 con 0x7f2d2806dcb0 2024-04-25T13:42:09.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.599+0000 7f2d27e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2d280d23b0 con 0x7f2d2806e800 2024-04-25T13:42:09.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.599+0000 7f2d26a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d2806dcb0 0x7f2d28153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:09.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.599+0000 7f2d1e000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d2806e3f0 0x7f2d280b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:09.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.599+0000 7f2d27400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d2806e800 0x7f2d2809fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:09.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.599+0000 7f2d26a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d2806dcb0 0x7f2d28153a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:33108/0 (socket says 172.21.15.123:33108) 2024-04-25T13:42:09.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.599+0000 7f2d26a00640 1 -- 172.21.15.123:0/4000425236 learned_addr learned my addr 172.21.15.123:0/4000425236 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:09.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.603+0000 7f2d1e000640 1 -- 172.21.15.123:0/4000425236 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d2806e800 msgr2=0x7f2d2809fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:09.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.603+0000 7f2d1e000640 1 --2- 172.21.15.123:0/4000425236 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d2806e800 0x7f2d2809fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:09.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.603+0000 7f2d1e000640 1 -- 172.21.15.123:0/4000425236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d2806dcb0 msgr2=0x7f2d28153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:09.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.603+0000 7f2d1e000640 1 --2- 172.21.15.123:0/4000425236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d2806dcb0 0x7f2d28153a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:09.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.603+0000 7f2d1e000640 1 -- 172.21.15.123:0/4000425236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d281673b0 con 0x7f2d2806e3f0 2024-04-25T13:42:09.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.603+0000 7f2d1e000640 1 --2- 172.21.15.123:0/4000425236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d2806e3f0 0x7f2d280b4390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2d1000b440 tx=0x7f2d1000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:09.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.603+0000 7f2d1f400640 1 -- 172.21.15.123:0/4000425236 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d10015020 con 0x7f2d2806e3f0 2024-04-25T13:42:09.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.603+0000 7f2d1f400640 1 -- 172.21.15.123:0/4000425236 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d10011830 con 0x7f2d2806e3f0 2024-04-25T13:42:09.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.603+0000 7f2d27e00640 1 -- 172.21.15.123:0/4000425236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d28167690 con 0x7f2d2806e3f0 2024-04-25T13:42:09.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.603+0000 7f2d1f400640 1 -- 172.21.15.123:0/4000425236 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d10011c20 con 0x7f2d2806e3f0 2024-04-25T13:42:09.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.603+0000 7f2d27e00640 1 -- 172.21.15.123:0/4000425236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d280b0540 con 0x7f2d2806e3f0 2024-04-25T13:42:09.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.603+0000 7f2d27e00640 1 -- 172.21.15.123:0/4000425236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d28050750 con 0x7f2d2806e3f0 2024-04-25T13:42:09.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.603+0000 7f2d1f400640 1 -- 172.21.15.123:0/4000425236 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2d10018020 con 0x7f2d2806e3f0 2024-04-25T13:42:09.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.603+0000 7f2d1f400640 1 --2- 172.21.15.123:0/4000425236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f2d0406f430 0x7f2d04071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:09.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.603+0000 7f2d1f400640 1 -- 172.21.15.123:0/4000425236 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2d1008ec10 con 0x7f2d2806e3f0 2024-04-25T13:42:09.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.603+0000 7f2d26a00640 1 --2- 172.21.15.123:0/4000425236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f2d0406f430 0x7f2d04071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:09.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.607+0000 7f2d26a00640 1 --2- 172.21.15.123:0/4000425236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f2d0406f430 0x7f2d04071940 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2d18000c10 tx=0x7f2d180a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:09.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.611+0000 7f2d1f400640 1 -- 172.21.15.123:0/4000425236 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2d1001f030 con 0x7f2d2806e3f0 2024-04-25T13:42:09.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.799+0000 7f2d27e00640 1 -- 172.21.15.123:0/4000425236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d280b1da0 con 0x7f2d2806e3f0 2024-04-25T13:42:09.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.799+0000 7f2d1f400640 1 -- 172.21.15.123:0/4000425236 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f2d1005b540 con 0x7f2d2806e3f0 2024-04-25T13:42:09.803 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:09.803 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6836/1018722177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1018722177},{"type":"v1","addr":"172.21.15.123:6836","nonce":1018722177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/606716425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":606716425},{"type":"v1","addr":"172.21.15.123:6837","nonce":606716425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/466677289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":466677289},{"type":"v1","addr":"172.21.15.130:6835","nonce":466677289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:42:05.806897+0000","modified":"2024-04-25T13:42:08.807565+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6834/1645626215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1645626215},{"type":"v1","addr":"172.21.15.130:6834","nonce":1645626215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T13:42:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 8 2024-04-25T13:42:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.803+0000 7f2d27e00640 1 -- 172.21.15.123:0/4000425236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f2d0406f430 msgr2=0x7f2d04071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.803+0000 7f2d27e00640 1 --2- 172.21.15.123:0/4000425236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f2d0406f430 0x7f2d04071940 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2d18000c10 tx=0x7f2d180a6000 comp rx=0 tx=0).stop 2024-04-25T13:42:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.803+0000 7f2d27e00640 1 -- 172.21.15.123:0/4000425236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d2806e3f0 msgr2=0x7f2d280b4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.803+0000 7f2d27e00640 1 --2- 172.21.15.123:0/4000425236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d2806e3f0 0x7f2d280b4390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2d1000b440 tx=0x7f2d1000b900 comp rx=0 tx=0).stop 2024-04-25T13:42:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.803+0000 7f2d27e00640 1 -- 172.21.15.123:0/4000425236 shutdown_connections 2024-04-25T13:42:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.803+0000 7f2d27e00640 1 --2- 172.21.15.123:0/4000425236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f2d0406f430 0x7f2d04071940 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.803+0000 7f2d27e00640 1 --2- 172.21.15.123:0/4000425236 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2d2806e800 0x7f2d2809fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.803+0000 7f2d27e00640 1 --2- 172.21.15.123:0/4000425236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d2806e3f0 0x7f2d280b4390 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.803+0000 7f2d27e00640 1 --2- 172.21.15.123:0/4000425236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d2806dcb0 0x7f2d28153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:09.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.803+0000 7f2d27e00640 1 -- 172.21.15.123:0/4000425236 >> 172.21.15.123:0/4000425236 conn(0x7f2d280d00c0 msgr2=0x7f2d2809dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:09.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.803+0000 7f2d27e00640 1 -- 172.21.15.123:0/4000425236 shutdown_connections 2024-04-25T13:42:09.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.803+0000 7f2d27e00640 1 -- 172.21.15.123:0/4000425236 wait complete. 2024-04-25T13:42:09.824 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:09.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.966+0000 7f57f5e00640 1 Processor -- start 2024-04-25T13:42:09.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.966+0000 7f57f5e00640 1 -- start start 2024-04-25T13:42:09.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.970+0000 7f57f5e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57f01604b0 0x7f57f0168140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:09.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.970+0000 7f57f5e00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57f00b3a70 con 0x7f57f00b5670 2024-04-25T13:42:09.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.970+0000 7f57f5e00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57f0145d70 con 0x7f57f00747a0 2024-04-25T13:42:09.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.970+0000 7f57f5e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f57f0074290 con 0x7f57f01604b0 2024-04-25T13:42:09.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.970+0000 7f57e6000640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f57f00b5670 0x7f57f015fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53172/0 (socket says 172.21.15.123:53172) 2024-04-25T13:42:09.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.970+0000 7f57e6000640 1 -- 172.21.15.123:0/2131429522 learned_addr learned my addr 172.21.15.123:0/2131429522 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:09.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.970+0000 7f57ef400640 1 --2- 172.21.15.123:0/2131429522 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57f01604b0 0x7f57f0168140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:09.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.970+0000 7f57ee000640 1 -- 172.21.15.123:0/2131429522 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2441301062 0 0) 0x7f57f00b3a70 con 0x7f57f00b5670 2024-04-25T13:42:09.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.970+0000 7f57ee000640 1 -- 172.21.15.123:0/2131429522 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57d4005740 con 0x7f57f00b5670 2024-04-25T13:42:09.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.970+0000 7f57ee000640 1 -- 172.21.15.123:0/2131429522 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1316506440 0 0) 0x7f57e00014a0 con 0x7f57f00747a0 2024-04-25T13:42:09.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.970+0000 7f57ee000640 1 -- 172.21.15.123:0/2131429522 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57f00b3a70 con 0x7f57f00747a0 2024-04-25T13:42:09.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.970+0000 7f57ef400640 1 -- 172.21.15.123:0/2131429522 >> v1:172.21.15.130:6789/0 conn(0x7f57f00747a0 legacy=0x7f57f00b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:09.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.970+0000 7f57ee000640 1 -- 172.21.15.123:0/2131429522 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 751076368 0 0) 0x7f57d4005740 con 0x7f57f00b5670 2024-04-25T13:42:09.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.970+0000 7f57ef400640 1 -- 172.21.15.123:0/2131429522 >> v1:172.21.15.123:6789/0 conn(0x7f57f00b5670 legacy=0x7f57f015fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:09.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.970+0000 7f57ef400640 1 -- 172.21.15.123:0/2131429522 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f0073c80 con 0x7f57f01604b0 2024-04-25T13:42:09.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.974+0000 7f57ef400640 1 --2- 172.21.15.123:0/2131429522 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57f01604b0 0x7f57f0168140 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f57e80097f0 tx=0x7f57e801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8c819c50f0dc4a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:09.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.974+0000 7f57ee000640 1 -- 172.21.15.123:0/2131429522 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e80b0070 con 0x7f57f01604b0 2024-04-25T13:42:09.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.974+0000 7f57ee000640 1 -- 172.21.15.123:0/2131429522 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57e80ab400 con 0x7f57f01604b0 2024-04-25T13:42:09.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.974+0000 7f57ee000640 1 -- 172.21.15.123:0/2131429522 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d8001680 con 0x7f57f01604b0 2024-04-25T13:42:09.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.974+0000 7f57f5e00640 1 -- 172.21.15.123:0/2131429522 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57f01604b0 msgr2=0x7f57f0168140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:09.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.974+0000 7f57f5e00640 1 --2- 172.21.15.123:0/2131429522 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57f01604b0 0x7f57f0168140 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f57e80097f0 tx=0x7f57e801c400 comp rx=0 tx=0).stop 2024-04-25T13:42:09.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.974+0000 7f57f5e00640 1 -- 172.21.15.123:0/2131429522 shutdown_connections 2024-04-25T13:42:09.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.974+0000 7f57f5e00640 1 --2- 172.21.15.123:0/2131429522 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57f01604b0 0x7f57f0168140 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:09.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.974+0000 7f57f5e00640 1 -- 172.21.15.123:0/2131429522 >> 172.21.15.123:0/2131429522 conn(0x7f57f006d210 msgr2=0x7f57f006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:09.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.974+0000 7f57f5e00640 1 -- 172.21.15.123:0/2131429522 shutdown_connections 2024-04-25T13:42:09.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.974+0000 7f57f5e00640 1 -- 172.21.15.123:0/2131429522 wait complete. 2024-04-25T13:42:09.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.978+0000 7f57f5e00640 1 Processor -- start 2024-04-25T13:42:09.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.978+0000 7f57f5e00640 1 -- start start 2024-04-25T13:42:09.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.978+0000 7f57f5e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57f00747a0 0x7f57f00cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:09.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.978+0000 7f57f5e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57f00b5670 0x7f57f01f8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:09.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.978+0000 7f57f5e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57f0158730 0x7f57f013cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:09.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.978+0000 7f57f5e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f57f00b6380 con 0x7f57f00747a0 2024-04-25T13:42:09.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.978+0000 7f57f5e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f57f0074bb0 con 0x7f57f00b5670 2024-04-25T13:42:09.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.978+0000 7f57f5e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f57f00b6500 con 0x7f57f0158730 2024-04-25T13:42:09.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.978+0000 7f57eea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57f00747a0 0x7f57f00cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:09.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.978+0000 7f57eea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57f00747a0 0x7f57f00cf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37052/0 (socket says 172.21.15.123:37052) 2024-04-25T13:42:09.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.978+0000 7f57eea00640 1 -- 172.21.15.123:0/848593451 learned_addr learned my addr 172.21.15.123:0/848593451 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:09.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.978+0000 7f57ef400640 1 --2- 172.21.15.123:0/848593451 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57f0158730 0x7f57f013cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:09.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.978+0000 7f57e6000640 1 --2- 172.21.15.123:0/848593451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57f00b5670 0x7f57f01f8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:09.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.978+0000 7f57eea00640 1 -- 172.21.15.123:0/848593451 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57f0158730 msgr2=0x7f57f013cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:09.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.978+0000 7f57eea00640 1 --2- 172.21.15.123:0/848593451 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57f0158730 0x7f57f013cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:09.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.978+0000 7f57eea00640 1 -- 172.21.15.123:0/848593451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57f00b5670 msgr2=0x7f57f01f8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:09.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.978+0000 7f57eea00640 1 --2- 172.21.15.123:0/848593451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57f00b5670 0x7f57f01f8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:09.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.978+0000 7f57eea00640 1 -- 172.21.15.123:0/848593451 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f0141f80 con 0x7f57f00747a0 2024-04-25T13:42:09.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.978+0000 7f57eea00640 1 --2- 172.21.15.123:0/848593451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57f00747a0 0x7f57f00cf1b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f57e0001640 tx=0x7f57e000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:09.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.982+0000 7f57e7e00640 1 -- 172.21.15.123:0/848593451 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e0003b80 con 0x7f57f00747a0 2024-04-25T13:42:09.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.982+0000 7f57e7e00640 1 -- 172.21.15.123:0/848593451 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57e0003d20 con 0x7f57f00747a0 2024-04-25T13:42:09.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.982+0000 7f57e7e00640 1 -- 172.21.15.123:0/848593451 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57e000aa50 con 0x7f57f00747a0 2024-04-25T13:42:09.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.982+0000 7f57f5e00640 1 -- 172.21.15.123:0/848593451 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57f00cf9a0 con 0x7f57f00747a0 2024-04-25T13:42:09.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.982+0000 7f57f5e00640 1 -- 172.21.15.123:0/848593451 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57f00cff60 con 0x7f57f00747a0 2024-04-25T13:42:09.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.982+0000 7f57f5e00640 1 -- 172.21.15.123:0/848593451 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57f00507c0 con 0x7f57f00747a0 2024-04-25T13:42:09.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.982+0000 7f57e7e00640 1 -- 172.21.15.123:0/848593451 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f57e000abf0 con 0x7f57f00747a0 2024-04-25T13:42:09.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.982+0000 7f57e7e00640 1 --2- 172.21.15.123:0/848593451 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f57cc06f400 0x7f57cc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:09.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.982+0000 7f57e7e00640 1 -- 172.21.15.123:0/848593451 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f57e008f260 con 0x7f57f00747a0 2024-04-25T13:42:09.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.982+0000 7f57e6000640 1 --2- 172.21.15.123:0/848593451 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f57cc06f400 0x7f57cc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:09.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.986+0000 7f57e6000640 1 --2- 172.21.15.123:0/848593451 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f57cc06f400 0x7f57cc071910 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f57f00b6fa0 tx=0x7f57d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:09.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:09.990+0000 7f57e7e00640 1 -- 172.21.15.123:0/848593451 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f57f0145d70 con 0x7f57f00747a0 2024-04-25T13:42:10.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.146+0000 7f57f5e00640 1 -- 172.21.15.123:0/848593451 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f57f00b6780 con 0x7f57f00747a0 2024-04-25T13:42:10.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.146+0000 7f57e7e00640 1 -- 172.21.15.123:0/848593451 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16629 (secure 0 0 0) 0x7f57e005c140 con 0x7f57f00747a0 2024-04-25T13:42:10.150 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:10.150 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:42:07.405529+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:03.949161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:04.755682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:10.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.150+0000 7f57f5e00640 1 -- 172.21.15.123:0/848593451 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f57cc06f400 msgr2=0x7f57cc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:10.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.150+0000 7f57f5e00640 1 --2- 172.21.15.123:0/848593451 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f57cc06f400 0x7f57cc071910 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f57f00b6fa0 tx=0x7f57d8009040 comp rx=0 tx=0).stop 2024-04-25T13:42:10.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.150+0000 7f57f5e00640 1 -- 172.21.15.123:0/848593451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57f00747a0 msgr2=0x7f57f00cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:10.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.150+0000 7f57f5e00640 1 --2- 172.21.15.123:0/848593451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57f00747a0 0x7f57f00cf1b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f57e0001640 tx=0x7f57e000ccd0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.150+0000 7f57f5e00640 1 -- 172.21.15.123:0/848593451 shutdown_connections 2024-04-25T13:42:10.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.150+0000 7f57f5e00640 1 --2- 172.21.15.123:0/848593451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57f00b5670 0x7f57f01f8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.150+0000 7f57f5e00640 1 --2- 172.21.15.123:0/848593451 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f57cc06f400 0x7f57cc071910 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.150+0000 7f57f5e00640 1 --2- 172.21.15.123:0/848593451 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57f0158730 0x7f57f013cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.150+0000 7f57f5e00640 1 --2- 172.21.15.123:0/848593451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57f00747a0 0x7f57f00cf1b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.150+0000 7f57f5e00640 1 -- 172.21.15.123:0/848593451 >> 172.21.15.123:0/848593451 conn(0x7f57f006d210 msgr2=0x7f57f0068590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:10.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.150+0000 7f57f5e00640 1 -- 172.21.15.123:0/848593451 shutdown_connections 2024-04-25T13:42:10.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.150+0000 7f57f5e00640 1 -- 172.21.15.123:0/848593451 wait complete. 2024-04-25T13:42:10.171 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T13:42:10.172 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:42:10.221 INFO:tasks.ceph.mds.b.smithi130.stderr:2024-04-25T13:42:10.221+0000 7f2692800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T13:42:10.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.314+0000 7f8f9d400640 1 Processor -- start 2024-04-25T13:42:10.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.314+0000 7f8f9d400640 1 -- start start 2024-04-25T13:42:10.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.318+0000 7f8f9d400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8f980cfc70 0x7f8f98073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:10.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.318+0000 7f8f9d400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8f980b14a0 0x7f8f98167890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:10.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.318+0000 7f8f9d400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f980745b0 con 0x7f8f98158400 2024-04-25T13:42:10.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.318+0000 7f8f9d400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f8f9809ff00 con 0x7f8f980cfc70 2024-04-25T13:42:10.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.318+0000 7f8f9d400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8f980aede0 con 0x7f8f980b14a0 2024-04-25T13:42:10.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.318+0000 7f8f96800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8f980cfc70 0x7f8f98073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:10.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.318+0000 7f8f96800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8f980cfc70 0x7f8f98073ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37056/0 (socket says 172.21.15.123:37056) 2024-04-25T13:42:10.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.318+0000 7f8f96800640 1 -- 172.21.15.123:0/3739191263 learned_addr learned my addr 172.21.15.123:0/3739191263 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:10.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.318+0000 7f8f97200640 1 --2- 172.21.15.123:0/3739191263 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8f980b14a0 0x7f8f98167890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:10.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.318+0000 7f8f96800640 1 -- 172.21.15.123:0/3739191263 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8f980b14a0 msgr2=0x7f8f98167890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:10.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.318+0000 7f8f96800640 1 --2- 172.21.15.123:0/3739191263 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8f980b14a0 0x7f8f98167890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.318+0000 7f8f96800640 1 -- 172.21.15.123:0/3739191263 >> v1:172.21.15.130:6789/0 conn(0x7f8f98158400 legacy=0x7f8f980b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:10.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.318+0000 7f8f96800640 1 -- 172.21.15.123:0/3739191263 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f980af0c0 con 0x7f8f980cfc70 2024-04-25T13:42:10.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.318+0000 7f8f97200640 1 --2- 172.21.15.123:0/3739191263 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8f980b14a0 0x7f8f98167890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:10.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.318+0000 7f8f96800640 1 --2- 172.21.15.123:0/3739191263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f980cfc70 0x7f8f98073ed0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009870 tx=0x7f8f8801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b971a42f41e08fa4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:10.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.318+0000 7f8f95400640 1 -- 172.21.15.123:0/3739191263 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f880a7070 con 0x7f8f980cfc70 2024-04-25T13:42:10.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.318+0000 7f8f95400640 1 -- 172.21.15.123:0/3739191263 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f880b0070 con 0x7f8f980cfc70 2024-04-25T13:42:10.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.318+0000 7f8f95400640 1 -- 172.21.15.123:0/3739191263 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f880ab890 con 0x7f8f980cfc70 2024-04-25T13:42:10.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.322+0000 7f8f9d400640 1 -- 172.21.15.123:0/3739191263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f980cfc70 msgr2=0x7f8f98073ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:10.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.322+0000 7f8f9d400640 1 --2- 172.21.15.123:0/3739191263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f980cfc70 0x7f8f98073ed0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009870 tx=0x7f8f8801c490 comp rx=0 tx=0).stop 2024-04-25T13:42:10.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.322+0000 7f8f9d400640 1 -- 172.21.15.123:0/3739191263 shutdown_connections 2024-04-25T13:42:10.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.322+0000 7f8f9d400640 1 --2- 172.21.15.123:0/3739191263 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8f980b14a0 0x7f8f98167890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.322+0000 7f8f9d400640 1 --2- 172.21.15.123:0/3739191263 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f980cfc70 0x7f8f98073ed0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.322+0000 7f8f9d400640 1 -- 172.21.15.123:0/3739191263 >> 172.21.15.123:0/3739191263 conn(0x7f8f980733b0 msgr2=0x7f8f980737c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:10.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.322+0000 7f8f9d400640 1 -- 172.21.15.123:0/3739191263 shutdown_connections 2024-04-25T13:42:10.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.322+0000 7f8f9d400640 1 -- 172.21.15.123:0/3739191263 wait complete. 2024-04-25T13:42:10.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.322+0000 7f8f9d400640 1 Processor -- start 2024-04-25T13:42:10.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.322+0000 7f8f9d400640 1 -- start start 2024-04-25T13:42:10.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.326+0000 7f8f9d400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8f980b14a0 0x7f8f98157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:10.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.326+0000 7f8f9d400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f980cfc70 0x7f8f98070900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:10.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.326+0000 7f8f9d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f98158400 0x7f8f981414b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:10.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.326+0000 7f8f9d400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9816a980 con 0x7f8f980cfc70 2024-04-25T13:42:10.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.326+0000 7f8f9d400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9816a800 con 0x7f8f98158400 2024-04-25T13:42:10.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.326+0000 7f8f9d400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8f9816ab00 con 0x7f8f980b14a0 2024-04-25T13:42:10.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.326+0000 7f8f95e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f980cfc70 0x7f8f98070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:10.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.326+0000 7f8f95e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f980cfc70 0x7f8f98070900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37070/0 (socket says 172.21.15.123:37070) 2024-04-25T13:42:10.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.326+0000 7f8f95e00640 1 -- 172.21.15.123:0/1269339679 learned_addr learned my addr 172.21.15.123:0/1269339679 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:10.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.326+0000 7f8f96800640 1 --2- 172.21.15.123:0/1269339679 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8f980b14a0 0x7f8f98157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:10.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.326+0000 7f8f97200640 1 --2- 172.21.15.123:0/1269339679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f98158400 0x7f8f981414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:10.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.326+0000 7f8f95e00640 1 -- 172.21.15.123:0/1269339679 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8f980b14a0 msgr2=0x7f8f98157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:10.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.326+0000 7f8f95e00640 1 --2- 172.21.15.123:0/1269339679 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8f980b14a0 0x7f8f98157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.326+0000 7f8f95e00640 1 -- 172.21.15.123:0/1269339679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f98158400 msgr2=0x7f8f981414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:10.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.326+0000 7f8f95e00640 1 --2- 172.21.15.123:0/1269339679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f98158400 0x7f8f981414b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.326+0000 7f8f95e00640 1 -- 172.21.15.123:0/1269339679 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f9809bba0 con 0x7f8f980cfc70 2024-04-25T13:42:10.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.326+0000 7f8f95e00640 1 --2- 172.21.15.123:0/1269339679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f980cfc70 0x7f8f98070900 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8f8400b410 tx=0x7f8f8400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:10.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.326+0000 7f8f8ea00640 1 -- 172.21.15.123:0/1269339679 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f84015030 con 0x7f8f980cfc70 2024-04-25T13:42:10.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.326+0000 7f8f8ea00640 1 -- 172.21.15.123:0/1269339679 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f84004020 con 0x7f8f980cfc70 2024-04-25T13:42:10.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.326+0000 7f8f8ea00640 1 -- 172.21.15.123:0/1269339679 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f84004410 con 0x7f8f980cfc70 2024-04-25T13:42:10.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.326+0000 7f8f9d400640 1 -- 172.21.15.123:0/1269339679 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f9806fe20 con 0x7f8f980cfc70 2024-04-25T13:42:10.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.326+0000 7f8f9d400640 1 -- 172.21.15.123:0/1269339679 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f9809be80 con 0x7f8f980cfc70 2024-04-25T13:42:10.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.326+0000 7f8f9d400640 1 -- 172.21.15.123:0/1269339679 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f980507c0 con 0x7f8f980cfc70 2024-04-25T13:42:10.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.330+0000 7f8f8ea00640 1 -- 172.21.15.123:0/1269339679 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8f84018070 con 0x7f8f980cfc70 2024-04-25T13:42:10.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.330+0000 7f8f8ea00640 1 --2- 172.21.15.123:0/1269339679 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8f7806f400 0x7f8f78071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:10.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.330+0000 7f8f8ea00640 1 -- 172.21.15.123:0/1269339679 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8f8408ecd0 con 0x7f8f980cfc70 2024-04-25T13:42:10.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.330+0000 7f8f96800640 1 --2- 172.21.15.123:0/1269339679 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8f7806f400 0x7f8f78071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:10.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.330+0000 7f8f96800640 1 --2- 172.21.15.123:0/1269339679 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8f7806f400 0x7f8f78071910 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8f880af000 tx=0x7f8f880a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:10.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.334+0000 7f8f8ea00640 1 -- 172.21.15.123:0/1269339679 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8f8405b5e0 con 0x7f8f980cfc70 2024-04-25T13:42:10.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.486+0000 7f8f9d400640 1 -- 172.21.15.123:0/1269339679 --> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8f980d15f0 con 0x7f8f7806f400 2024-04-25T13:42:10.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.498+0000 7f8f8ea00640 1 -- 172.21.15.123:0/1269339679 <== mgr.4107 v2:172.21.15.123:6832/715752891 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251934 (secure 0 0 0) 0x7f8f980d15f0 con 0x7f8f7806f400 2024-04-25T13:42:10.500 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:10.506 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-04-25T13:42:10.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.498+0000 7f8f9d400640 1 -- 172.21.15.123:0/1269339679 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8f7806f400 msgr2=0x7f8f78071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:10.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.498+0000 7f8f9d400640 1 --2- 172.21.15.123:0/1269339679 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8f7806f400 0x7f8f78071910 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8f880af000 tx=0x7f8f880a7000 comp rx=0 tx=0).stop 2024-04-25T13:42:10.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.498+0000 7f8f9d400640 1 -- 172.21.15.123:0/1269339679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f980cfc70 msgr2=0x7f8f98070900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:10.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.498+0000 7f8f9d400640 1 --2- 172.21.15.123:0/1269339679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f980cfc70 0x7f8f98070900 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8f8400b410 tx=0x7f8f8400b8d0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.502+0000 7f8f9d400640 1 -- 172.21.15.123:0/1269339679 shutdown_connections 2024-04-25T13:42:10.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.502+0000 7f8f9d400640 1 --2- 172.21.15.123:0/1269339679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f98158400 0x7f8f981414b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.502+0000 7f8f9d400640 1 --2- 172.21.15.123:0/1269339679 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8f7806f400 0x7f8f78071910 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.502+0000 7f8f9d400640 1 --2- 172.21.15.123:0/1269339679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f980cfc70 0x7f8f98070900 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.502+0000 7f8f9d400640 1 --2- 172.21.15.123:0/1269339679 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8f980b14a0 0x7f8f98157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.502+0000 7f8f9d400640 1 -- 172.21.15.123:0/1269339679 >> 172.21.15.123:0/1269339679 conn(0x7f8f980733b0 msgr2=0x7f8f980737c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:10.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.502+0000 7f8f9d400640 1 -- 172.21.15.123:0/1269339679 shutdown_connections 2024-04-25T13:42:10.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.502+0000 7f8f9d400640 1 -- 172.21.15.123:0/1269339679 wait complete. 2024-04-25T13:42:10.523 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-25T13:42:09.576869+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219088,"kb_used_data":2884,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755632,"statfs":{"total":773094113280,"available":772869767168,"internally_reserved":0,"allocated":2953216,"data_stored":1774584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,10],"upper_bound":32},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.191387"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.443626+0000","last_change":"2024-04-25T13:42:06.439729+0000","last_active":"2024-04-25T13:42:06.443626+0000","last_peered":"2024-04-25T13:42:06.443626+0000","last_clean":"2024-04-25T13:42:06.443626+0000","last_became_active":"2024-04-25T13:42:06.439449+0000","last_became_peered":"2024-04-25T13:42:06.439449+0000","last_unstale":"2024-04-25T13:42:06.443626+0000","last_undegraded":"2024-04-25T13:42:06.443626+0000","last_fullsized":"2024-04-25T13:42:06.443626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:38.216116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414744+0000","last_change":"2024-04-25T13:42:06.425008+0000","last_active":"2024-04-25T13:42:07.414744+0000","last_peered":"2024-04-25T13:42:07.414744+0000","last_clean":"2024-04-25T13:42:07.414744+0000","last_became_active":"2024-04-25T13:42:06.424669+0000","last_became_peered":"2024-04-25T13:42:06.424669+0000","last_unstale":"2024-04-25T13:42:07.414744+0000","last_undegraded":"2024-04-25T13:42:07.414744+0000","last_fullsized":"2024-04-25T13:42:07.414744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.382442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.433986+0000","last_change":"2024-04-25T13:42:06.425220+0000","last_active":"2024-04-25T13:42:06.433986+0000","last_peered":"2024-04-25T13:42:06.433986+0000","last_clean":"2024-04-25T13:42:06.433986+0000","last_became_active":"2024-04-25T13:42:06.424908+0000","last_became_peered":"2024-04-25T13:42:06.424908+0000","last_unstale":"2024-04-25T13:42:06.433986+0000","last_undegraded":"2024-04-25T13:42:06.433986+0000","last_fullsized":"2024-04-25T13:42:06.433986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:43.962804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416285+0000","last_change":"2024-04-25T13:42:06.437672+0000","last_active":"2024-04-25T13:42:07.416285+0000","last_peered":"2024-04-25T13:42:07.416285+0000","last_clean":"2024-04-25T13:42:07.416285+0000","last_became_active":"2024-04-25T13:42:06.425596+0000","last_became_peered":"2024-04-25T13:42:06.425596+0000","last_unstale":"2024-04-25T13:42:07.416285+0000","last_undegraded":"2024-04-25T13:42:07.416285+0000","last_fullsized":"2024-04-25T13:42:07.416285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:37.549411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.441288+0000","last_change":"2024-04-25T13:42:06.435739+0000","last_active":"2024-04-25T13:42:06.441288+0000","last_peered":"2024-04-25T13:42:06.441288+0000","last_clean":"2024-04-25T13:42:06.441288+0000","last_became_active":"2024-04-25T13:42:06.435439+0000","last_became_peered":"2024-04-25T13:42:06.435439+0000","last_unstale":"2024-04-25T13:42:06.441288+0000","last_undegraded":"2024-04-25T13:42:06.441288+0000","last_fullsized":"2024-04-25T13:42:06.441288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:06.506569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415289+0000","last_change":"2024-04-25T13:42:06.442430+0000","last_active":"2024-04-25T13:42:07.415289+0000","last_peered":"2024-04-25T13:42:07.415289+0000","last_clean":"2024-04-25T13:42:07.415289+0000","last_became_active":"2024-04-25T13:42:06.442052+0000","last_became_peered":"2024-04-25T13:42:06.442052+0000","last_unstale":"2024-04-25T13:42:07.415289+0000","last_undegraded":"2024-04-25T13:42:07.415289+0000","last_fullsized":"2024-04-25T13:42:07.415289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.382442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.441898+0000","last_change":"2024-04-25T13:42:06.435115+0000","last_active":"2024-04-25T13:42:06.441898+0000","last_peered":"2024-04-25T13:42:06.441898+0000","last_clean":"2024-04-25T13:42:06.441898+0000","last_became_active":"2024-04-25T13:42:06.434872+0000","last_became_peered":"2024-04-25T13:42:06.434872+0000","last_unstale":"2024-04-25T13:42:06.441898+0000","last_undegraded":"2024-04-25T13:42:06.441898+0000","last_fullsized":"2024-04-25T13:42:06.441898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:51:33.230810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695416+0000","last_change":"2024-04-25T13:42:06.447825+0000","last_active":"2024-04-25T13:42:07.695416+0000","last_peered":"2024-04-25T13:42:07.695416+0000","last_clean":"2024-04-25T13:42:07.695416+0000","last_became_active":"2024-04-25T13:42:06.447512+0000","last_became_peered":"2024-04-25T13:42:06.447512+0000","last_unstale":"2024-04-25T13:42:07.695416+0000","last_undegraded":"2024-04-25T13:42:07.695416+0000","last_fullsized":"2024-04-25T13:42:07.695416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:54.457915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.452395+0000","last_change":"2024-04-25T13:42:06.449425+0000","last_active":"2024-04-25T13:42:06.452395+0000","last_peered":"2024-04-25T13:42:06.452395+0000","last_clean":"2024-04-25T13:42:06.452395+0000","last_became_active":"2024-04-25T13:42:06.449116+0000","last_became_peered":"2024-04-25T13:42:06.449116+0000","last_unstale":"2024-04-25T13:42:06.452395+0000","last_undegraded":"2024-04-25T13:42:06.452395+0000","last_fullsized":"2024-04-25T13:42:06.452395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:38.780588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414743+0000","last_change":"2024-04-25T13:42:06.444979+0000","last_active":"2024-04-25T13:42:07.414743+0000","last_peered":"2024-04-25T13:42:07.414743+0000","last_clean":"2024-04-25T13:42:07.414743+0000","last_became_active":"2024-04-25T13:42:06.444648+0000","last_became_peered":"2024-04-25T13:42:06.444648+0000","last_unstale":"2024-04-25T13:42:07.414743+0000","last_undegraded":"2024-04-25T13:42:07.414743+0000","last_fullsized":"2024-04-25T13:42:07.414743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:45.608285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414435+0000","last_change":"2024-04-25T13:42:06.445383+0000","last_active":"2024-04-25T13:42:07.414435+0000","last_peered":"2024-04-25T13:42:07.414435+0000","last_clean":"2024-04-25T13:42:07.414435+0000","last_became_active":"2024-04-25T13:42:06.445066+0000","last_became_peered":"2024-04-25T13:42:06.445066+0000","last_unstale":"2024-04-25T13:42:07.414435+0000","last_undegraded":"2024-04-25T13:42:07.414435+0000","last_fullsized":"2024-04-25T13:42:07.414435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:43.073677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.870052+0000","last_change":"2024-04-25T13:42:06.436929+0000","last_active":"2024-04-25T13:42:07.870052+0000","last_peered":"2024-04-25T13:42:07.870052+0000","last_clean":"2024-04-25T13:42:07.870052+0000","last_became_active":"2024-04-25T13:42:06.436642+0000","last_became_peered":"2024-04-25T13:42:06.436642+0000","last_unstale":"2024-04-25T13:42:07.870052+0000","last_undegraded":"2024-04-25T13:42:07.870052+0000","last_fullsized":"2024-04-25T13:42:07.870052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:59.508605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695711+0000","last_change":"2024-04-25T13:42:06.421115+0000","last_active":"2024-04-25T13:42:07.695711+0000","last_peered":"2024-04-25T13:42:07.695711+0000","last_clean":"2024-04-25T13:42:07.695711+0000","last_became_active":"2024-04-25T13:42:06.420817+0000","last_became_peered":"2024-04-25T13:42:06.420817+0000","last_unstale":"2024-04-25T13:42:07.695711+0000","last_undegraded":"2024-04-25T13:42:07.695711+0000","last_fullsized":"2024-04-25T13:42:07.695711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:45.608285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.435972+0000","last_change":"2024-04-25T13:42:06.430965+0000","last_active":"2024-04-25T13:42:06.435972+0000","last_peered":"2024-04-25T13:42:06.435972+0000","last_clean":"2024-04-25T13:42:06.435972+0000","last_became_active":"2024-04-25T13:42:06.430586+0000","last_became_peered":"2024-04-25T13:42:06.430586+0000","last_unstale":"2024-04-25T13:42:06.435972+0000","last_undegraded":"2024-04-25T13:42:06.435972+0000","last_fullsized":"2024-04-25T13:42:06.435972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:14.980250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414156+0000","last_change":"2024-04-25T13:42:06.414901+0000","last_active":"2024-04-25T13:42:07.414156+0000","last_peered":"2024-04-25T13:42:07.414156+0000","last_clean":"2024-04-25T13:42:07.414156+0000","last_became_active":"2024-04-25T13:42:06.414422+0000","last_became_peered":"2024-04-25T13:42:06.414422+0000","last_unstale":"2024-04-25T13:42:07.414156+0000","last_undegraded":"2024-04-25T13:42:07.414156+0000","last_fullsized":"2024-04-25T13:42:07.414156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:43.073677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414538+0000","last_change":"2024-04-25T13:42:06.429527+0000","last_active":"2024-04-25T13:42:07.414538+0000","last_peered":"2024-04-25T13:42:07.414538+0000","last_clean":"2024-04-25T13:42:07.414538+0000","last_became_active":"2024-04-25T13:42:06.428862+0000","last_became_peered":"2024-04-25T13:42:06.428862+0000","last_unstale":"2024-04-25T13:42:07.414538+0000","last_undegraded":"2024-04-25T13:42:07.414538+0000","last_fullsized":"2024-04-25T13:42:07.414538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:21.556056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416688+0000","last_change":"2024-04-25T13:42:06.445283+0000","last_active":"2024-04-25T13:42:07.416688+0000","last_peered":"2024-04-25T13:42:07.416688+0000","last_clean":"2024-04-25T13:42:07.416688+0000","last_became_active":"2024-04-25T13:42:06.445004+0000","last_became_peered":"2024-04-25T13:42:06.445004+0000","last_unstale":"2024-04-25T13:42:07.416688+0000","last_undegraded":"2024-04-25T13:42:07.416688+0000","last_fullsized":"2024-04-25T13:42:07.416688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:36:55.456363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.429954+0000","last_change":"2024-04-25T13:42:06.427048+0000","last_active":"2024-04-25T13:42:06.429954+0000","last_peered":"2024-04-25T13:42:06.429954+0000","last_clean":"2024-04-25T13:42:06.429954+0000","last_became_active":"2024-04-25T13:42:06.426733+0000","last_became_peered":"2024-04-25T13:42:06.426733+0000","last_unstale":"2024-04-25T13:42:06.429954+0000","last_undegraded":"2024-04-25T13:42:06.429954+0000","last_fullsized":"2024-04-25T13:42:06.429954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:14.980250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.443648+0000","last_change":"2024-04-25T13:42:06.440148+0000","last_active":"2024-04-25T13:42:06.443648+0000","last_peered":"2024-04-25T13:42:06.443648+0000","last_clean":"2024-04-25T13:42:06.443648+0000","last_became_active":"2024-04-25T13:42:06.439713+0000","last_became_peered":"2024-04-25T13:42:06.439713+0000","last_unstale":"2024-04-25T13:42:06.443648+0000","last_undegraded":"2024-04-25T13:42:06.443648+0000","last_fullsized":"2024-04-25T13:42:06.443648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:43.073677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415435+0000","last_change":"2024-04-25T13:42:06.420914+0000","last_active":"2024-04-25T13:42:07.415435+0000","last_peered":"2024-04-25T13:42:07.415435+0000","last_clean":"2024-04-25T13:42:07.415435+0000","last_became_active":"2024-04-25T13:42:06.420671+0000","last_became_peered":"2024-04-25T13:42:06.420671+0000","last_unstale":"2024-04-25T13:42:07.415435+0000","last_undegraded":"2024-04-25T13:42:07.415435+0000","last_fullsized":"2024-04-25T13:42:07.415435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.382442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.440721+0000","last_change":"2024-04-25T13:42:06.436778+0000","last_active":"2024-04-25T13:42:06.440721+0000","last_peered":"2024-04-25T13:42:06.440721+0000","last_clean":"2024-04-25T13:42:06.440721+0000","last_became_active":"2024-04-25T13:42:06.436267+0000","last_became_peered":"2024-04-25T13:42:06.436267+0000","last_unstale":"2024-04-25T13:42:06.440721+0000","last_undegraded":"2024-04-25T13:42:06.440721+0000","last_fullsized":"2024-04-25T13:42:06.440721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:59.508605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415476+0000","last_change":"2024-04-25T13:42:06.426502+0000","last_active":"2024-04-25T13:42:07.415476+0000","last_peered":"2024-04-25T13:42:07.415476+0000","last_clean":"2024-04-25T13:42:07.415476+0000","last_became_active":"2024-04-25T13:42:06.426235+0000","last_became_peered":"2024-04-25T13:42:06.426235+0000","last_unstale":"2024-04-25T13:42:07.415476+0000","last_undegraded":"2024-04-25T13:42:07.415476+0000","last_fullsized":"2024-04-25T13:42:07.415476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:38.780588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695449+0000","last_change":"2024-04-25T13:42:06.415204+0000","last_active":"2024-04-25T13:42:07.695449+0000","last_peered":"2024-04-25T13:42:07.695449+0000","last_clean":"2024-04-25T13:42:07.695449+0000","last_became_active":"2024-04-25T13:42:06.414815+0000","last_became_peered":"2024-04-25T13:42:06.414815+0000","last_unstale":"2024-04-25T13:42:07.695449+0000","last_undegraded":"2024-04-25T13:42:07.695449+0000","last_fullsized":"2024-04-25T13:42:07.695449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:38.216116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414732+0000","last_change":"2024-04-25T13:42:06.429164+0000","last_active":"2024-04-25T13:42:07.414732+0000","last_peered":"2024-04-25T13:42:07.414732+0000","last_clean":"2024-04-25T13:42:07.414732+0000","last_became_active":"2024-04-25T13:42:06.428466+0000","last_became_peered":"2024-04-25T13:42:06.428466+0000","last_unstale":"2024-04-25T13:42:07.414732+0000","last_undegraded":"2024-04-25T13:42:07.414732+0000","last_fullsized":"2024-04-25T13:42:07.414732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:45.608285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695932+0000","last_change":"2024-04-25T13:42:06.416633+0000","last_active":"2024-04-25T13:42:07.695932+0000","last_peered":"2024-04-25T13:42:07.695932+0000","last_clean":"2024-04-25T13:42:07.695932+0000","last_became_active":"2024-04-25T13:42:06.415982+0000","last_became_peered":"2024-04-25T13:42:06.415982+0000","last_unstale":"2024-04-25T13:42:07.695932+0000","last_undegraded":"2024-04-25T13:42:07.695932+0000","last_fullsized":"2024-04-25T13:42:07.695932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:37.549411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414733+0000","last_change":"2024-04-25T13:42:06.429813+0000","last_active":"2024-04-25T13:42:07.414733+0000","last_peered":"2024-04-25T13:42:07.414733+0000","last_clean":"2024-04-25T13:42:07.414733+0000","last_became_active":"2024-04-25T13:42:06.429201+0000","last_became_peered":"2024-04-25T13:42:06.429201+0000","last_unstale":"2024-04-25T13:42:07.414733+0000","last_undegraded":"2024-04-25T13:42:07.414733+0000","last_fullsized":"2024-04-25T13:42:07.414733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:21.556056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414552+0000","last_change":"2024-04-25T13:42:06.423487+0000","last_active":"2024-04-25T13:42:07.414552+0000","last_peered":"2024-04-25T13:42:07.414552+0000","last_clean":"2024-04-25T13:42:07.414552+0000","last_became_active":"2024-04-25T13:42:06.423175+0000","last_became_peered":"2024-04-25T13:42:06.423175+0000","last_unstale":"2024-04-25T13:42:07.414552+0000","last_undegraded":"2024-04-25T13:42:07.414552+0000","last_fullsized":"2024-04-25T13:42:07.414552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:45.608285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695845+0000","last_change":"2024-04-25T13:42:06.419669+0000","last_active":"2024-04-25T13:42:07.695845+0000","last_peered":"2024-04-25T13:42:07.695845+0000","last_clean":"2024-04-25T13:42:07.695845+0000","last_became_active":"2024-04-25T13:42:06.419352+0000","last_became_peered":"2024-04-25T13:42:06.419352+0000","last_unstale":"2024-04-25T13:42:07.695845+0000","last_undegraded":"2024-04-25T13:42:07.695845+0000","last_fullsized":"2024-04-25T13:42:07.695845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:38.780588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.432224+0000","last_change":"2024-04-25T13:42:06.424606+0000","last_active":"2024-04-25T13:42:06.432224+0000","last_peered":"2024-04-25T13:42:06.432224+0000","last_clean":"2024-04-25T13:42:06.432224+0000","last_became_active":"2024-04-25T13:42:06.424286+0000","last_became_peered":"2024-04-25T13:42:06.424286+0000","last_unstale":"2024-04-25T13:42:06.432224+0000","last_undegraded":"2024-04-25T13:42:06.432224+0000","last_fullsized":"2024-04-25T13:42:06.432224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:40.020511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415714+0000","last_change":"2024-04-25T13:42:06.437956+0000","last_active":"2024-04-25T13:42:07.415714+0000","last_peered":"2024-04-25T13:42:07.415714+0000","last_clean":"2024-04-25T13:42:07.415714+0000","last_became_active":"2024-04-25T13:42:06.437530+0000","last_became_peered":"2024-04-25T13:42:06.437530+0000","last_unstale":"2024-04-25T13:42:07.415714+0000","last_undegraded":"2024-04-25T13:42:07.415714+0000","last_fullsized":"2024-04-25T13:42:07.415714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:32.855388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.424616+0000","last_change":"2024-04-25T13:42:06.420035+0000","last_active":"2024-04-25T13:42:06.424616+0000","last_peered":"2024-04-25T13:42:06.424616+0000","last_clean":"2024-04-25T13:42:06.424616+0000","last_became_active":"2024-04-25T13:42:06.419452+0000","last_became_peered":"2024-04-25T13:42:06.419452+0000","last_unstale":"2024-04-25T13:42:06.424616+0000","last_undegraded":"2024-04-25T13:42:06.424616+0000","last_fullsized":"2024-04-25T13:42:06.424616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:43.962804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414133+0000","last_change":"2024-04-25T13:42:06.428858+0000","last_active":"2024-04-25T13:42:07.414133+0000","last_peered":"2024-04-25T13:42:07.414133+0000","last_clean":"2024-04-25T13:42:07.414133+0000","last_became_active":"2024-04-25T13:42:06.428622+0000","last_became_peered":"2024-04-25T13:42:06.428622+0000","last_unstale":"2024-04-25T13:42:07.414133+0000","last_undegraded":"2024-04-25T13:42:07.414133+0000","last_fullsized":"2024-04-25T13:42:07.414133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:54.457915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.869806+0000","last_change":"2024-04-25T13:42:06.412033+0000","last_active":"2024-04-25T13:42:07.869806+0000","last_peered":"2024-04-25T13:42:07.869806+0000","last_clean":"2024-04-25T13:42:07.869806+0000","last_became_active":"2024-04-25T13:42:06.411702+0000","last_became_peered":"2024-04-25T13:42:06.411702+0000","last_unstale":"2024-04-25T13:42:07.869806+0000","last_undegraded":"2024-04-25T13:42:07.869806+0000","last_fullsized":"2024-04-25T13:42:07.869806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:21.415710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695870+0000","last_change":"2024-04-25T13:42:05.426545+0000","last_active":"2024-04-25T13:42:07.695870+0000","last_peered":"2024-04-25T13:42:07.695870+0000","last_clean":"2024-04-25T13:42:07.695870+0000","last_became_active":"2024-04-25T13:42:05.425486+0000","last_became_peered":"2024-04-25T13:42:05.425486+0000","last_unstale":"2024-04-25T13:42:07.695870+0000","last_undegraded":"2024-04-25T13:42:07.695870+0000","last_fullsized":"2024-04-25T13:42:07.695870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:38.792763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.432201+0000","last_change":"2024-04-25T13:42:06.424104+0000","last_active":"2024-04-25T13:42:06.432201+0000","last_peered":"2024-04-25T13:42:06.432201+0000","last_clean":"2024-04-25T13:42:06.432201+0000","last_became_active":"2024-04-25T13:42:06.423795+0000","last_became_peered":"2024-04-25T13:42:06.423795+0000","last_unstale":"2024-04-25T13:42:06.432201+0000","last_undegraded":"2024-04-25T13:42:06.432201+0000","last_fullsized":"2024-04-25T13:42:06.432201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:51.173110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414254+0000","last_change":"2024-04-25T13:42:05.412559+0000","last_active":"2024-04-25T13:42:07.414254+0000","last_peered":"2024-04-25T13:42:07.414254+0000","last_clean":"2024-04-25T13:42:07.414254+0000","last_became_active":"2024-04-25T13:42:05.412190+0000","last_became_peered":"2024-04-25T13:42:05.412190+0000","last_unstale":"2024-04-25T13:42:07.414254+0000","last_undegraded":"2024-04-25T13:42:07.414254+0000","last_fullsized":"2024-04-25T13:42:07.414254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:20.409104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695565+0000","last_change":"2024-04-25T13:42:05.425544+0000","last_active":"2024-04-25T13:42:07.695565+0000","last_peered":"2024-04-25T13:42:07.695565+0000","last_clean":"2024-04-25T13:42:07.695565+0000","last_became_active":"2024-04-25T13:42:05.425115+0000","last_became_peered":"2024-04-25T13:42:05.425115+0000","last_unstale":"2024-04-25T13:42:07.695565+0000","last_undegraded":"2024-04-25T13:42:07.695565+0000","last_fullsized":"2024-04-25T13:42:07.695565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:25.873825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695674+0000","last_change":"2024-04-25T13:42:06.428073+0000","last_active":"2024-04-25T13:42:07.695674+0000","last_peered":"2024-04-25T13:42:07.695674+0000","last_clean":"2024-04-25T13:42:07.695674+0000","last_became_active":"2024-04-25T13:42:06.427682+0000","last_became_peered":"2024-04-25T13:42:06.427682+0000","last_unstale":"2024-04-25T13:42:07.695674+0000","last_undegraded":"2024-04-25T13:42:07.695674+0000","last_fullsized":"2024-04-25T13:42:07.695674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:21.556056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414858+0000","last_change":"2024-04-25T13:42:05.409548+0000","last_active":"2024-04-25T13:42:07.414858+0000","last_peered":"2024-04-25T13:42:07.414858+0000","last_clean":"2024-04-25T13:42:07.414858+0000","last_became_active":"2024-04-25T13:42:05.409160+0000","last_became_peered":"2024-04-25T13:42:05.409160+0000","last_unstale":"2024-04-25T13:42:07.414858+0000","last_undegraded":"2024-04-25T13:42:07.414858+0000","last_fullsized":"2024-04-25T13:42:07.414858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:42.956198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414147+0000","last_change":"2024-04-25T13:42:06.417091+0000","last_active":"2024-04-25T13:42:07.414147+0000","last_peered":"2024-04-25T13:42:07.414147+0000","last_clean":"2024-04-25T13:42:07.414147+0000","last_became_active":"2024-04-25T13:42:06.416569+0000","last_became_peered":"2024-04-25T13:42:06.416569+0000","last_unstale":"2024-04-25T13:42:07.414147+0000","last_undegraded":"2024-04-25T13:42:07.414147+0000","last_fullsized":"2024-04-25T13:42:07.414147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:38.216116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414775+0000","last_change":"2024-04-25T13:42:05.418974+0000","last_active":"2024-04-25T13:42:07.414775+0000","last_peered":"2024-04-25T13:42:07.414775+0000","last_clean":"2024-04-25T13:42:07.414775+0000","last_became_active":"2024-04-25T13:42:05.418671+0000","last_became_peered":"2024-04-25T13:42:05.418671+0000","last_unstale":"2024-04-25T13:42:07.414775+0000","last_undegraded":"2024-04-25T13:42:07.414775+0000","last_fullsized":"2024-04-25T13:42:07.414775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:50.166504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416407+0000","last_change":"2024-04-25T13:42:06.439202+0000","last_active":"2024-04-25T13:42:07.416407+0000","last_peered":"2024-04-25T13:42:07.416407+0000","last_clean":"2024-04-25T13:42:07.416407+0000","last_became_active":"2024-04-25T13:42:06.438901+0000","last_became_peered":"2024-04-25T13:42:06.438901+0000","last_unstale":"2024-04-25T13:42:07.416407+0000","last_undegraded":"2024-04-25T13:42:07.416407+0000","last_fullsized":"2024-04-25T13:42:07.416407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:02.934983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416416+0000","last_change":"2024-04-25T13:42:05.418579+0000","last_active":"2024-04-25T13:42:07.416416+0000","last_peered":"2024-04-25T13:42:07.416416+0000","last_clean":"2024-04-25T13:42:07.416416+0000","last_became_active":"2024-04-25T13:42:05.418233+0000","last_became_peered":"2024-04-25T13:42:05.418233+0000","last_unstale":"2024-04-25T13:42:07.416416+0000","last_undegraded":"2024-04-25T13:42:07.416416+0000","last_fullsized":"2024-04-25T13:42:07.416416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:20.409104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.452576+0000","last_change":"2024-04-25T13:42:06.449721+0000","last_active":"2024-04-25T13:42:06.452576+0000","last_peered":"2024-04-25T13:42:06.452576+0000","last_clean":"2024-04-25T13:42:06.452576+0000","last_became_active":"2024-04-25T13:42:06.449373+0000","last_became_peered":"2024-04-25T13:42:06.449373+0000","last_unstale":"2024-04-25T13:42:06.452576+0000","last_undegraded":"2024-04-25T13:42:06.452576+0000","last_fullsized":"2024-04-25T13:42:06.452576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:28.591141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414570+0000","last_change":"2024-04-25T13:42:05.418805+0000","last_active":"2024-04-25T13:42:07.414570+0000","last_peered":"2024-04-25T13:42:07.414570+0000","last_clean":"2024-04-25T13:42:07.414570+0000","last_became_active":"2024-04-25T13:42:05.418384+0000","last_became_peered":"2024-04-25T13:42:05.418384+0000","last_unstale":"2024-04-25T13:42:07.414570+0000","last_undegraded":"2024-04-25T13:42:07.414570+0000","last_fullsized":"2024-04-25T13:42:07.414570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:21.589517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.870107+0000","last_change":"2024-04-25T13:42:06.415649+0000","last_active":"2024-04-25T13:42:07.870107+0000","last_peered":"2024-04-25T13:42:07.870107+0000","last_clean":"2024-04-25T13:42:07.870107+0000","last_became_active":"2024-04-25T13:42:06.411373+0000","last_became_peered":"2024-04-25T13:42:06.411373+0000","last_unstale":"2024-04-25T13:42:07.870107+0000","last_undegraded":"2024-04-25T13:42:07.870107+0000","last_fullsized":"2024-04-25T13:42:07.870107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:04.702886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415602+0000","last_change":"2024-04-25T13:42:05.423758+0000","last_active":"2024-04-25T13:42:07.415602+0000","last_peered":"2024-04-25T13:42:07.415602+0000","last_clean":"2024-04-25T13:42:07.415602+0000","last_became_active":"2024-04-25T13:42:05.423343+0000","last_became_peered":"2024-04-25T13:42:05.423343+0000","last_unstale":"2024-04-25T13:42:07.415602+0000","last_undegraded":"2024-04-25T13:42:07.415602+0000","last_fullsized":"2024-04-25T13:42:07.415602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:42.956198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.443522+0000","last_change":"2024-04-25T13:42:06.438756+0000","last_active":"2024-04-25T13:42:06.443522+0000","last_peered":"2024-04-25T13:42:06.443522+0000","last_clean":"2024-04-25T13:42:06.443522+0000","last_became_active":"2024-04-25T13:42:06.432572+0000","last_became_peered":"2024-04-25T13:42:06.432572+0000","last_unstale":"2024-04-25T13:42:06.443522+0000","last_undegraded":"2024-04-25T13:42:06.443522+0000","last_fullsized":"2024-04-25T13:42:06.443522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:54.457915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.432141+0000","last_change":"2024-04-25T13:42:05.405101+0000","last_active":"2024-04-25T13:42:06.432141+0000","last_peered":"2024-04-25T13:42:06.432141+0000","last_clean":"2024-04-25T13:42:06.432141+0000","last_became_active":"2024-04-25T13:42:05.404246+0000","last_became_peered":"2024-04-25T13:42:05.404246+0000","last_unstale":"2024-04-25T13:42:06.432141+0000","last_undegraded":"2024-04-25T13:42:06.432141+0000","last_fullsized":"2024-04-25T13:42:06.432141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:25.873825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.440713+0000","last_change":"2024-04-25T13:42:06.436678+0000","last_active":"2024-04-25T13:42:06.440713+0000","last_peered":"2024-04-25T13:42:06.440713+0000","last_clean":"2024-04-25T13:42:06.440713+0000","last_became_active":"2024-04-25T13:42:06.436287+0000","last_became_peered":"2024-04-25T13:42:06.436287+0000","last_unstale":"2024-04-25T13:42:06.440713+0000","last_undegraded":"2024-04-25T13:42:06.440713+0000","last_fullsized":"2024-04-25T13:42:06.440713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:22.596123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415802+0000","last_change":"2024-04-25T13:42:05.417191+0000","last_active":"2024-04-25T13:42:07.415802+0000","last_peered":"2024-04-25T13:42:07.415802+0000","last_clean":"2024-04-25T13:42:07.415802+0000","last_became_active":"2024-04-25T13:42:05.416840+0000","last_became_peered":"2024-04-25T13:42:05.416840+0000","last_unstale":"2024-04-25T13:42:07.415802+0000","last_undegraded":"2024-04-25T13:42:07.415802+0000","last_fullsized":"2024-04-25T13:42:07.415802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:50.166504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.448105+0000","last_change":"2024-04-25T13:42:06.444118+0000","last_active":"2024-04-25T13:42:06.448105+0000","last_peered":"2024-04-25T13:42:06.448105+0000","last_clean":"2024-04-25T13:42:06.448105+0000","last_became_active":"2024-04-25T13:42:06.443524+0000","last_became_peered":"2024-04-25T13:42:06.443524+0000","last_unstale":"2024-04-25T13:42:06.448105+0000","last_undegraded":"2024-04-25T13:42:06.448105+0000","last_fullsized":"2024-04-25T13:42:06.448105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:45.608285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414098+0000","last_change":"2024-04-25T13:42:05.414280+0000","last_active":"2024-04-25T13:42:07.414098+0000","last_peered":"2024-04-25T13:42:07.414098+0000","last_clean":"2024-04-25T13:42:07.414098+0000","last_became_active":"2024-04-25T13:42:05.413281+0000","last_became_peered":"2024-04-25T13:42:05.413281+0000","last_unstale":"2024-04-25T13:42:07.414098+0000","last_undegraded":"2024-04-25T13:42:07.414098+0000","last_fullsized":"2024-04-25T13:42:07.414098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:13.973644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414504+0000","last_change":"2024-04-25T13:42:06.430703+0000","last_active":"2024-04-25T13:42:07.414504+0000","last_peered":"2024-04-25T13:42:07.414504+0000","last_clean":"2024-04-25T13:42:07.414504+0000","last_became_active":"2024-04-25T13:42:06.428292+0000","last_became_peered":"2024-04-25T13:42:06.428292+0000","last_unstale":"2024-04-25T13:42:07.414504+0000","last_undegraded":"2024-04-25T13:42:07.414504+0000","last_fullsized":"2024-04-25T13:42:07.414504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:00.017229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.432910+0000","last_change":"2024-04-25T13:42:05.423359+0000","last_active":"2024-04-25T13:42:06.432910+0000","last_peered":"2024-04-25T13:42:06.432910+0000","last_clean":"2024-04-25T13:42:06.432910+0000","last_became_active":"2024-04-25T13:42:05.418070+0000","last_became_peered":"2024-04-25T13:42:05.418070+0000","last_unstale":"2024-04-25T13:42:06.432910+0000","last_undegraded":"2024-04-25T13:42:06.432910+0000","last_fullsized":"2024-04-25T13:42:06.432910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:38.792763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.443470+0000","last_change":"2024-04-25T13:42:06.438416+0000","last_active":"2024-04-25T13:42:06.443470+0000","last_peered":"2024-04-25T13:42:06.443470+0000","last_clean":"2024-04-25T13:42:06.443470+0000","last_became_active":"2024-04-25T13:42:06.436122+0000","last_became_peered":"2024-04-25T13:42:06.436122+0000","last_unstale":"2024-04-25T13:42:06.443470+0000","last_undegraded":"2024-04-25T13:42:06.443470+0000","last_fullsized":"2024-04-25T13:42:06.443470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:44.638274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.870073+0000","last_change":"2024-04-25T13:42:05.411439+0000","last_active":"2024-04-25T13:42:07.870073+0000","last_peered":"2024-04-25T13:42:07.870073+0000","last_clean":"2024-04-25T13:42:07.870073+0000","last_became_active":"2024-04-25T13:42:05.411041+0000","last_became_peered":"2024-04-25T13:42:05.411041+0000","last_unstale":"2024-04-25T13:42:07.870073+0000","last_undegraded":"2024-04-25T13:42:07.870073+0000","last_fullsized":"2024-04-25T13:42:07.870073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:29.973848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.443971+0000","last_change":"2024-04-25T13:42:06.440980+0000","last_active":"2024-04-25T13:42:06.443971+0000","last_peered":"2024-04-25T13:42:06.443971+0000","last_clean":"2024-04-25T13:42:06.443971+0000","last_became_active":"2024-04-25T13:42:06.440605+0000","last_became_peered":"2024-04-25T13:42:06.440605+0000","last_unstale":"2024-04-25T13:42:06.443971+0000","last_undegraded":"2024-04-25T13:42:06.443971+0000","last_fullsized":"2024-04-25T13:42:06.443971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:21.556056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.427272+0000","last_change":"2024-04-25T13:42:05.420768+0000","last_active":"2024-04-25T13:42:06.427272+0000","last_peered":"2024-04-25T13:42:06.427272+0000","last_clean":"2024-04-25T13:42:06.427272+0000","last_became_active":"2024-04-25T13:42:05.420338+0000","last_became_peered":"2024-04-25T13:42:05.420338+0000","last_unstale":"2024-04-25T13:42:06.427272+0000","last_undegraded":"2024-04-25T13:42:06.427272+0000","last_fullsized":"2024-04-25T13:42:06.427272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:50.166504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.444121+0000","last_change":"2024-04-25T13:42:06.440909+0000","last_active":"2024-04-25T13:42:06.444121+0000","last_peered":"2024-04-25T13:42:06.444121+0000","last_clean":"2024-04-25T13:42:06.444121+0000","last_became_active":"2024-04-25T13:42:06.440517+0000","last_became_peered":"2024-04-25T13:42:06.440517+0000","last_unstale":"2024-04-25T13:42:06.444121+0000","last_undegraded":"2024-04-25T13:42:06.444121+0000","last_fullsized":"2024-04-25T13:42:06.444121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:00.017229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414647+0000","last_change":"2024-04-25T13:42:05.421815+0000","last_active":"2024-04-25T13:42:07.414647+0000","last_peered":"2024-04-25T13:42:07.414647+0000","last_clean":"2024-04-25T13:42:07.414647+0000","last_became_active":"2024-04-25T13:42:05.421468+0000","last_became_peered":"2024-04-25T13:42:05.421468+0000","last_unstale":"2024-04-25T13:42:07.414647+0000","last_undegraded":"2024-04-25T13:42:07.414647+0000","last_fullsized":"2024-04-25T13:42:07.414647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:58.501999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416541+0000","last_change":"2024-04-25T13:42:06.425480+0000","last_active":"2024-04-25T13:42:07.416541+0000","last_peered":"2024-04-25T13:42:07.416541+0000","last_clean":"2024-04-25T13:42:07.416541+0000","last_became_active":"2024-04-25T13:42:06.424666+0000","last_became_peered":"2024-04-25T13:42:06.424666+0000","last_unstale":"2024-04-25T13:42:07.416541+0000","last_undegraded":"2024-04-25T13:42:07.416541+0000","last_fullsized":"2024-04-25T13:42:07.416541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:28.530411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.408306+0000","last_change":"2024-04-25T13:42:05.414975+0000","last_active":"2024-04-25T13:42:06.408306+0000","last_peered":"2024-04-25T13:42:06.408306+0000","last_clean":"2024-04-25T13:42:06.408306+0000","last_became_active":"2024-04-25T13:42:05.413273+0000","last_became_peered":"2024-04-25T13:42:05.413273+0000","last_unstale":"2024-04-25T13:42:06.408306+0000","last_undegraded":"2024-04-25T13:42:06.408306+0000","last_fullsized":"2024-04-25T13:42:06.408306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:18.167829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.448506+0000","last_change":"2024-04-25T13:42:06.447253+0000","last_active":"2024-04-25T13:42:06.448506+0000","last_peered":"2024-04-25T13:42:06.448506+0000","last_clean":"2024-04-25T13:42:06.448506+0000","last_became_active":"2024-04-25T13:42:06.446721+0000","last_became_peered":"2024-04-25T13:42:06.446721+0000","last_unstale":"2024-04-25T13:42:06.448506+0000","last_undegraded":"2024-04-25T13:42:06.448506+0000","last_fullsized":"2024-04-25T13:42:06.448506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.382442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":109,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.425168+0000","last_change":"2024-04-25T13:41:56.890628+0000","last_active":"2024-04-25T13:42:06.425168+0000","last_peered":"2024-04-25T13:42:06.425168+0000","last_clean":"2024-04-25T13:42:06.425168+0000","last_became_active":"2024-04-25T13:41:56.889261+0000","last_became_peered":"2024-04-25T13:41:56.889261+0000","last_unstale":"2024-04-25T13:42:06.425168+0000","last_undegraded":"2024-04-25T13:42:06.425168+0000","last_fullsized":"2024-04-25T13:42:06.425168+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:53.940471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:53.940471+0000","last_clean_scrub_stamp":"2024-04-25T13:41:53.940471+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:06.164380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416047+0000","last_change":"2024-04-25T13:42:05.413945+0000","last_active":"2024-04-25T13:42:07.416047+0000","last_peered":"2024-04-25T13:42:07.416047+0000","last_clean":"2024-04-25T13:42:07.416047+0000","last_became_active":"2024-04-25T13:42:05.413653+0000","last_became_peered":"2024-04-25T13:42:05.413653+0000","last_unstale":"2024-04-25T13:42:07.416047+0000","last_undegraded":"2024-04-25T13:42:07.416047+0000","last_fullsized":"2024-04-25T13:42:07.416047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:18.167829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695600+0000","last_change":"2024-04-25T13:42:06.447412+0000","last_active":"2024-04-25T13:42:07.695600+0000","last_peered":"2024-04-25T13:42:07.695600+0000","last_clean":"2024-04-25T13:42:07.695600+0000","last_became_active":"2024-04-25T13:42:06.447163+0000","last_became_peered":"2024-04-25T13:42:06.447163+0000","last_unstale":"2024-04-25T13:42:07.695600+0000","last_undegraded":"2024-04-25T13:42:07.695600+0000","last_fullsized":"2024-04-25T13:42:07.695600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:43.073677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.416134+0000","last_change":"2024-04-25T13:42:05.425468+0000","last_active":"2024-04-25T13:42:06.416134+0000","last_peered":"2024-04-25T13:42:06.416134+0000","last_clean":"2024-04-25T13:42:06.416134+0000","last_became_active":"2024-04-25T13:42:05.425039+0000","last_became_peered":"2024-04-25T13:42:05.425039+0000","last_unstale":"2024-04-25T13:42:06.416134+0000","last_undegraded":"2024-04-25T13:42:06.416134+0000","last_fullsized":"2024-04-25T13:42:06.416134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:13.973644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.431265+0000","last_change":"2024-04-25T13:42:06.423330+0000","last_active":"2024-04-25T13:42:06.431265+0000","last_peered":"2024-04-25T13:42:06.431265+0000","last_clean":"2024-04-25T13:42:06.431265+0000","last_became_active":"2024-04-25T13:42:06.422548+0000","last_became_peered":"2024-04-25T13:42:06.422548+0000","last_unstale":"2024-04-25T13:42:06.431265+0000","last_undegraded":"2024-04-25T13:42:06.431265+0000","last_fullsized":"2024-04-25T13:42:06.431265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:19.174434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.409712+0000","last_change":"2024-04-25T13:42:05.416592+0000","last_active":"2024-04-25T13:42:06.409712+0000","last_peered":"2024-04-25T13:42:06.409712+0000","last_clean":"2024-04-25T13:42:06.409712+0000","last_became_active":"2024-04-25T13:42:05.416251+0000","last_became_peered":"2024-04-25T13:42:05.416251+0000","last_unstale":"2024-04-25T13:42:06.409712+0000","last_undegraded":"2024-04-25T13:42:06.409712+0000","last_fullsized":"2024-04-25T13:42:06.409712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:39.013905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414307+0000","last_change":"2024-04-25T13:42:06.405128+0000","last_active":"2024-04-25T13:42:07.414307+0000","last_peered":"2024-04-25T13:42:07.414307+0000","last_clean":"2024-04-25T13:42:07.414307+0000","last_became_active":"2024-04-25T13:42:06.404786+0000","last_became_peered":"2024-04-25T13:42:06.404786+0000","last_unstale":"2024-04-25T13:42:07.414307+0000","last_undegraded":"2024-04-25T13:42:07.414307+0000","last_fullsized":"2024-04-25T13:42:07.414307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:00.017229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415847+0000","last_change":"2024-04-25T13:42:05.417435+0000","last_active":"2024-04-25T13:42:07.415847+0000","last_peered":"2024-04-25T13:42:07.415847+0000","last_clean":"2024-04-25T13:42:07.415847+0000","last_became_active":"2024-04-25T13:42:05.417069+0000","last_became_peered":"2024-04-25T13:42:05.417069+0000","last_unstale":"2024-04-25T13:42:07.415847+0000","last_undegraded":"2024-04-25T13:42:07.415847+0000","last_fullsized":"2024-04-25T13:42:07.415847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:39.013905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.869855+0000","last_change":"2024-04-25T13:42:06.435494+0000","last_active":"2024-04-25T13:42:07.869855+0000","last_peered":"2024-04-25T13:42:07.869855+0000","last_clean":"2024-04-25T13:42:07.869855+0000","last_became_active":"2024-04-25T13:42:06.425605+0000","last_became_peered":"2024-04-25T13:42:06.425605+0000","last_unstale":"2024-04-25T13:42:07.869855+0000","last_undegraded":"2024-04-25T13:42:07.869855+0000","last_fullsized":"2024-04-25T13:42:07.869855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:14.980250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414503+0000","last_change":"2024-04-25T13:42:05.419749+0000","last_active":"2024-04-25T13:42:07.414503+0000","last_peered":"2024-04-25T13:42:07.414503+0000","last_clean":"2024-04-25T13:42:07.414503+0000","last_became_active":"2024-04-25T13:42:05.419446+0000","last_became_peered":"2024-04-25T13:42:05.419446+0000","last_unstale":"2024-04-25T13:42:07.414503+0000","last_undegraded":"2024-04-25T13:42:07.414503+0000","last_fullsized":"2024-04-25T13:42:07.414503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:39.013905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416544+0000","last_change":"2024-04-25T13:42:06.438221+0000","last_active":"2024-04-25T13:42:07.416544+0000","last_peered":"2024-04-25T13:42:07.416544+0000","last_clean":"2024-04-25T13:42:07.416544+0000","last_became_active":"2024-04-25T13:42:06.430658+0000","last_became_peered":"2024-04-25T13:42:06.430658+0000","last_unstale":"2024-04-25T13:42:07.416544+0000","last_undegraded":"2024-04-25T13:42:07.416544+0000","last_fullsized":"2024-04-25T13:42:07.416544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:55.637014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.423504+0000","last_change":"2024-04-25T13:42:05.427944+0000","last_active":"2024-04-25T13:42:06.423504+0000","last_peered":"2024-04-25T13:42:06.423504+0000","last_clean":"2024-04-25T13:42:06.423504+0000","last_became_active":"2024-04-25T13:42:05.427721+0000","last_became_peered":"2024-04-25T13:42:05.427721+0000","last_unstale":"2024-04-25T13:42:06.423504+0000","last_undegraded":"2024-04-25T13:42:06.423504+0000","last_fullsized":"2024-04-25T13:42:06.423504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:27.584535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414350+0000","last_change":"2024-04-25T13:42:06.410624+0000","last_active":"2024-04-25T13:42:07.414350+0000","last_peered":"2024-04-25T13:42:07.414350+0000","last_clean":"2024-04-25T13:42:07.414350+0000","last_became_active":"2024-04-25T13:42:06.410260+0000","last_became_peered":"2024-04-25T13:42:06.410260+0000","last_unstale":"2024-04-25T13:42:07.414350+0000","last_undegraded":"2024-04-25T13:42:07.414350+0000","last_fullsized":"2024-04-25T13:42:07.414350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:21.556056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:08.407723+0000","last_change":"2024-04-25T13:42:05.420418+0000","last_active":"2024-04-25T13:42:08.407723+0000","last_peered":"2024-04-25T13:42:08.407723+0000","last_clean":"2024-04-25T13:42:08.407723+0000","last_became_active":"2024-04-25T13:42:05.420002+0000","last_became_peered":"2024-04-25T13:42:05.420002+0000","last_unstale":"2024-04-25T13:42:08.407723+0000","last_undegraded":"2024-04-25T13:42:08.407723+0000","last_fullsized":"2024-04-25T13:42:08.407723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:20.409104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.696037+0000","last_change":"2024-04-25T13:42:06.429612+0000","last_active":"2024-04-25T13:42:07.696037+0000","last_peered":"2024-04-25T13:42:07.696037+0000","last_clean":"2024-04-25T13:42:07.696037+0000","last_became_active":"2024-04-25T13:42:06.429281+0000","last_became_peered":"2024-04-25T13:42:06.429281+0000","last_unstale":"2024-04-25T13:42:07.696037+0000","last_undegraded":"2024-04-25T13:42:07.696037+0000","last_fullsized":"2024-04-25T13:42:07.696037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:54:07.642118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414966+0000","last_change":"2024-04-25T13:42:05.420871+0000","last_active":"2024-04-25T13:42:07.414966+0000","last_peered":"2024-04-25T13:42:07.414966+0000","last_clean":"2024-04-25T13:42:07.414966+0000","last_became_active":"2024-04-25T13:42:05.420493+0000","last_became_peered":"2024-04-25T13:42:05.420493+0000","last_unstale":"2024-04-25T13:42:07.414966+0000","last_undegraded":"2024-04-25T13:42:07.414966+0000","last_fullsized":"2024-04-25T13:42:07.414966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:39.013905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.435620+0000","last_change":"2024-04-25T13:42:06.430453+0000","last_active":"2024-04-25T13:42:06.435620+0000","last_peered":"2024-04-25T13:42:06.435620+0000","last_clean":"2024-04-25T13:42:06.435620+0000","last_became_active":"2024-04-25T13:42:06.430092+0000","last_became_peered":"2024-04-25T13:42:06.430092+0000","last_unstale":"2024-04-25T13:42:06.435620+0000","last_undegraded":"2024-04-25T13:42:06.435620+0000","last_fullsized":"2024-04-25T13:42:06.435620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:21.415710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.408740+0000","last_change":"2024-04-25T13:42:05.431023+0000","last_active":"2024-04-25T13:42:06.408740+0000","last_peered":"2024-04-25T13:42:06.408740+0000","last_clean":"2024-04-25T13:42:06.408740+0000","last_became_active":"2024-04-25T13:42:05.430721+0000","last_became_peered":"2024-04-25T13:42:05.430721+0000","last_unstale":"2024-04-25T13:42:06.408740+0000","last_undegraded":"2024-04-25T13:42:06.408740+0000","last_fullsized":"2024-04-25T13:42:06.408740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:20.409104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.869878+0000","last_change":"2024-04-25T13:42:06.409401+0000","last_active":"2024-04-25T13:42:07.869878+0000","last_peered":"2024-04-25T13:42:07.869878+0000","last_clean":"2024-04-25T13:42:07.869878+0000","last_became_active":"2024-04-25T13:42:06.409057+0000","last_became_peered":"2024-04-25T13:42:06.409057+0000","last_unstale":"2024-04-25T13:42:07.869878+0000","last_undegraded":"2024-04-25T13:42:07.869878+0000","last_fullsized":"2024-04-25T13:42:07.869878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:22.596123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414245+0000","last_change":"2024-04-25T13:42:05.421504+0000","last_active":"2024-04-25T13:42:07.414245+0000","last_peered":"2024-04-25T13:42:07.414245+0000","last_clean":"2024-04-25T13:42:07.414245+0000","last_became_active":"2024-04-25T13:42:05.421220+0000","last_became_peered":"2024-04-25T13:42:05.421220+0000","last_unstale":"2024-04-25T13:42:07.414245+0000","last_undegraded":"2024-04-25T13:42:07.414245+0000","last_fullsized":"2024-04-25T13:42:07.414245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:13.973644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695605+0000","last_change":"2024-04-25T13:42:06.431990+0000","last_active":"2024-04-25T13:42:07.695605+0000","last_peered":"2024-04-25T13:42:07.695605+0000","last_clean":"2024-04-25T13:42:07.695605+0000","last_became_active":"2024-04-25T13:42:06.431692+0000","last_became_peered":"2024-04-25T13:42:06.431692+0000","last_unstale":"2024-04-25T13:42:07.695605+0000","last_undegraded":"2024-04-25T13:42:07.695605+0000","last_fullsized":"2024-04-25T13:42:07.695605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:00.017229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414280+0000","last_change":"2024-04-25T13:42:05.432614+0000","last_active":"2024-04-25T13:42:07.414280+0000","last_peered":"2024-04-25T13:42:07.414280+0000","last_clean":"2024-04-25T13:42:07.414280+0000","last_became_active":"2024-04-25T13:42:05.432253+0000","last_became_peered":"2024-04-25T13:42:05.432253+0000","last_unstale":"2024-04-25T13:42:07.414280+0000","last_undegraded":"2024-04-25T13:42:07.414280+0000","last_fullsized":"2024-04-25T13:42:07.414280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:42.956198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695726+0000","last_change":"2024-04-25T13:42:06.425502+0000","last_active":"2024-04-25T13:42:07.695726+0000","last_peered":"2024-04-25T13:42:07.695726+0000","last_clean":"2024-04-25T13:42:07.695726+0000","last_became_active":"2024-04-25T13:42:06.425046+0000","last_became_peered":"2024-04-25T13:42:06.425046+0000","last_unstale":"2024-04-25T13:42:07.695726+0000","last_undegraded":"2024-04-25T13:42:07.695726+0000","last_fullsized":"2024-04-25T13:42:07.695726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.382442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.447993+0000","last_change":"2024-04-25T13:42:05.423955+0000","last_active":"2024-04-25T13:42:06.447993+0000","last_peered":"2024-04-25T13:42:06.447993+0000","last_clean":"2024-04-25T13:42:06.447993+0000","last_became_active":"2024-04-25T13:42:05.423590+0000","last_became_peered":"2024-04-25T13:42:05.423590+0000","last_unstale":"2024-04-25T13:42:06.447993+0000","last_undegraded":"2024-04-25T13:42:06.447993+0000","last_fullsized":"2024-04-25T13:42:06.447993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:21.589517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414130+0000","last_change":"2024-04-25T13:42:06.425907+0000","last_active":"2024-04-25T13:42:07.414130+0000","last_peered":"2024-04-25T13:42:07.414130+0000","last_clean":"2024-04-25T13:42:07.414130+0000","last_became_active":"2024-04-25T13:42:06.421536+0000","last_became_peered":"2024-04-25T13:42:06.421536+0000","last_unstale":"2024-04-25T13:42:07.414130+0000","last_undegraded":"2024-04-25T13:42:07.414130+0000","last_fullsized":"2024-04-25T13:42:07.414130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:38.216116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416472+0000","last_change":"2024-04-25T13:42:06.412858+0000","last_active":"2024-04-25T13:42:07.416472+0000","last_peered":"2024-04-25T13:42:07.416472+0000","last_clean":"2024-04-25T13:42:07.416472+0000","last_became_active":"2024-04-25T13:42:06.412522+0000","last_became_peered":"2024-04-25T13:42:06.412522+0000","last_unstale":"2024-04-25T13:42:07.416472+0000","last_undegraded":"2024-04-25T13:42:07.416472+0000","last_fullsized":"2024-04-25T13:42:07.416472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:33:49.773341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.449138+0000","last_change":"2024-04-25T13:42:05.426488+0000","last_active":"2024-04-25T13:42:06.449138+0000","last_peered":"2024-04-25T13:42:06.449138+0000","last_clean":"2024-04-25T13:42:06.449138+0000","last_became_active":"2024-04-25T13:42:05.426101+0000","last_became_peered":"2024-04-25T13:42:05.426101+0000","last_unstale":"2024-04-25T13:42:06.449138+0000","last_undegraded":"2024-04-25T13:42:06.449138+0000","last_fullsized":"2024-04-25T13:42:06.449138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:58.501999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416286+0000","last_change":"2024-04-25T13:42:06.420385+0000","last_active":"2024-04-25T13:42:07.416286+0000","last_peered":"2024-04-25T13:42:07.416286+0000","last_clean":"2024-04-25T13:42:07.416286+0000","last_became_active":"2024-04-25T13:42:06.419988+0000","last_became_peered":"2024-04-25T13:42:06.419988+0000","last_unstale":"2024-04-25T13:42:07.416286+0000","last_undegraded":"2024-04-25T13:42:07.416286+0000","last_fullsized":"2024-04-25T13:42:07.416286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:54:07.642118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.440042+0000","last_change":"2024-04-25T13:42:05.430513+0000","last_active":"2024-04-25T13:42:06.440042+0000","last_peered":"2024-04-25T13:42:06.440042+0000","last_clean":"2024-04-25T13:42:06.440042+0000","last_became_active":"2024-04-25T13:42:05.430211+0000","last_became_peered":"2024-04-25T13:42:05.430211+0000","last_unstale":"2024-04-25T13:42:06.440042+0000","last_undegraded":"2024-04-25T13:42:06.440042+0000","last_fullsized":"2024-04-25T13:42:06.440042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:03.696280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.449370+0000","last_change":"2024-04-25T13:42:06.446137+0000","last_active":"2024-04-25T13:42:06.449370+0000","last_peered":"2024-04-25T13:42:06.449370+0000","last_clean":"2024-04-25T13:42:06.449370+0000","last_became_active":"2024-04-25T13:42:06.445789+0000","last_became_peered":"2024-04-25T13:42:06.445789+0000","last_unstale":"2024-04-25T13:42:06.449370+0000","last_undegraded":"2024-04-25T13:42:06.449370+0000","last_fullsized":"2024-04-25T13:42:06.449370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:04.702886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695972+0000","last_change":"2024-04-25T13:42:05.423990+0000","last_active":"2024-04-25T13:42:07.695972+0000","last_peered":"2024-04-25T13:42:07.695972+0000","last_clean":"2024-04-25T13:42:07.695972+0000","last_became_active":"2024-04-25T13:42:05.420047+0000","last_became_peered":"2024-04-25T13:42:05.420047+0000","last_unstale":"2024-04-25T13:42:07.695972+0000","last_undegraded":"2024-04-25T13:42:07.695972+0000","last_fullsized":"2024-04-25T13:42:07.695972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:18.167829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695905+0000","last_change":"2024-04-25T13:42:06.429258+0000","last_active":"2024-04-25T13:42:07.695905+0000","last_peered":"2024-04-25T13:42:07.695905+0000","last_clean":"2024-04-25T13:42:07.695905+0000","last_became_active":"2024-04-25T13:42:06.428574+0000","last_became_peered":"2024-04-25T13:42:06.428574+0000","last_unstale":"2024-04-25T13:42:07.695905+0000","last_undegraded":"2024-04-25T13:42:07.695905+0000","last_fullsized":"2024-04-25T13:42:07.695905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:32.855388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.445201+0000","last_change":"2024-04-25T13:42:05.418742+0000","last_active":"2024-04-25T13:42:06.445201+0000","last_peered":"2024-04-25T13:42:06.445201+0000","last_clean":"2024-04-25T13:42:06.445201+0000","last_became_active":"2024-04-25T13:42:05.418017+0000","last_became_peered":"2024-04-25T13:42:05.418017+0000","last_unstale":"2024-04-25T13:42:06.445201+0000","last_undegraded":"2024-04-25T13:42:06.445201+0000","last_fullsized":"2024-04-25T13:42:06.445201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:38.792763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":660641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":69691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,10],"upper_bound":32},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":76151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":660697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:42:10.528 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:42:10.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.710+0000 7f16a7600640 1 Processor -- start 2024-04-25T13:42:10.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.710+0000 7f16a7600640 1 -- start start 2024-04-25T13:42:10.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.710+0000 7f16a7600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f16a0165310 0x7f16a00b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:10.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.710+0000 7f16a7600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f16a00b32f0 0x7f16a00b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:10.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.710+0000 7f16a7600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16a00b3c40 con 0x7f16a0167d00 2024-04-25T13:42:10.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.710+0000 7f16a7600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f16a00b5670 con 0x7f16a0165310 2024-04-25T13:42:10.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.710+0000 7f16a7600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f16a0072c00 con 0x7f16a00b32f0 2024-04-25T13:42:10.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.710+0000 7f16a4c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f16a0165310 0x7f16a00b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:10.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.710+0000 7f16a5600640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f16a0167d00 0x7f16a0168110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53180/0 (socket says 172.21.15.123:53180) 2024-04-25T13:42:10.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.710+0000 7f16a5600640 1 -- 172.21.15.123:0/3966025488 learned_addr learned my addr 172.21.15.123:0/3966025488 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:10.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.714+0000 7f1697e00640 1 --2- 172.21.15.123:0/3966025488 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f16a00b32f0 0x7f16a00b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:10.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.714+0000 7f16a4c00640 1 -- 172.21.15.123:0/3966025488 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f16a00b32f0 msgr2=0x7f16a00b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:10.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.714+0000 7f16a4c00640 1 --2- 172.21.15.123:0/3966025488 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f16a00b32f0 0x7f16a00b3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.714+0000 7f16a4c00640 1 -- 172.21.15.123:0/3966025488 >> v1:172.21.15.123:6789/0 conn(0x7f16a0167d00 legacy=0x7f16a0168110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:10.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.714+0000 7f16a4c00640 1 -- 172.21.15.123:0/3966025488 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a0072ea0 con 0x7f16a0165310 2024-04-25T13:42:10.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.714+0000 7f169fe00640 1 -- 172.21.15.123:0/3966025488 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3946003683 0 0) 0x7f16980014a0 con 0x7f16a0167d00 2024-04-25T13:42:10.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.714+0000 7f16a4c00640 1 --2- 172.21.15.123:0/3966025488 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a0165310 0x7f16a00b6130 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f16900097c0 tx=0x7f169001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5804f383fa0d57b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:10.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.714+0000 7f169fe00640 1 -- 172.21.15.123:0/3966025488 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16900b0070 con 0x7f16a0165310 2024-04-25T13:42:10.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.714+0000 7f169fe00640 1 -- 172.21.15.123:0/3966025488 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16900ab600 con 0x7f16a0165310 2024-04-25T13:42:10.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.714+0000 7f169fe00640 1 -- 172.21.15.123:0/3966025488 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16900ab9d0 con 0x7f16a0165310 2024-04-25T13:42:10.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.718+0000 7f16a7600640 1 -- 172.21.15.123:0/3966025488 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a0165310 msgr2=0x7f16a00b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:10.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.718+0000 7f16a7600640 1 --2- 172.21.15.123:0/3966025488 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a0165310 0x7f16a00b6130 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f16900097c0 tx=0x7f169001c410 comp rx=0 tx=0).stop 2024-04-25T13:42:10.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.718+0000 7f16a7600640 1 -- 172.21.15.123:0/3966025488 shutdown_connections 2024-04-25T13:42:10.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.718+0000 7f16a7600640 1 --2- 172.21.15.123:0/3966025488 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f16a00b32f0 0x7f16a00b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.718+0000 7f16a7600640 1 --2- 172.21.15.123:0/3966025488 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a0165310 0x7f16a00b6130 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.718+0000 7f16a7600640 1 -- 172.21.15.123:0/3966025488 >> 172.21.15.123:0/3966025488 conn(0x7f16a006d210 msgr2=0x7f16a006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:10.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.718+0000 7f16a7600640 1 -- 172.21.15.123:0/3966025488 shutdown_connections 2024-04-25T13:42:10.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.718+0000 7f16a7600640 1 -- 172.21.15.123:0/3966025488 wait complete. 2024-04-25T13:42:10.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.718+0000 7f16a7600640 1 Processor -- start 2024-04-25T13:42:10.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.718+0000 7f16a7600640 1 -- start start 2024-04-25T13:42:10.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.722+0000 7f16a7600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a00b32f0 0x7f16a015b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:10.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.722+0000 7f16a7600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f16a0165310 0x7f16a0163430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:10.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.722+0000 7f16a7600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16a0167d00 0x7f16a015f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:10.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.722+0000 7f16a7600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f16a00b67f0 con 0x7f16a00b32f0 2024-04-25T13:42:10.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.722+0000 7f16a7600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f16a00b6670 con 0x7f16a0167d00 2024-04-25T13:42:10.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.722+0000 7f16a7600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f16a0073980 con 0x7f16a0165310 2024-04-25T13:42:10.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.722+0000 7f16a4c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a00b32f0 0x7f16a015b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:10.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.722+0000 7f16a4c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a00b32f0 0x7f16a015b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37080/0 (socket says 172.21.15.123:37080) 2024-04-25T13:42:10.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.722+0000 7f16a4c00640 1 -- 172.21.15.123:0/917271698 learned_addr learned my addr 172.21.15.123:0/917271698 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:10.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.722+0000 7f16a5600640 1 --2- 172.21.15.123:0/917271698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16a0167d00 0x7f16a015f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:10.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.722+0000 7f16a4c00640 1 -- 172.21.15.123:0/917271698 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f16a0165310 msgr2=0x7f16a0163430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:10.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.722+0000 7f1697e00640 1 --2- 172.21.15.123:0/917271698 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f16a0165310 0x7f16a0163430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:10.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.722+0000 7f16a4c00640 1 --2- 172.21.15.123:0/917271698 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f16a0165310 0x7f16a0163430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.722+0000 7f16a4c00640 1 -- 172.21.15.123:0/917271698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16a0167d00 msgr2=0x7f16a015f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:10.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.722+0000 7f16a4c00640 1 --2- 172.21.15.123:0/917271698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16a0167d00 0x7f16a015f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.722+0000 7f16a4c00640 1 -- 172.21.15.123:0/917271698 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a015bd20 con 0x7f16a00b32f0 2024-04-25T13:42:10.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.722+0000 7f16a5600640 1 --2- 172.21.15.123:0/917271698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16a0167d00 0x7f16a015f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:10.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.722+0000 7f1697e00640 1 --2- 172.21.15.123:0/917271698 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f16a0165310 0x7f16a0163430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:10.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.722+0000 7f16a4c00640 1 --2- 172.21.15.123:0/917271698 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a00b32f0 0x7f16a015b7e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f169001a040 tx=0x7f169001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:10.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.722+0000 7f169d600640 1 -- 172.21.15.123:0/917271698 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16900b0050 con 0x7f16a00b32f0 2024-04-25T13:42:10.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.722+0000 7f169d600640 1 -- 172.21.15.123:0/917271698 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16900bc070 con 0x7f16a00b32f0 2024-04-25T13:42:10.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.722+0000 7f169d600640 1 -- 172.21.15.123:0/917271698 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16900b5850 con 0x7f16a00b32f0 2024-04-25T13:42:10.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.722+0000 7f16a7600640 1 -- 172.21.15.123:0/917271698 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16a015c440 con 0x7f16a00b32f0 2024-04-25T13:42:10.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.722+0000 7f16a7600640 1 -- 172.21.15.123:0/917271698 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16a015c720 con 0x7f16a00b32f0 2024-04-25T13:42:10.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.722+0000 7f16a7600640 1 -- 172.21.15.123:0/917271698 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16a00507c0 con 0x7f16a00b32f0 2024-04-25T13:42:10.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.722+0000 7f169d600640 1 -- 172.21.15.123:0/917271698 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f16900b59f0 con 0x7f16a00b32f0 2024-04-25T13:42:10.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.726+0000 7f169d600640 1 --2- 172.21.15.123:0/917271698 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f167c06f430 0x7f167c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:10.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.726+0000 7f169d600640 1 -- 172.21.15.123:0/917271698 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f16901298e0 con 0x7f16a00b32f0 2024-04-25T13:42:10.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.726+0000 7f1697e00640 1 --2- 172.21.15.123:0/917271698 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f167c06f430 0x7f167c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:10.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.726+0000 7f1697e00640 1 --2- 172.21.15.123:0/917271698 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f167c06f430 0x7f167c071940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f16a0160420 tx=0x7f1688008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:10.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.730+0000 7f169d600640 1 -- 172.21.15.123:0/917271698 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f16900c6020 con 0x7f16a00b32f0 2024-04-25T13:42:10.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.882+0000 7f16a7600640 1 -- 172.21.15.123:0/917271698 --> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f16a015c1f0 con 0x7f167c06f430 2024-04-25T13:42:10.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.890+0000 7f169d600640 1 -- 172.21.15.123:0/917271698 <== mgr.4107 v2:172.21.15.123:6832/715752891 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251934 (secure 0 0 0) 0x7f16a015c1f0 con 0x7f167c06f430 2024-04-25T13:42:10.896 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:10.898 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-04-25T13:42:10.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.894+0000 7f16a7600640 1 -- 172.21.15.123:0/917271698 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f167c06f430 msgr2=0x7f167c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:10.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.894+0000 7f16a7600640 1 --2- 172.21.15.123:0/917271698 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f167c06f430 0x7f167c071940 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f16a0160420 tx=0x7f1688008040 comp rx=0 tx=0).stop 2024-04-25T13:42:10.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.894+0000 7f16a7600640 1 -- 172.21.15.123:0/917271698 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a00b32f0 msgr2=0x7f16a015b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:10.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.894+0000 7f16a7600640 1 --2- 172.21.15.123:0/917271698 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a00b32f0 0x7f16a015b7e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f169001a040 tx=0x7f169001ac50 comp rx=0 tx=0).stop 2024-04-25T13:42:10.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.894+0000 7f16a7600640 1 -- 172.21.15.123:0/917271698 shutdown_connections 2024-04-25T13:42:10.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.894+0000 7f16a7600640 1 --2- 172.21.15.123:0/917271698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16a0167d00 0x7f16a015f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.894+0000 7f16a7600640 1 --2- 172.21.15.123:0/917271698 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f167c06f430 0x7f167c071940 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.894+0000 7f16a7600640 1 --2- 172.21.15.123:0/917271698 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f16a0165310 0x7f16a0163430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.894+0000 7f16a7600640 1 --2- 172.21.15.123:0/917271698 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16a00b32f0 0x7f16a015b7e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:10.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.894+0000 7f16a7600640 1 -- 172.21.15.123:0/917271698 >> 172.21.15.123:0/917271698 conn(0x7f16a006d210 msgr2=0x7f16a015d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:10.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.894+0000 7f16a7600640 1 -- 172.21.15.123:0/917271698 shutdown_connections 2024-04-25T13:42:10.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:10.894+0000 7f16a7600640 1 -- 172.21.15.123:0/917271698 wait complete. 2024-04-25T13:42:10.916 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-25T13:42:09.576869+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219088,"kb_used_data":2884,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755632,"statfs":{"total":773094113280,"available":772869767168,"internally_reserved":0,"allocated":2953216,"data_stored":1774584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,10],"upper_bound":32},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.191387"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.443626+0000","last_change":"2024-04-25T13:42:06.439729+0000","last_active":"2024-04-25T13:42:06.443626+0000","last_peered":"2024-04-25T13:42:06.443626+0000","last_clean":"2024-04-25T13:42:06.443626+0000","last_became_active":"2024-04-25T13:42:06.439449+0000","last_became_peered":"2024-04-25T13:42:06.439449+0000","last_unstale":"2024-04-25T13:42:06.443626+0000","last_undegraded":"2024-04-25T13:42:06.443626+0000","last_fullsized":"2024-04-25T13:42:06.443626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:38.216116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414744+0000","last_change":"2024-04-25T13:42:06.425008+0000","last_active":"2024-04-25T13:42:07.414744+0000","last_peered":"2024-04-25T13:42:07.414744+0000","last_clean":"2024-04-25T13:42:07.414744+0000","last_became_active":"2024-04-25T13:42:06.424669+0000","last_became_peered":"2024-04-25T13:42:06.424669+0000","last_unstale":"2024-04-25T13:42:07.414744+0000","last_undegraded":"2024-04-25T13:42:07.414744+0000","last_fullsized":"2024-04-25T13:42:07.414744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.382442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.433986+0000","last_change":"2024-04-25T13:42:06.425220+0000","last_active":"2024-04-25T13:42:06.433986+0000","last_peered":"2024-04-25T13:42:06.433986+0000","last_clean":"2024-04-25T13:42:06.433986+0000","last_became_active":"2024-04-25T13:42:06.424908+0000","last_became_peered":"2024-04-25T13:42:06.424908+0000","last_unstale":"2024-04-25T13:42:06.433986+0000","last_undegraded":"2024-04-25T13:42:06.433986+0000","last_fullsized":"2024-04-25T13:42:06.433986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:43.962804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416285+0000","last_change":"2024-04-25T13:42:06.437672+0000","last_active":"2024-04-25T13:42:07.416285+0000","last_peered":"2024-04-25T13:42:07.416285+0000","last_clean":"2024-04-25T13:42:07.416285+0000","last_became_active":"2024-04-25T13:42:06.425596+0000","last_became_peered":"2024-04-25T13:42:06.425596+0000","last_unstale":"2024-04-25T13:42:07.416285+0000","last_undegraded":"2024-04-25T13:42:07.416285+0000","last_fullsized":"2024-04-25T13:42:07.416285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:37.549411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.441288+0000","last_change":"2024-04-25T13:42:06.435739+0000","last_active":"2024-04-25T13:42:06.441288+0000","last_peered":"2024-04-25T13:42:06.441288+0000","last_clean":"2024-04-25T13:42:06.441288+0000","last_became_active":"2024-04-25T13:42:06.435439+0000","last_became_peered":"2024-04-25T13:42:06.435439+0000","last_unstale":"2024-04-25T13:42:06.441288+0000","last_undegraded":"2024-04-25T13:42:06.441288+0000","last_fullsized":"2024-04-25T13:42:06.441288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:06.506569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415289+0000","last_change":"2024-04-25T13:42:06.442430+0000","last_active":"2024-04-25T13:42:07.415289+0000","last_peered":"2024-04-25T13:42:07.415289+0000","last_clean":"2024-04-25T13:42:07.415289+0000","last_became_active":"2024-04-25T13:42:06.442052+0000","last_became_peered":"2024-04-25T13:42:06.442052+0000","last_unstale":"2024-04-25T13:42:07.415289+0000","last_undegraded":"2024-04-25T13:42:07.415289+0000","last_fullsized":"2024-04-25T13:42:07.415289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.382442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.441898+0000","last_change":"2024-04-25T13:42:06.435115+0000","last_active":"2024-04-25T13:42:06.441898+0000","last_peered":"2024-04-25T13:42:06.441898+0000","last_clean":"2024-04-25T13:42:06.441898+0000","last_became_active":"2024-04-25T13:42:06.434872+0000","last_became_peered":"2024-04-25T13:42:06.434872+0000","last_unstale":"2024-04-25T13:42:06.441898+0000","last_undegraded":"2024-04-25T13:42:06.441898+0000","last_fullsized":"2024-04-25T13:42:06.441898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:51:33.230810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695416+0000","last_change":"2024-04-25T13:42:06.447825+0000","last_active":"2024-04-25T13:42:07.695416+0000","last_peered":"2024-04-25T13:42:07.695416+0000","last_clean":"2024-04-25T13:42:07.695416+0000","last_became_active":"2024-04-25T13:42:06.447512+0000","last_became_peered":"2024-04-25T13:42:06.447512+0000","last_unstale":"2024-04-25T13:42:07.695416+0000","last_undegraded":"2024-04-25T13:42:07.695416+0000","last_fullsized":"2024-04-25T13:42:07.695416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:54.457915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.452395+0000","last_change":"2024-04-25T13:42:06.449425+0000","last_active":"2024-04-25T13:42:06.452395+0000","last_peered":"2024-04-25T13:42:06.452395+0000","last_clean":"2024-04-25T13:42:06.452395+0000","last_became_active":"2024-04-25T13:42:06.449116+0000","last_became_peered":"2024-04-25T13:42:06.449116+0000","last_unstale":"2024-04-25T13:42:06.452395+0000","last_undegraded":"2024-04-25T13:42:06.452395+0000","last_fullsized":"2024-04-25T13:42:06.452395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:38.780588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414743+0000","last_change":"2024-04-25T13:42:06.444979+0000","last_active":"2024-04-25T13:42:07.414743+0000","last_peered":"2024-04-25T13:42:07.414743+0000","last_clean":"2024-04-25T13:42:07.414743+0000","last_became_active":"2024-04-25T13:42:06.444648+0000","last_became_peered":"2024-04-25T13:42:06.444648+0000","last_unstale":"2024-04-25T13:42:07.414743+0000","last_undegraded":"2024-04-25T13:42:07.414743+0000","last_fullsized":"2024-04-25T13:42:07.414743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:45.608285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414435+0000","last_change":"2024-04-25T13:42:06.445383+0000","last_active":"2024-04-25T13:42:07.414435+0000","last_peered":"2024-04-25T13:42:07.414435+0000","last_clean":"2024-04-25T13:42:07.414435+0000","last_became_active":"2024-04-25T13:42:06.445066+0000","last_became_peered":"2024-04-25T13:42:06.445066+0000","last_unstale":"2024-04-25T13:42:07.414435+0000","last_undegraded":"2024-04-25T13:42:07.414435+0000","last_fullsized":"2024-04-25T13:42:07.414435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:43.073677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.870052+0000","last_change":"2024-04-25T13:42:06.436929+0000","last_active":"2024-04-25T13:42:07.870052+0000","last_peered":"2024-04-25T13:42:07.870052+0000","last_clean":"2024-04-25T13:42:07.870052+0000","last_became_active":"2024-04-25T13:42:06.436642+0000","last_became_peered":"2024-04-25T13:42:06.436642+0000","last_unstale":"2024-04-25T13:42:07.870052+0000","last_undegraded":"2024-04-25T13:42:07.870052+0000","last_fullsized":"2024-04-25T13:42:07.870052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:59.508605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695711+0000","last_change":"2024-04-25T13:42:06.421115+0000","last_active":"2024-04-25T13:42:07.695711+0000","last_peered":"2024-04-25T13:42:07.695711+0000","last_clean":"2024-04-25T13:42:07.695711+0000","last_became_active":"2024-04-25T13:42:06.420817+0000","last_became_peered":"2024-04-25T13:42:06.420817+0000","last_unstale":"2024-04-25T13:42:07.695711+0000","last_undegraded":"2024-04-25T13:42:07.695711+0000","last_fullsized":"2024-04-25T13:42:07.695711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:45.608285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.435972+0000","last_change":"2024-04-25T13:42:06.430965+0000","last_active":"2024-04-25T13:42:06.435972+0000","last_peered":"2024-04-25T13:42:06.435972+0000","last_clean":"2024-04-25T13:42:06.435972+0000","last_became_active":"2024-04-25T13:42:06.430586+0000","last_became_peered":"2024-04-25T13:42:06.430586+0000","last_unstale":"2024-04-25T13:42:06.435972+0000","last_undegraded":"2024-04-25T13:42:06.435972+0000","last_fullsized":"2024-04-25T13:42:06.435972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:14.980250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414156+0000","last_change":"2024-04-25T13:42:06.414901+0000","last_active":"2024-04-25T13:42:07.414156+0000","last_peered":"2024-04-25T13:42:07.414156+0000","last_clean":"2024-04-25T13:42:07.414156+0000","last_became_active":"2024-04-25T13:42:06.414422+0000","last_became_peered":"2024-04-25T13:42:06.414422+0000","last_unstale":"2024-04-25T13:42:07.414156+0000","last_undegraded":"2024-04-25T13:42:07.414156+0000","last_fullsized":"2024-04-25T13:42:07.414156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:43.073677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414538+0000","last_change":"2024-04-25T13:42:06.429527+0000","last_active":"2024-04-25T13:42:07.414538+0000","last_peered":"2024-04-25T13:42:07.414538+0000","last_clean":"2024-04-25T13:42:07.414538+0000","last_became_active":"2024-04-25T13:42:06.428862+0000","last_became_peered":"2024-04-25T13:42:06.428862+0000","last_unstale":"2024-04-25T13:42:07.414538+0000","last_undegraded":"2024-04-25T13:42:07.414538+0000","last_fullsized":"2024-04-25T13:42:07.414538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:21.556056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416688+0000","last_change":"2024-04-25T13:42:06.445283+0000","last_active":"2024-04-25T13:42:07.416688+0000","last_peered":"2024-04-25T13:42:07.416688+0000","last_clean":"2024-04-25T13:42:07.416688+0000","last_became_active":"2024-04-25T13:42:06.445004+0000","last_became_peered":"2024-04-25T13:42:06.445004+0000","last_unstale":"2024-04-25T13:42:07.416688+0000","last_undegraded":"2024-04-25T13:42:07.416688+0000","last_fullsized":"2024-04-25T13:42:07.416688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:36:55.456363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.429954+0000","last_change":"2024-04-25T13:42:06.427048+0000","last_active":"2024-04-25T13:42:06.429954+0000","last_peered":"2024-04-25T13:42:06.429954+0000","last_clean":"2024-04-25T13:42:06.429954+0000","last_became_active":"2024-04-25T13:42:06.426733+0000","last_became_peered":"2024-04-25T13:42:06.426733+0000","last_unstale":"2024-04-25T13:42:06.429954+0000","last_undegraded":"2024-04-25T13:42:06.429954+0000","last_fullsized":"2024-04-25T13:42:06.429954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:14.980250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.443648+0000","last_change":"2024-04-25T13:42:06.440148+0000","last_active":"2024-04-25T13:42:06.443648+0000","last_peered":"2024-04-25T13:42:06.443648+0000","last_clean":"2024-04-25T13:42:06.443648+0000","last_became_active":"2024-04-25T13:42:06.439713+0000","last_became_peered":"2024-04-25T13:42:06.439713+0000","last_unstale":"2024-04-25T13:42:06.443648+0000","last_undegraded":"2024-04-25T13:42:06.443648+0000","last_fullsized":"2024-04-25T13:42:06.443648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:43.073677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415435+0000","last_change":"2024-04-25T13:42:06.420914+0000","last_active":"2024-04-25T13:42:07.415435+0000","last_peered":"2024-04-25T13:42:07.415435+0000","last_clean":"2024-04-25T13:42:07.415435+0000","last_became_active":"2024-04-25T13:42:06.420671+0000","last_became_peered":"2024-04-25T13:42:06.420671+0000","last_unstale":"2024-04-25T13:42:07.415435+0000","last_undegraded":"2024-04-25T13:42:07.415435+0000","last_fullsized":"2024-04-25T13:42:07.415435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.382442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.440721+0000","last_change":"2024-04-25T13:42:06.436778+0000","last_active":"2024-04-25T13:42:06.440721+0000","last_peered":"2024-04-25T13:42:06.440721+0000","last_clean":"2024-04-25T13:42:06.440721+0000","last_became_active":"2024-04-25T13:42:06.436267+0000","last_became_peered":"2024-04-25T13:42:06.436267+0000","last_unstale":"2024-04-25T13:42:06.440721+0000","last_undegraded":"2024-04-25T13:42:06.440721+0000","last_fullsized":"2024-04-25T13:42:06.440721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:59.508605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415476+0000","last_change":"2024-04-25T13:42:06.426502+0000","last_active":"2024-04-25T13:42:07.415476+0000","last_peered":"2024-04-25T13:42:07.415476+0000","last_clean":"2024-04-25T13:42:07.415476+0000","last_became_active":"2024-04-25T13:42:06.426235+0000","last_became_peered":"2024-04-25T13:42:06.426235+0000","last_unstale":"2024-04-25T13:42:07.415476+0000","last_undegraded":"2024-04-25T13:42:07.415476+0000","last_fullsized":"2024-04-25T13:42:07.415476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:38.780588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695449+0000","last_change":"2024-04-25T13:42:06.415204+0000","last_active":"2024-04-25T13:42:07.695449+0000","last_peered":"2024-04-25T13:42:07.695449+0000","last_clean":"2024-04-25T13:42:07.695449+0000","last_became_active":"2024-04-25T13:42:06.414815+0000","last_became_peered":"2024-04-25T13:42:06.414815+0000","last_unstale":"2024-04-25T13:42:07.695449+0000","last_undegraded":"2024-04-25T13:42:07.695449+0000","last_fullsized":"2024-04-25T13:42:07.695449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:38.216116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414732+0000","last_change":"2024-04-25T13:42:06.429164+0000","last_active":"2024-04-25T13:42:07.414732+0000","last_peered":"2024-04-25T13:42:07.414732+0000","last_clean":"2024-04-25T13:42:07.414732+0000","last_became_active":"2024-04-25T13:42:06.428466+0000","last_became_peered":"2024-04-25T13:42:06.428466+0000","last_unstale":"2024-04-25T13:42:07.414732+0000","last_undegraded":"2024-04-25T13:42:07.414732+0000","last_fullsized":"2024-04-25T13:42:07.414732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:45.608285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695932+0000","last_change":"2024-04-25T13:42:06.416633+0000","last_active":"2024-04-25T13:42:07.695932+0000","last_peered":"2024-04-25T13:42:07.695932+0000","last_clean":"2024-04-25T13:42:07.695932+0000","last_became_active":"2024-04-25T13:42:06.415982+0000","last_became_peered":"2024-04-25T13:42:06.415982+0000","last_unstale":"2024-04-25T13:42:07.695932+0000","last_undegraded":"2024-04-25T13:42:07.695932+0000","last_fullsized":"2024-04-25T13:42:07.695932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:37.549411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414733+0000","last_change":"2024-04-25T13:42:06.429813+0000","last_active":"2024-04-25T13:42:07.414733+0000","last_peered":"2024-04-25T13:42:07.414733+0000","last_clean":"2024-04-25T13:42:07.414733+0000","last_became_active":"2024-04-25T13:42:06.429201+0000","last_became_peered":"2024-04-25T13:42:06.429201+0000","last_unstale":"2024-04-25T13:42:07.414733+0000","last_undegraded":"2024-04-25T13:42:07.414733+0000","last_fullsized":"2024-04-25T13:42:07.414733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:21.556056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414552+0000","last_change":"2024-04-25T13:42:06.423487+0000","last_active":"2024-04-25T13:42:07.414552+0000","last_peered":"2024-04-25T13:42:07.414552+0000","last_clean":"2024-04-25T13:42:07.414552+0000","last_became_active":"2024-04-25T13:42:06.423175+0000","last_became_peered":"2024-04-25T13:42:06.423175+0000","last_unstale":"2024-04-25T13:42:07.414552+0000","last_undegraded":"2024-04-25T13:42:07.414552+0000","last_fullsized":"2024-04-25T13:42:07.414552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:45.608285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695845+0000","last_change":"2024-04-25T13:42:06.419669+0000","last_active":"2024-04-25T13:42:07.695845+0000","last_peered":"2024-04-25T13:42:07.695845+0000","last_clean":"2024-04-25T13:42:07.695845+0000","last_became_active":"2024-04-25T13:42:06.419352+0000","last_became_peered":"2024-04-25T13:42:06.419352+0000","last_unstale":"2024-04-25T13:42:07.695845+0000","last_undegraded":"2024-04-25T13:42:07.695845+0000","last_fullsized":"2024-04-25T13:42:07.695845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:38.780588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.432224+0000","last_change":"2024-04-25T13:42:06.424606+0000","last_active":"2024-04-25T13:42:06.432224+0000","last_peered":"2024-04-25T13:42:06.432224+0000","last_clean":"2024-04-25T13:42:06.432224+0000","last_became_active":"2024-04-25T13:42:06.424286+0000","last_became_peered":"2024-04-25T13:42:06.424286+0000","last_unstale":"2024-04-25T13:42:06.432224+0000","last_undegraded":"2024-04-25T13:42:06.432224+0000","last_fullsized":"2024-04-25T13:42:06.432224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:40.020511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415714+0000","last_change":"2024-04-25T13:42:06.437956+0000","last_active":"2024-04-25T13:42:07.415714+0000","last_peered":"2024-04-25T13:42:07.415714+0000","last_clean":"2024-04-25T13:42:07.415714+0000","last_became_active":"2024-04-25T13:42:06.437530+0000","last_became_peered":"2024-04-25T13:42:06.437530+0000","last_unstale":"2024-04-25T13:42:07.415714+0000","last_undegraded":"2024-04-25T13:42:07.415714+0000","last_fullsized":"2024-04-25T13:42:07.415714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:32.855388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.424616+0000","last_change":"2024-04-25T13:42:06.420035+0000","last_active":"2024-04-25T13:42:06.424616+0000","last_peered":"2024-04-25T13:42:06.424616+0000","last_clean":"2024-04-25T13:42:06.424616+0000","last_became_active":"2024-04-25T13:42:06.419452+0000","last_became_peered":"2024-04-25T13:42:06.419452+0000","last_unstale":"2024-04-25T13:42:06.424616+0000","last_undegraded":"2024-04-25T13:42:06.424616+0000","last_fullsized":"2024-04-25T13:42:06.424616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:43.962804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414133+0000","last_change":"2024-04-25T13:42:06.428858+0000","last_active":"2024-04-25T13:42:07.414133+0000","last_peered":"2024-04-25T13:42:07.414133+0000","last_clean":"2024-04-25T13:42:07.414133+0000","last_became_active":"2024-04-25T13:42:06.428622+0000","last_became_peered":"2024-04-25T13:42:06.428622+0000","last_unstale":"2024-04-25T13:42:07.414133+0000","last_undegraded":"2024-04-25T13:42:07.414133+0000","last_fullsized":"2024-04-25T13:42:07.414133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:54.457915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.869806+0000","last_change":"2024-04-25T13:42:06.412033+0000","last_active":"2024-04-25T13:42:07.869806+0000","last_peered":"2024-04-25T13:42:07.869806+0000","last_clean":"2024-04-25T13:42:07.869806+0000","last_became_active":"2024-04-25T13:42:06.411702+0000","last_became_peered":"2024-04-25T13:42:06.411702+0000","last_unstale":"2024-04-25T13:42:07.869806+0000","last_undegraded":"2024-04-25T13:42:07.869806+0000","last_fullsized":"2024-04-25T13:42:07.869806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:21.415710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695870+0000","last_change":"2024-04-25T13:42:05.426545+0000","last_active":"2024-04-25T13:42:07.695870+0000","last_peered":"2024-04-25T13:42:07.695870+0000","last_clean":"2024-04-25T13:42:07.695870+0000","last_became_active":"2024-04-25T13:42:05.425486+0000","last_became_peered":"2024-04-25T13:42:05.425486+0000","last_unstale":"2024-04-25T13:42:07.695870+0000","last_undegraded":"2024-04-25T13:42:07.695870+0000","last_fullsized":"2024-04-25T13:42:07.695870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:38.792763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.432201+0000","last_change":"2024-04-25T13:42:06.424104+0000","last_active":"2024-04-25T13:42:06.432201+0000","last_peered":"2024-04-25T13:42:06.432201+0000","last_clean":"2024-04-25T13:42:06.432201+0000","last_became_active":"2024-04-25T13:42:06.423795+0000","last_became_peered":"2024-04-25T13:42:06.423795+0000","last_unstale":"2024-04-25T13:42:06.432201+0000","last_undegraded":"2024-04-25T13:42:06.432201+0000","last_fullsized":"2024-04-25T13:42:06.432201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:51.173110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414254+0000","last_change":"2024-04-25T13:42:05.412559+0000","last_active":"2024-04-25T13:42:07.414254+0000","last_peered":"2024-04-25T13:42:07.414254+0000","last_clean":"2024-04-25T13:42:07.414254+0000","last_became_active":"2024-04-25T13:42:05.412190+0000","last_became_peered":"2024-04-25T13:42:05.412190+0000","last_unstale":"2024-04-25T13:42:07.414254+0000","last_undegraded":"2024-04-25T13:42:07.414254+0000","last_fullsized":"2024-04-25T13:42:07.414254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:20.409104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695565+0000","last_change":"2024-04-25T13:42:05.425544+0000","last_active":"2024-04-25T13:42:07.695565+0000","last_peered":"2024-04-25T13:42:07.695565+0000","last_clean":"2024-04-25T13:42:07.695565+0000","last_became_active":"2024-04-25T13:42:05.425115+0000","last_became_peered":"2024-04-25T13:42:05.425115+0000","last_unstale":"2024-04-25T13:42:07.695565+0000","last_undegraded":"2024-04-25T13:42:07.695565+0000","last_fullsized":"2024-04-25T13:42:07.695565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:25.873825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695674+0000","last_change":"2024-04-25T13:42:06.428073+0000","last_active":"2024-04-25T13:42:07.695674+0000","last_peered":"2024-04-25T13:42:07.695674+0000","last_clean":"2024-04-25T13:42:07.695674+0000","last_became_active":"2024-04-25T13:42:06.427682+0000","last_became_peered":"2024-04-25T13:42:06.427682+0000","last_unstale":"2024-04-25T13:42:07.695674+0000","last_undegraded":"2024-04-25T13:42:07.695674+0000","last_fullsized":"2024-04-25T13:42:07.695674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:21.556056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414858+0000","last_change":"2024-04-25T13:42:05.409548+0000","last_active":"2024-04-25T13:42:07.414858+0000","last_peered":"2024-04-25T13:42:07.414858+0000","last_clean":"2024-04-25T13:42:07.414858+0000","last_became_active":"2024-04-25T13:42:05.409160+0000","last_became_peered":"2024-04-25T13:42:05.409160+0000","last_unstale":"2024-04-25T13:42:07.414858+0000","last_undegraded":"2024-04-25T13:42:07.414858+0000","last_fullsized":"2024-04-25T13:42:07.414858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:42.956198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414147+0000","last_change":"2024-04-25T13:42:06.417091+0000","last_active":"2024-04-25T13:42:07.414147+0000","last_peered":"2024-04-25T13:42:07.414147+0000","last_clean":"2024-04-25T13:42:07.414147+0000","last_became_active":"2024-04-25T13:42:06.416569+0000","last_became_peered":"2024-04-25T13:42:06.416569+0000","last_unstale":"2024-04-25T13:42:07.414147+0000","last_undegraded":"2024-04-25T13:42:07.414147+0000","last_fullsized":"2024-04-25T13:42:07.414147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:38.216116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414775+0000","last_change":"2024-04-25T13:42:05.418974+0000","last_active":"2024-04-25T13:42:07.414775+0000","last_peered":"2024-04-25T13:42:07.414775+0000","last_clean":"2024-04-25T13:42:07.414775+0000","last_became_active":"2024-04-25T13:42:05.418671+0000","last_became_peered":"2024-04-25T13:42:05.418671+0000","last_unstale":"2024-04-25T13:42:07.414775+0000","last_undegraded":"2024-04-25T13:42:07.414775+0000","last_fullsized":"2024-04-25T13:42:07.414775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:50.166504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416407+0000","last_change":"2024-04-25T13:42:06.439202+0000","last_active":"2024-04-25T13:42:07.416407+0000","last_peered":"2024-04-25T13:42:07.416407+0000","last_clean":"2024-04-25T13:42:07.416407+0000","last_became_active":"2024-04-25T13:42:06.438901+0000","last_became_peered":"2024-04-25T13:42:06.438901+0000","last_unstale":"2024-04-25T13:42:07.416407+0000","last_undegraded":"2024-04-25T13:42:07.416407+0000","last_fullsized":"2024-04-25T13:42:07.416407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:02.934983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416416+0000","last_change":"2024-04-25T13:42:05.418579+0000","last_active":"2024-04-25T13:42:07.416416+0000","last_peered":"2024-04-25T13:42:07.416416+0000","last_clean":"2024-04-25T13:42:07.416416+0000","last_became_active":"2024-04-25T13:42:05.418233+0000","last_became_peered":"2024-04-25T13:42:05.418233+0000","last_unstale":"2024-04-25T13:42:07.416416+0000","last_undegraded":"2024-04-25T13:42:07.416416+0000","last_fullsized":"2024-04-25T13:42:07.416416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:20.409104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.452576+0000","last_change":"2024-04-25T13:42:06.449721+0000","last_active":"2024-04-25T13:42:06.452576+0000","last_peered":"2024-04-25T13:42:06.452576+0000","last_clean":"2024-04-25T13:42:06.452576+0000","last_became_active":"2024-04-25T13:42:06.449373+0000","last_became_peered":"2024-04-25T13:42:06.449373+0000","last_unstale":"2024-04-25T13:42:06.452576+0000","last_undegraded":"2024-04-25T13:42:06.452576+0000","last_fullsized":"2024-04-25T13:42:06.452576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:28.591141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414570+0000","last_change":"2024-04-25T13:42:05.418805+0000","last_active":"2024-04-25T13:42:07.414570+0000","last_peered":"2024-04-25T13:42:07.414570+0000","last_clean":"2024-04-25T13:42:07.414570+0000","last_became_active":"2024-04-25T13:42:05.418384+0000","last_became_peered":"2024-04-25T13:42:05.418384+0000","last_unstale":"2024-04-25T13:42:07.414570+0000","last_undegraded":"2024-04-25T13:42:07.414570+0000","last_fullsized":"2024-04-25T13:42:07.414570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:21.589517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.870107+0000","last_change":"2024-04-25T13:42:06.415649+0000","last_active":"2024-04-25T13:42:07.870107+0000","last_peered":"2024-04-25T13:42:07.870107+0000","last_clean":"2024-04-25T13:42:07.870107+0000","last_became_active":"2024-04-25T13:42:06.411373+0000","last_became_peered":"2024-04-25T13:42:06.411373+0000","last_unstale":"2024-04-25T13:42:07.870107+0000","last_undegraded":"2024-04-25T13:42:07.870107+0000","last_fullsized":"2024-04-25T13:42:07.870107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:04.702886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415602+0000","last_change":"2024-04-25T13:42:05.423758+0000","last_active":"2024-04-25T13:42:07.415602+0000","last_peered":"2024-04-25T13:42:07.415602+0000","last_clean":"2024-04-25T13:42:07.415602+0000","last_became_active":"2024-04-25T13:42:05.423343+0000","last_became_peered":"2024-04-25T13:42:05.423343+0000","last_unstale":"2024-04-25T13:42:07.415602+0000","last_undegraded":"2024-04-25T13:42:07.415602+0000","last_fullsized":"2024-04-25T13:42:07.415602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:42.956198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.443522+0000","last_change":"2024-04-25T13:42:06.438756+0000","last_active":"2024-04-25T13:42:06.443522+0000","last_peered":"2024-04-25T13:42:06.443522+0000","last_clean":"2024-04-25T13:42:06.443522+0000","last_became_active":"2024-04-25T13:42:06.432572+0000","last_became_peered":"2024-04-25T13:42:06.432572+0000","last_unstale":"2024-04-25T13:42:06.443522+0000","last_undegraded":"2024-04-25T13:42:06.443522+0000","last_fullsized":"2024-04-25T13:42:06.443522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:54.457915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.432141+0000","last_change":"2024-04-25T13:42:05.405101+0000","last_active":"2024-04-25T13:42:06.432141+0000","last_peered":"2024-04-25T13:42:06.432141+0000","last_clean":"2024-04-25T13:42:06.432141+0000","last_became_active":"2024-04-25T13:42:05.404246+0000","last_became_peered":"2024-04-25T13:42:05.404246+0000","last_unstale":"2024-04-25T13:42:06.432141+0000","last_undegraded":"2024-04-25T13:42:06.432141+0000","last_fullsized":"2024-04-25T13:42:06.432141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:25.873825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.440713+0000","last_change":"2024-04-25T13:42:06.436678+0000","last_active":"2024-04-25T13:42:06.440713+0000","last_peered":"2024-04-25T13:42:06.440713+0000","last_clean":"2024-04-25T13:42:06.440713+0000","last_became_active":"2024-04-25T13:42:06.436287+0000","last_became_peered":"2024-04-25T13:42:06.436287+0000","last_unstale":"2024-04-25T13:42:06.440713+0000","last_undegraded":"2024-04-25T13:42:06.440713+0000","last_fullsized":"2024-04-25T13:42:06.440713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:22.596123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415802+0000","last_change":"2024-04-25T13:42:05.417191+0000","last_active":"2024-04-25T13:42:07.415802+0000","last_peered":"2024-04-25T13:42:07.415802+0000","last_clean":"2024-04-25T13:42:07.415802+0000","last_became_active":"2024-04-25T13:42:05.416840+0000","last_became_peered":"2024-04-25T13:42:05.416840+0000","last_unstale":"2024-04-25T13:42:07.415802+0000","last_undegraded":"2024-04-25T13:42:07.415802+0000","last_fullsized":"2024-04-25T13:42:07.415802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:50.166504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.448105+0000","last_change":"2024-04-25T13:42:06.444118+0000","last_active":"2024-04-25T13:42:06.448105+0000","last_peered":"2024-04-25T13:42:06.448105+0000","last_clean":"2024-04-25T13:42:06.448105+0000","last_became_active":"2024-04-25T13:42:06.443524+0000","last_became_peered":"2024-04-25T13:42:06.443524+0000","last_unstale":"2024-04-25T13:42:06.448105+0000","last_undegraded":"2024-04-25T13:42:06.448105+0000","last_fullsized":"2024-04-25T13:42:06.448105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:45.608285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414098+0000","last_change":"2024-04-25T13:42:05.414280+0000","last_active":"2024-04-25T13:42:07.414098+0000","last_peered":"2024-04-25T13:42:07.414098+0000","last_clean":"2024-04-25T13:42:07.414098+0000","last_became_active":"2024-04-25T13:42:05.413281+0000","last_became_peered":"2024-04-25T13:42:05.413281+0000","last_unstale":"2024-04-25T13:42:07.414098+0000","last_undegraded":"2024-04-25T13:42:07.414098+0000","last_fullsized":"2024-04-25T13:42:07.414098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:13.973644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414504+0000","last_change":"2024-04-25T13:42:06.430703+0000","last_active":"2024-04-25T13:42:07.414504+0000","last_peered":"2024-04-25T13:42:07.414504+0000","last_clean":"2024-04-25T13:42:07.414504+0000","last_became_active":"2024-04-25T13:42:06.428292+0000","last_became_peered":"2024-04-25T13:42:06.428292+0000","last_unstale":"2024-04-25T13:42:07.414504+0000","last_undegraded":"2024-04-25T13:42:07.414504+0000","last_fullsized":"2024-04-25T13:42:07.414504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:00.017229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.432910+0000","last_change":"2024-04-25T13:42:05.423359+0000","last_active":"2024-04-25T13:42:06.432910+0000","last_peered":"2024-04-25T13:42:06.432910+0000","last_clean":"2024-04-25T13:42:06.432910+0000","last_became_active":"2024-04-25T13:42:05.418070+0000","last_became_peered":"2024-04-25T13:42:05.418070+0000","last_unstale":"2024-04-25T13:42:06.432910+0000","last_undegraded":"2024-04-25T13:42:06.432910+0000","last_fullsized":"2024-04-25T13:42:06.432910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:38.792763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.443470+0000","last_change":"2024-04-25T13:42:06.438416+0000","last_active":"2024-04-25T13:42:06.443470+0000","last_peered":"2024-04-25T13:42:06.443470+0000","last_clean":"2024-04-25T13:42:06.443470+0000","last_became_active":"2024-04-25T13:42:06.436122+0000","last_became_peered":"2024-04-25T13:42:06.436122+0000","last_unstale":"2024-04-25T13:42:06.443470+0000","last_undegraded":"2024-04-25T13:42:06.443470+0000","last_fullsized":"2024-04-25T13:42:06.443470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:44.638274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.870073+0000","last_change":"2024-04-25T13:42:05.411439+0000","last_active":"2024-04-25T13:42:07.870073+0000","last_peered":"2024-04-25T13:42:07.870073+0000","last_clean":"2024-04-25T13:42:07.870073+0000","last_became_active":"2024-04-25T13:42:05.411041+0000","last_became_peered":"2024-04-25T13:42:05.411041+0000","last_unstale":"2024-04-25T13:42:07.870073+0000","last_undegraded":"2024-04-25T13:42:07.870073+0000","last_fullsized":"2024-04-25T13:42:07.870073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:29.973848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.443971+0000","last_change":"2024-04-25T13:42:06.440980+0000","last_active":"2024-04-25T13:42:06.443971+0000","last_peered":"2024-04-25T13:42:06.443971+0000","last_clean":"2024-04-25T13:42:06.443971+0000","last_became_active":"2024-04-25T13:42:06.440605+0000","last_became_peered":"2024-04-25T13:42:06.440605+0000","last_unstale":"2024-04-25T13:42:06.443971+0000","last_undegraded":"2024-04-25T13:42:06.443971+0000","last_fullsized":"2024-04-25T13:42:06.443971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:21.556056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.427272+0000","last_change":"2024-04-25T13:42:05.420768+0000","last_active":"2024-04-25T13:42:06.427272+0000","last_peered":"2024-04-25T13:42:06.427272+0000","last_clean":"2024-04-25T13:42:06.427272+0000","last_became_active":"2024-04-25T13:42:05.420338+0000","last_became_peered":"2024-04-25T13:42:05.420338+0000","last_unstale":"2024-04-25T13:42:06.427272+0000","last_undegraded":"2024-04-25T13:42:06.427272+0000","last_fullsized":"2024-04-25T13:42:06.427272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:50.166504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.444121+0000","last_change":"2024-04-25T13:42:06.440909+0000","last_active":"2024-04-25T13:42:06.444121+0000","last_peered":"2024-04-25T13:42:06.444121+0000","last_clean":"2024-04-25T13:42:06.444121+0000","last_became_active":"2024-04-25T13:42:06.440517+0000","last_became_peered":"2024-04-25T13:42:06.440517+0000","last_unstale":"2024-04-25T13:42:06.444121+0000","last_undegraded":"2024-04-25T13:42:06.444121+0000","last_fullsized":"2024-04-25T13:42:06.444121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:00.017229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414647+0000","last_change":"2024-04-25T13:42:05.421815+0000","last_active":"2024-04-25T13:42:07.414647+0000","last_peered":"2024-04-25T13:42:07.414647+0000","last_clean":"2024-04-25T13:42:07.414647+0000","last_became_active":"2024-04-25T13:42:05.421468+0000","last_became_peered":"2024-04-25T13:42:05.421468+0000","last_unstale":"2024-04-25T13:42:07.414647+0000","last_undegraded":"2024-04-25T13:42:07.414647+0000","last_fullsized":"2024-04-25T13:42:07.414647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:58.501999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416541+0000","last_change":"2024-04-25T13:42:06.425480+0000","last_active":"2024-04-25T13:42:07.416541+0000","last_peered":"2024-04-25T13:42:07.416541+0000","last_clean":"2024-04-25T13:42:07.416541+0000","last_became_active":"2024-04-25T13:42:06.424666+0000","last_became_peered":"2024-04-25T13:42:06.424666+0000","last_unstale":"2024-04-25T13:42:07.416541+0000","last_undegraded":"2024-04-25T13:42:07.416541+0000","last_fullsized":"2024-04-25T13:42:07.416541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:28.530411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.408306+0000","last_change":"2024-04-25T13:42:05.414975+0000","last_active":"2024-04-25T13:42:06.408306+0000","last_peered":"2024-04-25T13:42:06.408306+0000","last_clean":"2024-04-25T13:42:06.408306+0000","last_became_active":"2024-04-25T13:42:05.413273+0000","last_became_peered":"2024-04-25T13:42:05.413273+0000","last_unstale":"2024-04-25T13:42:06.408306+0000","last_undegraded":"2024-04-25T13:42:06.408306+0000","last_fullsized":"2024-04-25T13:42:06.408306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:18.167829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.448506+0000","last_change":"2024-04-25T13:42:06.447253+0000","last_active":"2024-04-25T13:42:06.448506+0000","last_peered":"2024-04-25T13:42:06.448506+0000","last_clean":"2024-04-25T13:42:06.448506+0000","last_became_active":"2024-04-25T13:42:06.446721+0000","last_became_peered":"2024-04-25T13:42:06.446721+0000","last_unstale":"2024-04-25T13:42:06.448506+0000","last_undegraded":"2024-04-25T13:42:06.448506+0000","last_fullsized":"2024-04-25T13:42:06.448506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.382442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":109,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.425168+0000","last_change":"2024-04-25T13:41:56.890628+0000","last_active":"2024-04-25T13:42:06.425168+0000","last_peered":"2024-04-25T13:42:06.425168+0000","last_clean":"2024-04-25T13:42:06.425168+0000","last_became_active":"2024-04-25T13:41:56.889261+0000","last_became_peered":"2024-04-25T13:41:56.889261+0000","last_unstale":"2024-04-25T13:42:06.425168+0000","last_undegraded":"2024-04-25T13:42:06.425168+0000","last_fullsized":"2024-04-25T13:42:06.425168+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:53.940471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:53.940471+0000","last_clean_scrub_stamp":"2024-04-25T13:41:53.940471+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:06.164380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416047+0000","last_change":"2024-04-25T13:42:05.413945+0000","last_active":"2024-04-25T13:42:07.416047+0000","last_peered":"2024-04-25T13:42:07.416047+0000","last_clean":"2024-04-25T13:42:07.416047+0000","last_became_active":"2024-04-25T13:42:05.413653+0000","last_became_peered":"2024-04-25T13:42:05.413653+0000","last_unstale":"2024-04-25T13:42:07.416047+0000","last_undegraded":"2024-04-25T13:42:07.416047+0000","last_fullsized":"2024-04-25T13:42:07.416047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:18.167829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695600+0000","last_change":"2024-04-25T13:42:06.447412+0000","last_active":"2024-04-25T13:42:07.695600+0000","last_peered":"2024-04-25T13:42:07.695600+0000","last_clean":"2024-04-25T13:42:07.695600+0000","last_became_active":"2024-04-25T13:42:06.447163+0000","last_became_peered":"2024-04-25T13:42:06.447163+0000","last_unstale":"2024-04-25T13:42:07.695600+0000","last_undegraded":"2024-04-25T13:42:07.695600+0000","last_fullsized":"2024-04-25T13:42:07.695600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:43.073677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.416134+0000","last_change":"2024-04-25T13:42:05.425468+0000","last_active":"2024-04-25T13:42:06.416134+0000","last_peered":"2024-04-25T13:42:06.416134+0000","last_clean":"2024-04-25T13:42:06.416134+0000","last_became_active":"2024-04-25T13:42:05.425039+0000","last_became_peered":"2024-04-25T13:42:05.425039+0000","last_unstale":"2024-04-25T13:42:06.416134+0000","last_undegraded":"2024-04-25T13:42:06.416134+0000","last_fullsized":"2024-04-25T13:42:06.416134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:13.973644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.431265+0000","last_change":"2024-04-25T13:42:06.423330+0000","last_active":"2024-04-25T13:42:06.431265+0000","last_peered":"2024-04-25T13:42:06.431265+0000","last_clean":"2024-04-25T13:42:06.431265+0000","last_became_active":"2024-04-25T13:42:06.422548+0000","last_became_peered":"2024-04-25T13:42:06.422548+0000","last_unstale":"2024-04-25T13:42:06.431265+0000","last_undegraded":"2024-04-25T13:42:06.431265+0000","last_fullsized":"2024-04-25T13:42:06.431265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:19.174434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.409712+0000","last_change":"2024-04-25T13:42:05.416592+0000","last_active":"2024-04-25T13:42:06.409712+0000","last_peered":"2024-04-25T13:42:06.409712+0000","last_clean":"2024-04-25T13:42:06.409712+0000","last_became_active":"2024-04-25T13:42:05.416251+0000","last_became_peered":"2024-04-25T13:42:05.416251+0000","last_unstale":"2024-04-25T13:42:06.409712+0000","last_undegraded":"2024-04-25T13:42:06.409712+0000","last_fullsized":"2024-04-25T13:42:06.409712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:39.013905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414307+0000","last_change":"2024-04-25T13:42:06.405128+0000","last_active":"2024-04-25T13:42:07.414307+0000","last_peered":"2024-04-25T13:42:07.414307+0000","last_clean":"2024-04-25T13:42:07.414307+0000","last_became_active":"2024-04-25T13:42:06.404786+0000","last_became_peered":"2024-04-25T13:42:06.404786+0000","last_unstale":"2024-04-25T13:42:07.414307+0000","last_undegraded":"2024-04-25T13:42:07.414307+0000","last_fullsized":"2024-04-25T13:42:07.414307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:00.017229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415847+0000","last_change":"2024-04-25T13:42:05.417435+0000","last_active":"2024-04-25T13:42:07.415847+0000","last_peered":"2024-04-25T13:42:07.415847+0000","last_clean":"2024-04-25T13:42:07.415847+0000","last_became_active":"2024-04-25T13:42:05.417069+0000","last_became_peered":"2024-04-25T13:42:05.417069+0000","last_unstale":"2024-04-25T13:42:07.415847+0000","last_undegraded":"2024-04-25T13:42:07.415847+0000","last_fullsized":"2024-04-25T13:42:07.415847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:39.013905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.869855+0000","last_change":"2024-04-25T13:42:06.435494+0000","last_active":"2024-04-25T13:42:07.869855+0000","last_peered":"2024-04-25T13:42:07.869855+0000","last_clean":"2024-04-25T13:42:07.869855+0000","last_became_active":"2024-04-25T13:42:06.425605+0000","last_became_peered":"2024-04-25T13:42:06.425605+0000","last_unstale":"2024-04-25T13:42:07.869855+0000","last_undegraded":"2024-04-25T13:42:07.869855+0000","last_fullsized":"2024-04-25T13:42:07.869855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:14.980250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414503+0000","last_change":"2024-04-25T13:42:05.419749+0000","last_active":"2024-04-25T13:42:07.414503+0000","last_peered":"2024-04-25T13:42:07.414503+0000","last_clean":"2024-04-25T13:42:07.414503+0000","last_became_active":"2024-04-25T13:42:05.419446+0000","last_became_peered":"2024-04-25T13:42:05.419446+0000","last_unstale":"2024-04-25T13:42:07.414503+0000","last_undegraded":"2024-04-25T13:42:07.414503+0000","last_fullsized":"2024-04-25T13:42:07.414503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:39.013905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416544+0000","last_change":"2024-04-25T13:42:06.438221+0000","last_active":"2024-04-25T13:42:07.416544+0000","last_peered":"2024-04-25T13:42:07.416544+0000","last_clean":"2024-04-25T13:42:07.416544+0000","last_became_active":"2024-04-25T13:42:06.430658+0000","last_became_peered":"2024-04-25T13:42:06.430658+0000","last_unstale":"2024-04-25T13:42:07.416544+0000","last_undegraded":"2024-04-25T13:42:07.416544+0000","last_fullsized":"2024-04-25T13:42:07.416544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:55.637014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.423504+0000","last_change":"2024-04-25T13:42:05.427944+0000","last_active":"2024-04-25T13:42:06.423504+0000","last_peered":"2024-04-25T13:42:06.423504+0000","last_clean":"2024-04-25T13:42:06.423504+0000","last_became_active":"2024-04-25T13:42:05.427721+0000","last_became_peered":"2024-04-25T13:42:05.427721+0000","last_unstale":"2024-04-25T13:42:06.423504+0000","last_undegraded":"2024-04-25T13:42:06.423504+0000","last_fullsized":"2024-04-25T13:42:06.423504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:27.584535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414350+0000","last_change":"2024-04-25T13:42:06.410624+0000","last_active":"2024-04-25T13:42:07.414350+0000","last_peered":"2024-04-25T13:42:07.414350+0000","last_clean":"2024-04-25T13:42:07.414350+0000","last_became_active":"2024-04-25T13:42:06.410260+0000","last_became_peered":"2024-04-25T13:42:06.410260+0000","last_unstale":"2024-04-25T13:42:07.414350+0000","last_undegraded":"2024-04-25T13:42:07.414350+0000","last_fullsized":"2024-04-25T13:42:07.414350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:21.556056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:08.407723+0000","last_change":"2024-04-25T13:42:05.420418+0000","last_active":"2024-04-25T13:42:08.407723+0000","last_peered":"2024-04-25T13:42:08.407723+0000","last_clean":"2024-04-25T13:42:08.407723+0000","last_became_active":"2024-04-25T13:42:05.420002+0000","last_became_peered":"2024-04-25T13:42:05.420002+0000","last_unstale":"2024-04-25T13:42:08.407723+0000","last_undegraded":"2024-04-25T13:42:08.407723+0000","last_fullsized":"2024-04-25T13:42:08.407723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:20.409104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.696037+0000","last_change":"2024-04-25T13:42:06.429612+0000","last_active":"2024-04-25T13:42:07.696037+0000","last_peered":"2024-04-25T13:42:07.696037+0000","last_clean":"2024-04-25T13:42:07.696037+0000","last_became_active":"2024-04-25T13:42:06.429281+0000","last_became_peered":"2024-04-25T13:42:06.429281+0000","last_unstale":"2024-04-25T13:42:07.696037+0000","last_undegraded":"2024-04-25T13:42:07.696037+0000","last_fullsized":"2024-04-25T13:42:07.696037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:54:07.642118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414966+0000","last_change":"2024-04-25T13:42:05.420871+0000","last_active":"2024-04-25T13:42:07.414966+0000","last_peered":"2024-04-25T13:42:07.414966+0000","last_clean":"2024-04-25T13:42:07.414966+0000","last_became_active":"2024-04-25T13:42:05.420493+0000","last_became_peered":"2024-04-25T13:42:05.420493+0000","last_unstale":"2024-04-25T13:42:07.414966+0000","last_undegraded":"2024-04-25T13:42:07.414966+0000","last_fullsized":"2024-04-25T13:42:07.414966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:39.013905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.435620+0000","last_change":"2024-04-25T13:42:06.430453+0000","last_active":"2024-04-25T13:42:06.435620+0000","last_peered":"2024-04-25T13:42:06.435620+0000","last_clean":"2024-04-25T13:42:06.435620+0000","last_became_active":"2024-04-25T13:42:06.430092+0000","last_became_peered":"2024-04-25T13:42:06.430092+0000","last_unstale":"2024-04-25T13:42:06.435620+0000","last_undegraded":"2024-04-25T13:42:06.435620+0000","last_fullsized":"2024-04-25T13:42:06.435620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:21.415710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.408740+0000","last_change":"2024-04-25T13:42:05.431023+0000","last_active":"2024-04-25T13:42:06.408740+0000","last_peered":"2024-04-25T13:42:06.408740+0000","last_clean":"2024-04-25T13:42:06.408740+0000","last_became_active":"2024-04-25T13:42:05.430721+0000","last_became_peered":"2024-04-25T13:42:05.430721+0000","last_unstale":"2024-04-25T13:42:06.408740+0000","last_undegraded":"2024-04-25T13:42:06.408740+0000","last_fullsized":"2024-04-25T13:42:06.408740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:20.409104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.869878+0000","last_change":"2024-04-25T13:42:06.409401+0000","last_active":"2024-04-25T13:42:07.869878+0000","last_peered":"2024-04-25T13:42:07.869878+0000","last_clean":"2024-04-25T13:42:07.869878+0000","last_became_active":"2024-04-25T13:42:06.409057+0000","last_became_peered":"2024-04-25T13:42:06.409057+0000","last_unstale":"2024-04-25T13:42:07.869878+0000","last_undegraded":"2024-04-25T13:42:07.869878+0000","last_fullsized":"2024-04-25T13:42:07.869878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:22.596123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414245+0000","last_change":"2024-04-25T13:42:05.421504+0000","last_active":"2024-04-25T13:42:07.414245+0000","last_peered":"2024-04-25T13:42:07.414245+0000","last_clean":"2024-04-25T13:42:07.414245+0000","last_became_active":"2024-04-25T13:42:05.421220+0000","last_became_peered":"2024-04-25T13:42:05.421220+0000","last_unstale":"2024-04-25T13:42:07.414245+0000","last_undegraded":"2024-04-25T13:42:07.414245+0000","last_fullsized":"2024-04-25T13:42:07.414245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:13.973644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695605+0000","last_change":"2024-04-25T13:42:06.431990+0000","last_active":"2024-04-25T13:42:07.695605+0000","last_peered":"2024-04-25T13:42:07.695605+0000","last_clean":"2024-04-25T13:42:07.695605+0000","last_became_active":"2024-04-25T13:42:06.431692+0000","last_became_peered":"2024-04-25T13:42:06.431692+0000","last_unstale":"2024-04-25T13:42:07.695605+0000","last_undegraded":"2024-04-25T13:42:07.695605+0000","last_fullsized":"2024-04-25T13:42:07.695605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:00.017229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414280+0000","last_change":"2024-04-25T13:42:05.432614+0000","last_active":"2024-04-25T13:42:07.414280+0000","last_peered":"2024-04-25T13:42:07.414280+0000","last_clean":"2024-04-25T13:42:07.414280+0000","last_became_active":"2024-04-25T13:42:05.432253+0000","last_became_peered":"2024-04-25T13:42:05.432253+0000","last_unstale":"2024-04-25T13:42:07.414280+0000","last_undegraded":"2024-04-25T13:42:07.414280+0000","last_fullsized":"2024-04-25T13:42:07.414280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:42.956198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695726+0000","last_change":"2024-04-25T13:42:06.425502+0000","last_active":"2024-04-25T13:42:07.695726+0000","last_peered":"2024-04-25T13:42:07.695726+0000","last_clean":"2024-04-25T13:42:07.695726+0000","last_became_active":"2024-04-25T13:42:06.425046+0000","last_became_peered":"2024-04-25T13:42:06.425046+0000","last_unstale":"2024-04-25T13:42:07.695726+0000","last_undegraded":"2024-04-25T13:42:07.695726+0000","last_fullsized":"2024-04-25T13:42:07.695726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.382442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.447993+0000","last_change":"2024-04-25T13:42:05.423955+0000","last_active":"2024-04-25T13:42:06.447993+0000","last_peered":"2024-04-25T13:42:06.447993+0000","last_clean":"2024-04-25T13:42:06.447993+0000","last_became_active":"2024-04-25T13:42:05.423590+0000","last_became_peered":"2024-04-25T13:42:05.423590+0000","last_unstale":"2024-04-25T13:42:06.447993+0000","last_undegraded":"2024-04-25T13:42:06.447993+0000","last_fullsized":"2024-04-25T13:42:06.447993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:21.589517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414130+0000","last_change":"2024-04-25T13:42:06.425907+0000","last_active":"2024-04-25T13:42:07.414130+0000","last_peered":"2024-04-25T13:42:07.414130+0000","last_clean":"2024-04-25T13:42:07.414130+0000","last_became_active":"2024-04-25T13:42:06.421536+0000","last_became_peered":"2024-04-25T13:42:06.421536+0000","last_unstale":"2024-04-25T13:42:07.414130+0000","last_undegraded":"2024-04-25T13:42:07.414130+0000","last_fullsized":"2024-04-25T13:42:07.414130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:38.216116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416472+0000","last_change":"2024-04-25T13:42:06.412858+0000","last_active":"2024-04-25T13:42:07.416472+0000","last_peered":"2024-04-25T13:42:07.416472+0000","last_clean":"2024-04-25T13:42:07.416472+0000","last_became_active":"2024-04-25T13:42:06.412522+0000","last_became_peered":"2024-04-25T13:42:06.412522+0000","last_unstale":"2024-04-25T13:42:07.416472+0000","last_undegraded":"2024-04-25T13:42:07.416472+0000","last_fullsized":"2024-04-25T13:42:07.416472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:33:49.773341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.449138+0000","last_change":"2024-04-25T13:42:05.426488+0000","last_active":"2024-04-25T13:42:06.449138+0000","last_peered":"2024-04-25T13:42:06.449138+0000","last_clean":"2024-04-25T13:42:06.449138+0000","last_became_active":"2024-04-25T13:42:05.426101+0000","last_became_peered":"2024-04-25T13:42:05.426101+0000","last_unstale":"2024-04-25T13:42:06.449138+0000","last_undegraded":"2024-04-25T13:42:06.449138+0000","last_fullsized":"2024-04-25T13:42:06.449138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:58.501999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416286+0000","last_change":"2024-04-25T13:42:06.420385+0000","last_active":"2024-04-25T13:42:07.416286+0000","last_peered":"2024-04-25T13:42:07.416286+0000","last_clean":"2024-04-25T13:42:07.416286+0000","last_became_active":"2024-04-25T13:42:06.419988+0000","last_became_peered":"2024-04-25T13:42:06.419988+0000","last_unstale":"2024-04-25T13:42:07.416286+0000","last_undegraded":"2024-04-25T13:42:07.416286+0000","last_fullsized":"2024-04-25T13:42:07.416286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:54:07.642118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.440042+0000","last_change":"2024-04-25T13:42:05.430513+0000","last_active":"2024-04-25T13:42:06.440042+0000","last_peered":"2024-04-25T13:42:06.440042+0000","last_clean":"2024-04-25T13:42:06.440042+0000","last_became_active":"2024-04-25T13:42:05.430211+0000","last_became_peered":"2024-04-25T13:42:05.430211+0000","last_unstale":"2024-04-25T13:42:06.440042+0000","last_undegraded":"2024-04-25T13:42:06.440042+0000","last_fullsized":"2024-04-25T13:42:06.440042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:03.696280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.449370+0000","last_change":"2024-04-25T13:42:06.446137+0000","last_active":"2024-04-25T13:42:06.449370+0000","last_peered":"2024-04-25T13:42:06.449370+0000","last_clean":"2024-04-25T13:42:06.449370+0000","last_became_active":"2024-04-25T13:42:06.445789+0000","last_became_peered":"2024-04-25T13:42:06.445789+0000","last_unstale":"2024-04-25T13:42:06.449370+0000","last_undegraded":"2024-04-25T13:42:06.449370+0000","last_fullsized":"2024-04-25T13:42:06.449370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:04.702886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695972+0000","last_change":"2024-04-25T13:42:05.423990+0000","last_active":"2024-04-25T13:42:07.695972+0000","last_peered":"2024-04-25T13:42:07.695972+0000","last_clean":"2024-04-25T13:42:07.695972+0000","last_became_active":"2024-04-25T13:42:05.420047+0000","last_became_peered":"2024-04-25T13:42:05.420047+0000","last_unstale":"2024-04-25T13:42:07.695972+0000","last_undegraded":"2024-04-25T13:42:07.695972+0000","last_fullsized":"2024-04-25T13:42:07.695972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:18.167829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695905+0000","last_change":"2024-04-25T13:42:06.429258+0000","last_active":"2024-04-25T13:42:07.695905+0000","last_peered":"2024-04-25T13:42:07.695905+0000","last_clean":"2024-04-25T13:42:07.695905+0000","last_became_active":"2024-04-25T13:42:06.428574+0000","last_became_peered":"2024-04-25T13:42:06.428574+0000","last_unstale":"2024-04-25T13:42:07.695905+0000","last_undegraded":"2024-04-25T13:42:07.695905+0000","last_fullsized":"2024-04-25T13:42:07.695905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:32.855388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T13:42:06.445201+0000","last_change":"2024-04-25T13:42:05.418742+0000","last_active":"2024-04-25T13:42:06.445201+0000","last_peered":"2024-04-25T13:42:06.445201+0000","last_clean":"2024-04-25T13:42:06.445201+0000","last_became_active":"2024-04-25T13:42:05.418017+0000","last_became_peered":"2024-04-25T13:42:05.418017+0000","last_unstale":"2024-04-25T13:42:06.445201+0000","last_undegraded":"2024-04-25T13:42:06.445201+0000","last_fullsized":"2024-04-25T13:42:06.445201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:38.792763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":660641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":69691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,10],"upper_bound":32},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":76151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":660697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:42:10.923 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T13:42:10.924 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T13:42:10.924 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T13:42:10.924 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T13:42:10.924 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T13:42:11.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.102+0000 7f4b1fe00640 1 Processor -- start 2024-04-25T13:42:11.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.102+0000 7f4b1fe00640 1 -- start start 2024-04-25T13:42:11.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.102+0000 7f4b1fe00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4b180d0f80 0x7f4b18160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:11.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.102+0000 7f4b1fe00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4b180b5010 0x7f4b180b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:11.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.102+0000 7f4b1fe00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b18161520 con 0x7f4b180b32f0 2024-04-25T13:42:11.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.102+0000 7f4b1fe00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4b1815cfe0 con 0x7f4b180b5010 2024-04-25T13:42:11.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.102+0000 7f4b1fe00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4b1815d240 con 0x7f4b180d0f80 2024-04-25T13:42:11.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.102+0000 7f4b1ca00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4b180b32f0 0x7f4b180b3700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53194/0 (socket says 172.21.15.123:53194) 2024-04-25T13:42:11.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.102+0000 7f4b1ca00640 1 -- 172.21.15.123:0/3695069045 learned_addr learned my addr 172.21.15.123:0/3695069045 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:11.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.102+0000 7f4b1de00640 1 --2- 172.21.15.123:0/3695069045 >> v2:172.21.15.123:3300/0 conn(0x7f4b180b5010 0x7f4b180b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:11.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.102+0000 7f4b1d400640 1 --2- 172.21.15.123:0/3695069045 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4b180d0f80 0x7f4b18160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:11.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.102+0000 7f4b17e00640 1 -- 172.21.15.123:0/3695069045 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 616930123 0 0) 0x7f4b18161520 con 0x7f4b180b32f0 2024-04-25T13:42:11.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.102+0000 7f4b1de00640 1 -- 172.21.15.123:0/3695069045 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4b180d0f80 msgr2=0x7f4b18160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:11.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.102+0000 7f4b1de00640 1 --2- 172.21.15.123:0/3695069045 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4b180d0f80 0x7f4b18160fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:11.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.102+0000 7f4b1de00640 1 -- 172.21.15.123:0/3695069045 >> v1:172.21.15.123:6789/0 conn(0x7f4b180b32f0 legacy=0x7f4b180b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:11.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.102+0000 7f4b1de00640 1 -- 172.21.15.123:0/3695069045 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b1815d520 con 0x7f4b180b5010 2024-04-25T13:42:11.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.106+0000 7f4b1de00640 1 --2- 172.21.15.123:0/3695069045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b180b5010 0x7f4b180b5420 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4b10009d90 tx=0x7f4b1001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e501260148cb3c53 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:11.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.106+0000 7f4b17e00640 1 -- 172.21.15.123:0/3695069045 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b100b2070 con 0x7f4b180b5010 2024-04-25T13:42:11.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.106+0000 7f4b17e00640 1 -- 172.21.15.123:0/3695069045 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b100a5890 con 0x7f4b180b5010 2024-04-25T13:42:11.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.106+0000 7f4b17e00640 1 -- 172.21.15.123:0/3695069045 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b100a5c60 con 0x7f4b180b5010 2024-04-25T13:42:11.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.106+0000 7f4b1fe00640 1 -- 172.21.15.123:0/3695069045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b180b5010 msgr2=0x7f4b180b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:11.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.106+0000 7f4b1fe00640 1 --2- 172.21.15.123:0/3695069045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b180b5010 0x7f4b180b5420 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4b10009d90 tx=0x7f4b1001c8b0 comp rx=0 tx=0).stop 2024-04-25T13:42:11.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.106+0000 7f4b1fe00640 1 -- 172.21.15.123:0/3695069045 shutdown_connections 2024-04-25T13:42:11.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.106+0000 7f4b1fe00640 1 --2- 172.21.15.123:0/3695069045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b180b5010 0x7f4b180b5420 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:11.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.106+0000 7f4b1fe00640 1 --2- 172.21.15.123:0/3695069045 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4b180d0f80 0x7f4b18160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:11.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.106+0000 7f4b1fe00640 1 -- 172.21.15.123:0/3695069045 >> 172.21.15.123:0/3695069045 conn(0x7f4b1806d210 msgr2=0x7f4b1806ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:11.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.106+0000 7f4b1fe00640 1 -- 172.21.15.123:0/3695069045 shutdown_connections 2024-04-25T13:42:11.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.106+0000 7f4b1fe00640 1 -- 172.21.15.123:0/3695069045 wait complete. 2024-04-25T13:42:11.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.110+0000 7f4b1fe00640 1 Processor -- start 2024-04-25T13:42:11.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.110+0000 7f4b1fe00640 1 -- start start 2024-04-25T13:42:11.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.110+0000 7f4b1fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b180b32f0 0x7f4b181557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:11.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.110+0000 7f4b1fe00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4b180b5010 0x7f4b18156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:11.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.110+0000 7f4b1fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b180d0f80 0x7f4b18153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:11.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.110+0000 7f4b1fe00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4b181697b0 con 0x7f4b180d0f80 2024-04-25T13:42:11.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.110+0000 7f4b1fe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4b180b6470 con 0x7f4b180b32f0 2024-04-25T13:42:11.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.110+0000 7f4b1fe00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4b18169930 con 0x7f4b180b5010 2024-04-25T13:42:11.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.110+0000 7f4b1de00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b180d0f80 0x7f4b18153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:11.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.110+0000 7f4b1de00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b180d0f80 0x7f4b18153af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37108/0 (socket says 172.21.15.123:37108) 2024-04-25T13:42:11.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.110+0000 7f4b1de00640 1 -- 172.21.15.123:0/4275385415 learned_addr learned my addr 172.21.15.123:0/4275385415 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:11.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.110+0000 7f4b1ca00640 1 --2- 172.21.15.123:0/4275385415 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4b180b5010 0x7f4b18156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:11.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.110+0000 7f4b1d400640 1 --2- 172.21.15.123:0/4275385415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b180b32f0 0x7f4b181557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:11.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.110+0000 7f4b1de00640 1 -- 172.21.15.123:0/4275385415 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4b180b5010 msgr2=0x7f4b18156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:11.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.110+0000 7f4b1de00640 1 --2- 172.21.15.123:0/4275385415 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4b180b5010 0x7f4b18156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:11.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.110+0000 7f4b1de00640 1 -- 172.21.15.123:0/4275385415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b180b32f0 msgr2=0x7f4b181557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:11.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.110+0000 7f4b1de00640 1 --2- 172.21.15.123:0/4275385415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b180b32f0 0x7f4b181557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:11.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.110+0000 7f4b1de00640 1 -- 172.21.15.123:0/4275385415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b18159040 con 0x7f4b180d0f80 2024-04-25T13:42:11.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.110+0000 7f4b1ca00640 1 --2- 172.21.15.123:0/4275385415 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4b180b5010 0x7f4b18156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:11.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.110+0000 7f4b1d400640 1 --2- 172.21.15.123:0/4275385415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b180b32f0 0x7f4b181557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:11.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.114+0000 7f4b1de00640 1 --2- 172.21.15.123:0/4275385415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b180d0f80 0x7f4b18153af0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4b1001af60 tx=0x7f4b10019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:11.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.114+0000 7f4b15600640 1 -- 172.21.15.123:0/4275385415 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b100b2050 con 0x7f4b180d0f80 2024-04-25T13:42:11.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.114+0000 7f4b15600640 1 -- 172.21.15.123:0/4275385415 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b100be070 con 0x7f4b180d0f80 2024-04-25T13:42:11.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.114+0000 7f4b1fe00640 1 -- 172.21.15.123:0/4275385415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b18159320 con 0x7f4b180d0f80 2024-04-25T13:42:11.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.114+0000 7f4b15600640 1 -- 172.21.15.123:0/4275385415 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b100ada50 con 0x7f4b180d0f80 2024-04-25T13:42:11.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.114+0000 7f4b1fe00640 1 -- 172.21.15.123:0/4275385415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b181598e0 con 0x7f4b180d0f80 2024-04-25T13:42:11.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.114+0000 7f4b1fe00640 1 -- 172.21.15.123:0/4275385415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b180507c0 con 0x7f4b180d0f80 2024-04-25T13:42:11.117 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.114+0000 7f4b15600640 1 -- 172.21.15.123:0/4275385415 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4b100a5710 con 0x7f4b180d0f80 2024-04-25T13:42:11.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.114+0000 7f4b15600640 1 --2- 172.21.15.123:0/4275385415 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4af806f430 0x7f4af8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:11.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.114+0000 7f4b15600640 1 -- 172.21.15.123:0/4275385415 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4b1012ae20 con 0x7f4b180d0f80 2024-04-25T13:42:11.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.114+0000 7f4b1d400640 1 --2- 172.21.15.123:0/4275385415 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4af806f430 0x7f4af8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:11.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.118+0000 7f4b1d400640 1 --2- 172.21.15.123:0/4275385415 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4af806f430 0x7f4af8071940 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4b18070fa0 tx=0x7f4b0c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:11.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.118+0000 7f4b15600640 1 -- 172.21.15.123:0/4275385415 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4b10016560 con 0x7f4b180d0f80 2024-04-25T13:42:11.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.310+0000 7f4b1fe00640 1 -- 172.21.15.123:0/4275385415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f4b180b45d0 con 0x7f4b180d0f80 2024-04-25T13:42:11.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.314+0000 7f4b15600640 1 -- 172.21.15.123:0/4275385415 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+179549 (secure 0 0 0) 0x7f4b100f7d80 con 0x7f4b180d0f80 2024-04-25T13:42:11.327 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:11.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.318+0000 7f4b1fe00640 1 -- 172.21.15.123:0/4275385415 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4af806f430 msgr2=0x7f4af8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:11.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.318+0000 7f4b1fe00640 1 --2- 172.21.15.123:0/4275385415 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4af806f430 0x7f4af8071940 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4b18070fa0 tx=0x7f4b0c008040 comp rx=0 tx=0).stop 2024-04-25T13:42:11.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.318+0000 7f4b1fe00640 1 -- 172.21.15.123:0/4275385415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b180d0f80 msgr2=0x7f4b18153af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:11.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.318+0000 7f4b1fe00640 1 --2- 172.21.15.123:0/4275385415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b180d0f80 0x7f4b18153af0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4b1001af60 tx=0x7f4b10019650 comp rx=0 tx=0).stop 2024-04-25T13:42:11.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.318+0000 7f4b1fe00640 1 -- 172.21.15.123:0/4275385415 shutdown_connections 2024-04-25T13:42:11.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.318+0000 7f4b1fe00640 1 --2- 172.21.15.123:0/4275385415 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4af806f430 0x7f4af8071940 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:11.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.318+0000 7f4b1fe00640 1 --2- 172.21.15.123:0/4275385415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b180d0f80 0x7f4b18153af0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:11.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.318+0000 7f4b1fe00640 1 --2- 172.21.15.123:0/4275385415 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4b180b5010 0x7f4b18156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:11.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.318+0000 7f4b1fe00640 1 --2- 172.21.15.123:0/4275385415 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b180b32f0 0x7f4b181557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:11.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.318+0000 7f4b1fe00640 1 -- 172.21.15.123:0/4275385415 >> 172.21.15.123:0/4275385415 conn(0x7f4b1806d210 msgr2=0x7f4b180cfad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:11.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.318+0000 7f4b1fe00640 1 -- 172.21.15.123:0/4275385415 shutdown_connections 2024-04-25T13:42:11.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.318+0000 7f4b1fe00640 1 -- 172.21.15.123:0/4275385415 wait complete. 2024-04-25T13:42:11.340 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":715752891},{"type":"v1","addr":"172.21.15.123:6833","nonce":715752891}]},"active_addr":"172.21.15.123:6833/715752891","active_change":"2024-04-25T13:41:45.562456+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":2733204097}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":2549964968}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":1936036798}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":2058129107}]}]} 2024-04-25T13:42:11.343 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T13:42:11.344 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T13:42:11.344 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:11.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.486+0000 7f9f0cc00640 1 Processor -- start 2024-04-25T13:42:11.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.486+0000 7f9f0cc00640 1 -- start start 2024-04-25T13:42:11.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.490+0000 7f9f0cc00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9f0815fef0 0x7f9f080b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:11.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.490+0000 7f9f0cc00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f080cd850 0x7f9f080b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:11.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.490+0000 7f9f0cc00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f080b65d0 con 0x7f9f08072ad0 2024-04-25T13:42:11.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.490+0000 7f9f0cc00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f9f08163910 con 0x7f9f0815fef0 2024-04-25T13:42:11.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.490+0000 7f9f0cc00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9f081641b0 con 0x7f9f080cd850 2024-04-25T13:42:11.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.490+0000 7f9f05e00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9f0815fef0 0x7f9f080b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:11.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.490+0000 7f9f05400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f080cd850 0x7f9f080b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:11.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.490+0000 7f9f05e00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9f0815fef0 0x7f9f080b32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:53180/0 (socket says 172.21.15.123:53180) 2024-04-25T13:42:11.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.490+0000 7f9f05e00640 1 -- 172.21.15.123:0/2381407885 learned_addr learned my addr 172.21.15.123:0/2381407885 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:11.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.490+0000 7f9f04a00640 1 -- 172.21.15.123:0/2381407885 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 606362588 0 0) 0x7f9f080b65d0 con 0x7f9f08072ad0 2024-04-25T13:42:11.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.490+0000 7f9f04a00640 1 -- 172.21.15.123:0/2381407885 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9eec003530 con 0x7f9f08072ad0 2024-04-25T13:42:11.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.490+0000 7f9f05400640 1 -- 172.21.15.123:0/2381407885 >> v2:172.21.15.130:3300/0 conn(0x7f9f0815fef0 msgr2=0x7f9f080b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:11.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.490+0000 7f9f05400640 1 --2- 172.21.15.123:0/2381407885 >> v2:172.21.15.130:3300/0 conn(0x7f9f0815fef0 0x7f9f080b32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:11.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.490+0000 7f9f05400640 1 -- 172.21.15.123:0/2381407885 >> v1:172.21.15.130:6789/0 conn(0x7f9f08072ad0 legacy=0x7f9f08072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:11.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.490+0000 7f9f05400640 1 -- 172.21.15.123:0/2381407885 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f08074440 con 0x7f9f080cd850 2024-04-25T13:42:11.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.490+0000 7f9f05e00640 1 --2- 172.21.15.123:0/2381407885 >> v2:172.21.15.130:3300/0 conn(0x7f9f0815fef0 0x7f9f080b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:11.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.494+0000 7f9f05400640 1 --2- 172.21.15.123:0/2381407885 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f080cd850 0x7f9f080b3830 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9f08163a90 tx=0x7f9ef401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc967ae084643b9f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:11.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.494+0000 7f9f04a00640 1 -- 172.21.15.123:0/2381407885 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef40b0070 con 0x7f9f080cd850 2024-04-25T13:42:11.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.494+0000 7f9f04a00640 1 -- 172.21.15.123:0/2381407885 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ef40ab600 con 0x7f9f080cd850 2024-04-25T13:42:11.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.494+0000 7f9f04a00640 1 -- 172.21.15.123:0/2381407885 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef40ab9d0 con 0x7f9f080cd850 2024-04-25T13:42:11.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.494+0000 7f9f0cc00640 1 -- 172.21.15.123:0/2381407885 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f080cd850 msgr2=0x7f9f080b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:11.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.494+0000 7f9f0cc00640 1 --2- 172.21.15.123:0/2381407885 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f080cd850 0x7f9f080b3830 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9f08163a90 tx=0x7f9ef401c3e0 comp rx=0 tx=0).stop 2024-04-25T13:42:11.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.494+0000 7f9f0cc00640 1 -- 172.21.15.123:0/2381407885 shutdown_connections 2024-04-25T13:42:11.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.494+0000 7f9f0cc00640 1 --2- 172.21.15.123:0/2381407885 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f080cd850 0x7f9f080b3830 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:11.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.494+0000 7f9f0cc00640 1 --2- 172.21.15.123:0/2381407885 >> v2:172.21.15.130:3300/0 conn(0x7f9f0815fef0 0x7f9f080b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:11.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.494+0000 7f9f0cc00640 1 -- 172.21.15.123:0/2381407885 >> 172.21.15.123:0/2381407885 conn(0x7f9f0806d210 msgr2=0x7f9f0806ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:11.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.494+0000 7f9f0cc00640 1 -- 172.21.15.123:0/2381407885 shutdown_connections 2024-04-25T13:42:11.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.494+0000 7f9f0cc00640 1 -- 172.21.15.123:0/2381407885 wait complete. 2024-04-25T13:42:11.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.498+0000 7f9f0cc00640 1 Processor -- start 2024-04-25T13:42:11.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.498+0000 7f9f0cc00640 1 -- start start 2024-04-25T13:42:11.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.498+0000 7f9f0cc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f08072ad0 0x7f9f08157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:11.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.498+0000 7f9f0cc00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f080cd850 0x7f9f0814f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:11.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.498+0000 7f9f0cc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f0815fef0 0x7f9f0814f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:11.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.498+0000 7f9f0cc00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9f081647c0 con 0x7f9f0815fef0 2024-04-25T13:42:11.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.498+0000 7f9f0cc00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9f08164640 con 0x7f9f08072ad0 2024-04-25T13:42:11.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.498+0000 7f9f0cc00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9f0816d2b0 con 0x7f9f080cd850 2024-04-25T13:42:11.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.498+0000 7f9f06800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f0815fef0 0x7f9f0814f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:11.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.498+0000 7f9f06800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f0815fef0 0x7f9f0814f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37112/0 (socket says 172.21.15.123:37112) 2024-04-25T13:42:11.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.498+0000 7f9f06800640 1 -- 172.21.15.123:0/1432724677 learned_addr learned my addr 172.21.15.123:0/1432724677 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:11.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.498+0000 7f9f05e00640 1 --2- 172.21.15.123:0/1432724677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f08072ad0 0x7f9f08157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:11.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.498+0000 7f9f05400640 1 --2- 172.21.15.123:0/1432724677 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f080cd850 0x7f9f0814f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:11.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.498+0000 7f9f06800640 1 -- 172.21.15.123:0/1432724677 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f080cd850 msgr2=0x7f9f0814f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:11.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.498+0000 7f9f06800640 1 --2- 172.21.15.123:0/1432724677 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f080cd850 0x7f9f0814f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:11.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.498+0000 7f9f06800640 1 -- 172.21.15.123:0/1432724677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f08072ad0 msgr2=0x7f9f08157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:11.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.498+0000 7f9f06800640 1 --2- 172.21.15.123:0/1432724677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f08072ad0 0x7f9f08157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:11.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.498+0000 7f9f06800640 1 -- 172.21.15.123:0/1432724677 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f08159e50 con 0x7f9f0815fef0 2024-04-25T13:42:11.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.498+0000 7f9f06800640 1 --2- 172.21.15.123:0/1432724677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f0815fef0 0x7f9f0814f580 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000c760 tx=0x7f9f0000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:11.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.498+0000 7f9efe000640 1 -- 172.21.15.123:0/1432724677 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f00003b80 con 0x7f9f0815fef0 2024-04-25T13:42:11.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.502+0000 7f9f0cc00640 1 -- 172.21.15.123:0/1432724677 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f0815a130 con 0x7f9f0815fef0 2024-04-25T13:42:11.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.502+0000 7f9efe000640 1 -- 172.21.15.123:0/1432724677 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f00003d20 con 0x7f9f0815fef0 2024-04-25T13:42:11.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.502+0000 7f9efe000640 1 -- 172.21.15.123:0/1432724677 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0000aa90 con 0x7f9f0815fef0 2024-04-25T13:42:11.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.502+0000 7f9f0cc00640 1 -- 172.21.15.123:0/1432724677 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f0815a6f0 con 0x7f9f0815fef0 2024-04-25T13:42:11.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.502+0000 7f9f0cc00640 1 -- 172.21.15.123:0/1432724677 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f080507c0 con 0x7f9f0815fef0 2024-04-25T13:42:11.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.502+0000 7f9efe000640 1 -- 172.21.15.123:0/1432724677 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9f0000ac30 con 0x7f9f0815fef0 2024-04-25T13:42:11.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.502+0000 7f9efe000640 1 --2- 172.21.15.123:0/1432724677 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9ee806f400 0x7f9ee8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:11.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.502+0000 7f9efe000640 1 -- 172.21.15.123:0/1432724677 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9f0008f0f0 con 0x7f9f0815fef0 2024-04-25T13:42:11.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.502+0000 7f9f05e00640 1 --2- 172.21.15.123:0/1432724677 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9ee806f400 0x7f9ee8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:11.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.506+0000 7f9f05e00640 1 --2- 172.21.15.123:0/1432724677 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9ee806f400 0x7f9ee8071910 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8006cd0 tx=0x7f9ef8009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:11.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.506+0000 7f9efe000640 1 -- 172.21.15.123:0/1432724677 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9f0005b900 con 0x7f9f0815fef0 2024-04-25T13:42:11.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.666+0000 7f9f0cc00640 1 -- 172.21.15.123:0/1432724677 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9f0806dc70 con 0x7f9f0815fef0 2024-04-25T13:42:11.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.670+0000 7f9efe000640 1 -- 172.21.15.123:0/1432724677 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16629 (secure 0 0 0) 0x7f9f0005fc00 con 0x7f9f0815fef0 2024-04-25T13:42:11.672 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:11.672 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:42:07.405529+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:03.949161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:04.755682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:11.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.670+0000 7f9f0cc00640 1 -- 172.21.15.123:0/1432724677 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9ee806f400 msgr2=0x7f9ee8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:11.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.670+0000 7f9f0cc00640 1 --2- 172.21.15.123:0/1432724677 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9ee806f400 0x7f9ee8071910 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8006cd0 tx=0x7f9ef8009240 comp rx=0 tx=0).stop 2024-04-25T13:42:11.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.670+0000 7f9f0cc00640 1 -- 172.21.15.123:0/1432724677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f0815fef0 msgr2=0x7f9f0814f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:11.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.670+0000 7f9f0cc00640 1 --2- 172.21.15.123:0/1432724677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f0815fef0 0x7f9f0814f580 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9f0000c760 tx=0x7f9f0000cc20 comp rx=0 tx=0).stop 2024-04-25T13:42:11.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.670+0000 7f9f0cc00640 1 -- 172.21.15.123:0/1432724677 shutdown_connections 2024-04-25T13:42:11.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.670+0000 7f9f0cc00640 1 --2- 172.21.15.123:0/1432724677 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9ee806f400 0x7f9ee8071910 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:11.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.670+0000 7f9f0cc00640 1 --2- 172.21.15.123:0/1432724677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9f0815fef0 0x7f9f0814f580 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:11.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.670+0000 7f9f0cc00640 1 --2- 172.21.15.123:0/1432724677 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f080cd850 0x7f9f0814f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:11.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.670+0000 7f9f0cc00640 1 --2- 172.21.15.123:0/1432724677 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f08072ad0 0x7f9f08157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:11.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.670+0000 7f9f0cc00640 1 -- 172.21.15.123:0/1432724677 >> 172.21.15.123:0/1432724677 conn(0x7f9f0806d210 msgr2=0x7f9f080b2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:11.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.670+0000 7f9f0cc00640 1 -- 172.21.15.123:0/1432724677 shutdown_connections 2024-04-25T13:42:11.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.670+0000 7f9f0cc00640 1 -- 172.21.15.123:0/1432724677 wait complete. 2024-04-25T13:42:11.695 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T13:42:11.695 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:11.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.838+0000 7f741aa00640 1 Processor -- start 2024-04-25T13:42:11.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.838+0000 7f741aa00640 1 -- start start 2024-04-25T13:42:11.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.838+0000 7f741aa00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7414158400 0x7f7414073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:11.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.838+0000 7f741aa00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74140745b0 con 0x7f74140b14a0 2024-04-25T13:42:11.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.838+0000 7f741aa00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74140aede0 con 0x7f74140cfc70 2024-04-25T13:42:11.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.838+0000 7f741aa00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f741409ff00 con 0x7f7414158400 2024-04-25T13:42:11.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.838+0000 7f740b400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f74140b14a0 0x7f7414165880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53200/0 (socket says 172.21.15.123:53200) 2024-04-25T13:42:11.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.838+0000 7f740b400640 1 -- 172.21.15.123:0/4289957346 learned_addr learned my addr 172.21.15.123:0/4289957346 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:11.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.842+0000 7f7418a00640 1 --2- 172.21.15.123:0/4289957346 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7414158400 0x7f7414073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:11.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.842+0000 7f7413400640 1 -- 172.21.15.123:0/4289957346 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2711472940 0 0) 0x7f74140745b0 con 0x7f74140b14a0 2024-04-25T13:42:11.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.842+0000 7f7413400640 1 -- 172.21.15.123:0/4289957346 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73f8003530 con 0x7f74140b14a0 2024-04-25T13:42:11.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.842+0000 7f7413400640 1 -- 172.21.15.123:0/4289957346 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 852806908 0 0) 0x7f74140aede0 con 0x7f74140cfc70 2024-04-25T13:42:11.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.842+0000 7f7413400640 1 -- 172.21.15.123:0/4289957346 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74140745b0 con 0x7f74140cfc70 2024-04-25T13:42:11.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.842+0000 7f7418a00640 1 -- 172.21.15.123:0/4289957346 >> v1:172.21.15.130:6789/0 conn(0x7f74140cfc70 legacy=0x7f74140b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:11.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.842+0000 7f7418a00640 1 -- 172.21.15.123:0/4289957346 >> v1:172.21.15.123:6789/0 conn(0x7f74140b14a0 legacy=0x7f7414165880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:11.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.842+0000 7f7418a00640 1 -- 172.21.15.123:0/4289957346 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74140af0c0 con 0x7f7414158400 2024-04-25T13:42:11.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.842+0000 7f7418a00640 1 --2- 172.21.15.123:0/4289957346 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7414158400 0x7f7414073ed0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f740c009dc0 tx=0x7f740c01c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7de75b9a48c2538d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:11.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.842+0000 7f7413400640 1 -- 172.21.15.123:0/4289957346 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740c0b2070 con 0x7f7414158400 2024-04-25T13:42:11.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.842+0000 7f7413400640 1 -- 172.21.15.123:0/4289957346 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f740c0a59e0 con 0x7f7414158400 2024-04-25T13:42:11.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.842+0000 7f7413400640 1 -- 172.21.15.123:0/4289957346 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740c0a5db0 con 0x7f7414158400 2024-04-25T13:42:11.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.846+0000 7f741aa00640 1 -- 172.21.15.123:0/4289957346 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7414158400 msgr2=0x7f7414073ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:11.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.846+0000 7f741aa00640 1 --2- 172.21.15.123:0/4289957346 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7414158400 0x7f7414073ed0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f740c009dc0 tx=0x7f740c01c900 comp rx=0 tx=0).stop 2024-04-25T13:42:11.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.846+0000 7f741aa00640 1 -- 172.21.15.123:0/4289957346 shutdown_connections 2024-04-25T13:42:11.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.846+0000 7f741aa00640 1 --2- 172.21.15.123:0/4289957346 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7414158400 0x7f7414073ed0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:11.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.846+0000 7f741aa00640 1 -- 172.21.15.123:0/4289957346 >> 172.21.15.123:0/4289957346 conn(0x7f74140733b0 msgr2=0x7f74140737c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:11.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.846+0000 7f741aa00640 1 -- 172.21.15.123:0/4289957346 shutdown_connections 2024-04-25T13:42:11.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.846+0000 7f741aa00640 1 -- 172.21.15.123:0/4289957346 wait complete. 2024-04-25T13:42:11.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.846+0000 7f741aa00640 1 Processor -- start 2024-04-25T13:42:11.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.846+0000 7f741aa00640 1 -- start start 2024-04-25T13:42:11.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.850+0000 7f741aa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74140b14a0 0x7f74141f9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:11.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.850+0000 7f741aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74140cfc70 0x7f7414152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:11.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.850+0000 7f741aa00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7414158400 0x7f741406f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:11.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.850+0000 7f741aa00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f741416bb60 con 0x7f74140b14a0 2024-04-25T13:42:11.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.850+0000 7f741aa00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f741416b9e0 con 0x7f74140cfc70 2024-04-25T13:42:11.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.850+0000 7f741aa00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f741416bce0 con 0x7f7414158400 2024-04-25T13:42:11.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.850+0000 7f7413e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74140b14a0 0x7f74141f9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:11.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.850+0000 7f7413e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74140b14a0 0x7f74141f9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37118/0 (socket says 172.21.15.123:37118) 2024-04-25T13:42:11.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.850+0000 7f7413e00640 1 -- 172.21.15.123:0/2777125439 learned_addr learned my addr 172.21.15.123:0/2777125439 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:11.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.850+0000 7f740b400640 1 --2- 172.21.15.123:0/2777125439 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74140cfc70 0x7f7414152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:11.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.850+0000 7f7418a00640 1 --2- 172.21.15.123:0/2777125439 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7414158400 0x7f741406f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:11.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.850+0000 7f7413e00640 1 -- 172.21.15.123:0/2777125439 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7414158400 msgr2=0x7f741406f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:11.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.850+0000 7f7413e00640 1 --2- 172.21.15.123:0/2777125439 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7414158400 0x7f741406f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:11.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.850+0000 7f7413e00640 1 -- 172.21.15.123:0/2777125439 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74140cfc70 msgr2=0x7f7414152780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:11.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.850+0000 7f7413e00640 1 --2- 172.21.15.123:0/2777125439 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74140cfc70 0x7f7414152780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:11.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.850+0000 7f7413e00640 1 -- 172.21.15.123:0/2777125439 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74140b1b70 con 0x7f74140b14a0 2024-04-25T13:42:11.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.850+0000 7f7413e00640 1 --2- 172.21.15.123:0/2777125439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74140b14a0 0x7f74141f9e60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f740400c390 tx=0x7f740400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:11.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.850+0000 7f7410c00640 1 -- 172.21.15.123:0/2777125439 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7404017070 con 0x7f74140b14a0 2024-04-25T13:42:11.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.850+0000 7f7410c00640 1 -- 172.21.15.123:0/2777125439 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74040052f0 con 0x7f74140b14a0 2024-04-25T13:42:11.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.850+0000 7f741aa00640 1 -- 172.21.15.123:0/2777125439 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74140b1e50 con 0x7f74140b14a0 2024-04-25T13:42:11.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.850+0000 7f7410c00640 1 -- 172.21.15.123:0/2777125439 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7404003840 con 0x7f74140b14a0 2024-04-25T13:42:11.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.850+0000 7f741aa00640 1 -- 172.21.15.123:0/2777125439 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74140b2410 con 0x7f74140b14a0 2024-04-25T13:42:11.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.850+0000 7f741aa00640 1 -- 172.21.15.123:0/2777125439 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74140507c0 con 0x7f74140b14a0 2024-04-25T13:42:11.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.850+0000 7f7410c00640 1 -- 172.21.15.123:0/2777125439 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f740401a070 con 0x7f74140b14a0 2024-04-25T13:42:11.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.854+0000 7f7410c00640 1 --2- 172.21.15.123:0/2777125439 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f73f006f430 0x7f73f0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:11.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.854+0000 7f7410c00640 1 -- 172.21.15.123:0/2777125439 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f740408e710 con 0x7f74140b14a0 2024-04-25T13:42:11.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.854+0000 7f740b400640 1 --2- 172.21.15.123:0/2777125439 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f73f006f430 0x7f73f0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:11.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.854+0000 7f740b400640 1 --2- 172.21.15.123:0/2777125439 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f73f006f430 0x7f73f0071940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f73fc0011f0 tx=0x7f73fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:11.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:11.858+0000 7f7410c00640 1 -- 172.21.15.123:0/2777125439 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f740405b560 con 0x7f74140b14a0 2024-04-25T13:42:12.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.014+0000 7f741aa00640 1 -- 172.21.15.123:0/2777125439 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f741415f410 con 0x7f74140b14a0 2024-04-25T13:42:12.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.014+0000 7f7410c00640 1 -- 172.21.15.123:0/2777125439 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16629 (secure 0 0 0) 0x7f740405ae60 con 0x7f74140b14a0 2024-04-25T13:42:12.019 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:12.019 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:42:07.405529+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:03.949161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:04.755682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:12.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.018+0000 7f741aa00640 1 -- 172.21.15.123:0/2777125439 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f73f006f430 msgr2=0x7f73f0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.018+0000 7f741aa00640 1 --2- 172.21.15.123:0/2777125439 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f73f006f430 0x7f73f0071940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f73fc0011f0 tx=0x7f73fc009040 comp rx=0 tx=0).stop 2024-04-25T13:42:12.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.018+0000 7f741aa00640 1 -- 172.21.15.123:0/2777125439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74140b14a0 msgr2=0x7f74141f9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.018+0000 7f741aa00640 1 --2- 172.21.15.123:0/2777125439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74140b14a0 0x7f74141f9e60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f740400c390 tx=0x7f740400c850 comp rx=0 tx=0).stop 2024-04-25T13:42:12.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.018+0000 7f741aa00640 1 -- 172.21.15.123:0/2777125439 shutdown_connections 2024-04-25T13:42:12.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.018+0000 7f741aa00640 1 --2- 172.21.15.123:0/2777125439 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74140cfc70 0x7f7414152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.018+0000 7f741aa00640 1 --2- 172.21.15.123:0/2777125439 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f73f006f430 0x7f73f0071940 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.018+0000 7f741aa00640 1 --2- 172.21.15.123:0/2777125439 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7414158400 0x7f741406f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.018+0000 7f741aa00640 1 --2- 172.21.15.123:0/2777125439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74140b14a0 0x7f74141f9e60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.018+0000 7f741aa00640 1 -- 172.21.15.123:0/2777125439 >> 172.21.15.123:0/2777125439 conn(0x7f74140733b0 msgr2=0x7f74140d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:12.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.018+0000 7f741aa00640 1 -- 172.21.15.123:0/2777125439 shutdown_connections 2024-04-25T13:42:12.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.018+0000 7f741aa00640 1 -- 172.21.15.123:0/2777125439 wait complete. 2024-04-25T13:42:12.041 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T13:42:12.041 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T13:42:12.042 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T13:42:12.042 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T13:42:12.042 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T13:42:12.043 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T13:42:12.043 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T13:42:12.044 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T13:42:12.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.310+0000 7f984fe00640 1 Processor -- start 2024-04-25T13:42:12.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.310+0000 7f984fe00640 1 -- start start 2024-04-25T13:42:12.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.314+0000 7f1100a00640 1 Processor -- start 2024-04-25T13:42:12.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.314+0000 7f1100a00640 1 -- start start 2024-04-25T13:42:12.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.314+0000 7ff7e1400640 1 Processor -- start 2024-04-25T13:42:12.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.314+0000 7f1b83200640 1 Processor -- start 2024-04-25T13:42:12.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.314+0000 7f984fe00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9850160530 0x7f985015bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.314+0000 7f1b83200640 1 -- start start 2024-04-25T13:42:12.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.314+0000 7ff7e1400640 1 -- start start 2024-04-25T13:42:12.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.314+0000 7f984fe00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f98500d1f20 0x7f98500cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.314+0000 7f984fe00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f985015c1c0 con 0x7f98500b4430 2024-04-25T13:42:12.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.314+0000 7f984fe00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f98500b5870 con 0x7f9850160530 2024-04-25T13:42:12.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.314+0000 7f984fe00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f98500b4c60 con 0x7f98500d1f20 2024-04-25T13:42:12.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7f984e000640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f98500b4430 0x7f98500d1810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.123:51450/0 (socket says 172.21.15.123:51450) 2024-04-25T13:42:12.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7f984e000640 1 -- 172.21.15.123:0/2775586161 learned_addr learned my addr 172.21.15.123:0/2775586161 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:12.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7f984ea00640 1 --2- 172.21.15.123:0/2775586161 >> v2:172.21.15.123:3300/0 conn(0x7f9850160530 0x7f985015bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7f984f400640 1 --2- 172.21.15.123:0/2775586161 >> v2:172.21.15.130:3300/0 conn(0x7f98500d1f20 0x7f98500cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7f984f400640 1 -- 172.21.15.123:0/2775586161 >> v2:172.21.15.123:3300/0 conn(0x7f9850160530 msgr2=0x7f985015bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:12.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7f984f400640 1 --2- 172.21.15.123:0/2775586161 >> v2:172.21.15.123:3300/0 conn(0x7f9850160530 0x7f985015bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7f1100a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f10fc0cf3e0 0x7f10fc0d0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7f1100a00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f10fc0cf7f0 0x7f10fc0d0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7f1100a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10fc0ce660 con 0x7f10fc0b8ea0 2024-04-25T13:42:12.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7f1100a00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f10fc0b92b0 con 0x7f10fc0cf7f0 2024-04-25T13:42:12.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7f1100a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f10fc0ce430 con 0x7f10fc0cf3e0 2024-04-25T13:42:12.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7f10f9400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f10fc0cf3e0 0x7f10fc0d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7f10f9400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f10fc0cf3e0 0x7f10fc0d0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:37500/0 (socket says 172.21.15.123:37500) 2024-04-25T13:42:12.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7f10f9400640 1 -- 172.21.15.123:0/1205024436 learned_addr learned my addr 172.21.15.123:0/1205024436 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:12.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7f10fa800640 1 --2- 172.21.15.123:0/1205024436 >> v2:172.21.15.130:3300/0 conn(0x7f10fc0cf7f0 0x7f10fc0d0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7f10f9400640 1 -- 172.21.15.123:0/1205024436 >> v2:172.21.15.130:3300/0 conn(0x7f10fc0cf7f0 msgr2=0x7f10fc0d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:12.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7f10f9400640 1 --2- 172.21.15.123:0/1205024436 >> v2:172.21.15.130:3300/0 conn(0x7f10fc0cf7f0 0x7f10fc0d0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7f10f9400640 1 -- 172.21.15.123:0/1205024436 >> v1:172.21.15.123:6789/0 conn(0x7f10fc0b8ea0 legacy=0x7f10fc0b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:12.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7f10f9400640 1 -- 172.21.15.123:0/1205024436 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10fc0ce900 con 0x7f10fc0cf3e0 2024-04-25T13:42:12.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7f10fa800640 1 --2- 172.21.15.123:0/1205024436 >> v2:172.21.15.130:3300/0 conn(0x7f10fc0cf7f0 0x7f10fc0d0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:12.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7f984f400640 1 -- 172.21.15.123:0/2775586161 >> v1:172.21.15.130:6789/0 conn(0x7f98500b4430 legacy=0x7f98500d1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7f984f400640 1 -- 172.21.15.123:0/2775586161 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98500b4f40 con 0x7f98500d1f20 2024-04-25T13:42:12.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7f984ea00640 1 --2- 172.21.15.123:0/2775586161 >> v2:172.21.15.123:3300/0 conn(0x7f9850160530 0x7f985015bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:12.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7ff7e1400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff7d404fe70 0x7ff7d4006860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7f9b21000640 1 Processor -- start 2024-04-25T13:42:12.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7ff7e1400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7d4034460 con 0x7ff7d4006da0 2024-04-25T13:42:12.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7ff7e1400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7d40060a0 con 0x7ff7d404f350 2024-04-25T13:42:12.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7ff7e1400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff7d40e0620 con 0x7ff7d404fe70 2024-04-25T13:42:12.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7ff7e0a00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff7d4006da0 0x7ff7d40071b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53218/0 (socket says 172.21.15.123:53218) 2024-04-25T13:42:12.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7ff7e0a00640 1 -- 172.21.15.123:0/2227704909 learned_addr learned my addr 172.21.15.123:0/2227704909 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:12.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7f1b83200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1b8415be80 0x7f1b840b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f1b83200640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1b840d1c90 0x7f1b840ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7ff7db400640 1 --2- 172.21.15.123:0/2227704909 >> v2:172.21.15.123:3300/0 conn(0x7ff7d404fe70 0x7ff7d4006860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7ff7daa00640 1 -- 172.21.15.123:0/2227704909 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2518308009 0 0) 0x7ff7d40060a0 con 0x7ff7d404f350 2024-04-25T13:42:12.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7ff7db400640 1 -- 172.21.15.123:0/2227704909 >> v1:172.21.15.130:6789/0 conn(0x7ff7d404f350 legacy=0x7ff7d404f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7ff7db400640 1 -- 172.21.15.123:0/2227704909 >> v1:172.21.15.123:6789/0 conn(0x7ff7d4006da0 legacy=0x7ff7d40071b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7ff7db400640 1 -- 172.21.15.123:0/2227704909 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d40e0900 con 0x7ff7d404fe70 2024-04-25T13:42:12.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.318+0000 7f9b21000640 1 -- start start 2024-04-25T13:42:12.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f1b83200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b840b5de0 con 0x7f1b840b4df0 2024-04-25T13:42:12.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f1b83200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f1b8415c290 con 0x7f1b8415be80 2024-04-25T13:42:12.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f1b83200640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f1b8415fb20 con 0x7f1b840d1c90 2024-04-25T13:42:12.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f1b81400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1b840b4df0 0x7f1b840d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53224/0 (socket says 172.21.15.123:53224) 2024-04-25T13:42:12.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f1b81400640 1 -- 172.21.15.123:0/420922202 learned_addr learned my addr 172.21.15.123:0/420922202 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:12.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f1b82800640 1 --2- 172.21.15.123:0/420922202 >> v2:172.21.15.130:3300/0 conn(0x7f1b840d1c90 0x7f1b840ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f1b82800640 1 -- 172.21.15.123:0/420922202 >> v2:172.21.15.123:3300/0 conn(0x7f1b8415be80 msgr2=0x7f1b840b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:12.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f1b82800640 1 --2- 172.21.15.123:0/420922202 >> v2:172.21.15.123:3300/0 conn(0x7f1b8415be80 0x7f1b840b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f1b82800640 1 -- 172.21.15.123:0/420922202 >> v1:172.21.15.123:6789/0 conn(0x7f1b840b4df0 legacy=0x7f1b840d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:12.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f1b82800640 1 -- 172.21.15.123:0/420922202 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b8415fe00 con 0x7f1b840d1c90 2024-04-25T13:42:12.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f9b1b400640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f9b1404f350 0x7f9b14006930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.123:51466/0 (socket says 172.21.15.123:51466) 2024-04-25T13:42:12.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f9b21000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9b14034220 0x7f9b14039c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f9b21000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b14038bf0 con 0x7f9b1404f760 2024-04-25T13:42:12.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f9b21000640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b14038e90 con 0x7f9b1404f350 2024-04-25T13:42:12.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f9b1b400640 1 -- 172.21.15.123:0/3859338167 learned_addr learned my addr 172.21.15.123:0/3859338167 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:12.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f9b1aa00640 1 --1- 172.21.15.123:0/3859338167 >> v1:172.21.15.123:6789/0 conn(0x7f9b1404f760 0x7f9b14033b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53228/0 (socket says 172.21.15.123:53228) 2024-04-25T13:42:12.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f9b21000640 1 -- 172.21.15.123:0/3859338167 --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9b140397c0 con 0x7f9b14034220 2024-04-25T13:42:12.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f9b1be00640 1 --2- 172.21.15.123:0/3859338167 >> v2:172.21.15.123:3300/0 conn(0x7f9b14034220 0x7f9b14039c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f9b1a000640 1 -- 172.21.15.123:0/3859338167 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3656981712 0 0) 0x7f9b14038e90 con 0x7f9b1404f350 2024-04-25T13:42:12.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f9b1a000640 1 -- 172.21.15.123:0/3859338167 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b04003450 con 0x7f9b1404f350 2024-04-25T13:42:12.330 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f10f9400640 1 --2- 172.21.15.123:0/1205024436 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f10fc0cf3e0 0x7f10fc0d0050 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0b2fc0 tx=0x7f10e802d450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d57557fabff96c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f9b1a000640 1 -- 172.21.15.123:0/3859338167 <== mon.1 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1605306140 0 0) 0x7f9b04003450 con 0x7f9b1404f350 2024-04-25T13:42:12.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f9b1a000640 1 -- 172.21.15.123:0/3859338167 >> v2:172.21.15.123:3300/0 conn(0x7f9b14034220 msgr2=0x7f9b14039c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:12.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f9b1a000640 1 --2- 172.21.15.123:0/3859338167 >> v2:172.21.15.123:3300/0 conn(0x7f9b14034220 0x7f9b14039c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f9b1a000640 1 -- 172.21.15.123:0/3859338167 >> v1:172.21.15.123:6789/0 conn(0x7f9b1404f760 legacy=0x7f9b14033b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f984f400640 1 --2- 172.21.15.123:0/2775586161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f98500d1f20 0x7f98500cea60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f98500b61f0 tx=0x7f984001e660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=255949817c6d2d8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f9b1a000640 1 -- 172.21.15.123:0/3859338167 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b14039170 con 0x7f9b1404f350 2024-04-25T13:42:12.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f9b1a000640 1 -- 172.21.15.123:0/3859338167 <== mon.1 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7f9b10001680 con 0x7f9b1404f350 2024-04-25T13:42:12.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f9b1a000640 1 -- 172.21.15.123:0/3859338167 >> v1:172.21.15.130:6789/0 conn(0x7f9b1404f350 legacy=0x7f9b14006930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f9b1a000640 1 --2- 172.21.15.123:0/3859338167 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b04003ab0 0x7f9b04003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f984d600640 1 -- 172.21.15.123:0/2775586161 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98400a86c0 con 0x7f98500d1f20 2024-04-25T13:42:12.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f984d600640 1 -- 172.21.15.123:0/2775586161 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98400a8860 con 0x7f98500d1f20 2024-04-25T13:42:12.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f984d600640 1 -- 172.21.15.123:0/2775586161 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98400a8c30 con 0x7f98500d1f20 2024-04-25T13:42:12.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f10f8a00640 1 -- 172.21.15.123:0/1205024436 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e80bc410 con 0x7f10fc0cf3e0 2024-04-25T13:42:12.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f10f8a00640 1 -- 172.21.15.123:0/1205024436 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10e80c1070 con 0x7f10fc0cf3e0 2024-04-25T13:42:12.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f10f8a00640 1 -- 172.21.15.123:0/1205024436 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e80bc7d0 con 0x7f10fc0cf3e0 2024-04-25T13:42:12.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f9b1a000640 1 --2- 172.21.15.123:0/3859338167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b0400ac60 0x7f9b0400d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.322+0000 7f9b1a000640 1 --2- 172.21.15.123:0/3859338167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b0400d7a0 0x7f9b0400fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f9b1a000640 1 -- 172.21.15.123:0/3859338167 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9b140397c0 con 0x7f9b0400d7a0 2024-04-25T13:42:12.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f9b1a000640 1 -- 172.21.15.123:0/3859338167 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9b04010590 con 0x7f9b0400ac60 2024-04-25T13:42:12.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f9b1a000640 1 -- 172.21.15.123:0/3859338167 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9b04010790 con 0x7f9b04003ab0 2024-04-25T13:42:12.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f9b1aa00640 1 --2- 172.21.15.123:0/3859338167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b0400ac60 0x7f9b0400d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f9b1b400640 1 --2- 172.21.15.123:0/3859338167 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b04003ab0 0x7f9b04003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f5bec000640 1 Processor -- start 2024-04-25T13:42:12.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f9b1aa00640 1 -- 172.21.15.123:0/3859338167 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b04003ab0 msgr2=0x7f9b04003ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:12.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f9b1aa00640 1 --2- 172.21.15.123:0/3859338167 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b04003ab0 0x7f9b04003ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f9b1aa00640 1 -- 172.21.15.123:0/3859338167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b0400d7a0 msgr2=0x7f9b0400fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:12.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f9b1aa00640 1 --2- 172.21.15.123:0/3859338167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b0400d7a0 0x7f9b0400fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f9b1aa00640 1 -- 172.21.15.123:0/3859338167 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b04003450 con 0x7f9b0400ac60 2024-04-25T13:42:12.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f9b1be00640 1 -- 172.21.15.123:0/3859338167 reap_dead start 2024-04-25T13:42:12.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7fee71800640 1 Processor -- start 2024-04-25T13:42:12.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7fee71800640 1 -- start start 2024-04-25T13:42:12.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7ff7db400640 1 --2- 172.21.15.123:0/2227704909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7d404fe70 0x7ff7d4006860 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff7d00097c0 tx=0x7ff7d001d660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4351f1d464ae3a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f1100a00640 1 -- 172.21.15.123:0/1205024436 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f10fc0cf3e0 msgr2=0x7f10fc0d0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f1100a00640 1 --2- 172.21.15.123:0/1205024436 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f10fc0cf3e0 0x7f10fc0d0050 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0b2fc0 tx=0x7f10e802d450 comp rx=0 tx=0).stop 2024-04-25T13:42:12.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f984fe00640 1 -- 172.21.15.123:0/2775586161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f98500d1f20 msgr2=0x7f98500cea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f984fe00640 1 --2- 172.21.15.123:0/2775586161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f98500d1f20 0x7f98500cea60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f98500b61f0 tx=0x7f984001e660 comp rx=0 tx=0).stop 2024-04-25T13:42:12.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f5bec000640 1 -- start start 2024-04-25T13:42:12.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f984fe00640 1 -- 172.21.15.123:0/2775586161 shutdown_connections 2024-04-25T13:42:12.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f984fe00640 1 --2- 172.21.15.123:0/2775586161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f98500d1f20 0x7f98500cea60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f984fe00640 1 --2- 172.21.15.123:0/2775586161 >> v2:172.21.15.123:3300/0 conn(0x7f9850160530 0x7f985015bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f984fe00640 1 -- 172.21.15.123:0/2775586161 >> 172.21.15.123:0/2775586161 conn(0x7f985006c670 msgr2=0x7f985006ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:12.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f1100a00640 1 -- 172.21.15.123:0/1205024436 shutdown_connections 2024-04-25T13:42:12.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f1100a00640 1 --2- 172.21.15.123:0/1205024436 >> v2:172.21.15.130:3300/0 conn(0x7f10fc0cf7f0 0x7f10fc0d0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f1100a00640 1 --2- 172.21.15.123:0/1205024436 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f10fc0cf3e0 0x7f10fc0d0050 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f1100a00640 1 -- 172.21.15.123:0/1205024436 >> 172.21.15.123:0/1205024436 conn(0x7f10fc0d36e0 msgr2=0x7f10fc0d3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:12.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f1b82800640 1 --2- 172.21.15.123:0/420922202 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b840d1c90 0x7f1b840ceb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1b840d2230 tx=0x7f1b7001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f895668a4eb79d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f1b80a00640 1 -- 172.21.15.123:0/420922202 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b700ab430 con 0x7f1b840d1c90 2024-04-25T13:42:12.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f1b80a00640 1 -- 172.21.15.123:0/420922202 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b700b0070 con 0x7f1b840d1c90 2024-04-25T13:42:12.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f1b80a00640 1 -- 172.21.15.123:0/420922202 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b700ab7f0 con 0x7f1b840d1c90 2024-04-25T13:42:12.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f984fe00640 1 -- 172.21.15.123:0/2775586161 shutdown_connections 2024-04-25T13:42:12.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f984fe00640 1 -- 172.21.15.123:0/2775586161 wait complete. 2024-04-25T13:42:12.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7ff7daa00640 1 -- 172.21.15.123:0/2227704909 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d00a7610 con 0x7ff7d404fe70 2024-04-25T13:42:12.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7ff7daa00640 1 -- 172.21.15.123:0/2227704909 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7d00a77b0 con 0x7ff7d404fe70 2024-04-25T13:42:12.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7ff7daa00640 1 -- 172.21.15.123:0/2227704909 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d00a7610 con 0x7ff7d404fe70 2024-04-25T13:42:12.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7ff7e1400640 1 -- 172.21.15.123:0/2227704909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7d404fe70 msgr2=0x7ff7d4006860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7ff7e1400640 1 --2- 172.21.15.123:0/2227704909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7d404fe70 0x7ff7d4006860 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff7d00097c0 tx=0x7ff7d001d660 comp rx=0 tx=0).stop 2024-04-25T13:42:12.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7ff7e1400640 1 -- 172.21.15.123:0/2227704909 shutdown_connections 2024-04-25T13:42:12.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7ff7e1400640 1 --2- 172.21.15.123:0/2227704909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7d404fe70 0x7ff7d4006860 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7ff7e1400640 1 -- 172.21.15.123:0/2227704909 >> 172.21.15.123:0/2227704909 conn(0x7ff7d4054d00 msgr2=0x7ff7d4055110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:12.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7ff7e1400640 1 -- 172.21.15.123:0/2227704909 shutdown_connections 2024-04-25T13:42:12.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7ff7e1400640 1 -- 172.21.15.123:0/2227704909 wait complete. 2024-04-25T13:42:12.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f1100a00640 1 -- 172.21.15.123:0/1205024436 shutdown_connections 2024-04-25T13:42:12.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f5bec000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f5be4147280 0x7f5be40b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f5bec000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5be414a320 0x7f5be40b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f5bec000640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5be40b41c0 con 0x7f5be40b3db0 2024-04-25T13:42:12.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f5bec000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5be40ce8c0 con 0x7f5be4147280 2024-04-25T13:42:12.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f5bec000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f5be414a730 con 0x7f5be414a320 2024-04-25T13:42:12.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7fee71800640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fee6c073130 0x7fee6c15c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f1b83200640 1 -- 172.21.15.123:0/420922202 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b840d1c90 msgr2=0x7f1b840ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f1b83200640 1 --2- 172.21.15.123:0/420922202 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b840d1c90 0x7f1b840ceb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1b840d2230 tx=0x7f1b7001c410 comp rx=0 tx=0).stop 2024-04-25T13:42:12.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.326+0000 7f1100a00640 1 -- 172.21.15.123:0/1205024436 wait complete. 2024-04-25T13:42:12.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f5bea000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5be414a320 0x7f5be40b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f5bea000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5be414a320 0x7f5be40b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:37508/0 (socket says 172.21.15.123:37508) 2024-04-25T13:42:12.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f5bea000640 1 -- 172.21.15.123:0/308229763 learned_addr learned my addr 172.21.15.123:0/308229763 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:12.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f5be9600640 1 --2- 172.21.15.123:0/308229763 >> v2:172.21.15.123:3300/0 conn(0x7f5be4147280 0x7f5be40b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f1100a00640 1 Processor -- start 2024-04-25T13:42:12.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f5bea000640 1 -- 172.21.15.123:0/308229763 >> v2:172.21.15.123:3300/0 conn(0x7f5be4147280 msgr2=0x7f5be40b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:12.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f5bea000640 1 --2- 172.21.15.123:0/308229763 >> v2:172.21.15.123:3300/0 conn(0x7f5be4147280 0x7f5be40b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f5bea000640 1 -- 172.21.15.123:0/308229763 >> v1:172.21.15.130:6789/0 conn(0x7f5be40b3db0 legacy=0x7f5be4149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:12.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f9b1aa00640 1 --2- 172.21.15.123:0/3859338167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b0400ac60 0x7f9b0400d080 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9b080018a0 tx=0x7f9b0801c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a8c30c6497dc4e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f1b83200640 1 -- 172.21.15.123:0/420922202 shutdown_connections 2024-04-25T13:42:12.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f1b83200640 1 --2- 172.21.15.123:0/420922202 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b840d1c90 0x7f1b840ceb30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f1b83200640 1 --2- 172.21.15.123:0/420922202 >> v2:172.21.15.123:3300/0 conn(0x7f1b8415be80 0x7f1b840b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f5bea000640 1 -- 172.21.15.123:0/308229763 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be414a980 con 0x7f5be414a320 2024-04-25T13:42:12.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7fee6b400640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fee6c073130 0x7fee6c15c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f1b83200640 1 -- 172.21.15.123:0/420922202 >> 172.21.15.123:0/420922202 conn(0x7f1b8406c840 msgr2=0x7f1b8406cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:12.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f1100a00640 1 -- start start 2024-04-25T13:42:12.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f5be9600640 1 --2- 172.21.15.123:0/308229763 >> v2:172.21.15.123:3300/0 conn(0x7f5be4147280 0x7f5be40b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:12.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f1b83200640 1 -- 172.21.15.123:0/420922202 shutdown_connections 2024-04-25T13:42:12.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f1b83200640 1 -- 172.21.15.123:0/420922202 wait complete. 2024-04-25T13:42:12.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7fee6b400640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fee6c073130 0x7fee6c15c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:53266/0 (socket says 172.21.15.123:53266) 2024-04-25T13:42:12.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7fee6be00640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fee6c0b58a0 0x7fee6c072a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.123:51482/0 (socket says 172.21.15.123:51482) 2024-04-25T13:42:12.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7fee6b400640 1 -- 172.21.15.123:0/3096495953 learned_addr learned my addr 172.21.15.123:0/3096495953 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:12.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7fee71800640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6c15d110 con 0x7fee6c0b5cb0 2024-04-25T13:42:12.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f984fe00640 1 Processor -- start 2024-04-25T13:42:12.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7fee71800640 1 -- 172.21.15.123:0/3096495953 --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee6c15fb40 con 0x7fee6c0b58a0 2024-04-25T13:42:12.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7fee71800640 1 -- 172.21.15.123:0/3096495953 --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fee6c15fe20 con 0x7fee6c073130 2024-04-25T13:42:12.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f6691400640 1 Processor -- start 2024-04-25T13:42:12.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f9b1a000640 1 -- 172.21.15.123:0/3859338167 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b08001470 con 0x7f9b0400ac60 2024-04-25T13:42:12.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f9b1a000640 1 -- 172.21.15.123:0/3859338167 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b08007290 con 0x7f9b0400ac60 2024-04-25T13:42:12.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f9b1a000640 1 -- 172.21.15.123:0/3859338167 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b08007680 con 0x7f9b0400ac60 2024-04-25T13:42:12.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7fee6b400640 1 -- 172.21.15.123:0/3096495953 >> v1:172.21.15.130:6789/0 conn(0x7fee6c0b58a0 legacy=0x7fee6c072a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:12.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7fee6b400640 1 -- 172.21.15.123:0/3096495953 >> v1:172.21.15.123:6789/0 conn(0x7fee6c0b5cb0 legacy=0x7fee6c15c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:12.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7fee6b400640 1 -- 172.21.15.123:0/3096495953 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6c160100 con 0x7fee6c073130 2024-04-25T13:42:12.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f984fe00640 1 -- start start 2024-04-25T13:42:12.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f984fe00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f98500b4430 0x7f985014d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f984fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9850160530 0x7f985014eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f984fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9850161710 0x7f98501643d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f984fe00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9850168e40 con 0x7f9850160530 2024-04-25T13:42:12.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f984fe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9850168cc0 con 0x7f9850161710 2024-04-25T13:42:12.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f984fe00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9850168fc0 con 0x7f98500b4430 2024-04-25T13:42:12.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f1100a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f10fc0b8ea0 0x7f10fc0b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f1100a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10fc0cf3e0 0x7f10fc157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f1100a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10fc0cf7f0 0x7f10fc153fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f9b21000640 1 -- 172.21.15.123:0/3859338167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b0400ac60 msgr2=0x7f9b0400d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f9b21000640 1 --2- 172.21.15.123:0/3859338167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b0400ac60 0x7f9b0400d080 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9b080018a0 tx=0x7f9b0801c500 comp rx=0 tx=0).stop 2024-04-25T13:42:12.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f984ea00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f98500b4430 0x7f985014d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f984ea00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f98500b4430 0x7f985014d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:37534/0 (socket says 172.21.15.123:37534) 2024-04-25T13:42:12.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f984ea00640 1 -- 172.21.15.123:0/4094021132 learned_addr learned my addr 172.21.15.123:0/4094021132 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:12.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f10fa800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10fc0cf7f0 0x7f10fc153fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f10f9e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f10fc0b8ea0 0x7f10fc0b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f10fa800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10fc0cf7f0 0x7f10fc153fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37188/0 (socket says 172.21.15.123:37188) 2024-04-25T13:42:12.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f10f9e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f10fc0b8ea0 0x7f10fc0b1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:37520/0 (socket says 172.21.15.123:37520) 2024-04-25T13:42:12.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7ff7e1400640 1 Processor -- start 2024-04-25T13:42:12.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f10f9400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10fc0cf3e0 0x7f10fc157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f1100a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc168f60 con 0x7f10fc0cf7f0 2024-04-25T13:42:12.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f1100a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f10fc0d2800 con 0x7f10fc0cf3e0 2024-04-25T13:42:12.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f10fa800640 1 -- 172.21.15.123:0/3566143517 learned_addr learned my addr 172.21.15.123:0/3566143517 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:12.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f1100a00640 1 -- 172.21.15.123:0/3566143517 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f10fc1690e0 con 0x7f10fc0b8ea0 2024-04-25T13:42:12.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f984f400640 1 --2- 172.21.15.123:0/4094021132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9850161710 0x7f98501643d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f984ea00640 1 -- 172.21.15.123:0/4094021132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9850161710 msgr2=0x7f98501643d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f984ea00640 1 --2- 172.21.15.123:0/4094021132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9850161710 0x7f98501643d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f984ea00640 1 -- 172.21.15.123:0/4094021132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9850160530 msgr2=0x7f985014eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f984ea00640 1 --2- 172.21.15.123:0/4094021132 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9850160530 0x7f985014eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f984ea00640 1 -- 172.21.15.123:0/4094021132 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985014dac0 con 0x7f98500b4430 2024-04-25T13:42:12.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.330+0000 7f6691400640 1 -- start start 2024-04-25T13:42:12.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7ff7e1400640 1 -- start start 2024-04-25T13:42:12.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f9b21000640 1 -- 172.21.15.123:0/3859338167 shutdown_connections 2024-04-25T13:42:12.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f9b21000640 1 --2- 172.21.15.123:0/3859338167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b0400ac60 0x7f9b0400d080 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f9b21000640 1 -- 172.21.15.123:0/3859338167 >> 172.21.15.123:0/3859338167 conn(0x7f9b14054d00 msgr2=0x7f9b14055110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:12.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f9b21000640 1 -- 172.21.15.123:0/3859338167 shutdown_connections 2024-04-25T13:42:12.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f1b83200640 1 Processor -- start 2024-04-25T13:42:12.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f9b21000640 1 -- 172.21.15.123:0/3859338167 wait complete. 2024-04-25T13:42:12.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f984ea00640 1 --2- 172.21.15.123:0/4094021132 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f98500b4430 0x7f985014d1c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f983c00d830 tx=0x7f983c00dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f6691400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f668c14a320 0x7f668c0b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f10f9400640 1 -- 172.21.15.123:0/3566143517 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f10fc0b8ea0 msgr2=0x7f10fc0b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f10f9400640 1 --2- 172.21.15.123:0/3566143517 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f10fc0b8ea0 0x7f10fc0b1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f10f9400640 1 -- 172.21.15.123:0/3566143517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10fc0cf7f0 msgr2=0x7f10fc153fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f10f9400640 1 --2- 172.21.15.123:0/3566143517 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10fc0cf7f0 0x7f10fc153fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f668a800640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f668c147280 0x7f668c0b3870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.123:51490/0 (socket says 172.21.15.123:51490) 2024-04-25T13:42:12.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f10f9400640 1 -- 172.21.15.123:0/3566143517 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10fc157e40 con 0x7f10fc0cf3e0 2024-04-25T13:42:12.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f6691400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f668c14a980 con 0x7f668c0b3f80 2024-04-25T13:42:12.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f6691400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f668c0cdf90 con 0x7f668c147280 2024-04-25T13:42:12.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f6691400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f668c0ce8c0 con 0x7f668c14a320 2024-04-25T13:42:12.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f668a800640 1 -- 172.21.15.123:0/4107809475 learned_addr learned my addr 172.21.15.123:0/4107809475 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:12.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f9847400640 1 -- 172.21.15.123:0/4094021132 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983c018020 con 0x7f98500b4430 2024-04-25T13:42:12.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f9847400640 1 -- 172.21.15.123:0/4094021132 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f983c0096c0 con 0x7f98500b4430 2024-04-25T13:42:12.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f9847400640 1 -- 172.21.15.123:0/4094021132 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983c009ab0 con 0x7f98500b4430 2024-04-25T13:42:12.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7f984fe00640 1 -- 172.21.15.123:0/4094021132 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f985014dda0 con 0x7f98500b4430 2024-04-25T13:42:12.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.334+0000 7f10f9400640 1 --2- 172.21.15.123:0/3566143517 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10fc0cf3e0 0x7f10fc157110 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f10e80bd000 tx=0x7f10e802bc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7f668b200640 1 --2- 172.21.15.123:0/4107809475 >> v2:172.21.15.123:3300/0 conn(0x7f668c14a320 0x7f668c0b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7f1b83200640 1 -- start start 2024-04-25T13:42:12.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7fee6b400640 1 --2- 172.21.15.123:0/3096495953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee6c073130 0x7fee6c15c3b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fee58007360 tx=0x7fee5801d420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12f9ac3dbf4fd90a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7f668b200640 1 -- 172.21.15.123:0/4107809475 >> v1:172.21.15.130:6789/0 conn(0x7f668c147280 legacy=0x7f668c0b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7f668b200640 1 -- 172.21.15.123:0/4107809475 >> v1:172.21.15.123:6789/0 conn(0x7f668c0b3f80 legacy=0x7f668c149c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7f668b200640 1 -- 172.21.15.123:0/4107809475 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f668c0ce270 con 0x7f668c14a320 2024-04-25T13:42:12.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7f984fe00640 1 -- 172.21.15.123:0/4094021132 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f985014e360 con 0x7f98500b4430 2024-04-25T13:42:12.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7ff7e1400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7d4006da0 0x7ff7d40d8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7ff7e1400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7d404f350 0x7ff7d40e2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7ff7e1400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7d404fe70 0x7ff7d40e9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7ff7e1400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d40e0300 con 0x7ff7d4006da0 2024-04-25T13:42:12.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7ff7e1400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d40e0180 con 0x7ff7d404fe70 2024-04-25T13:42:12.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7ff7e1400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff7d40edf10 con 0x7ff7d404f350 2024-04-25T13:42:12.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7fee6aa00640 1 -- 172.21.15.123:0/3096495953 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee58008be0 con 0x7fee6c073130 2024-04-25T13:42:12.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7fee6aa00640 1 -- 172.21.15.123:0/3096495953 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee58008d80 con 0x7fee6c073130 2024-04-25T13:42:12.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7fee6aa00640 1 -- 172.21.15.123:0/3096495953 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee5800a2f0 con 0x7fee6c073130 2024-04-25T13:42:12.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7ff7e0a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7d404fe70 0x7ff7d40e9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7ff7e0a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7d404fe70 0x7ff7d40e9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:53296/0 (socket says 172.21.15.123:53296) 2024-04-25T13:42:12.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7ff7e0a00640 1 -- 172.21.15.123:0/313423679 learned_addr learned my addr 172.21.15.123:0/313423679 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:12.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7f984fe00640 1 -- 172.21.15.123:0/4094021132 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f985014e740 con 0x7f98500b4430 2024-04-25T13:42:12.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7f10f2000640 1 -- 172.21.15.123:0/3566143517 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e80cf5f0 con 0x7f10fc0cf3e0 2024-04-25T13:42:12.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7f10f2000640 1 -- 172.21.15.123:0/3566143517 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10e80cf7d0 con 0x7f10fc0cf3e0 2024-04-25T13:42:12.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7f1100a00640 1 -- 172.21.15.123:0/3566143517 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10fc1f8f80 con 0x7f10fc0cf3e0 2024-04-25T13:42:12.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7f10f2000640 1 -- 172.21.15.123:0/3566143517 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e80cfbc0 con 0x7f10fc0cf3e0 2024-04-25T13:42:12.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7f1100a00640 1 -- 172.21.15.123:0/3566143517 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10fc1f9540 con 0x7f10fc0cf3e0 2024-04-25T13:42:12.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7ff7db400640 1 --2- 172.21.15.123:0/313423679 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7d404f350 0x7ff7d40e2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7ff7e0a00640 1 -- 172.21.15.123:0/313423679 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7d404f350 msgr2=0x7ff7d40e2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7ff7e0a00640 1 --2- 172.21.15.123:0/313423679 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7d404f350 0x7ff7d40e2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7ff7e0a00640 1 -- 172.21.15.123:0/313423679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7d4006da0 msgr2=0x7ff7d40d8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7ff7e0a00640 1 --2- 172.21.15.123:0/313423679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7d4006da0 0x7ff7d40d8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7ff7e0a00640 1 -- 172.21.15.123:0/313423679 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d4048e10 con 0x7ff7d404fe70 2024-04-25T13:42:12.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7fee71800640 1 -- 172.21.15.123:0/3096495953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee6c073130 msgr2=0x7fee6c15c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7fee71800640 1 --2- 172.21.15.123:0/3096495953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee6c073130 0x7fee6c15c3b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fee58007360 tx=0x7fee5801d420 comp rx=0 tx=0).stop 2024-04-25T13:42:12.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7ff7db400640 1 --2- 172.21.15.123:0/313423679 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7d404f350 0x7ff7d40e2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:12.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7ff7e0a00640 1 --2- 172.21.15.123:0/313423679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7d404fe70 0x7ff7d40e9760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc06b7b0 tx=0x7ff7dc06da50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7f1100a00640 1 -- 172.21.15.123:0/3566143517 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f10fc050750 con 0x7f10fc0cf3e0 2024-04-25T13:42:12.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7f5bea000640 1 --2- 172.21.15.123:0/308229763 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5be414a320 0x7f5be40b4770 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009870 tx=0x7f5bd801c310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8a5091d936229bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7f9b21000640 1 Processor -- start 2024-04-25T13:42:12.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7ff7cfe00640 1 -- 172.21.15.123:0/313423679 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc094600 con 0x7ff7d404fe70 2024-04-25T13:42:12.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7ff7cfe00640 1 -- 172.21.15.123:0/313423679 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7dc0947a0 con 0x7ff7d404fe70 2024-04-25T13:42:12.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7ff7cfe00640 1 -- 172.21.15.123:0/313423679 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc094600 con 0x7ff7d404fe70 2024-04-25T13:42:12.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7ff7e1400640 1 -- 172.21.15.123:0/313423679 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7d40490f0 con 0x7ff7d404fe70 2024-04-25T13:42:12.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7fee71800640 1 -- 172.21.15.123:0/3096495953 shutdown_connections 2024-04-25T13:42:12.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7fee71800640 1 --2- 172.21.15.123:0/3096495953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee6c073130 0x7fee6c15c3b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7fee71800640 1 -- 172.21.15.123:0/3096495953 >> 172.21.15.123:0/3096495953 conn(0x7fee6c06ca70 msgr2=0x7fee6c06ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:12.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f1b83200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b840b4df0 0x7f1b8415db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f1b83200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b8415be80 0x7f1b840b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f1b83200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b84151250 0x7f1b84150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f1b83200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1b84168d40 con 0x7f1b8415be80 2024-04-25T13:42:12.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f1b83200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1b84070d70 con 0x7f1b840b4df0 2024-04-25T13:42:12.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f1b83200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f1b84168ec0 con 0x7f1b84151250 2024-04-25T13:42:12.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f9847400640 1 -- 172.21.15.123:0/4094021132 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f983c01b020 con 0x7f98500b4430 2024-04-25T13:42:12.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7ff7e1400640 1 -- 172.21.15.123:0/313423679 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7d40496b0 con 0x7ff7d404fe70 2024-04-25T13:42:12.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7ff7e1400640 1 -- 172.21.15.123:0/313423679 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff7b8001040 con 0x7ff7d404fe70 2024-04-25T13:42:12.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f5be3e00640 1 -- 172.21.15.123:0/308229763 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd80b0070 con 0x7f5be414a320 2024-04-25T13:42:12.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f5be3e00640 1 -- 172.21.15.123:0/308229763 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bd80ab600 con 0x7f5be414a320 2024-04-25T13:42:12.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f5be3e00640 1 -- 172.21.15.123:0/308229763 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd80ab9d0 con 0x7f5be414a320 2024-04-25T13:42:12.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.338+0000 7f9b21000640 1 -- start start 2024-04-25T13:42:12.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f1b82800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b84151250 0x7f1b84150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f1b82800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b84151250 0x7f1b84150ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:37550/0 (socket says 172.21.15.123:37550) 2024-04-25T13:42:12.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f1b82800640 1 -- 172.21.15.123:0/2560272565 learned_addr learned my addr 172.21.15.123:0/2560272565 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:12.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f1b81400640 1 --2- 172.21.15.123:0/2560272565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b8415be80 0x7f1b840b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f1b82800640 1 -- 172.21.15.123:0/2560272565 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b840b4df0 msgr2=0x7f1b8415db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f1b82800640 1 --2- 172.21.15.123:0/2560272565 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b840b4df0 0x7f1b8415db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f1b82800640 1 -- 172.21.15.123:0/2560272565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b8415be80 msgr2=0x7f1b840b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f1b82800640 1 --2- 172.21.15.123:0/2560272565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b8415be80 0x7f1b840b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f1b82800640 1 -- 172.21.15.123:0/2560272565 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b84150ff0 con 0x7f1b84151250 2024-04-25T13:42:12.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f1b81400640 1 --2- 172.21.15.123:0/2560272565 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b8415be80 0x7f1b840b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:12.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f1b82800640 1 --2- 172.21.15.123:0/2560272565 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b84151250 0x7f1b84150ab0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1b7001a040 tx=0x7f1b700191b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f9b21000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b0400ac60 0x7f9b140d5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f9b21000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b140d8c80 0x7f9b14186ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f9b21000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b1417cc30 0x7f9b140e02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f9847400640 1 --2- 172.21.15.123:0/4094021132 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f983006f450 0x7f9830071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7ff7cfe00640 1 -- 172.21.15.123:0/313423679 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff7dc09e390 con 0x7ff7d404fe70 2024-04-25T13:42:12.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f5bec000640 1 -- 172.21.15.123:0/308229763 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5be414a320 msgr2=0x7f5be40b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f5bec000640 1 --2- 172.21.15.123:0/308229763 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5be414a320 0x7f5be40b4770 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8009870 tx=0x7f5bd801c310 comp rx=0 tx=0).stop 2024-04-25T13:42:12.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f1b7a000640 1 -- 172.21.15.123:0/2560272565 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b700abc40 con 0x7f1b84151250 2024-04-25T13:42:12.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f1b7a000640 1 -- 172.21.15.123:0/2560272565 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b700bc070 con 0x7f1b84151250 2024-04-25T13:42:12.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f1b7a000640 1 -- 172.21.15.123:0/2560272565 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b700b43f0 con 0x7f1b84151250 2024-04-25T13:42:12.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f9b1aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b140d8c80 0x7f9b14186ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f9b1b400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b0400ac60 0x7f9b140d5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f9b1b400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b0400ac60 0x7f9b140d5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:37554/0 (socket says 172.21.15.123:37554) 2024-04-25T13:42:12.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f1b83200640 1 -- 172.21.15.123:0/2560272565 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b84156360 con 0x7f1b84151250 2024-04-25T13:42:12.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f1b83200640 1 -- 172.21.15.123:0/2560272565 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b84156c30 con 0x7f1b84151250 2024-04-25T13:42:12.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f9847400640 1 -- 172.21.15.123:0/4094021132 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f983c08fda0 con 0x7f98500b4430 2024-04-25T13:42:12.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f9847400640 1 --2- 172.21.15.123:0/4094021132 >> [v2:172.21.15.123:6824/1411373789,v1:172.21.15.123:6825/1411373789] conn(0x7f9830077720 0x7f9830079b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f9847400640 1 -- 172.21.15.123:0/4094021132 --> [v2:172.21.15.123:6824/1411373789,v1:172.21.15.123:6825/1411373789] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f983c008f30 con 0x7f9830077720 2024-04-25T13:42:12.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f9847400640 1 -- 172.21.15.123:0/4094021132 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f983c090150 con 0x7f98500b4430 2024-04-25T13:42:12.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f9b1aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b140d8c80 0x7f9b14186ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:53314/0 (socket says 172.21.15.123:53314) 2024-04-25T13:42:12.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f9b21000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9b14054590 con 0x7f9b1417cc30 2024-04-25T13:42:12.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f9b21000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9b140e0160 con 0x7f9b140d8c80 2024-04-25T13:42:12.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f9b21000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9b14033b10 con 0x7f9b0400ac60 2024-04-25T13:42:12.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f9b1b400640 1 -- 172.21.15.123:0/2879487883 learned_addr learned my addr 172.21.15.123:0/2879487883 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:12.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f9b1be00640 1 --2- 172.21.15.123:0/2879487883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b1417cc30 0x7f9b140e02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f5bec000640 1 -- 172.21.15.123:0/308229763 shutdown_connections 2024-04-25T13:42:12.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f5bec000640 1 --2- 172.21.15.123:0/308229763 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5be414a320 0x7f5be40b4770 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f5bec000640 1 --2- 172.21.15.123:0/308229763 >> v2:172.21.15.123:3300/0 conn(0x7f5be4147280 0x7f5be40b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f5bec000640 1 -- 172.21.15.123:0/308229763 >> 172.21.15.123:0/308229763 conn(0x7f5be406ca70 msgr2=0x7f5be406ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:12.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7ff7cfe00640 1 --2- 172.21.15.123:0/313423679 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff7bc06f630 0x7ff7bc071b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f5bec000640 1 -- 172.21.15.123:0/308229763 shutdown_connections 2024-04-25T13:42:12.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7fee71800640 1 -- 172.21.15.123:0/3096495953 shutdown_connections 2024-04-25T13:42:12.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7fee71800640 1 -- 172.21.15.123:0/3096495953 wait complete. 2024-04-25T13:42:12.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.342+0000 7f10f2000640 1 -- 172.21.15.123:0/3566143517 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f10e80c53f0 con 0x7f10fc0cf3e0 2024-04-25T13:42:12.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f10f2000640 1 --2- 172.21.15.123:0/3566143517 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f10dc06f400 0x7f10dc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f10f2000640 1 -- 172.21.15.123:0/3566143517 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f10e813a7d0 con 0x7f10fc0cf3e0 2024-04-25T13:42:12.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f10f2000640 1 --2- 172.21.15.123:0/3566143517 >> [v2:172.21.15.130:6821/1535108655,v1:172.21.15.130:6823/1535108655] conn(0x7f10dc0775f0 0x7f10dc079a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f10f2000640 1 -- 172.21.15.123:0/3566143517 --> [v2:172.21.15.130:6821/1535108655,v1:172.21.15.130:6823/1535108655] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10e80cde50 con 0x7f10dc0775f0 2024-04-25T13:42:12.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f984e000640 1 --2- 172.21.15.123:0/4094021132 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f983006f450 0x7f9830071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7ff7cfe00640 1 -- 172.21.15.123:0/313423679 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff7dc10b070 con 0x7ff7d404fe70 2024-04-25T13:42:12.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7ff7dbe00640 1 --2- 172.21.15.123:0/313423679 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff7bc06f630 0x7ff7bc071b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7ff7cfe00640 1 --2- 172.21.15.123:0/313423679 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x7ff7bc0778a0 0x7ff7bc079cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7ff7cfe00640 1 -- 172.21.15.123:0/313423679 --> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff7bc07a3c0 con 0x7ff7bc0778a0 2024-04-25T13:42:12.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7ff7cfe00640 1 -- 172.21.15.123:0/313423679 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff7dc10b460 con 0x7ff7d404fe70 2024-04-25T13:42:12.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f5bec000640 1 -- 172.21.15.123:0/308229763 wait complete. 2024-04-25T13:42:12.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f984f400640 1 --2- 172.21.15.123:0/4094021132 >> [v2:172.21.15.123:6824/1411373789,v1:172.21.15.123:6825/1411373789] conn(0x7f9830077720 0x7f9830079b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f10f9e00640 1 --2- 172.21.15.123:0/3566143517 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f10dc06f400 0x7f10dc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7ff7db400640 1 --2- 172.21.15.123:0/313423679 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x7ff7bc0778a0 0x7ff7bc079cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f9b1b400640 1 -- 172.21.15.123:0/2879487883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b140d8c80 msgr2=0x7f9b14186ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f9b1b400640 1 --2- 172.21.15.123:0/2879487883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b140d8c80 0x7f9b14186ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f9b1b400640 1 -- 172.21.15.123:0/2879487883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b1417cc30 msgr2=0x7f9b140e02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f9b1b400640 1 --2- 172.21.15.123:0/2879487883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9b1417cc30 0x7f9b140e02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f9b1b400640 1 -- 172.21.15.123:0/2879487883 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b140d5d70 con 0x7f9b0400ac60 2024-04-25T13:42:12.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f10fa800640 1 --2- 172.21.15.123:0/3566143517 >> [v2:172.21.15.130:6821/1535108655,v1:172.21.15.130:6823/1535108655] conn(0x7f10dc0775f0 0x7f10dc079a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f9b1b400640 1 --2- 172.21.15.123:0/2879487883 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b0400ac60 0x7f9b140d5240 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000cfd0 tx=0x7f9b10004f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f984f400640 1 --2- 172.21.15.123:0/4094021132 >> [v2:172.21.15.123:6824/1411373789,v1:172.21.15.123:6825/1411373789] conn(0x7f9830077720 0x7f9830079b70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f1b83200640 1 -- 172.21.15.123:0/2560272565 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1b84157010 con 0x7f1b84151250 2024-04-25T13:42:12.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f668b200640 1 --2- 172.21.15.123:0/4107809475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f668c14a320 0x7f668c0b4770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6684009d90 tx=0x7f668401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77712efb71c409f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7fee71800640 1 Processor -- start 2024-04-25T13:42:12.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f9b0f400640 1 -- 172.21.15.123:0/2879487883 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b10007740 con 0x7f9b0400ac60 2024-04-25T13:42:12.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f9b21000640 1 -- 172.21.15.123:0/2879487883 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b14186440 con 0x7f9b0400ac60 2024-04-25T13:42:12.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f9b0f400640 1 -- 172.21.15.123:0/2879487883 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b1001a070 con 0x7f9b0400ac60 2024-04-25T13:42:12.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f9b0f400640 1 -- 172.21.15.123:0/2879487883 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b10007740 con 0x7f9b0400ac60 2024-04-25T13:42:12.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f6689400640 1 -- 172.21.15.123:0/4107809475 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66840b2070 con 0x7f668c14a320 2024-04-25T13:42:12.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f9b21000640 1 -- 172.21.15.123:0/2879487883 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b141866e0 con 0x7f9b0400ac60 2024-04-25T13:42:12.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f10f9e00640 1 --2- 172.21.15.123:0/3566143517 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f10dc06f400 0x7f10dc071910 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f10ec007fd0 tx=0x7f10ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7ff7db400640 1 --2- 172.21.15.123:0/313423679 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x7ff7bc0778a0 0x7ff7bc079cf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f984e000640 1 --2- 172.21.15.123:0/4094021132 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f983006f450 0x7f9830071960 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f985015b180 tx=0x7f9848007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f10f2000640 1 -- 172.21.15.123:0/3566143517 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f10e8141050 con 0x7f10fc0cf3e0 2024-04-25T13:42:12.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7ff7dbe00640 1 --2- 172.21.15.123:0/313423679 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff7bc06f630 0x7ff7bc071b40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8000f70 tx=0x7ff7c80079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7fee71800640 1 -- start start 2024-04-25T13:42:12.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.346+0000 7f10fa800640 1 --2- 172.21.15.123:0/3566143517 >> [v2:172.21.15.130:6821/1535108655,v1:172.21.15.130:6823/1535108655] conn(0x7f10dc0775f0 0x7f10dc079a40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7f9847400640 1 -- 172.21.15.123:0/4094021132 <== osd.2 v2:172.21.15.123:6824/1411373789 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f983c008f30 con 0x7f9830077720 2024-04-25T13:42:12.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7f6689400640 1 -- 172.21.15.123:0/4107809475 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66840a5940 con 0x7f668c14a320 2024-04-25T13:42:12.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7f6689400640 1 -- 172.21.15.123:0/4107809475 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66840b2070 con 0x7f668c14a320 2024-04-25T13:42:12.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7f9b21000640 1 -- 172.21.15.123:0/2879487883 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9af8001040 con 0x7f9b0400ac60 2024-04-25T13:42:12.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7ff7cfe00640 1 -- 172.21.15.123:0/313423679 <== osd.3 v2:172.21.15.123:6816/898268961 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff7bc07a3c0 con 0x7ff7bc0778a0 2024-04-25T13:42:12.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7f6691400640 1 -- 172.21.15.123:0/4107809475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f668c14a320 msgr2=0x7f668c0b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7f6691400640 1 --2- 172.21.15.123:0/4107809475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f668c14a320 0x7f668c0b4770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6684009d90 tx=0x7f668401c970 comp rx=0 tx=0).stop 2024-04-25T13:42:12.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7fee71800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee6c0b58a0 0x7fee6c1444c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7fee71800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee6c0b5cb0 0x7fee6c0b4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7f6691400640 1 -- 172.21.15.123:0/4107809475 shutdown_connections 2024-04-25T13:42:12.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7f6691400640 1 --2- 172.21.15.123:0/4107809475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f668c14a320 0x7f668c0b4770 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7fee71800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee6c0cf900 0x7fee6c0cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7fee71800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c1531e0 con 0x7fee6c0cf900 2024-04-25T13:42:12.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7fee71800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fee6c153060 con 0x7fee6c0b5cb0 2024-04-25T13:42:12.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7fee71800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fee6c0b44a0 con 0x7fee6c0b58a0 2024-04-25T13:42:12.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7fee70e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee6c0cf900 0x7fee6c0cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7fee70e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee6c0cf900 0x7fee6c0cfd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37248/0 (socket says 172.21.15.123:37248) 2024-04-25T13:42:12.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7fee70e00640 1 -- 172.21.15.123:0/2175240365 learned_addr learned my addr 172.21.15.123:0/2175240365 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:12.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7f6691400640 1 -- 172.21.15.123:0/4107809475 >> 172.21.15.123:0/4107809475 conn(0x7f668c06ca70 msgr2=0x7f668c06ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:12.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7f1b7a000640 1 -- 172.21.15.123:0/2560272565 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1b700b4590 con 0x7f1b84151250 2024-04-25T13:42:12.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7f1b7a000640 1 --2- 172.21.15.123:0/2560272565 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1b6406f430 0x7f1b64071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7f1b7a000640 1 -- 172.21.15.123:0/2560272565 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1b70128ab0 con 0x7f1b84151250 2024-04-25T13:42:12.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7f1b7a000640 1 --2- 172.21.15.123:0/2560272565 >> [v2:172.21.15.123:6800/477459895,v1:172.21.15.123:6801/477459895] conn(0x7f1b64077680 0x7f1b64079ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7f1b7a000640 1 -- 172.21.15.123:0/2560272565 --> [v2:172.21.15.123:6800/477459895,v1:172.21.15.123:6801/477459895] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1b700b5e50 con 0x7f1b64077680 2024-04-25T13:42:12.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7fee6b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee6c0b5cb0 0x7fee6c0b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7f9b0f400640 1 -- 172.21.15.123:0/2879487883 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9b10014070 con 0x7f9b0400ac60 2024-04-25T13:42:12.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7fee70e00640 1 -- 172.21.15.123:0/2175240365 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee6c0b58a0 msgr2=0x7fee6c1444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7fee70e00640 1 --2- 172.21.15.123:0/2175240365 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee6c0b58a0 0x7fee6c1444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7fee70e00640 1 -- 172.21.15.123:0/2175240365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee6c0b5cb0 msgr2=0x7fee6c0b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7fee70e00640 1 --2- 172.21.15.123:0/2175240365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee6c0b5cb0 0x7fee6c0b4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7fee70e00640 1 -- 172.21.15.123:0/2175240365 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee6c0d0250 con 0x7fee6c0cf900 2024-04-25T13:42:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7f6691400640 1 -- 172.21.15.123:0/4107809475 shutdown_connections 2024-04-25T13:42:12.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7fee70e00640 1 --2- 172.21.15.123:0/2175240365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee6c0cf900 0x7fee6c0cfd10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fee6400b9a0 tx=0x7fee6400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7f6691400640 1 -- 172.21.15.123:0/4107809475 wait complete. 2024-04-25T13:42:12.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7f1b81400640 1 --2- 172.21.15.123:0/2560272565 >> [v2:172.21.15.123:6800/477459895,v1:172.21.15.123:6801/477459895] conn(0x7f1b64077680 0x7f1b64079ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.354+0000 7fee63e00640 1 -- 172.21.15.123:0/2175240365 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64019070 con 0x7fee6c0cf900 2024-04-25T13:42:12.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.354+0000 7fee63e00640 1 -- 172.21.15.123:0/2175240365 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee6400cba0 con 0x7fee6c0cf900 2024-04-25T13:42:12.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.350+0000 7f9b0f400640 1 --2- 172.21.15.123:0/2879487883 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9afc06f630 0x7f9afc071b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.354+0000 7f9b0f400640 1 -- 172.21.15.123:0/2879487883 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9b100917d0 con 0x7f9b0400ac60 2024-04-25T13:42:12.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.354+0000 7f1b81e00640 1 --2- 172.21.15.123:0/2560272565 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1b6406f430 0x7f1b64071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.354+0000 7fee71800640 1 -- 172.21.15.123:0/2175240365 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee6c1535b0 con 0x7fee6c0cf900 2024-04-25T13:42:12.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.354+0000 7fee63e00640 1 -- 172.21.15.123:0/2175240365 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64014440 con 0x7fee6c0cf900 2024-04-25T13:42:12.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.354+0000 7fee71800640 1 -- 172.21.15.123:0/2175240365 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee6c153b70 con 0x7fee6c0cf900 2024-04-25T13:42:12.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.354+0000 7f1b81400640 1 --2- 172.21.15.123:0/2560272565 >> [v2:172.21.15.123:6800/477459895,v1:172.21.15.123:6801/477459895] conn(0x7f1b64077680 0x7f1b64079ad0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.354+0000 7f10f2000640 1 -- 172.21.15.123:0/3566143517 <== osd.4 v2:172.21.15.130:6821/1535108655 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f10e80cde50 con 0x7f10dc0775f0 2024-04-25T13:42:12.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.354+0000 7f9b0f400640 1 --2- 172.21.15.123:0/2879487883 >> [v2:172.21.15.130:6816/940897425,v1:172.21.15.130:6817/940897425] conn(0x7f9afc077820 0x7f9afc079c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.354+0000 7f9b0f400640 1 -- 172.21.15.123:0/2879487883 --> [v2:172.21.15.130:6816/940897425,v1:172.21.15.130:6817/940897425] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b10010e50 con 0x7f9afc077820 2024-04-25T13:42:12.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.354+0000 7f9b0f400640 1 -- 172.21.15.123:0/2879487883 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9b10091b80 con 0x7f9b0400ac60 2024-04-25T13:42:12.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.354+0000 7f1b81e00640 1 --2- 172.21.15.123:0/2560272565 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1b6406f430 0x7f1b64071940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1b840ce5c0 tx=0x7f1b7c009250 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.354+0000 7f5bec000640 1 Processor -- start 2024-04-25T13:42:12.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.354+0000 7f5bec000640 1 -- start start 2024-04-25T13:42:12.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.354+0000 7fee71800640 1 -- 172.21.15.123:0/2175240365 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fee44001040 con 0x7fee6c0cf900 2024-04-25T13:42:12.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.354+0000 7f9b1aa00640 1 --2- 172.21.15.123:0/2879487883 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9afc06f630 0x7f9afc071b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.354+0000 7f9b1be00640 1 --2- 172.21.15.123:0/2879487883 >> [v2:172.21.15.130:6816/940897425,v1:172.21.15.130:6817/940897425] conn(0x7f9afc077820 0x7f9afc079c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.354+0000 7f6691400640 1 Processor -- start 2024-04-25T13:42:12.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f9b1be00640 1 --2- 172.21.15.123:0/2879487883 >> [v2:172.21.15.130:6816/940897425,v1:172.21.15.130:6817/940897425] conn(0x7f9afc077820 0x7f9afc079c70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f6691400640 1 -- start start 2024-04-25T13:42:12.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7fee63e00640 1 -- 172.21.15.123:0/2175240365 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fee6401c070 con 0x7fee6c0cf900 2024-04-25T13:42:12.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f5bec000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5be40b3db0 0x7f5be413b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f5bec000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5be4147280 0x7f5be4140f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f1b7a000640 1 -- 172.21.15.123:0/2560272565 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1b700f18e0 con 0x7f1b84151250 2024-04-25T13:42:12.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f5be9600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5be40b3db0 0x7f5be413b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f9b0f400640 1 -- 172.21.15.123:0/2879487883 <== osd.7 v2:172.21.15.130:6816/940897425 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9b10010e50 con 0x7f9afc077820 2024-04-25T13:42:12.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f5be9600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5be40b3db0 0x7f5be413b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:37566/0 (socket says 172.21.15.123:37566) 2024-04-25T13:42:12.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f5bec000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5be414a320 0x7f5be414dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f5bec000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5be4147810 con 0x7f5be4147280 2024-04-25T13:42:12.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f5bec000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5be4147690 con 0x7f5be414a320 2024-04-25T13:42:12.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f5bec000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f5be41711a0 con 0x7f5be40b3db0 2024-04-25T13:42:12.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7fee63e00640 1 --2- 172.21.15.123:0/2175240365 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fee4c06f450 0x7fee4c071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f6691400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f668c147280 0x7f668c1384e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f6691400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f668c14a320 0x7f668c136970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f9b1aa00640 1 --2- 172.21.15.123:0/2879487883 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9afc06f630 0x7f9afc071b40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9b080ac000 tx=0x7f9b080a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7fee63e00640 1 -- 172.21.15.123:0/2175240365 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fee6408f690 con 0x7fee6c0cf900 2024-04-25T13:42:12.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f6691400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f668c138a20 0x7f668c136eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f6691400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f668c172540 con 0x7f668c147280 2024-04-25T13:42:12.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f6691400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f668c1723c0 con 0x7f668c14a320 2024-04-25T13:42:12.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f6691400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f668c1726c0 con 0x7f668c138a20 2024-04-25T13:42:12.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7fee63e00640 1 --2- 172.21.15.123:0/2175240365 >> [v2:172.21.15.123:6808/2208828636,v1:172.21.15.123:6809/2208828636] conn(0x7fee4c0776a0 0x7fee4c079af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7fee63e00640 1 -- 172.21.15.123:0/2175240365 --> [v2:172.21.15.123:6808/2208828636,v1:172.21.15.123:6809/2208828636] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fee64021e50 con 0x7fee4c0776a0 2024-04-25T13:42:12.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7fee63e00640 1 -- 172.21.15.123:0/2175240365 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fee640585b0 con 0x7fee6c0cf900 2024-04-25T13:42:12.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7fee6be00640 1 --2- 172.21.15.123:0/2175240365 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fee4c06f450 0x7fee4c071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f1b7a000640 1 -- 172.21.15.123:0/2560272565 <== osd.1 v2:172.21.15.123:6800/477459895 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1b700b5e50 con 0x7f1b64077680 2024-04-25T13:42:12.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f6689e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f668c14a320 0x7f668c136970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f6689e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f668c14a320 0x7f668c136970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:53332/0 (socket says 172.21.15.123:53332) 2024-04-25T13:42:12.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f6689e00640 1 -- 172.21.15.123:0/3353353151 learned_addr learned my addr 172.21.15.123:0/3353353151 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:12.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f668b200640 1 --2- 172.21.15.123:0/3353353151 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f668c138a20 0x7f668c136eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f668a800640 1 --2- 172.21.15.123:0/3353353151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f668c147280 0x7f668c1384e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f5bea000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5be414a320 0x7f5be414dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f5bea000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5be414a320 0x7f5be414dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:53322/0 (socket says 172.21.15.123:53322) 2024-04-25T13:42:12.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f5bea000640 1 -- 172.21.15.123:0/1773092456 learned_addr learned my addr 172.21.15.123:0/1773092456 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:12.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f668b200640 1 -- 172.21.15.123:0/3353353151 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f668c14a320 msgr2=0x7f668c136970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f668b200640 1 --2- 172.21.15.123:0/3353353151 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f668c14a320 0x7f668c136970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f668b200640 1 -- 172.21.15.123:0/3353353151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f668c147280 msgr2=0x7f668c1384e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f668b200640 1 --2- 172.21.15.123:0/3353353151 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f668c147280 0x7f668c1384e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f668b200640 1 -- 172.21.15.123:0/3353353151 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f668c14d520 con 0x7f668c138a20 2024-04-25T13:42:12.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7fee6be00640 1 --2- 172.21.15.123:0/2175240365 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fee4c06f450 0x7fee4c071960 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fee6c0b4260 tx=0x7fee5c006bd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.362+0000 7fee6b400640 1 --2- 172.21.15.123:0/2175240365 >> [v2:172.21.15.123:6808/2208828636,v1:172.21.15.123:6809/2208828636] conn(0x7fee4c0776a0 0x7fee4c079af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.358+0000 7f5be8c00640 1 --2- 172.21.15.123:0/1773092456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5be4147280 0x7f5be4140f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.362+0000 7f668b200640 1 --2- 172.21.15.123:0/3353353151 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f668c138a20 0x7f668c136eb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f66840ac000 tx=0x7f6684019710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.362+0000 7fee6b400640 1 --2- 172.21.15.123:0/2175240365 >> [v2:172.21.15.123:6808/2208828636,v1:172.21.15.123:6809/2208828636] conn(0x7fee4c0776a0 0x7fee4c079af0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.362+0000 7f5bea000640 1 -- 172.21.15.123:0/1773092456 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5be40b3db0 msgr2=0x7f5be413b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.362+0000 7f5bea000640 1 --2- 172.21.15.123:0/1773092456 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5be40b3db0 0x7f5be413b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.362+0000 7f5bea000640 1 -- 172.21.15.123:0/1773092456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5be4147280 msgr2=0x7f5be4140f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.362+0000 7f5bea000640 1 --2- 172.21.15.123:0/1773092456 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5be4147280 0x7f5be4140f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.362+0000 7f5bea000640 1 -- 172.21.15.123:0/1773092456 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5be4139c70 con 0x7f5be414a320 2024-04-25T13:42:12.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.362+0000 7f5be9600640 1 --2- 172.21.15.123:0/1773092456 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5be40b3db0 0x7f5be413b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:12.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.362+0000 7f6682a00640 1 -- 172.21.15.123:0/3353353151 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66840b2040 con 0x7f668c138a20 2024-04-25T13:42:12.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.362+0000 7f6691400640 1 -- 172.21.15.123:0/3353353151 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f668c14d800 con 0x7f668c138a20 2024-04-25T13:42:12.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.362+0000 7f6682a00640 1 -- 172.21.15.123:0/3353353151 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66840bf070 con 0x7f668c138a20 2024-04-25T13:42:12.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.362+0000 7f6682a00640 1 -- 172.21.15.123:0/3353353151 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6684004040 con 0x7f668c138a20 2024-04-25T13:42:12.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.362+0000 7f6691400640 1 -- 172.21.15.123:0/3353353151 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f668c13d1f0 con 0x7f668c138a20 2024-04-25T13:42:12.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.362+0000 7f5bea000640 1 --2- 172.21.15.123:0/1773092456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5be414a320 0x7f5be414dad0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8019f40 tx=0x7f5bd80190b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.362+0000 7fee63e00640 1 -- 172.21.15.123:0/2175240365 <== osd.0 v2:172.21.15.123:6808/2208828636 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fee64021e50 con 0x7fee4c0776a0 2024-04-25T13:42:12.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.362+0000 7f6677e00640 1 -- 172.21.15.123:0/3353353151 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6660001040 con 0x7f668c138a20 2024-04-25T13:42:12.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.362+0000 7f5be1600640 1 -- 172.21.15.123:0/1773092456 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd80bb070 con 0x7f5be414a320 2024-04-25T13:42:12.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.362+0000 7f5be1600640 1 -- 172.21.15.123:0/1773092456 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bd80b1040 con 0x7f5be414a320 2024-04-25T13:42:12.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.362+0000 7f5be1600640 1 -- 172.21.15.123:0/1773092456 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bd80b0070 con 0x7f5be414a320 2024-04-25T13:42:12.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.362+0000 7f5bec000640 1 -- 172.21.15.123:0/1773092456 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5be4139f30 con 0x7f5be414a320 2024-04-25T13:42:12.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.362+0000 7f5bec000640 1 -- 172.21.15.123:0/1773092456 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5be415bf80 con 0x7f5be414a320 2024-04-25T13:42:12.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.366+0000 7f6682a00640 1 -- 172.21.15.123:0/3353353151 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f66840a5940 con 0x7f668c138a20 2024-04-25T13:42:12.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.370+0000 7f5bec000640 1 -- 172.21.15.123:0/1773092456 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5be4139a90 con 0x7f5be414a320 2024-04-25T13:42:12.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.370+0000 7f6682a00640 1 --2- 172.21.15.123:0/3353353151 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f666c06f400 0x7f666c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.370+0000 7f6682a00640 1 -- 172.21.15.123:0/3353353151 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f668412a890 con 0x7f668c138a20 2024-04-25T13:42:12.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.370+0000 7f668a800640 1 --2- 172.21.15.123:0/3353353151 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f666c06f400 0x7f666c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.370+0000 7f6682a00640 1 --2- 172.21.15.123:0/3353353151 >> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] conn(0x7f666c077650 0x7f666c079aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.370+0000 7f6682a00640 1 -- 172.21.15.123:0/3353353151 --> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f66840beec0 con 0x7f666c077650 2024-04-25T13:42:12.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.370+0000 7f6682a00640 1 -- 172.21.15.123:0/3353353151 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f668412ac40 con 0x7f668c138a20 2024-04-25T13:42:12.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.370+0000 7f6689e00640 1 --2- 172.21.15.123:0/3353353151 >> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] conn(0x7f666c077650 0x7f666c079aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.370+0000 7f668a800640 1 --2- 172.21.15.123:0/3353353151 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f666c06f400 0x7f666c071910 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f667c005890 tx=0x7f667c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.370+0000 7f5be1600640 1 -- 172.21.15.123:0/1773092456 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5bd80aa7f0 con 0x7f5be414a320 2024-04-25T13:42:12.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.374+0000 7f5be1600640 1 --2- 172.21.15.123:0/1773092456 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5bc406f500 0x7f5bc4071a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.374+0000 7f5be1600640 1 -- 172.21.15.123:0/1773092456 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5bd81287d0 con 0x7f5be414a320 2024-04-25T13:42:12.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.374+0000 7f5be1600640 1 --2- 172.21.15.123:0/1773092456 >> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] conn(0x7f5bc4077750 0x7f5bc4079ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.374+0000 7f5be1600640 1 -- 172.21.15.123:0/1773092456 --> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5bd80ab600 con 0x7f5bc4077750 2024-04-25T13:42:12.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.374+0000 7f5be1600640 1 -- 172.21.15.123:0/1773092456 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5bd812f050 con 0x7f5be414a320 2024-04-25T13:42:12.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.374+0000 7f5be8c00640 1 --2- 172.21.15.123:0/1773092456 >> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] conn(0x7f5bc4077750 0x7f5bc4079ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.374+0000 7f6689e00640 1 --2- 172.21.15.123:0/3353353151 >> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] conn(0x7f666c077650 0x7f666c079aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.374+0000 7f5be9600640 1 --2- 172.21.15.123:0/1773092456 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5bc406f500 0x7f5bc4071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.374+0000 7f6682a00640 1 -- 172.21.15.123:0/3353353151 <== osd.5 v2:172.21.15.130:6800/2763000783 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f66840beec0 con 0x7f666c077650 2024-04-25T13:42:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.374+0000 7f5be8c00640 1 --2- 172.21.15.123:0/1773092456 >> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] conn(0x7f5bc4077750 0x7f5bc4079ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.374+0000 7f5be9600640 1 --2- 172.21.15.123:0/1773092456 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5bc406f500 0x7f5bc4071a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc009fd0 tx=0x7f5bdc00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.378+0000 7f5be1600640 1 -- 172.21.15.123:0/1773092456 <== osd.6 v2:172.21.15.130:6801/3650490477 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5bd80ab600 con 0x7f5bc4077750 2024-04-25T13:42:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.378+0000 7f1b83200640 1 -- 172.21.15.123:0/2560272565 --> [v2:172.21.15.123:6800/477459895,v1:172.21.15.123:6801/477459895] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1b8415e290 con 0x7f1b64077680 2024-04-25T13:42:12.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.378+0000 7f1b7a000640 1 -- 172.21.15.123:0/2560272565 <== osd.1 v2:172.21.15.123:6800/477459895 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1b8415e290 con 0x7f1b64077680 2024-04-25T13:42:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.382+0000 7f984fe00640 1 -- 172.21.15.123:0/4094021132 --> [v2:172.21.15.123:6824/1411373789,v1:172.21.15.123:6825/1411373789] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9850162a90 con 0x7f9830077720 2024-04-25T13:42:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.382+0000 7f9847400640 1 -- 172.21.15.123:0/4094021132 <== osd.2 v2:172.21.15.123:6824/1411373789 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9850162a90 con 0x7f9830077720 2024-04-25T13:42:12.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.382+0000 7f1b83200640 1 -- 172.21.15.123:0/2560272565 >> [v2:172.21.15.123:6800/477459895,v1:172.21.15.123:6801/477459895] conn(0x7f1b64077680 msgr2=0x7f1b64079ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.382+0000 7f1b83200640 1 --2- 172.21.15.123:0/2560272565 >> [v2:172.21.15.123:6800/477459895,v1:172.21.15.123:6801/477459895] conn(0x7f1b64077680 0x7f1b64079ad0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.382+0000 7f984fe00640 1 -- 172.21.15.123:0/4094021132 >> [v2:172.21.15.123:6824/1411373789,v1:172.21.15.123:6825/1411373789] conn(0x7f9830077720 msgr2=0x7f9830079b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.382+0000 7f984fe00640 1 --2- 172.21.15.123:0/4094021132 >> [v2:172.21.15.123:6824/1411373789,v1:172.21.15.123:6825/1411373789] conn(0x7f9830077720 0x7f9830079b70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.382+0000 7f984fe00640 1 -- 172.21.15.123:0/4094021132 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f983006f450 msgr2=0x7f9830071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.382+0000 7f984fe00640 1 --2- 172.21.15.123:0/4094021132 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f983006f450 0x7f9830071960 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f985015b180 tx=0x7f9848007d30 comp rx=0 tx=0).stop 2024-04-25T13:42:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.382+0000 7f984fe00640 1 -- 172.21.15.123:0/4094021132 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f98500b4430 msgr2=0x7f985014d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.382+0000 7f984fe00640 1 --2- 172.21.15.123:0/4094021132 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f98500b4430 0x7f985014d1c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f983c00d830 tx=0x7f983c00dcf0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.382+0000 7f984f400640 1 -- 172.21.15.123:0/4094021132 reap_dead start 2024-04-25T13:42:12.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.382+0000 7f984fe00640 1 -- 172.21.15.123:0/4094021132 shutdown_connections 2024-04-25T13:42:12.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.382+0000 7f984fe00640 1 -- 172.21.15.123:0/4094021132 >> 172.21.15.123:0/4094021132 conn(0x7f985006c670 msgr2=0x7f98500d1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:12.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.382+0000 7f1b83200640 1 -- 172.21.15.123:0/2560272565 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1b6406f430 msgr2=0x7f1b64071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.382+0000 7f1b83200640 1 --2- 172.21.15.123:0/2560272565 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1b6406f430 0x7f1b64071940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1b840ce5c0 tx=0x7f1b7c009250 comp rx=0 tx=0).stop 2024-04-25T13:42:12.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.382+0000 7f1b83200640 1 -- 172.21.15.123:0/2560272565 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b84151250 msgr2=0x7f1b84150ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.382+0000 7f1b83200640 1 --2- 172.21.15.123:0/2560272565 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b84151250 0x7f1b84150ab0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1b7001a040 tx=0x7f1b700191b0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.382+0000 7f1b82800640 1 -- 172.21.15.123:0/2560272565 reap_dead start 2024-04-25T13:42:12.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.382+0000 7f1b83200640 1 -- 172.21.15.123:0/2560272565 shutdown_connections 2024-04-25T13:42:12.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.382+0000 7f1b83200640 1 -- 172.21.15.123:0/2560272565 >> 172.21.15.123:0/2560272565 conn(0x7f1b8406c840 msgr2=0x7f1b84164ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:12.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.382+0000 7f1b83200640 1 -- 172.21.15.123:0/2560272565 shutdown_connections 2024-04-25T13:42:12.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.382+0000 7f1b83200640 1 -- 172.21.15.123:0/2560272565 wait complete. 2024-04-25T13:42:12.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.382+0000 7f984fe00640 1 -- 172.21.15.123:0/4094021132 shutdown_connections 2024-04-25T13:42:12.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.382+0000 7f984fe00640 1 -- 172.21.15.123:0/4094021132 wait complete. 2024-04-25T13:42:12.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.382+0000 7ff7e1400640 1 -- 172.21.15.123:0/313423679 --> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff7b8002de0 con 0x7ff7bc0778a0 2024-04-25T13:42:12.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.382+0000 7ff7cfe00640 1 -- 172.21.15.123:0/313423679 <== osd.3 v2:172.21.15.123:6816/898268961 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff7b8002de0 con 0x7ff7bc0778a0 2024-04-25T13:42:12.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.386+0000 7f1100a00640 1 -- 172.21.15.123:0/3566143517 --> [v2:172.21.15.130:6821/1535108655,v1:172.21.15.130:6823/1535108655] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f10fc1f9b00 con 0x7f10dc0775f0 2024-04-25T13:42:12.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.386+0000 7f9b21000640 1 -- 172.21.15.123:0/2879487883 --> [v2:172.21.15.130:6816/940897425,v1:172.21.15.130:6817/940897425] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9af8002de0 con 0x7f9afc077820 2024-04-25T13:42:12.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.386+0000 7ff7e1400640 1 -- 172.21.15.123:0/313423679 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x7ff7bc0778a0 msgr2=0x7ff7bc079cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.386+0000 7ff7e1400640 1 --2- 172.21.15.123:0/313423679 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x7ff7bc0778a0 0x7ff7bc079cf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.386+0000 7f10f2000640 1 -- 172.21.15.123:0/3566143517 <== osd.4 v2:172.21.15.130:6821/1535108655 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f10fc1f9b00 con 0x7f10dc0775f0 2024-04-25T13:42:12.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7ff7e1400640 1 -- 172.21.15.123:0/313423679 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff7bc06f630 msgr2=0x7ff7bc071b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7ff7e1400640 1 --2- 172.21.15.123:0/313423679 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff7bc06f630 0x7ff7bc071b40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8000f70 tx=0x7ff7c80079c0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7ff7e1400640 1 -- 172.21.15.123:0/313423679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7d404fe70 msgr2=0x7ff7d40e9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7ff7e1400640 1 --2- 172.21.15.123:0/313423679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7d404fe70 0x7ff7d40e9760 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc06b7b0 tx=0x7ff7dc06da50 comp rx=0 tx=0).stop 2024-04-25T13:42:12.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7ff7e0a00640 1 -- 172.21.15.123:0/313423679 reap_dead start 2024-04-25T13:42:12.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7ff7e1400640 1 -- 172.21.15.123:0/313423679 shutdown_connections 2024-04-25T13:42:12.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7ff7e1400640 1 -- 172.21.15.123:0/313423679 >> 172.21.15.123:0/313423679 conn(0x7ff7d4054d00 msgr2=0x7ff7d4005aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:12.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7f1100a00640 1 -- 172.21.15.123:0/3566143517 >> [v2:172.21.15.130:6821/1535108655,v1:172.21.15.130:6823/1535108655] conn(0x7f10dc0775f0 msgr2=0x7f10dc079a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7f1100a00640 1 --2- 172.21.15.123:0/3566143517 >> [v2:172.21.15.130:6821/1535108655,v1:172.21.15.130:6823/1535108655] conn(0x7f10dc0775f0 0x7f10dc079a40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7ff7e1400640 1 -- 172.21.15.123:0/313423679 shutdown_connections 2024-04-25T13:42:12.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7f9b0f400640 1 -- 172.21.15.123:0/2879487883 <== osd.7 v2:172.21.15.130:6816/940897425 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9af8002de0 con 0x7f9afc077820 2024-04-25T13:42:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7ff7e1400640 1 -- 172.21.15.123:0/313423679 wait complete. 2024-04-25T13:42:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7f1100a00640 1 -- 172.21.15.123:0/3566143517 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f10dc06f400 msgr2=0x7f10dc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7f1100a00640 1 --2- 172.21.15.123:0/3566143517 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f10dc06f400 0x7f10dc071910 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f10ec007fd0 tx=0x7f10ec009040 comp rx=0 tx=0).stop 2024-04-25T13:42:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7f1100a00640 1 -- 172.21.15.123:0/3566143517 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10fc0cf3e0 msgr2=0x7f10fc157110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7f1100a00640 1 --2- 172.21.15.123:0/3566143517 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f10fc0cf3e0 0x7f10fc157110 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f10e80bd000 tx=0x7f10e802bc90 comp rx=0 tx=0).stop 2024-04-25T13:42:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7f10fa800640 1 -- 172.21.15.123:0/3566143517 reap_dead start 2024-04-25T13:42:12.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7f1100a00640 1 -- 172.21.15.123:0/3566143517 shutdown_connections 2024-04-25T13:42:12.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7f1100a00640 1 -- 172.21.15.123:0/3566143517 >> 172.21.15.123:0/3566143517 conn(0x7f10fc0d36e0 msgr2=0x7f10fc0b6530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:12.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7f1100a00640 1 -- 172.21.15.123:0/3566143517 shutdown_connections 2024-04-25T13:42:12.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7f1100a00640 1 -- 172.21.15.123:0/3566143517 wait complete. 2024-04-25T13:42:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7f9b21000640 1 -- 172.21.15.123:0/2879487883 >> [v2:172.21.15.130:6816/940897425,v1:172.21.15.130:6817/940897425] conn(0x7f9afc077820 msgr2=0x7f9afc079c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7f9b21000640 1 --2- 172.21.15.123:0/2879487883 >> [v2:172.21.15.130:6816/940897425,v1:172.21.15.130:6817/940897425] conn(0x7f9afc077820 0x7f9afc079c70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7f9b21000640 1 -- 172.21.15.123:0/2879487883 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9afc06f630 msgr2=0x7f9afc071b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7f9b21000640 1 --2- 172.21.15.123:0/2879487883 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9afc06f630 0x7f9afc071b40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9b080ac000 tx=0x7f9b080a7000 comp rx=0 tx=0).stop 2024-04-25T13:42:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7f9b21000640 1 -- 172.21.15.123:0/2879487883 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b0400ac60 msgr2=0x7f9b140d5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7f9b21000640 1 --2- 172.21.15.123:0/2879487883 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b0400ac60 0x7f9b140d5240 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9b1000cfd0 tx=0x7f9b10004f20 comp rx=0 tx=0).stop 2024-04-25T13:42:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7f9b1be00640 1 -- 172.21.15.123:0/2879487883 reap_dead start 2024-04-25T13:42:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7f9b21000640 1 -- 172.21.15.123:0/2879487883 shutdown_connections 2024-04-25T13:42:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7f9b21000640 1 -- 172.21.15.123:0/2879487883 >> 172.21.15.123:0/2879487883 conn(0x7f9b14054d00 msgr2=0x7f9b140db950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7f9b21000640 1 -- 172.21.15.123:0/2879487883 shutdown_connections 2024-04-25T13:42:12.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7f9b21000640 1 -- 172.21.15.123:0/2879487883 wait complete. 2024-04-25T13:42:12.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.390+0000 7fee71800640 1 -- 172.21.15.123:0/2175240365 --> [v2:172.21.15.123:6808/2208828636,v1:172.21.15.123:6809/2208828636] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fee44002de0 con 0x7fee4c0776a0 2024-04-25T13:42:12.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.394+0000 7fee63e00640 1 -- 172.21.15.123:0/2175240365 <== osd.0 v2:172.21.15.123:6808/2208828636 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fee44002de0 con 0x7fee4c0776a0 2024-04-25T13:42:12.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.394+0000 7fee71800640 1 -- 172.21.15.123:0/2175240365 >> [v2:172.21.15.123:6808/2208828636,v1:172.21.15.123:6809/2208828636] conn(0x7fee4c0776a0 msgr2=0x7fee4c079af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.394+0000 7fee71800640 1 --2- 172.21.15.123:0/2175240365 >> [v2:172.21.15.123:6808/2208828636,v1:172.21.15.123:6809/2208828636] conn(0x7fee4c0776a0 0x7fee4c079af0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.394+0000 7fee71800640 1 -- 172.21.15.123:0/2175240365 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fee4c06f450 msgr2=0x7fee4c071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.394+0000 7fee71800640 1 --2- 172.21.15.123:0/2175240365 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fee4c06f450 0x7fee4c071960 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fee6c0b4260 tx=0x7fee5c006bd0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.394+0000 7fee71800640 1 -- 172.21.15.123:0/2175240365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee6c0cf900 msgr2=0x7fee6c0cfd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.394+0000 7fee71800640 1 --2- 172.21.15.123:0/2175240365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee6c0cf900 0x7fee6c0cfd10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fee6400b9a0 tx=0x7fee6400be60 comp rx=0 tx=0).stop 2024-04-25T13:42:12.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.394+0000 7fee70e00640 1 -- 172.21.15.123:0/2175240365 reap_dead start 2024-04-25T13:42:12.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.394+0000 7fee71800640 1 -- 172.21.15.123:0/2175240365 shutdown_connections 2024-04-25T13:42:12.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.394+0000 7fee71800640 1 -- 172.21.15.123:0/2175240365 >> 172.21.15.123:0/2175240365 conn(0x7fee6c06ca70 msgr2=0x7fee6c0b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:12.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.394+0000 7fee71800640 1 -- 172.21.15.123:0/2175240365 shutdown_connections 2024-04-25T13:42:12.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.394+0000 7fee71800640 1 -- 172.21.15.123:0/2175240365 wait complete. 2024-04-25T13:42:12.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.410+0000 7f6677e00640 1 -- 172.21.15.123:0/3353353151 --> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6660002de0 con 0x7f666c077650 2024-04-25T13:42:12.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.410+0000 7f5bec000640 1 -- 172.21.15.123:0/1773092456 --> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5be413b670 con 0x7f5bc4077750 2024-04-25T13:42:12.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.410+0000 7f6682a00640 1 -- 172.21.15.123:0/3353353151 <== osd.5 v2:172.21.15.130:6800/2763000783 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6660002de0 con 0x7f666c077650 2024-04-25T13:42:12.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.410+0000 7f5be1600640 1 -- 172.21.15.123:0/1773092456 <== osd.6 v2:172.21.15.130:6801/3650490477 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5be413b670 con 0x7f5bc4077750 2024-04-25T13:42:12.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.410+0000 7f6677e00640 1 -- 172.21.15.123:0/3353353151 >> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] conn(0x7f666c077650 msgr2=0x7f666c079aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.410+0000 7f6677e00640 1 --2- 172.21.15.123:0/3353353151 >> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] conn(0x7f666c077650 0x7f666c079aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.414+0000 7f6677e00640 1 -- 172.21.15.123:0/3353353151 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f666c06f400 msgr2=0x7f666c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.414+0000 7f6677e00640 1 --2- 172.21.15.123:0/3353353151 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f666c06f400 0x7f666c071910 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f667c005890 tx=0x7f667c009040 comp rx=0 tx=0).stop 2024-04-25T13:42:12.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.414+0000 7f6677e00640 1 -- 172.21.15.123:0/3353353151 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f668c138a20 msgr2=0x7f668c136eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.414+0000 7f6677e00640 1 --2- 172.21.15.123:0/3353353151 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f668c138a20 0x7f668c136eb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f66840ac000 tx=0x7f6684019710 comp rx=0 tx=0).stop 2024-04-25T13:42:12.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.414+0000 7f668b200640 1 -- 172.21.15.123:0/3353353151 reap_dead start 2024-04-25T13:42:12.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.414+0000 7f5bec000640 1 -- 172.21.15.123:0/1773092456 >> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] conn(0x7f5bc4077750 msgr2=0x7f5bc4079ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.414+0000 7f5bec000640 1 --2- 172.21.15.123:0/1773092456 >> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] conn(0x7f5bc4077750 0x7f5bc4079ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.414+0000 7f6677e00640 1 -- 172.21.15.123:0/3353353151 shutdown_connections 2024-04-25T13:42:12.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.414+0000 7f6677e00640 1 -- 172.21.15.123:0/3353353151 >> 172.21.15.123:0/3353353151 conn(0x7f668c06ca70 msgr2=0x7f668c0d0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:12.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.414+0000 7f6677e00640 1 -- 172.21.15.123:0/3353353151 shutdown_connections 2024-04-25T13:42:12.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.414+0000 7f6677e00640 1 -- 172.21.15.123:0/3353353151 wait complete. 2024-04-25T13:42:12.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.418+0000 7f5bec000640 1 -- 172.21.15.123:0/1773092456 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5bc406f500 msgr2=0x7f5bc4071a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.418+0000 7f5bec000640 1 --2- 172.21.15.123:0/1773092456 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5bc406f500 0x7f5bc4071a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc009fd0 tx=0x7f5bdc00b040 comp rx=0 tx=0).stop 2024-04-25T13:42:12.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.418+0000 7f5bec000640 1 -- 172.21.15.123:0/1773092456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5be414a320 msgr2=0x7f5be414dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.418+0000 7f5bec000640 1 --2- 172.21.15.123:0/1773092456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5be414a320 0x7f5be414dad0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5bd8019f40 tx=0x7f5bd80190b0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.418+0000 7f5bea000640 1 -- 172.21.15.123:0/1773092456 reap_dead start 2024-04-25T13:42:12.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.418+0000 7f5bec000640 1 -- 172.21.15.123:0/1773092456 shutdown_connections 2024-04-25T13:42:12.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.418+0000 7f5bec000640 1 -- 172.21.15.123:0/1773092456 >> 172.21.15.123:0/1773092456 conn(0x7f5be406ca70 msgr2=0x7f5be413ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:12.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.418+0000 7f5bec000640 1 -- 172.21.15.123:0/1773092456 shutdown_connections 2024-04-25T13:42:12.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.418+0000 7f5bec000640 1 -- 172.21.15.123:0/1773092456 wait complete. 2024-04-25T13:42:12.445 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2024-04-25T13:42:12.445 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T13:42:12.446 INFO:teuthology.orchestra.run.smithi123.stdout:55834574854 2024-04-25T13:42:12.447 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T13:42:12.447 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2024-04-25T13:42:12.448 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T13:42:12.448 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2024-04-25T13:42:12.448 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T13:42:12.449 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2024-04-25T13:42:12.449 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T13:42:12.450 INFO:teuthology.orchestra.run.smithi123.stdout:55834574853 2024-04-25T13:42:12.451 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T13:42:12.452 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2024-04-25T13:42:12.452 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T13:42:12.453 INFO:teuthology.orchestra.run.smithi123.stdout:55834574853 2024-04-25T13:42:12.454 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T13:42:12.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.710+0000 7f397ac00640 1 Processor -- start 2024-04-25T13:42:12.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.710+0000 7f397ac00640 1 -- start start 2024-04-25T13:42:12.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.710+0000 7f397ac00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f396c0eb8f0 0x7f396c0e7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.710+0000 7f397ac00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f396c006810 0x7f396c006c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.710+0000 7f397ac00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f396c038350 con 0x7f396c033a80 2024-04-25T13:42:12.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.710+0000 7f397ac00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f396c0060a0 con 0x7f396c0eb8f0 2024-04-25T13:42:12.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.710+0000 7f397ac00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f396c006380 con 0x7f396c006810 2024-04-25T13:42:12.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.710+0000 7f3973400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f396c033a80 0x7f396c033e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53252/0 (socket says 172.21.15.123:53252) 2024-04-25T13:42:12.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.710+0000 7f3973400640 1 -- 172.21.15.123:0/463905286 learned_addr learned my addr 172.21.15.123:0/463905286 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:12.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.710+0000 7effee200640 1 Processor -- start 2024-04-25T13:42:12.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.710+0000 7f3978c00640 1 --2- 172.21.15.123:0/463905286 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f396c006810 0x7f396c006c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.714+0000 7f3973e00640 1 --2- 172.21.15.123:0/463905286 >> v2:172.21.15.130:3300/0 conn(0x7f396c0eb8f0 0x7f396c0e7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.714+0000 7effee200640 1 -- start start 2024-04-25T13:42:12.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.714+0000 7f3972a00640 1 -- 172.21.15.123:0/463905286 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 107246181 0 0) 0x7f3960001120 con 0x7f396c033a80 2024-04-25T13:42:12.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.714+0000 7f3978c00640 1 -- 172.21.15.123:0/463905286 >> v2:172.21.15.130:3300/0 conn(0x7f396c0eb8f0 msgr2=0x7f396c0e7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:12.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.714+0000 7f3978c00640 1 --2- 172.21.15.123:0/463905286 >> v2:172.21.15.130:3300/0 conn(0x7f396c0eb8f0 0x7f396c0e7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.714+0000 7f3978c00640 1 -- 172.21.15.123:0/463905286 >> v1:172.21.15.123:6789/0 conn(0x7f396c033a80 legacy=0x7f396c033e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.714+0000 7f3978c00640 1 -- 172.21.15.123:0/463905286 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396c0ec0d0 con 0x7f396c006810 2024-04-25T13:42:12.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.714+0000 7f3f8b200640 1 Processor -- start 2024-04-25T13:42:12.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.714+0000 7f3f8b200640 1 -- start start 2024-04-25T13:42:12.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.714+0000 7f9613e00640 1 Processor -- start 2024-04-25T13:42:12.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.714+0000 7effee200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7effe80b2f70 0x7effe80b3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.714+0000 7effee200640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7effe80d0ff0 0x7effe80d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.714+0000 7effee200640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effe80cf1e0 con 0x7effe80c55c0 2024-04-25T13:42:12.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.714+0000 7effee200640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7effe80cfdf0 con 0x7effe80d0ff0 2024-04-25T13:42:12.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.714+0000 7effee200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7effe80cf4c0 con 0x7effe80b2f70 2024-04-25T13:42:12.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.714+0000 7effe7e00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7effe80d0ff0 0x7effe80d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.714+0000 7effe7e00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7effe80d0ff0 0x7effe80d1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:53348/0 (socket says 172.21.15.123:53348) 2024-04-25T13:42:12.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.714+0000 7effe7e00640 1 -- 172.21.15.123:0/1104138710 learned_addr learned my addr 172.21.15.123:0/1104138710 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:12.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7effe7e00640 1 -- 172.21.15.123:0/1104138710 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7effe80b2f70 msgr2=0x7effe80b3380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T13:42:12.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7effe7e00640 1 --2- 172.21.15.123:0/1104138710 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7effe80b2f70 0x7effe80b3380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7effe7e00640 1 -- 172.21.15.123:0/1104138710 >> v1:172.21.15.130:6789/0 conn(0x7effe80c55c0 legacy=0x7effe80c59d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T13:42:12.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7effe7e00640 1 -- 172.21.15.123:0/1104138710 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe80cf7a0 con 0x7effe80d0ff0 2024-04-25T13:42:12.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f3978c00640 1 --2- 172.21.15.123:0/463905286 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f396c006810 0x7f396c006c20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3974051a60 tx=0x7f39740993b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8618ccf97439c63 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.714+0000 7f9613e00640 1 -- start start 2024-04-25T13:42:12.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f3f8b200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f8c164530 0x7f3f8c0d3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f3f8b200640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3f8c0d3e90 0x7f3f8c0d42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f3f8b200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3f8c06d860 0x7f3f8c06dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f3f8b200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f3f8c0d47e0 con 0x7f3f8c06d860 2024-04-25T13:42:12.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f3f8b200640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f3f8c06ebc0 con 0x7f3f8c0d3e90 2024-04-25T13:42:12.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f3f8b200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3f8c0b9c60 con 0x7f3f8c164530 2024-04-25T13:42:12.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f3972a00640 1 -- 172.21.15.123:0/463905286 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3974121e60 con 0x7f396c006810 2024-04-25T13:42:12.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f3972a00640 1 -- 172.21.15.123:0/463905286 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3974128640 con 0x7f396c006810 2024-04-25T13:42:12.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f3972a00640 1 -- 172.21.15.123:0/463905286 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3974128a70 con 0x7f396c006810 2024-04-25T13:42:12.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f3f89e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f8c164530 0x7f3f8c0d3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f3f89e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f8c164530 0x7f3f8c0d3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:37592/0 (socket says 172.21.15.123:37592) 2024-04-25T13:42:12.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f3f89e00640 1 -- 172.21.15.123:0/2546769487 learned_addr learned my addr 172.21.15.123:0/2546769487 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:12.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f3f8a800640 1 --2- 172.21.15.123:0/2546769487 >> v2:172.21.15.123:3300/0 conn(0x7f3f8c06d860 0x7f3f8c06dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f397ac00640 1 -- 172.21.15.123:0/463905286 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f396c006810 msgr2=0x7f396c006c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f397ac00640 1 --2- 172.21.15.123:0/463905286 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f396c006810 0x7f396c006c20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3974051a60 tx=0x7f39740993b0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7fb9a6800640 1 Processor -- start 2024-04-25T13:42:12.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f9613e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f96140d1b20 0x7f9614168950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f9613e00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96140b0ed0 con 0x7f9614073530 2024-04-25T13:42:12.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f9613e00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9614164fc0 con 0x7f9614168540 2024-04-25T13:42:12.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f9613e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9614167dd0 con 0x7f96140d1b20 2024-04-25T13:42:12.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f9612a00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9614073530 0x7f96141647e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53260/0 (socket says 172.21.15.123:53260) 2024-04-25T13:42:12.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f9612a00640 1 -- 172.21.15.123:0/2665595402 learned_addr learned my addr 172.21.15.123:0/2665595402 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:12.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f3f89e00640 1 -- 172.21.15.123:0/2546769487 >> v2:172.21.15.130:3300/0 conn(0x7f3f8c0d3e90 msgr2=0x7f3f8c0d42a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T13:42:12.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f3f89e00640 1 --2- 172.21.15.123:0/2546769487 >> v2:172.21.15.130:3300/0 conn(0x7f3f8c0d3e90 0x7f3f8c0d42a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f3f89e00640 1 -- 172.21.15.123:0/2546769487 >> v2:172.21.15.123:3300/0 conn(0x7f3f8c06d860 msgr2=0x7f3f8c06dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:12.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f3f89e00640 1 --2- 172.21.15.123:0/2546769487 >> v2:172.21.15.123:3300/0 conn(0x7f3f8c06d860 0x7f3f8c06dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f3f89e00640 1 -- 172.21.15.123:0/2546769487 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8c0b9f40 con 0x7f3f8c164530 2024-04-25T13:42:12.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7fb9a6800640 1 -- start start 2024-04-25T13:42:12.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f9611600640 1 -- 172.21.15.123:0/2665595402 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 23698618 0 0) 0x7f96140b0ed0 con 0x7f9614073530 2024-04-25T13:42:12.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.718+0000 7f9611600640 1 -- 172.21.15.123:0/2665595402 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95f8003530 con 0x7f9614073530 2024-04-25T13:42:12.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f9611600640 1 -- 172.21.15.123:0/2665595402 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 706111267 0 0) 0x7f95f8003530 con 0x7f9614073530 2024-04-25T13:42:12.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f9611600640 1 -- 172.21.15.123:0/2665595402 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f96140d1b20 msgr2=0x7f9614168950 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T13:42:12.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f9611600640 1 --2- 172.21.15.123:0/2665595402 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f96140d1b20 0x7f9614168950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f9611600640 1 -- 172.21.15.123:0/2665595402 >> v1:172.21.15.130:6789/0 conn(0x7f9614168540 legacy=0x7f96140d1410 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T13:42:12.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f9611600640 1 -- 172.21.15.123:0/2665595402 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96141652a0 con 0x7f9614073530 2024-04-25T13:42:12.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f397ac00640 1 -- 172.21.15.123:0/463905286 shutdown_connections 2024-04-25T13:42:12.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f397ac00640 1 --2- 172.21.15.123:0/463905286 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f396c006810 0x7f396c006c20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f397ac00640 1 --2- 172.21.15.123:0/463905286 >> v2:172.21.15.130:3300/0 conn(0x7f396c0eb8f0 0x7f396c0e7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f397ac00640 1 -- 172.21.15.123:0/463905286 >> 172.21.15.123:0/463905286 conn(0x7f396c054d00 msgr2=0x7f396c055110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:12.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f9611600640 1 -- 172.21.15.123:0/2665595402 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7f95fc001680 con 0x7f9614073530 2024-04-25T13:42:12.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f9611600640 1 -- 172.21.15.123:0/2665595402 >> v1:172.21.15.123:6789/0 conn(0x7f9614073530 legacy=0x7f96141647e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f9611600640 1 --2- 172.21.15.123:0/2665595402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95f80039f0 0x7f95f8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f9611600640 1 --2- 172.21.15.123:0/2665595402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f8004810 0x7f95f8004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f9611600640 1 --2- 172.21.15.123:0/2665595402 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95f8005360 0x7f95f800b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f9611600640 1 -- 172.21.15.123:0/2665595402 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9614167dd0 con 0x7f95f8004810 2024-04-25T13:42:12.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f9611600640 1 -- 172.21.15.123:0/2665595402 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f95f800c280 con 0x7f95f80039f0 2024-04-25T13:42:12.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f9611600640 1 -- 172.21.15.123:0/2665595402 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f95f800c480 con 0x7f95f8005360 2024-04-25T13:42:12.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f397ac00640 1 -- 172.21.15.123:0/463905286 shutdown_connections 2024-04-25T13:42:12.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f397ac00640 1 -- 172.21.15.123:0/463905286 wait complete. 2024-04-25T13:42:12.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7fb9a6800640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb9a00703a0 0x7fb9a00b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7fb9a6800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9a00d2010 0x7fb9a015d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7effe7e00640 1 --2- 172.21.15.123:0/1104138710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effe80d0ff0 0x7effe80d1400 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7effe0009e50 tx=0x7effe001ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5792ab875e58a2b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7fb9a6800640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9a015cdf0 con 0x7fb9a015d430 2024-04-25T13:42:12.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7fb9a6800640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fb9a015dd80 con 0x7fb9a00703a0 2024-04-25T13:42:12.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7fb9a6800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb9a015d0d0 con 0x7fb9a00d2010 2024-04-25T13:42:12.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7fb9a5400640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb9a00703a0 0x7fb9a00b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7fb9a4a00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb9a015d430 0x7fb9a00d1900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53262/0 (socket says 172.21.15.123:53262) 2024-04-25T13:42:12.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7fb9a4a00640 1 -- 172.21.15.123:0/1520272170 learned_addr learned my addr 172.21.15.123:0/1520272170 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:12.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7fb9a5e00640 1 --2- 172.21.15.123:0/1520272170 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9a00d2010 0x7fb9a015d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f9612a00640 1 --2- 172.21.15.123:0/2665595402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95f80039f0 0x7f95f8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f9613400640 1 --2- 172.21.15.123:0/2665595402 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95f8005360 0x7f95f800b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7effe6000640 1 -- 172.21.15.123:0/1104138710 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe00a5690 con 0x7effe80d0ff0 2024-04-25T13:42:12.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f9612000640 1 --2- 172.21.15.123:0/2665595402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f8004810 0x7f95f8004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7effe6000640 1 -- 172.21.15.123:0/1104138710 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effe00a5830 con 0x7effe80d0ff0 2024-04-25T13:42:12.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7effe6000640 1 -- 172.21.15.123:0/1104138710 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe00a5c00 con 0x7effe80d0ff0 2024-04-25T13:42:12.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f9613400640 1 -- 172.21.15.123:0/2665595402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95f80039f0 msgr2=0x7f95f8003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:12.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f9613400640 1 --2- 172.21.15.123:0/2665595402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95f80039f0 0x7f95f8003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f9613400640 1 -- 172.21.15.123:0/2665595402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f8004810 msgr2=0x7f95f8004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:12.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f9613400640 1 --2- 172.21.15.123:0/2665595402 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f95f8004810 0x7f95f8004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f9613400640 1 -- 172.21.15.123:0/2665595402 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96141652a0 con 0x7f95f8005360 2024-04-25T13:42:12.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7f397ac00640 1 Processor -- start 2024-04-25T13:42:12.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7fb9a5400640 1 -- 172.21.15.123:0/1520272170 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9a00d2010 msgr2=0x7fb9a015d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:12.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7fb9a5400640 1 --2- 172.21.15.123:0/1520272170 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9a00d2010 0x7fb9a015d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f3f89e00640 1 --2- 172.21.15.123:0/2546769487 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f8c164530 0x7f3f8c0d3950 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0d69c0 tx=0x7f3f7401c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32e2d857ca4848ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f397ac00640 1 -- start start 2024-04-25T13:42:12.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7effee200640 1 -- 172.21.15.123:0/1104138710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effe80d0ff0 msgr2=0x7effe80d1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7effee200640 1 --2- 172.21.15.123:0/1104138710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effe80d0ff0 0x7effe80d1400 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7effe0009e50 tx=0x7effe001ca10 comp rx=0 tx=0).stop 2024-04-25T13:42:12.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7fb9a5400640 1 -- 172.21.15.123:0/1520272170 >> v1:172.21.15.123:6789/0 conn(0x7fb9a015d430 legacy=0x7fb9a00d1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7fb9a5400640 1 -- 172.21.15.123:0/1520272170 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a00b44a0 con 0x7fb9a00703a0 2024-04-25T13:42:12.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.722+0000 7fb9a5e00640 1 --2- 172.21.15.123:0/1520272170 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9a00d2010 0x7fb9a015d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:12.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f3f88a00640 1 -- 172.21.15.123:0/2546769487 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f740b2070 con 0x7f3f8c164530 2024-04-25T13:42:12.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f3f88a00640 1 -- 172.21.15.123:0/2546769487 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f740a9070 con 0x7f3f8c164530 2024-04-25T13:42:12.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f65bee00640 1 Processor -- start 2024-04-25T13:42:12.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f3f88a00640 1 -- 172.21.15.123:0/2546769487 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f740ad880 con 0x7f3f8c164530 2024-04-25T13:42:12.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f3d49a00640 1 Processor -- start 2024-04-25T13:42:12.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7effee200640 1 -- 172.21.15.123:0/1104138710 shutdown_connections 2024-04-25T13:42:12.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7effee200640 1 --2- 172.21.15.123:0/1104138710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effe80d0ff0 0x7effe80d1400 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7effee200640 1 --2- 172.21.15.123:0/1104138710 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7effe80b2f70 0x7effe80b3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7effee200640 1 -- 172.21.15.123:0/1104138710 >> 172.21.15.123:0/1104138710 conn(0x7effe80d25f0 msgr2=0x7effe80d2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:12.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f65bee00640 1 -- start start 2024-04-25T13:42:12.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7effee200640 1 -- 172.21.15.123:0/1104138710 shutdown_connections 2024-04-25T13:42:12.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f3d49a00640 1 -- start start 2024-04-25T13:42:12.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f397ac00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f396c006810 0x7f396c0491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f397ac00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f396c033a80 0x7f396c0d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f397ac00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f396c0eb8f0 0x7f396c04a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f3f8b200640 1 -- 172.21.15.123:0/2546769487 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f8c164530 msgr2=0x7f3f8c0d3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f3f8b200640 1 --2- 172.21.15.123:0/2546769487 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f8c164530 0x7f3f8c0d3950 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0d69c0 tx=0x7f3f7401c4b0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f3973400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f396c033a80 0x7f396c0d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f3f8b200640 1 -- 172.21.15.123:0/2546769487 shutdown_connections 2024-04-25T13:42:12.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f3f8b200640 1 --2- 172.21.15.123:0/2546769487 >> v2:172.21.15.123:3300/0 conn(0x7f3f8c06d860 0x7f3f8c06dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f3f8b200640 1 --2- 172.21.15.123:0/2546769487 >> v2:172.21.15.130:3300/0 conn(0x7f3f8c0d3e90 0x7f3f8c0d42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f3f8b200640 1 --2- 172.21.15.123:0/2546769487 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f8c164530 0x7f3f8c0d3950 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f3f8b200640 1 -- 172.21.15.123:0/2546769487 >> 172.21.15.123:0/2546769487 conn(0x7f3f8c0d58c0 msgr2=0x7f3f8c0d5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:12.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f397ac00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f396c0ebe80 con 0x7f396c033a80 2024-04-25T13:42:12.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f397ac00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f396c0ebd00 con 0x7f396c0eb8f0 2024-04-25T13:42:12.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f397ac00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f396c0f4c30 con 0x7f396c006810 2024-04-25T13:42:12.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f3973e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f396c006810 0x7f396c0491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f3973e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f396c006810 0x7f396c0491d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:37632/0 (socket says 172.21.15.123:37632) 2024-04-25T13:42:12.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f3973e00640 1 -- 172.21.15.123:0/1437300635 learned_addr learned my addr 172.21.15.123:0/1437300635 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:12.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f3f8b200640 1 -- 172.21.15.123:0/2546769487 shutdown_connections 2024-04-25T13:42:12.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f3f8b200640 1 -- 172.21.15.123:0/2546769487 wait complete. 2024-04-25T13:42:12.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f3978c00640 1 --2- 172.21.15.123:0/1437300635 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f396c0eb8f0 0x7f396c04a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f3973e00640 1 -- 172.21.15.123:0/1437300635 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f396c0eb8f0 msgr2=0x7f396c04a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f3973e00640 1 --2- 172.21.15.123:0/1437300635 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f396c0eb8f0 0x7f396c04a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f3973e00640 1 -- 172.21.15.123:0/1437300635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f396c033a80 msgr2=0x7f396c0d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f3973e00640 1 --2- 172.21.15.123:0/1437300635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f396c033a80 0x7f396c0d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7f3973e00640 1 -- 172.21.15.123:0/1437300635 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396c0d3720 con 0x7f396c006810 2024-04-25T13:42:12.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7f9613400640 1 --2- 172.21.15.123:0/2665595402 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95f8005360 0x7f95f800b9f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9614168020 tx=0x7f960c01cd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c7d5708dfc5227a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7f3973e00640 1 --2- 172.21.15.123:0/1437300635 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f396c006810 0x7f396c0491d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f396800e840 tx=0x7f396800ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7fb9a5400640 1 --2- 172.21.15.123:0/1520272170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9a00703a0 0x7fb9a00b4ca0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb9940097c0 tx=0x7fb99401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=618f3255fa283b2d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7f3967e00640 1 -- 172.21.15.123:0/1437300635 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3968017070 con 0x7f396c006810 2024-04-25T13:42:12.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7f3967e00640 1 -- 172.21.15.123:0/1437300635 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f396800ee90 con 0x7f396c006810 2024-04-25T13:42:12.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7f3967e00640 1 -- 172.21.15.123:0/1437300635 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396800cb60 con 0x7f396c006810 2024-04-25T13:42:12.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7f397ac00640 1 -- 172.21.15.123:0/1437300635 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f396c049bb0 con 0x7f396c006810 2024-04-25T13:42:12.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7f9611600640 1 -- 172.21.15.123:0/2665595402 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c0b2070 con 0x7f95f8005360 2024-04-25T13:42:12.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7f9611600640 1 -- 172.21.15.123:0/2665595402 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f960c0a5b80 con 0x7f95f8005360 2024-04-25T13:42:12.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7f9611600640 1 -- 172.21.15.123:0/2665595402 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c009a30 con 0x7f95f8005360 2024-04-25T13:42:12.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7fb99fe00640 1 -- 172.21.15.123:0/1520272170 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9940aa5f0 con 0x7fb9a00703a0 2024-04-25T13:42:12.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7fb99fe00640 1 -- 172.21.15.123:0/1520272170 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9940af070 con 0x7fb9a00703a0 2024-04-25T13:42:12.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7fb99fe00640 1 -- 172.21.15.123:0/1520272170 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9940aa9b0 con 0x7fb9a00703a0 2024-04-25T13:42:12.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7f397ac00640 1 -- 172.21.15.123:0/1437300635 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f396c0e3ba0 con 0x7f396c006810 2024-04-25T13:42:12.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.726+0000 7effee200640 1 -- 172.21.15.123:0/1104138710 wait complete. 2024-04-25T13:42:12.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7effee200640 1 Processor -- start 2024-04-25T13:42:12.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7effee200640 1 -- start start 2024-04-25T13:42:12.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7f9613e00640 1 -- 172.21.15.123:0/2665595402 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95f8005360 msgr2=0x7f95f800b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7f9613e00640 1 --2- 172.21.15.123:0/2665595402 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95f8005360 0x7f95f800b9f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9614168020 tx=0x7f960c01cd90 comp rx=0 tx=0).stop 2024-04-25T13:42:12.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7f65bee00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f65b80b3f80 0x7f65b8149c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7f65bee00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65b814a980 con 0x7f65b814a150 2024-04-25T13:42:12.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7f65bee00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65b80cdf90 con 0x7f65b8147280 2024-04-25T13:42:12.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7f65bee00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f65b80ce8c0 con 0x7f65b80b3f80 2024-04-25T13:42:12.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7f65b7e00640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f65b8147280 0x7f65b80b3870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.123:51518/0 (socket says 172.21.15.123:51518) 2024-04-25T13:42:12.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7f65b7e00640 1 -- 172.21.15.123:0/213804955 learned_addr learned my addr 172.21.15.123:0/213804955 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:12.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7f65af400640 1 --2- 172.21.15.123:0/213804955 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f65b80b3f80 0x7f65b8149c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7f65b7400640 1 -- 172.21.15.123:0/213804955 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 103865538 0 0) 0x7f65b80cdf90 con 0x7f65b8147280 2024-04-25T13:42:12.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7f65b7400640 1 -- 172.21.15.123:0/213804955 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6598003530 con 0x7f65b8147280 2024-04-25T13:42:12.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7f65af400640 1 -- 172.21.15.123:0/213804955 >> v1:172.21.15.130:6789/0 conn(0x7f65b8147280 legacy=0x7f65b80b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7f65af400640 1 -- 172.21.15.123:0/213804955 >> v1:172.21.15.123:6789/0 conn(0x7f65b814a150 legacy=0x7f65b80b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7f65af400640 1 -- 172.21.15.123:0/213804955 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b80ce270 con 0x7f65b80b3f80 2024-04-25T13:42:12.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7fb9a6800640 1 -- 172.21.15.123:0/1520272170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9a00703a0 msgr2=0x7fb9a00b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7fb9a6800640 1 --2- 172.21.15.123:0/1520272170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9a00703a0 0x7fb9a00b4ca0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb9940097c0 tx=0x7fb99401c470 comp rx=0 tx=0).stop 2024-04-25T13:42:12.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7f9613400640 1 -- 172.21.15.123:0/2665595402 reap_dead start 2024-04-25T13:42:12.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7f3f8b200640 1 Processor -- start 2024-04-25T13:42:12.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.730+0000 7f3f8b200640 1 -- start start 2024-04-25T13:42:12.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7fb9a6800640 1 -- 172.21.15.123:0/1520272170 shutdown_connections 2024-04-25T13:42:12.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7fb9a6800640 1 --2- 172.21.15.123:0/1520272170 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9a00d2010 0x7fb9a015d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7fb9a6800640 1 --2- 172.21.15.123:0/1520272170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9a00703a0 0x7fb9a00b4ca0 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb9940097c0 tx=0x7fb99401c470 comp rx=0 tx=0).stop 2024-04-25T13:42:12.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7fb9a6800640 1 -- 172.21.15.123:0/1520272170 >> 172.21.15.123:0/1520272170 conn(0x7fb9a006c670 msgr2=0x7fb9a006ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:12.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f397ac00640 1 -- 172.21.15.123:0/1437300635 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f396c005580 con 0x7f396c006810 2024-04-25T13:42:12.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f640b000640 1 Processor -- start 2024-04-25T13:42:12.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f640b000640 1 -- start start 2024-04-25T13:42:12.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f3f8b200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f8c06d860 0x7f3f8c162040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f3f8b200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f8c0d3e90 0x7f3f8c164c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f3f8b200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f8c164530 0x7f3f8c159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f3f8b200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8c09dc20 con 0x7f3f8c164530 2024-04-25T13:42:12.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f3f8b200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3f8c09daa0 con 0x7f3f8c06d860 2024-04-25T13:42:12.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f3f8b200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3f8c09dda0 con 0x7f3f8c0d3e90 2024-04-25T13:42:12.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7effee200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effe80b2f70 0x7effe81537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f3967e00640 1 -- 172.21.15.123:0/1437300635 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f396801a070 con 0x7f396c006810 2024-04-25T13:42:12.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7effee200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7effe80c55c0 0x7effe8162a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7effee200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effe80d0ff0 0x7effe81649f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7effee200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7effe81712f0 con 0x7effe80b2f70 2024-04-25T13:42:12.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7effee200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7effe8171170 con 0x7effe80d0ff0 2024-04-25T13:42:12.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7effee200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7effe8171470 con 0x7effe80c55c0 2024-04-25T13:42:12.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f9613e00640 1 -- 172.21.15.123:0/2665595402 shutdown_connections 2024-04-25T13:42:12.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f9613e00640 1 -- 172.21.15.123:0/2665595402 >> 172.21.15.123:0/2665595402 conn(0x7f961406c840 msgr2=0x7f961406cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:12.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f3f89400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f8c0d3e90 0x7f3f8c164c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f3f89400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f8c0d3e90 0x7f3f8c164c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:37638/0 (socket says 172.21.15.123:37638) 2024-04-25T13:42:12.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f3f89400640 1 -- 172.21.15.123:0/2727097748 learned_addr learned my addr 172.21.15.123:0/2727097748 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:12.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7effe7400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effe80b2f70 0x7effe81537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7effe6a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7effe80c55c0 0x7effe8162a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7effe6a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7effe80c55c0 0x7effe8162a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:37650/0 (socket says 172.21.15.123:37650) 2024-04-25T13:42:12.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7effe6a00640 1 -- 172.21.15.123:0/2017629064 learned_addr learned my addr 172.21.15.123:0/2017629064 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:12.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f3d49a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3d440b4430 0x7f3d440d1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7effe7e00640 1 --2- 172.21.15.123:0/2017629064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effe80d0ff0 0x7effe81649f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f3f89e00640 1 --2- 172.21.15.123:0/2727097748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f8c06d860 0x7f3f8c162040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f3f8a800640 1 --2- 172.21.15.123:0/2727097748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f8c164530 0x7f3f8c159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7effe6a00640 1 -- 172.21.15.123:0/2017629064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effe80d0ff0 msgr2=0x7effe81649f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7effe6a00640 1 --2- 172.21.15.123:0/2017629064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effe80d0ff0 0x7effe81649f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7effe6a00640 1 -- 172.21.15.123:0/2017629064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effe80b2f70 msgr2=0x7effe81537c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7effe6a00640 1 --2- 172.21.15.123:0/2017629064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effe80b2f70 0x7effe81537c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7effe6a00640 1 -- 172.21.15.123:0/2017629064 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe8154330 con 0x7effe80c55c0 2024-04-25T13:42:12.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f3d43e00640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f3d44160530 0x7f3d4415bc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.123:51522/0 (socket says 172.21.15.123:51522) 2024-04-25T13:42:12.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f3d43e00640 1 -- 172.21.15.123:0/12317696 learned_addr learned my addr 172.21.15.123:0/12317696 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:12.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f3d49a00640 1 -- 172.21.15.123:0/12317696 --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d440d2160 con 0x7f3d440d1d50 2024-04-25T13:42:12.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f3d49a00640 1 -- 172.21.15.123:0/12317696 --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d440b4c60 con 0x7f3d44160530 2024-04-25T13:42:12.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f3d49a00640 1 -- 172.21.15.123:0/12317696 --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f3d440b5870 con 0x7f3d440b4430 2024-04-25T13:42:12.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7effe7e00640 1 --2- 172.21.15.123:0/2017629064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effe80d0ff0 0x7effe81649f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:12.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7effe6a00640 1 --2- 172.21.15.123:0/2017629064 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7effe80c55c0 0x7effe8162a70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7effd400b390 tx=0x7effd400b850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f3f8a800640 1 -- 172.21.15.123:0/2727097748 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f8c0d3e90 msgr2=0x7f3f8c164c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f3f8a800640 1 --2- 172.21.15.123:0/2727097748 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f8c0d3e90 0x7f3f8c164c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f3f8a800640 1 -- 172.21.15.123:0/2727097748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f8c06d860 msgr2=0x7f3f8c162040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f3f8a800640 1 --2- 172.21.15.123:0/2727097748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f8c06d860 0x7f3f8c162040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f3f8a800640 1 -- 172.21.15.123:0/2727097748 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8c157070 con 0x7f3f8c164530 2024-04-25T13:42:12.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f3f8a800640 1 --2- 172.21.15.123:0/2727097748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f8c164530 0x7f3f8c159220 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00ebd0 tx=0x7f3f7c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f65af400640 1 --2- 172.21.15.123:0/213804955 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f65b80b3f80 0x7f65b8149c10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f65b80cea40 tx=0x7f65a001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14da3c8a3410b694 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f9613e00640 1 -- 172.21.15.123:0/2665595402 shutdown_connections 2024-04-25T13:42:12.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f9613e00640 1 -- 172.21.15.123:0/2665595402 wait complete. 2024-04-25T13:42:12.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f3d43400640 1 --2- 172.21.15.123:0/12317696 >> v2:172.21.15.123:3300/0 conn(0x7f3d440b4430 0x7f3d440d1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f3f82000640 1 -- 172.21.15.123:0/2727097748 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c018020 con 0x7f3f8c164530 2024-04-25T13:42:12.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f3f82000640 1 -- 172.21.15.123:0/2727097748 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f7c00cd20 con 0x7f3f8c164530 2024-04-25T13:42:12.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f3f82000640 1 -- 172.21.15.123:0/2727097748 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c0146c0 con 0x7f3f8c164530 2024-04-25T13:42:12.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f640b000640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f640415fd10 0x7f64040b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f640b000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f64040b5820 0x7f64040d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f640b000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64040d1bc0 0x7f64040af010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7f3967e00640 1 --2- 172.21.15.123:0/1437300635 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f395406f400 0x7f3954071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f3967e00640 1 -- 172.21.15.123:0/1437300635 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f396808f5a0 con 0x7f396c006810 2024-04-25T13:42:12.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f640b000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f64040d1fd0 con 0x7f64040b5820 2024-04-25T13:42:12.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f640b000640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f6404070870 con 0x7f640415fd10 2024-04-25T13:42:12.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f640b000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f640406f3b0 con 0x7f64040d1bc0 2024-04-25T13:42:12.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7fb9a6800640 1 -- 172.21.15.123:0/1520272170 shutdown_connections 2024-04-25T13:42:12.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.734+0000 7fb9a6800640 1 -- 172.21.15.123:0/1520272170 wait complete. 2024-04-25T13:42:12.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f3d42a00640 1 -- 172.21.15.123:0/12317696 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 722572834 0 0) 0x7f3d440b4c60 con 0x7f3d44160530 2024-04-25T13:42:12.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f6409c00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f640415fd10 0x7f64040b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f6409c00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f640415fd10 0x7f64040b52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:53426/0 (socket says 172.21.15.123:53426) 2024-04-25T13:42:12.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f6409c00640 1 -- 172.21.15.123:0/585443987 learned_addr learned my addr 172.21.15.123:0/585443987 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:12.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f3d42a00640 1 -- 172.21.15.123:0/12317696 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d28003530 con 0x7f3d44160530 2024-04-25T13:42:12.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f3f8b200640 1 -- 172.21.15.123:0/2727097748 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f8c15afa0 con 0x7f3f8c164530 2024-04-25T13:42:12.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f640a600640 1 --2- 172.21.15.123:0/585443987 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64040d1bc0 0x7f64040af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f6409200640 1 --2- 172.21.15.123:0/585443987 >> v2:172.21.15.123:3300/0 conn(0x7f64040b5820 0x7f64040d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f3973400640 1 --2- 172.21.15.123:0/1437300635 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f395406f400 0x7f3954071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f3d43400640 1 -- 172.21.15.123:0/12317696 >> v1:172.21.15.130:6789/0 conn(0x7f3d44160530 legacy=0x7f3d4415bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f3d43400640 1 -- 172.21.15.123:0/12317696 >> v1:172.21.15.123:6789/0 conn(0x7f3d440d1d50 legacy=0x7f3d440cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f3d43400640 1 -- 172.21.15.123:0/12317696 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d440b4f40 con 0x7f3d440b4430 2024-04-25T13:42:12.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f6409c00640 1 -- 172.21.15.123:0/585443987 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64040d1bc0 msgr2=0x7f64040af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:12.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f6409c00640 1 --2- 172.21.15.123:0/585443987 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64040d1bc0 0x7f64040af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f6409c00640 1 -- 172.21.15.123:0/585443987 >> v2:172.21.15.123:3300/0 conn(0x7f64040b5820 msgr2=0x7f64040d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:12.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f6409c00640 1 --2- 172.21.15.123:0/585443987 >> v2:172.21.15.123:3300/0 conn(0x7f64040b5820 0x7f64040d1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f6409c00640 1 -- 172.21.15.123:0/585443987 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f640406f690 con 0x7f640415fd10 2024-04-25T13:42:12.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f3f8b200640 1 -- 172.21.15.123:0/2727097748 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f8c161b20 con 0x7f3f8c164530 2024-04-25T13:42:12.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f3f8b200640 1 -- 172.21.15.123:0/2727097748 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f8c156de0 con 0x7f3f8c164530 2024-04-25T13:42:12.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f3973400640 1 --2- 172.21.15.123:0/1437300635 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f395406f400 0x7f3954071910 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3960007c40 tx=0x7f3960007b90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7fb9a6800640 1 Processor -- start 2024-04-25T13:42:12.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f9613e00640 1 Processor -- start 2024-04-25T13:42:12.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7fb9a6800640 1 -- start start 2024-04-25T13:42:12.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.738+0000 7f9613e00640 1 -- start start 2024-04-25T13:42:12.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7f65b7400640 1 -- 172.21.15.123:0/213804955 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a00a7070 con 0x7f65b80b3f80 2024-04-25T13:42:12.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7f65b7400640 1 -- 172.21.15.123:0/213804955 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a00b0070 con 0x7f65b80b3f80 2024-04-25T13:42:12.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7f65b7400640 1 -- 172.21.15.123:0/213804955 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a00ab890 con 0x7f65b80b3f80 2024-04-25T13:42:12.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7f3967e00640 1 -- 172.21.15.123:0/1437300635 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f396805bd20 con 0x7f396c006810 2024-04-25T13:42:12.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7f65bee00640 1 -- 172.21.15.123:0/213804955 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f65b80b3f80 msgr2=0x7f65b8149c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7f65bee00640 1 --2- 172.21.15.123:0/213804955 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f65b80b3f80 0x7f65b8149c10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f65b80cea40 tx=0x7f65a001c450 comp rx=0 tx=0).stop 2024-04-25T13:42:12.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.746+0000 7f65bee00640 1 -- 172.21.15.123:0/213804955 shutdown_connections 2024-04-25T13:42:12.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.746+0000 7f65bee00640 1 --2- 172.21.15.123:0/213804955 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f65b80b3f80 0x7f65b8149c10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.746+0000 7f65bee00640 1 -- 172.21.15.123:0/213804955 >> 172.21.15.123:0/213804955 conn(0x7f65b806ca70 msgr2=0x7f65b806ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:12.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.746+0000 7f65bee00640 1 -- 172.21.15.123:0/213804955 shutdown_connections 2024-04-25T13:42:12.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7f3f82000640 1 -- 172.21.15.123:0/2727097748 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3f7c01b020 con 0x7f3f8c164530 2024-04-25T13:42:12.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7f3f82000640 1 --2- 172.21.15.123:0/2727097748 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3f6806f4d0 0x7f3f680719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7f3f82000640 1 -- 172.21.15.123:0/2727097748 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3f7c08fd30 con 0x7f3f8c164530 2024-04-25T13:42:12.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7f3f89e00640 1 --2- 172.21.15.123:0/2727097748 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3f6806f4d0 0x7f3f680719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7f9613e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95f8005360 0x7f9614160180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7f9613e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f961414a940 0x7f96140aa580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7f9613e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96140aaac0 0x7f96140b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7f9613e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f96140d1ca0 con 0x7f96140aaac0 2024-04-25T13:42:12.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7f9613e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f96140d1b20 con 0x7f95f8005360 2024-04-25T13:42:12.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7f9613e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9614168950 con 0x7f961414a940 2024-04-25T13:42:12.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7f9612000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f961414a940 0x7f96140aa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7f9612000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f961414a940 0x7f96140aa580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:37676/0 (socket says 172.21.15.123:37676) 2024-04-25T13:42:12.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7f9612000640 1 -- 172.21.15.123:0/3178542008 learned_addr learned my addr 172.21.15.123:0/3178542008 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:12.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7f9612000640 1 -- 172.21.15.123:0/3178542008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95f8005360 msgr2=0x7f9614160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7f9612a00640 1 --2- 172.21.15.123:0/3178542008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95f8005360 0x7f9614160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7f9612000640 1 --2- 172.21.15.123:0/3178542008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95f8005360 0x7f9614160180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7f9612000640 1 -- 172.21.15.123:0/3178542008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96140aaac0 msgr2=0x7f96140b16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7f9612000640 1 --2- 172.21.15.123:0/3178542008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96140aaac0 0x7f96140b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7f9612000640 1 -- 172.21.15.123:0/3178542008 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96140ab320 con 0x7f961414a940 2024-04-25T13:42:12.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.746+0000 7f9612000640 1 --2- 172.21.15.123:0/3178542008 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f961414a940 0x7f96140aa580 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9604009e70 tx=0x7f960400ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.746+0000 7f9612a00640 1 --2- 172.21.15.123:0/3178542008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95f8005360 0x7f9614160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:12.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7fb9a6800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9a015d430 0x7fb9a016c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7fb9a6800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9a01fd750 0x7fb9a0159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7fb9a6800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9a00aa460 0x7fb9a00aa870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7fb9a6800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a0162c10 con 0x7fb9a00aa460 2024-04-25T13:42:12.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7fb9a6800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a0162a90 con 0x7fb9a01fd750 2024-04-25T13:42:12.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7fb9a6800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb9a0162d90 con 0x7fb9a015d430 2024-04-25T13:42:12.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7fb9a5400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9a015d430 0x7fb9a016c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7fb9a5400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9a015d430 0x7fb9a016c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:37686/0 (socket says 172.21.15.123:37686) 2024-04-25T13:42:12.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7fb9a5400640 1 -- 172.21.15.123:0/2798945139 learned_addr learned my addr 172.21.15.123:0/2798945139 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:12.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7fb9a4a00640 1 --2- 172.21.15.123:0/2798945139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9a01fd750 0x7fb9a0159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7fb9a5400640 1 -- 172.21.15.123:0/2798945139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9a01fd750 msgr2=0x7fb9a0159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7fb9a5400640 1 --2- 172.21.15.123:0/2798945139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9a01fd750 0x7fb9a0159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7fb9a5400640 1 -- 172.21.15.123:0/2798945139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9a00aa460 msgr2=0x7fb9a00aa870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7fb9a5400640 1 --2- 172.21.15.123:0/2798945139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9a00aa460 0x7fb9a00aa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7fb9a5400640 1 -- 172.21.15.123:0/2798945139 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a00aadb0 con 0x7fb9a015d430 2024-04-25T13:42:12.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7fb9a4a00640 1 --2- 172.21.15.123:0/2798945139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9a01fd750 0x7fb9a0159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:12.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7fb9a5400640 1 --2- 172.21.15.123:0/2798945139 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9a015d430 0x7fb9a016c540 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb994019080 tx=0x7fb99401acb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.746+0000 7fb99d600640 1 -- 172.21.15.123:0/2798945139 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9940be410 con 0x7fb9a015d430 2024-04-25T13:42:12.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.746+0000 7fb99d600640 1 -- 172.21.15.123:0/2798945139 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9940be5b0 con 0x7fb9a015d430 2024-04-25T13:42:12.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.746+0000 7fb99d600640 1 -- 172.21.15.123:0/2798945139 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9940be9a0 con 0x7fb9a015d430 2024-04-25T13:42:12.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7f6409c00640 1 --2- 172.21.15.123:0/585443987 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f640415fd10 0x7f64040b52e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f64040cdaf0 tx=0x7f63f801c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47d9a5d924dc47 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7effdf400640 1 -- 172.21.15.123:0/2017629064 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4015020 con 0x7effe80c55c0 2024-04-25T13:42:12.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7effdf400640 1 -- 172.21.15.123:0/2017629064 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effd4011830 con 0x7effe80c55c0 2024-04-25T13:42:12.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7effdf400640 1 -- 172.21.15.123:0/2017629064 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4011c20 con 0x7effe80c55c0 2024-04-25T13:42:12.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7effee200640 1 -- 172.21.15.123:0/2017629064 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effe8163650 con 0x7effe80c55c0 2024-04-25T13:42:12.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7effee200640 1 -- 172.21.15.123:0/2017629064 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7effe80b5db0 con 0x7effe80c55c0 2024-04-25T13:42:12.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.742+0000 7effee200640 1 -- 172.21.15.123:0/2017629064 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effe8050750 con 0x7effe80c55c0 2024-04-25T13:42:12.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.746+0000 7f3d43400640 1 --2- 172.21.15.123:0/12317696 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d440b4430 0x7f3d440d1810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c009740 tx=0x7f3d2c01c1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89973fb42b8b847 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.746+0000 7fb9a6800640 1 -- 172.21.15.123:0/2798945139 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9a01696c0 con 0x7fb9a015d430 2024-04-25T13:42:12.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.746+0000 7fb9a6800640 1 -- 172.21.15.123:0/2798945139 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9a0169c80 con 0x7fb9a015d430 2024-04-25T13:42:12.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.746+0000 7f6403e00640 1 -- 172.21.15.123:0/585443987 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f80ab620 con 0x7f640415fd10 2024-04-25T13:42:12.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.746+0000 7f3f89e00640 1 --2- 172.21.15.123:0/2727097748 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3f6806f4d0 0x7f3f680719e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3f740af000 tx=0x7f3f740a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.746+0000 7f6403e00640 1 -- 172.21.15.123:0/585443987 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63f80b0070 con 0x7f640415fd10 2024-04-25T13:42:12.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.746+0000 7f6403e00640 1 -- 172.21.15.123:0/585443987 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f80ab9e0 con 0x7f640415fd10 2024-04-25T13:42:12.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.746+0000 7f65bee00640 1 -- 172.21.15.123:0/213804955 wait complete. 2024-04-25T13:42:12.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.746+0000 7effdf400640 1 -- 172.21.15.123:0/2017629064 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7effd4018020 con 0x7effe80c55c0 2024-04-25T13:42:12.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.746+0000 7fb9a6800640 1 -- 172.21.15.123:0/2798945139 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9a0050750 con 0x7fb9a015d430 2024-04-25T13:42:12.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.746+0000 7f640b000640 1 -- 172.21.15.123:0/585443987 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f640415fd10 msgr2=0x7f64040b52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.746+0000 7f640b000640 1 --2- 172.21.15.123:0/585443987 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f640415fd10 0x7f64040b52e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f64040cdaf0 tx=0x7f63f801c460 comp rx=0 tx=0).stop 2024-04-25T13:42:12.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.746+0000 7f640b000640 1 -- 172.21.15.123:0/585443987 shutdown_connections 2024-04-25T13:42:12.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.746+0000 7f640b000640 1 --2- 172.21.15.123:0/585443987 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64040d1bc0 0x7f64040af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.746+0000 7f640b000640 1 --2- 172.21.15.123:0/585443987 >> v2:172.21.15.123:3300/0 conn(0x7f64040b5820 0x7f64040d1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.746+0000 7f640b000640 1 --2- 172.21.15.123:0/585443987 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f640415fd10 0x7f64040b52e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.746+0000 7f640b000640 1 -- 172.21.15.123:0/585443987 >> 172.21.15.123:0/585443987 conn(0x7f640406c670 msgr2=0x7f640406ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:12.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.746+0000 7effdf400640 1 --2- 172.21.15.123:0/2017629064 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7effc806f450 0x7effc8071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.750+0000 7f640b000640 1 -- 172.21.15.123:0/585443987 shutdown_connections 2024-04-25T13:42:12.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.750+0000 7f640b000640 1 -- 172.21.15.123:0/585443987 wait complete. 2024-04-25T13:42:12.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.750+0000 7f65bee00640 1 Processor -- start 2024-04-25T13:42:12.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.750+0000 7effdf400640 1 -- 172.21.15.123:0/2017629064 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7effd408f5e0 con 0x7effe80c55c0 2024-04-25T13:42:12.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.750+0000 7f65bee00640 1 -- start start 2024-04-25T13:42:12.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.750+0000 7effe7400640 1 --2- 172.21.15.123:0/2017629064 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7effc806f450 0x7effc8071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.750+0000 7effe7400640 1 --2- 172.21.15.123:0/2017629064 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7effc806f450 0x7effc8071960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7effd8006fd0 tx=0x7effd8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.750+0000 7f960aa00640 1 -- 172.21.15.123:0/3178542008 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9604028070 con 0x7f961414a940 2024-04-25T13:42:12.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.750+0000 7f9613e00640 1 -- 172.21.15.123:0/3178542008 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f961415f3c0 con 0x7f961414a940 2024-04-25T13:42:12.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.750+0000 7f9613e00640 1 -- 172.21.15.123:0/3178542008 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f961415f980 con 0x7f961414a940 2024-04-25T13:42:12.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.750+0000 7f960aa00640 1 -- 172.21.15.123:0/3178542008 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f960400ee60 con 0x7f961414a940 2024-04-25T13:42:12.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.750+0000 7f960aa00640 1 -- 172.21.15.123:0/3178542008 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9604028070 con 0x7f961414a940 2024-04-25T13:42:12.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.750+0000 7f65bee00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f65b8147280 0x7f65b81577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.750+0000 7f65bee00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65b814a150 0x7f65b815cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.750+0000 7f65bee00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f65b815d140 0x7f65b815f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.750+0000 7f65bee00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f65b8172330 con 0x7f65b814a150 2024-04-25T13:42:12.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.750+0000 7f65bee00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f65b81721b0 con 0x7f65b815d140 2024-04-25T13:42:12.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.750+0000 7f65bee00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f65b81724b0 con 0x7f65b8147280 2024-04-25T13:42:12.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.750+0000 7f65b7e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f65b8147280 0x7f65b81577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.750+0000 7f65b7e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f65b8147280 0x7f65b81577f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:37700/0 (socket says 172.21.15.123:37700) 2024-04-25T13:42:12.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.750+0000 7f65b7e00640 1 -- 172.21.15.123:0/2333886079 learned_addr learned my addr 172.21.15.123:0/2333886079 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:12.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.750+0000 7f65bce00640 1 --2- 172.21.15.123:0/2333886079 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f65b815d140 0x7f65b815f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.750+0000 7effdf400640 1 -- 172.21.15.123:0/2017629064 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7effd401f020 con 0x7effe80c55c0 2024-04-25T13:42:12.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.750+0000 7f3f82000640 1 -- 172.21.15.123:0/2727097748 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3f7c022030 con 0x7f3f8c164530 2024-04-25T13:42:12.780 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.750+0000 7f9613e00640 1 -- 172.21.15.123:0/3178542008 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95ec0052a0 con 0x7f961414a940 2024-04-25T13:42:12.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.750+0000 7f3d42a00640 1 -- 172.21.15.123:0/12317696 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c0b0070 con 0x7f3d440b4430 2024-04-25T13:42:12.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7f3d42a00640 1 -- 172.21.15.123:0/12317696 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d2c0a4e50 con 0x7f3d440b4430 2024-04-25T13:42:12.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7f3d42a00640 1 -- 172.21.15.123:0/12317696 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c001980 con 0x7f3d440b4430 2024-04-25T13:42:12.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7f640b000640 1 Processor -- start 2024-04-25T13:42:12.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7f65af400640 1 --2- 172.21.15.123:0/2333886079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65b814a150 0x7f65b815cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.781 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7f65b7e00640 1 -- 172.21.15.123:0/2333886079 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f65b815d140 msgr2=0x7f65b815f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7f65b7e00640 1 --2- 172.21.15.123:0/2333886079 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f65b815d140 0x7f65b815f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7f65b7e00640 1 -- 172.21.15.123:0/2333886079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65b814a150 msgr2=0x7f65b815cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7f65b7e00640 1 --2- 172.21.15.123:0/2333886079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65b814a150 0x7f65b815cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7f65b7e00640 1 -- 172.21.15.123:0/2333886079 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b815d970 con 0x7f65b8147280 2024-04-25T13:42:12.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7f640b000640 1 -- start start 2024-04-25T13:42:12.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7f65b7e00640 1 --2- 172.21.15.123:0/2333886079 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f65b8147280 0x7f65b81577f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f65a800c470 tx=0x7f65a800c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7f3d49a00640 1 -- 172.21.15.123:0/12317696 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d440b4430 msgr2=0x7f3d440d1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7f3d49a00640 1 --2- 172.21.15.123:0/12317696 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d440b4430 0x7f3d440d1810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c009740 tx=0x7f3d2c01c1e0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7fb99d600640 1 -- 172.21.15.123:0/2798945139 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb9940bc020 con 0x7fb9a015d430 2024-04-25T13:42:12.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7f3d49a00640 1 -- 172.21.15.123:0/12317696 shutdown_connections 2024-04-25T13:42:12.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7f3d49a00640 1 --2- 172.21.15.123:0/12317696 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d440b4430 0x7f3d440d1810 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7f3d49a00640 1 -- 172.21.15.123:0/12317696 >> 172.21.15.123:0/12317696 conn(0x7f3d4406c670 msgr2=0x7f3d4406ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:12.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7f3d49a00640 1 -- 172.21.15.123:0/12317696 shutdown_connections 2024-04-25T13:42:12.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7f3d49a00640 1 -- 172.21.15.123:0/12317696 wait complete. 2024-04-25T13:42:12.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7fb99d600640 1 --2- 172.21.15.123:0/2798945139 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb98006f4d0 0x7fb9800719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7fb99d600640 1 -- 172.21.15.123:0/2798945139 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb994129da0 con 0x7fb9a015d430 2024-04-25T13:42:12.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7f640b000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64040b5820 0x7f64041602a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7f640b000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64040d1bc0 0x7f64040b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7f640b000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f640415fd10 0x7f640415a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7f640b000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6404160120 con 0x7f64040b5820 2024-04-25T13:42:12.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7f640b000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f64041647e0 con 0x7f64040d1bc0 2024-04-25T13:42:12.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7f640b000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f6404072a30 con 0x7f640415fd10 2024-04-25T13:42:12.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.754+0000 7fb9a4a00640 1 --2- 172.21.15.123:0/2798945139 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb98006f4d0 0x7fb9800719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.758+0000 7f6409c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64040b5820 0x7f64041602a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.758+0000 7fb9a4a00640 1 --2- 172.21.15.123:0/2798945139 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb98006f4d0 0x7fb9800719e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb98c005890 tx=0x7fb98c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.758+0000 7f6409c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64040b5820 0x7f64041602a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37368/0 (socket says 172.21.15.123:37368) 2024-04-25T13:42:12.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.758+0000 7f6409c00640 1 -- 172.21.15.123:0/1387818255 learned_addr learned my addr 172.21.15.123:0/1387818255 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:12.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.758+0000 7f6409200640 1 --2- 172.21.15.123:0/1387818255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64040d1bc0 0x7f64040b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.758+0000 7f6409200640 1 -- 172.21.15.123:0/1387818255 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f640415fd10 msgr2=0x7f640415a600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T13:42:12.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.758+0000 7f6409200640 1 --2- 172.21.15.123:0/1387818255 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f640415fd10 0x7f640415a600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.758+0000 7f6409200640 1 -- 172.21.15.123:0/1387818255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64040b5820 msgr2=0x7f64041602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.758+0000 7f6409200640 1 --2- 172.21.15.123:0/1387818255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64040b5820 0x7f64041602a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.758+0000 7f6409200640 1 -- 172.21.15.123:0/1387818255 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64040b2eb0 con 0x7f64040d1bc0 2024-04-25T13:42:12.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.758+0000 7f6409200640 1 --2- 172.21.15.123:0/1387818255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64040d1bc0 0x7f64040b2970 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f63f000d5d0 tx=0x7f63f000da90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.758+0000 7f65b4c00640 1 -- 172.21.15.123:0/2333886079 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a8018070 con 0x7f65b8147280 2024-04-25T13:42:12.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.758+0000 7f65b4c00640 1 -- 172.21.15.123:0/2333886079 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a80074e0 con 0x7f65b8147280 2024-04-25T13:42:12.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.758+0000 7f65bee00640 1 -- 172.21.15.123:0/2333886079 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65b815dc50 con 0x7f65b8147280 2024-04-25T13:42:12.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.758+0000 7f65b4c00640 1 -- 172.21.15.123:0/2333886079 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a80049f0 con 0x7f65b8147280 2024-04-25T13:42:12.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.758+0000 7f65bee00640 1 -- 172.21.15.123:0/2333886079 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f65b815e210 con 0x7f65b8147280 2024-04-25T13:42:12.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.758+0000 7f3d49a00640 1 Processor -- start 2024-04-25T13:42:12.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.758+0000 7fb99d600640 1 -- 172.21.15.123:0/2798945139 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb9a00aadb0 con 0x7fb9a015d430 2024-04-25T13:42:12.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.758+0000 7f3d49a00640 1 -- start start 2024-04-25T13:42:12.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.758+0000 7f65bee00640 1 -- 172.21.15.123:0/2333886079 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65b8050750 con 0x7f65b8147280 2024-04-25T13:42:12.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.758+0000 7f960aa00640 1 -- 172.21.15.123:0/3178542008 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f960402b070 con 0x7f961414a940 2024-04-25T13:42:12.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.758+0000 7f960aa00640 1 --2- 172.21.15.123:0/3178542008 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f95f006f600 0x7f95f0071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.758+0000 7f960aa00640 1 -- 172.21.15.123:0/3178542008 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f96040a0590 con 0x7f961414a940 2024-04-25T13:42:12.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.762+0000 7f9612a00640 1 --2- 172.21.15.123:0/3178542008 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f95f006f600 0x7f95f0071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.762+0000 7f3d49a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d440b4430 0x7f3d440aa460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.762+0000 7f3d49a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d440d1d50 0x7f3d44157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.762+0000 7f3d49a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d44160530 0x7f3d441599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.762+0000 7f3d43400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d440d1d50 0x7f3d44157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.762+0000 7f3d43400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d440d1d50 0x7f3d44157db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37374/0 (socket says 172.21.15.123:37374) 2024-04-25T13:42:12.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.762+0000 7f3d43400640 1 -- 172.21.15.123:0/3873348514 learned_addr learned my addr 172.21.15.123:0/3873348514 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:12.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.762+0000 7f3d49a00640 1 -- 172.21.15.123:0/3873348514 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3d440b4840 con 0x7f3d440d1d50 2024-04-25T13:42:12.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.762+0000 7f3d49a00640 1 -- 172.21.15.123:0/3873348514 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3d440b5500 con 0x7f3d440b4430 2024-04-25T13:42:12.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.762+0000 7f3d43e00640 1 --2- 172.21.15.123:0/3873348514 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d440b4430 0x7f3d440aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.762+0000 7f9612a00640 1 --2- 172.21.15.123:0/3178542008 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f95f006f600 0x7f95f0071b10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f961406ec60 tx=0x7f95fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.762+0000 7f960aa00640 1 -- 172.21.15.123:0/3178542008 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f960406d460 con 0x7f961414a940 2024-04-25T13:42:12.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.762+0000 7f3d49a00640 1 -- 172.21.15.123:0/3873348514 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3d440b49c0 con 0x7f3d44160530 2024-04-25T13:42:12.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.762+0000 7f3d49000640 1 --2- 172.21.15.123:0/3873348514 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d44160530 0x7f3d441599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.762+0000 7f3d43e00640 1 -- 172.21.15.123:0/3873348514 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d44160530 msgr2=0x7f3d441599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.762+0000 7f3d43e00640 1 --2- 172.21.15.123:0/3873348514 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d44160530 0x7f3d441599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.762+0000 7f3d43e00640 1 -- 172.21.15.123:0/3873348514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d440d1d50 msgr2=0x7f3d44157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:12.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.762+0000 7f3d43e00640 1 --2- 172.21.15.123:0/3873348514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d440d1d50 0x7f3d44157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:12.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.762+0000 7f3d43e00640 1 -- 172.21.15.123:0/3873348514 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d440ab400 con 0x7f3d440b4430 2024-04-25T13:42:12.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.762+0000 7f3d43400640 1 --2- 172.21.15.123:0/3873348514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d440d1d50 0x7f3d44157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:12.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.762+0000 7f3d43e00640 1 --2- 172.21.15.123:0/3873348514 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d440b4430 0x7f3d440aa460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c00caa0 tx=0x7f3d3c00cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.762+0000 7f65b4c00640 1 -- 172.21.15.123:0/2333886079 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f65a801b070 con 0x7f65b8147280 2024-04-25T13:42:12.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.766+0000 7f3d3be00640 1 -- 172.21.15.123:0/3873348514 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c018070 con 0x7f3d440b4430 2024-04-25T13:42:12.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.766+0000 7f3d3be00640 1 -- 172.21.15.123:0/3873348514 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d3c00a730 con 0x7f3d440b4430 2024-04-25T13:42:12.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.766+0000 7f3d3be00640 1 -- 172.21.15.123:0/3873348514 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c00ab00 con 0x7f3d440b4430 2024-04-25T13:42:12.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.766+0000 7f3d49a00640 1 -- 172.21.15.123:0/3873348514 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d440aae40 con 0x7f3d440b4430 2024-04-25T13:42:12.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.766+0000 7f3d49a00640 1 -- 172.21.15.123:0/3873348514 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d44204070 con 0x7f3d440b4430 2024-04-25T13:42:12.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.766+0000 7f65b4c00640 1 --2- 172.21.15.123:0/2333886079 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f659406f450 0x7f6594071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.766+0000 7f65b4c00640 1 -- 172.21.15.123:0/2333886079 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f65a808ea50 con 0x7f65b8147280 2024-04-25T13:42:12.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.766+0000 7f65af400640 1 --2- 172.21.15.123:0/2333886079 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f659406f450 0x7f6594071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.770+0000 7f65af400640 1 --2- 172.21.15.123:0/2333886079 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f659406f450 0x7f6594071960 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f65a00af000 tx=0x7f65a00a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.770+0000 7f65b4c00640 1 -- 172.21.15.123:0/2333886079 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f65a805b3f0 con 0x7f65b8147280 2024-04-25T13:42:12.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.770+0000 7f3d3be00640 1 -- 172.21.15.123:0/3873348514 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3d3c01b070 con 0x7f3d440b4430 2024-04-25T13:42:12.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.766+0000 7f6401600640 1 -- 172.21.15.123:0/1387818255 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f00125f0 con 0x7f64040d1bc0 2024-04-25T13:42:12.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.766+0000 7f6401600640 1 -- 172.21.15.123:0/1387818255 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63f0019070 con 0x7f64040d1bc0 2024-04-25T13:42:12.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.766+0000 7f6401600640 1 -- 172.21.15.123:0/1387818255 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63f0012990 con 0x7f64040d1bc0 2024-04-25T13:42:12.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.766+0000 7f640b000640 1 -- 172.21.15.123:0/1387818255 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64040b3360 con 0x7f64040d1bc0 2024-04-25T13:42:12.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.770+0000 7f640b000640 1 -- 172.21.15.123:0/1387818255 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64040b3920 con 0x7f64040d1bc0 2024-04-25T13:42:12.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.770+0000 7f3d3be00640 1 --2- 172.21.15.123:0/3873348514 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3d2006f500 0x7f3d20071a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.770+0000 7f3d3be00640 1 -- 172.21.15.123:0/3873348514 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3d3c08eb00 con 0x7f3d440b4430 2024-04-25T13:42:12.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.770+0000 7f3d43400640 1 --2- 172.21.15.123:0/3873348514 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3d2006f500 0x7f3d20071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.774+0000 7f3d49a00640 1 -- 172.21.15.123:0/3873348514 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d44050750 con 0x7f3d440b4430 2024-04-25T13:42:12.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.774+0000 7f3d43400640 1 --2- 172.21.15.123:0/3873348514 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3d2006f500 0x7f3d20071a10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c009740 tx=0x7f3d2c0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.770+0000 7f6401600640 1 -- 172.21.15.123:0/1387818255 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f63f0012b30 con 0x7f64040d1bc0 2024-04-25T13:42:12.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.770+0000 7f63f6a00640 1 -- 172.21.15.123:0/1387818255 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6404050750 con 0x7f64040d1bc0 2024-04-25T13:42:12.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.774+0000 7f6401600640 1 --2- 172.21.15.123:0/1387818255 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f63e406f450 0x7f63e4071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:12.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.774+0000 7f6409c00640 1 --2- 172.21.15.123:0/1387818255 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f63e406f450 0x7f63e4071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:12.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.774+0000 7f6409c00640 1 --2- 172.21.15.123:0/1387818255 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f63e406f450 0x7f63e4071960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f63f801c4a0 tx=0x7f63f80a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:12.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.778+0000 7f6401600640 1 -- 172.21.15.123:0/1387818255 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f63f0057b30 con 0x7f64040d1bc0 2024-04-25T13:42:12.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.778+0000 7f3d3be00640 1 -- 172.21.15.123:0/3873348514 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3d3c05b410 con 0x7f3d440b4430 2024-04-25T13:42:12.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:12.786+0000 7f6401600640 1 -- 172.21.15.123:0/1387818255 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f63f005bc40 con 0x7f64040d1bc0 2024-04-25T13:42:13.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.058+0000 7fb9a6800640 1 -- 172.21.15.123:0/2798945139 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb9a00ceea0 con 0x7fb9a015d430 2024-04-25T13:42:13.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.062+0000 7fb99d600640 1 -- 172.21.15.123:0/2798945139 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb9a00b53f0 con 0x7fb9a015d430 2024-04-25T13:42:13.064 INFO:teuthology.orchestra.run.smithi123.stdout:55834574854 2024-04-25T13:42:13.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.070+0000 7fb9a6800640 1 -- 172.21.15.123:0/2798945139 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb98006f4d0 msgr2=0x7fb9800719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:13.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.070+0000 7fb9a6800640 1 --2- 172.21.15.123:0/2798945139 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb98006f4d0 0x7fb9800719e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb98c005890 tx=0x7fb98c009040 comp rx=0 tx=0).stop 2024-04-25T13:42:13.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.070+0000 7fb9a6800640 1 -- 172.21.15.123:0/2798945139 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9a015d430 msgr2=0x7fb9a016c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:13.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.070+0000 7fb9a6800640 1 --2- 172.21.15.123:0/2798945139 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9a015d430 0x7fb9a016c540 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb994019080 tx=0x7fb99401acb0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.070+0000 7fb9a6800640 1 -- 172.21.15.123:0/2798945139 shutdown_connections 2024-04-25T13:42:13.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.070+0000 7fb9a6800640 1 --2- 172.21.15.123:0/2798945139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb9a01fd750 0x7fb9a0159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.070+0000 7fb9a6800640 1 --2- 172.21.15.123:0/2798945139 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb98006f4d0 0x7fb9800719e0 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb98c005890 tx=0x7fb98c009040 comp rx=0 tx=0).stop 2024-04-25T13:42:13.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.070+0000 7fb9a6800640 1 --2- 172.21.15.123:0/2798945139 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb9a00aa460 0x7fb9a00aa870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.070+0000 7fb9a6800640 1 --2- 172.21.15.123:0/2798945139 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb9a015d430 0x7fb9a016c540 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.070+0000 7fb9a6800640 1 -- 172.21.15.123:0/2798945139 >> 172.21.15.123:0/2798945139 conn(0x7fb9a006c670 msgr2=0x7fb9a00b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:13.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.070+0000 7fb9a6800640 1 -- 172.21.15.123:0/2798945139 shutdown_connections 2024-04-25T13:42:13.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.070+0000 7fb9a6800640 1 -- 172.21.15.123:0/2798945139 wait complete. 2024-04-25T13:42:13.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.074+0000 7f397ac00640 1 -- 172.21.15.123:0/1437300635 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f396c053220 con 0x7f396c006810 2024-04-25T13:42:13.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.082+0000 7f3967e00640 1 -- 172.21.15.123:0/1437300635 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3968060020 con 0x7f396c006810 2024-04-25T13:42:13.084 INFO:teuthology.orchestra.run.smithi123.stdout:55834574854 2024-04-25T13:42:13.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.086+0000 7f397ac00640 1 -- 172.21.15.123:0/1437300635 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f395406f400 msgr2=0x7f3954071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:13.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.086+0000 7f397ac00640 1 --2- 172.21.15.123:0/1437300635 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f395406f400 0x7f3954071910 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3960007c40 tx=0x7f3960007b90 comp rx=0 tx=0).stop 2024-04-25T13:42:13.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.086+0000 7f397ac00640 1 -- 172.21.15.123:0/1437300635 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f396c006810 msgr2=0x7f396c0491d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:13.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.086+0000 7f397ac00640 1 --2- 172.21.15.123:0/1437300635 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f396c006810 0x7f396c0491d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f396800e840 tx=0x7f396800ec40 comp rx=0 tx=0).stop 2024-04-25T13:42:13.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.086+0000 7f397ac00640 1 -- 172.21.15.123:0/1437300635 shutdown_connections 2024-04-25T13:42:13.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.086+0000 7f397ac00640 1 --2- 172.21.15.123:0/1437300635 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f396c0eb8f0 0x7f396c04a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.086+0000 7f397ac00640 1 --2- 172.21.15.123:0/1437300635 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f395406f400 0x7f3954071910 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.086+0000 7f397ac00640 1 --2- 172.21.15.123:0/1437300635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f396c033a80 0x7f396c0d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.086+0000 7f397ac00640 1 --2- 172.21.15.123:0/1437300635 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f396c006810 0x7f396c0491d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.086+0000 7f397ac00640 1 -- 172.21.15.123:0/1437300635 >> 172.21.15.123:0/1437300635 conn(0x7f396c054d00 msgr2=0x7f396c053990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:13.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.086+0000 7f397ac00640 1 -- 172.21.15.123:0/1437300635 shutdown_connections 2024-04-25T13:42:13.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.086+0000 7f397ac00640 1 -- 172.21.15.123:0/1437300635 wait complete. 2024-04-25T13:42:13.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.094+0000 7f3f8b200640 1 -- 172.21.15.123:0/2727097748 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f3f8c050750 con 0x7f3f8c164530 2024-04-25T13:42:13.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.098+0000 7f3f82000640 1 -- 172.21.15.123:0/2727097748 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3f7c010040 con 0x7f3f8c164530 2024-04-25T13:42:13.102 INFO:teuthology.orchestra.run.smithi123.stdout:55834574853 2024-04-25T13:42:13.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.098+0000 7f9613e00640 1 -- 172.21.15.123:0/3178542008 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f95ec005860 con 0x7f961414a940 2024-04-25T13:42:13.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.098+0000 7f3f8b200640 1 -- 172.21.15.123:0/2727097748 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3f6806f4d0 msgr2=0x7f3f680719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:13.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.098+0000 7f3f8b200640 1 --2- 172.21.15.123:0/2727097748 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3f6806f4d0 0x7f3f680719e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3f740af000 tx=0x7f3f740a7000 comp rx=0 tx=0).stop 2024-04-25T13:42:13.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.098+0000 7f3f8b200640 1 -- 172.21.15.123:0/2727097748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f8c164530 msgr2=0x7f3f8c159220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:13.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.098+0000 7f3f8b200640 1 --2- 172.21.15.123:0/2727097748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f8c164530 0x7f3f8c159220 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00ebd0 tx=0x7f3f7c00c490 comp rx=0 tx=0).stop 2024-04-25T13:42:13.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.098+0000 7f3f8b200640 1 -- 172.21.15.123:0/2727097748 shutdown_connections 2024-04-25T13:42:13.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.098+0000 7f3f8b200640 1 --2- 172.21.15.123:0/2727097748 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3f6806f4d0 0x7f3f680719e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.098+0000 7f3f8b200640 1 --2- 172.21.15.123:0/2727097748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3f8c164530 0x7f3f8c159220 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.098+0000 7f3f8b200640 1 --2- 172.21.15.123:0/2727097748 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3f8c0d3e90 0x7f3f8c164c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.098+0000 7f3f8b200640 1 --2- 172.21.15.123:0/2727097748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f8c06d860 0x7f3f8c162040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.098+0000 7f3f8b200640 1 -- 172.21.15.123:0/2727097748 >> 172.21.15.123:0/2727097748 conn(0x7f3f8c0d58c0 msgr2=0x7f3f8c163aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:13.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.098+0000 7f3f8b200640 1 -- 172.21.15.123:0/2727097748 shutdown_connections 2024-04-25T13:42:13.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.102+0000 7f3f8b200640 1 -- 172.21.15.123:0/2727097748 wait complete. 2024-04-25T13:42:13.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.102+0000 7f960aa00640 1 -- 172.21.15.123:0/3178542008 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f960406cd60 con 0x7f961414a940 2024-04-25T13:42:13.106 INFO:teuthology.orchestra.run.smithi123.stdout:55834574854 2024-04-25T13:42:13.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.106+0000 7effee200640 1 -- 172.21.15.123:0/2017629064 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7effe80d1700 con 0x7effe80c55c0 2024-04-25T13:42:13.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.106+0000 7effdf400640 1 -- 172.21.15.123:0/2017629064 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7effe8154330 con 0x7effe80c55c0 2024-04-25T13:42:13.110 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2024-04-25T13:42:13.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2024-04-25T13:42:13.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.106+0000 7f9613e00640 1 -- 172.21.15.123:0/3178542008 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f95f006f600 msgr2=0x7f95f0071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:13.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.106+0000 7f9613e00640 1 --2- 172.21.15.123:0/3178542008 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f95f006f600 0x7f95f0071b10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f961406ec60 tx=0x7f95fc009040 comp rx=0 tx=0).stop 2024-04-25T13:42:13.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.106+0000 7f9613e00640 1 -- 172.21.15.123:0/3178542008 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f961414a940 msgr2=0x7f96140aa580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:13.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.106+0000 7f9613e00640 1 --2- 172.21.15.123:0/3178542008 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f961414a940 0x7f96140aa580 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9604009e70 tx=0x7f960400ec70 comp rx=0 tx=0).stop 2024-04-25T13:42:13.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.106+0000 7f9613e00640 1 -- 172.21.15.123:0/3178542008 shutdown_connections 2024-04-25T13:42:13.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.106+0000 7f9613e00640 1 --2- 172.21.15.123:0/3178542008 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f95f006f600 0x7f95f0071b10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.106+0000 7f9613e00640 1 --2- 172.21.15.123:0/3178542008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f96140aaac0 0x7f96140b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.106+0000 7f9613e00640 1 --2- 172.21.15.123:0/3178542008 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f961414a940 0x7f96140aa580 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.106+0000 7f9613e00640 1 --2- 172.21.15.123:0/3178542008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f95f8005360 0x7f9614160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.106+0000 7f9613e00640 1 -- 172.21.15.123:0/3178542008 >> 172.21.15.123:0/3178542008 conn(0x7f961406c840 msgr2=0x7f96140cd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:13.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.106+0000 7f9613e00640 1 -- 172.21.15.123:0/3178542008 shutdown_connections 2024-04-25T13:42:13.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.110+0000 7f9613e00640 1 -- 172.21.15.123:0/3178542008 wait complete. 2024-04-25T13:42:13.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.110+0000 7f65bee00640 1 -- 172.21.15.123:0/2333886079 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f65b80cdb60 con 0x7f65b8147280 2024-04-25T13:42:13.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.110+0000 7effee200640 1 -- 172.21.15.123:0/2017629064 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7effc806f450 msgr2=0x7effc8071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:13.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.110+0000 7f65b4c00640 1 -- 172.21.15.123:0/2333886079 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f65a805f6f0 con 0x7f65b8147280 2024-04-25T13:42:13.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.110+0000 7effee200640 1 --2- 172.21.15.123:0/2017629064 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7effc806f450 0x7effc8071960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7effd8006fd0 tx=0x7effd8008040 comp rx=0 tx=0).stop 2024-04-25T13:42:13.114 INFO:teuthology.orchestra.run.smithi123.stdout:55834574852 2024-04-25T13:42:13.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.110+0000 7effee200640 1 -- 172.21.15.123:0/2017629064 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7effe80c55c0 msgr2=0x7effe8162a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:13.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.110+0000 7effee200640 1 --2- 172.21.15.123:0/2017629064 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7effe80c55c0 0x7effe8162a70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7effd400b390 tx=0x7effd400b850 comp rx=0 tx=0).stop 2024-04-25T13:42:13.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.110+0000 7effee200640 1 -- 172.21.15.123:0/2017629064 shutdown_connections 2024-04-25T13:42:13.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.110+0000 7effee200640 1 --2- 172.21.15.123:0/2017629064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effe80d0ff0 0x7effe81649f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.110+0000 7effee200640 1 --2- 172.21.15.123:0/2017629064 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7effc806f450 0x7effc8071960 secure :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7effd8006fd0 tx=0x7effd8008040 comp rx=0 tx=0).stop 2024-04-25T13:42:13.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.114+0000 7effee200640 1 --2- 172.21.15.123:0/2017629064 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7effe80c55c0 0x7effe8162a70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.114+0000 7effee200640 1 --2- 172.21.15.123:0/2017629064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effe80b2f70 0x7effe81537c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.114+0000 7effee200640 1 -- 172.21.15.123:0/2017629064 >> 172.21.15.123:0/2017629064 conn(0x7effe80d25f0 msgr2=0x7effe80d2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:13.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.114+0000 7effee200640 1 -- 172.21.15.123:0/2017629064 shutdown_connections 2024-04-25T13:42:13.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.114+0000 7effee200640 1 -- 172.21.15.123:0/2017629064 wait complete. 2024-04-25T13:42:13.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.114+0000 7f65bee00640 1 -- 172.21.15.123:0/2333886079 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f659406f450 msgr2=0x7f6594071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:13.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.114+0000 7f65bee00640 1 --2- 172.21.15.123:0/2333886079 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f659406f450 0x7f6594071960 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f65a00af000 tx=0x7f65a00a7000 comp rx=0 tx=0).stop 2024-04-25T13:42:13.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.114+0000 7f65bee00640 1 -- 172.21.15.123:0/2333886079 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f65b8147280 msgr2=0x7f65b81577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:13.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.114+0000 7f65bee00640 1 --2- 172.21.15.123:0/2333886079 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f65b8147280 0x7f65b81577f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f65a800c470 tx=0x7f65a800c930 comp rx=0 tx=0).stop 2024-04-25T13:42:13.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.118+0000 7f65bee00640 1 -- 172.21.15.123:0/2333886079 shutdown_connections 2024-04-25T13:42:13.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.118+0000 7f65bee00640 1 --2- 172.21.15.123:0/2333886079 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f65b815d140 0x7f65b815f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.118+0000 7f65bee00640 1 --2- 172.21.15.123:0/2333886079 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f659406f450 0x7f6594071960 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.118+0000 7f65bee00640 1 --2- 172.21.15.123:0/2333886079 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f65b814a150 0x7f65b815cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.118+0000 7f65bee00640 1 --2- 172.21.15.123:0/2333886079 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f65b8147280 0x7f65b81577f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.118+0000 7f65bee00640 1 -- 172.21.15.123:0/2333886079 >> 172.21.15.123:0/2333886079 conn(0x7f65b806ca70 msgr2=0x7f65b80734e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:13.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.118+0000 7f65bee00640 1 -- 172.21.15.123:0/2333886079 shutdown_connections 2024-04-25T13:42:13.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.118+0000 7f65bee00640 1 -- 172.21.15.123:0/2333886079 wait complete. 2024-04-25T13:42:13.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.122+0000 7f3d49a00640 1 -- 172.21.15.123:0/3873348514 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f3d4406f510 con 0x7f3d440b4430 2024-04-25T13:42:13.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.122+0000 7f3d3be00640 1 -- 172.21.15.123:0/3873348514 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3d3c05f710 con 0x7f3d440b4430 2024-04-25T13:42:13.125 INFO:teuthology.orchestra.run.smithi123.stdout:55834574854 2024-04-25T13:42:13.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2024-04-25T13:42:13.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.122+0000 7f63f6a00640 1 -- 172.21.15.123:0/1387818255 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f640406f190 con 0x7f64040d1bc0 2024-04-25T13:42:13.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.126+0000 7f3d49a00640 1 -- 172.21.15.123:0/3873348514 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3d2006f500 msgr2=0x7f3d20071a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:13.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.126+0000 7f3d49a00640 1 --2- 172.21.15.123:0/3873348514 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3d2006f500 0x7f3d20071a10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c009740 tx=0x7f3d2c0a6000 comp rx=0 tx=0).stop 2024-04-25T13:42:13.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.126+0000 7f3d49a00640 1 -- 172.21.15.123:0/3873348514 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d440b4430 msgr2=0x7f3d440aa460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:13.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.126+0000 7f3d49a00640 1 --2- 172.21.15.123:0/3873348514 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d440b4430 0x7f3d440aa460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c00caa0 tx=0x7f3d3c00cf60 comp rx=0 tx=0).stop 2024-04-25T13:42:13.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.126+0000 7f3d49a00640 1 -- 172.21.15.123:0/3873348514 shutdown_connections 2024-04-25T13:42:13.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.126+0000 7f3d49a00640 1 --2- 172.21.15.123:0/3873348514 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3d2006f500 0x7f3d20071a10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.126+0000 7f3d49a00640 1 --2- 172.21.15.123:0/3873348514 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d44160530 0x7f3d441599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.126+0000 7f3d49a00640 1 --2- 172.21.15.123:0/3873348514 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d440d1d50 0x7f3d44157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.126+0000 7f3d49a00640 1 --2- 172.21.15.123:0/3873348514 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d440b4430 0x7f3d440aa460 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.126+0000 7f3d49a00640 1 -- 172.21.15.123:0/3873348514 >> 172.21.15.123:0/3873348514 conn(0x7f3d4406c670 msgr2=0x7f3d4415b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:13.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.126+0000 7f6401600640 1 -- 172.21.15.123:0/1387818255 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f63f005b540 con 0x7f64040d1bc0 2024-04-25T13:42:13.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.126+0000 7f3d49a00640 1 -- 172.21.15.123:0/3873348514 shutdown_connections 2024-04-25T13:42:13.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.126+0000 7f3d49a00640 1 -- 172.21.15.123:0/3873348514 wait complete. 2024-04-25T13:42:13.131 INFO:teuthology.orchestra.run.smithi123.stdout:55834574852 2024-04-25T13:42:13.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2024-04-25T13:42:13.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.134+0000 7f63f6a00640 1 -- 172.21.15.123:0/1387818255 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f63e406f450 msgr2=0x7f63e4071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:13.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.134+0000 7f63f6a00640 1 --2- 172.21.15.123:0/1387818255 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f63e406f450 0x7f63e4071960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f63f801c4a0 tx=0x7f63f80a7000 comp rx=0 tx=0).stop 2024-04-25T13:42:13.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.134+0000 7f63f6a00640 1 -- 172.21.15.123:0/1387818255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64040d1bc0 msgr2=0x7f64040b2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:13.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.134+0000 7f63f6a00640 1 --2- 172.21.15.123:0/1387818255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64040d1bc0 0x7f64040b2970 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f63f000d5d0 tx=0x7f63f000da90 comp rx=0 tx=0).stop 2024-04-25T13:42:13.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.134+0000 7f63f6a00640 1 -- 172.21.15.123:0/1387818255 shutdown_connections 2024-04-25T13:42:13.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.134+0000 7f63f6a00640 1 --2- 172.21.15.123:0/1387818255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64040d1bc0 0x7f64040b2970 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.134+0000 7f63f6a00640 1 --2- 172.21.15.123:0/1387818255 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f63e406f450 0x7f63e4071960 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.134+0000 7f63f6a00640 1 --2- 172.21.15.123:0/1387818255 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f640415fd10 0x7f640415a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.134+0000 7f63f6a00640 1 --2- 172.21.15.123:0/1387818255 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64040b5820 0x7f64041602a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:13.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.134+0000 7f63f6a00640 1 -- 172.21.15.123:0/1387818255 >> 172.21.15.123:0/1387818255 conn(0x7f640406c670 msgr2=0x7f640415e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:13.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.134+0000 7f63f6a00640 1 -- 172.21.15.123:0/1387818255 shutdown_connections 2024-04-25T13:42:13.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:13.134+0000 7f63f6a00640 1 -- 172.21.15.123:0/1387818255 wait complete. 2024-04-25T13:42:13.148 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2024-04-25T13:42:13.153 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2024-04-25T13:42:13.153 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2024-04-25T13:42:13.160 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2024-04-25T13:42:13.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2024-04-25T13:42:14.112 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T13:42:14.127 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T13:42:14.136 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T13:42:14.149 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T13:42:14.154 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T13:42:14.154 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T13:42:14.160 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T13:42:14.166 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T13:42:14.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.330+0000 7fdf59800640 1 Processor -- start 2024-04-25T13:42:14.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.330+0000 7fdf59800640 1 -- start start 2024-04-25T13:42:14.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.334+0000 7fdf59800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdf5415cdb0 0x7fdf540b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.334+0000 7fdf59800640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdf540d17a0 0x7fdf540d1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.334+0000 7fdf59800640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf540d20f0 con 0x7fdf54152660 2024-04-25T13:42:14.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.334+0000 7fdf59800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fdf540b0e00 con 0x7fdf5415cdb0 2024-04-25T13:42:14.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.334+0000 7fdf59800640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fdf5415ff00 con 0x7fdf540d17a0 2024-04-25T13:42:14.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf52000640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdf540d17a0 0x7fdf540d1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf52a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdf5415cdb0 0x7fdf540b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf53400640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fdf54152660 0x7fdf54152a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.123:51534/0 (socket says 172.21.15.123:51534) 2024-04-25T13:42:14.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf53400640 1 -- 172.21.15.123:0/845440494 learned_addr learned my addr 172.21.15.123:0/845440494 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:14.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf51600640 1 -- 172.21.15.123:0/845440494 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2903979560 0 0) 0x7fdf540d20f0 con 0x7fdf54152660 2024-04-25T13:42:14.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf51600640 1 -- 172.21.15.123:0/845440494 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf38003530 con 0x7fdf54152660 2024-04-25T13:42:14.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf51600640 1 -- 172.21.15.123:0/845440494 <== mon.1 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3658532977 0 0) 0x7fdf38003530 con 0x7fdf54152660 2024-04-25T13:42:14.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf51600640 1 -- 172.21.15.123:0/845440494 >> v2:172.21.15.130:3300/0 conn(0x7fdf540d17a0 msgr2=0x7fdf540d1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:14.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf51600640 1 --2- 172.21.15.123:0/845440494 >> v2:172.21.15.130:3300/0 conn(0x7fdf540d17a0 0x7fdf540d1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf51600640 1 -- 172.21.15.123:0/845440494 >> v2:172.21.15.123:3300/0 conn(0x7fdf5415cdb0 msgr2=0x7fdf540b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:14.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf51600640 1 --2- 172.21.15.123:0/845440494 >> v2:172.21.15.123:3300/0 conn(0x7fdf5415cdb0 0x7fdf540b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf51600640 1 -- 172.21.15.123:0/845440494 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf541601e0 con 0x7fdf54152660 2024-04-25T13:42:14.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf51600640 1 -- 172.21.15.123:0/845440494 <== mon.1 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7fdf40001680 con 0x7fdf54152660 2024-04-25T13:42:14.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf51600640 1 -- 172.21.15.123:0/845440494 >> v1:172.21.15.130:6789/0 conn(0x7fdf54152660 legacy=0x7fdf54152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf51600640 1 --2- 172.21.15.123:0/845440494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf380037b0 0x7fdf38003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf51600640 1 --2- 172.21.15.123:0/845440494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf38004100 0x7fdf3800b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf51600640 1 --2- 172.21.15.123:0/845440494 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf3800b560 0x7fdf3800d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf51600640 1 -- 172.21.15.123:0/845440494 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdf540b0e00 con 0x7fdf380037b0 2024-04-25T13:42:14.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf51600640 1 -- 172.21.15.123:0/845440494 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5415ff00 con 0x7fdf38004100 2024-04-25T13:42:14.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf51600640 1 -- 172.21.15.123:0/845440494 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fdf38004ea0 con 0x7fdf3800b560 2024-04-25T13:42:14.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf52a00640 1 --2- 172.21.15.123:0/845440494 >> v2:172.21.15.123:3300/0 conn(0x7fdf5415cdb0 0x7fdf540b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:14.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf52000640 1 --2- 172.21.15.123:0/845440494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf38004100 0x7fdf3800b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf53400640 1 --2- 172.21.15.123:0/845440494 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf3800b560 0x7fdf3800d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf52a00640 1 --2- 172.21.15.123:0/845440494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf380037b0 0x7fdf38003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf52000640 1 -- 172.21.15.123:0/845440494 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf3800b560 msgr2=0x7fdf3800d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:14.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf52000640 1 --2- 172.21.15.123:0/845440494 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf3800b560 0x7fdf3800d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf52000640 1 -- 172.21.15.123:0/845440494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf380037b0 msgr2=0x7fdf38003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:14.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf52000640 1 --2- 172.21.15.123:0/845440494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf380037b0 0x7fdf38003bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf52000640 1 -- 172.21.15.123:0/845440494 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf38003530 con 0x7fdf38004100 2024-04-25T13:42:14.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.338+0000 7fdf53400640 1 -- 172.21.15.123:0/845440494 reap_dead start 2024-04-25T13:42:14.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.342+0000 7fdf52000640 1 --2- 172.21.15.123:0/845440494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf38004100 0x7fdf3800b020 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdf540d2410 tx=0x7fdf4c01cd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d1a9a5c46aeb637 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.346+0000 7fdf51600640 1 -- 172.21.15.123:0/845440494 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c009610 con 0x7fdf38004100 2024-04-25T13:42:14.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.346+0000 7fdf51600640 1 -- 172.21.15.123:0/845440494 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf4c0a5d00 con 0x7fdf38004100 2024-04-25T13:42:14.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.346+0000 7fdf51600640 1 -- 172.21.15.123:0/845440494 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c009610 con 0x7fdf38004100 2024-04-25T13:42:14.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.346+0000 7fdf59800640 1 -- 172.21.15.123:0/845440494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf38004100 msgr2=0x7fdf3800b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.346+0000 7fdf59800640 1 --2- 172.21.15.123:0/845440494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf38004100 0x7fdf3800b020 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdf540d2410 tx=0x7fdf4c01cd10 comp rx=0 tx=0).stop 2024-04-25T13:42:14.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.350+0000 7fdf59800640 1 -- 172.21.15.123:0/845440494 shutdown_connections 2024-04-25T13:42:14.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.350+0000 7fdf59800640 1 --2- 172.21.15.123:0/845440494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf38004100 0x7fdf3800b020 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.350+0000 7fdf59800640 1 -- 172.21.15.123:0/845440494 >> 172.21.15.123:0/845440494 conn(0x7fdf5406c670 msgr2=0x7fdf5406ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:14.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.350+0000 7fdf59800640 1 -- 172.21.15.123:0/845440494 shutdown_connections 2024-04-25T13:42:14.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.350+0000 7fdf59800640 1 -- 172.21.15.123:0/845440494 wait complete. 2024-04-25T13:42:14.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.354+0000 7fdf59800640 1 Processor -- start 2024-04-25T13:42:14.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.354+0000 7fdf59800640 1 -- start start 2024-04-25T13:42:14.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.358+0000 7fdf59800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf38004100 0x7fdf540aa770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.358+0000 7fdf59800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf541f4ea0 0x7fdf541f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.358+0000 7fdf59800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf5415a650 0x7fdf5415aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.358+0000 7fdf52a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf38004100 0x7fdf540aa770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.358+0000 7fdf52000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf541f4ea0 0x7fdf541f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.358+0000 7fdf52a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf38004100 0x7fdf540aa770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:37748/0 (socket says 172.21.15.123:37748) 2024-04-25T13:42:14.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.358+0000 7fdf52000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf541f4ea0 0x7fdf541f52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:53512/0 (socket says 172.21.15.123:53512) 2024-04-25T13:42:14.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.358+0000 7fdf59800640 1 -- 172.21.15.123:0/616593119 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5415d1c0 con 0x7fdf5415a650 2024-04-25T13:42:14.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.358+0000 7fdf52a00640 1 -- 172.21.15.123:0/616593119 learned_addr learned my addr 172.21.15.123:0/616593119 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:14.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.358+0000 7fdf59800640 1 -- 172.21.15.123:0/616593119 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdf54153280 con 0x7fdf541f4ea0 2024-04-25T13:42:14.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.358+0000 7fdf53400640 1 --2- 172.21.15.123:0/616593119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf5415a650 0x7fdf5415aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.358+0000 7fdf59800640 1 -- 172.21.15.123:0/616593119 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fdf540b08c0 con 0x7fdf38004100 2024-04-25T13:42:14.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.362+0000 7fdf52000640 1 -- 172.21.15.123:0/616593119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf38004100 msgr2=0x7fdf540aa770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.362+0000 7fdf52000640 1 --2- 172.21.15.123:0/616593119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf38004100 0x7fdf540aa770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.362+0000 7fdf52000640 1 -- 172.21.15.123:0/616593119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf5415a650 msgr2=0x7fdf5415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.362+0000 7fdf52000640 1 --2- 172.21.15.123:0/616593119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf5415a650 0x7fdf5415aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.362+0000 7fdf52000640 1 -- 172.21.15.123:0/616593119 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf54142670 con 0x7fdf541f4ea0 2024-04-25T13:42:14.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.366+0000 7fdf52000640 1 --2- 172.21.15.123:0/616593119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf541f4ea0 0x7fdf541f52b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c0ab000 tx=0x7fdf38004830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.366+0000 7fdf4aa00640 1 -- 172.21.15.123:0/616593119 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c0bd020 con 0x7fdf541f4ea0 2024-04-25T13:42:14.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.366+0000 7fdf4aa00640 1 -- 172.21.15.123:0/616593119 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf4c0039a0 con 0x7fdf541f4ea0 2024-04-25T13:42:14.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.366+0000 7fdf4aa00640 1 -- 172.21.15.123:0/616593119 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c009610 con 0x7fdf541f4ea0 2024-04-25T13:42:14.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.366+0000 7fdf59800640 1 -- 172.21.15.123:0/616593119 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf5415afa0 con 0x7fdf541f4ea0 2024-04-25T13:42:14.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.366+0000 7fdf59800640 1 -- 172.21.15.123:0/616593119 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf541e9250 con 0x7fdf541f4ea0 2024-04-25T13:42:14.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.370+0000 7fdf3fe00640 1 -- 172.21.15.123:0/616593119 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf54050750 con 0x7fdf541f4ea0 2024-04-25T13:42:14.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.370+0000 7fdf4aa00640 1 -- 172.21.15.123:0/616593119 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fdf4c0140d0 con 0x7fdf541f4ea0 2024-04-25T13:42:14.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.370+0000 7fdf4aa00640 1 --2- 172.21.15.123:0/616593119 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdf3406f400 0x7fdf34071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.374+0000 7fdf4aa00640 1 -- 172.21.15.123:0/616593119 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdf4c129fa0 con 0x7fdf541f4ea0 2024-04-25T13:42:14.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.374+0000 7fdf52a00640 1 --2- 172.21.15.123:0/616593119 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdf3406f400 0x7fdf34071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.378+0000 7fdf52a00640 1 --2- 172.21.15.123:0/616593119 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdf3406f400 0x7fdf34071910 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdf44006aa0 tx=0x7fdf44008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.378+0000 7fdf4aa00640 1 -- 172.21.15.123:0/616593119 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdf4c0c7020 con 0x7fdf541f4ea0 2024-04-25T13:42:14.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.406+0000 7ff3ce200640 1 Processor -- start 2024-04-25T13:42:14.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.406+0000 7ff3ce200640 1 -- start start 2024-04-25T13:42:14.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.406+0000 7f9781200640 1 Processor -- start 2024-04-25T13:42:14.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.406+0000 7ff3ce200640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff3c80ccc10 0x7ff3c80cd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.406+0000 7ff3ce200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff3c80cd560 0x7ff3c8168630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.406+0000 7ff3ce200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3c80d0ef0 con 0x7ff3c80d1f50 2024-04-25T13:42:14.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.406+0000 7ff3ce200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff3c80d1ac0 con 0x7ff3c80cd560 2024-04-25T13:42:14.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.406+0000 7ff3ce200640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7ff3c80d1190 con 0x7ff3c80ccc10 2024-04-25T13:42:14.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.410+0000 7ff3c6a00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff3c80ccc10 0x7ff3c80cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.410+0000 7ff3c6a00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff3c80ccc10 0x7ff3c80cd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:53514/0 (socket says 172.21.15.123:53514) 2024-04-25T13:42:14.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.410+0000 7ff3c6a00640 1 -- 172.21.15.123:0/2612067802 learned_addr learned my addr 172.21.15.123:0/2612067802 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:14.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.410+0000 7ff3c6a00640 1 -- 172.21.15.123:0/2612067802 >> v2:172.21.15.123:3300/0 conn(0x7ff3c80cd560 msgr2=0x7ff3c8168630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:14.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.410+0000 7ff3c6a00640 1 --2- 172.21.15.123:0/2612067802 >> v2:172.21.15.123:3300/0 conn(0x7ff3c80cd560 0x7ff3c8168630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.410+0000 7ff3c6a00640 1 -- 172.21.15.123:0/2612067802 >> v1:172.21.15.123:6789/0 conn(0x7ff3c80d1f50 legacy=0x7ff3c80c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:14.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.410+0000 7ff3c6a00640 1 -- 172.21.15.123:0/2612067802 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c80d1470 con 0x7ff3c80ccc10 2024-04-25T13:42:14.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.406+0000 7f9781200640 1 -- start start 2024-04-25T13:42:14.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.410+0000 7f9781200640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f977c06f5c0 0x7f977c1642b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.410+0000 7f9781200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f977c167db0 0x7f977c1681c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.410+0000 7f9781200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f977c168700 0x7f977c072fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.410+0000 7f9781200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f977c070740 con 0x7f977c167db0 2024-04-25T13:42:14.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.410+0000 7f9781200640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f977c06fb30 con 0x7f977c06f5c0 2024-04-25T13:42:14.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.410+0000 7f9781200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f977c06fe10 con 0x7f977c168700 2024-04-25T13:42:14.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.410+0000 7f9779400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f977c167db0 0x7f977c1681c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.410+0000 7f977a800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f977c168700 0x7f977c072fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.410+0000 7f977a800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f977c168700 0x7f977c072fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:37758/0 (socket says 172.21.15.123:37758) 2024-04-25T13:42:14.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.410+0000 7f977a800640 1 -- 172.21.15.123:0/88432357 learned_addr learned my addr 172.21.15.123:0/88432357 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:14.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.410+0000 7f9779e00640 1 --2- 172.21.15.123:0/88432357 >> v2:172.21.15.130:3300/0 conn(0x7f977c06f5c0 0x7f977c1642b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.414+0000 7f9779400640 1 -- 172.21.15.123:0/88432357 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f977c168700 msgr2=0x7f977c072fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:14.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.414+0000 7f9779400640 1 --2- 172.21.15.123:0/88432357 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f977c168700 0x7f977c072fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.414+0000 7f9779400640 1 -- 172.21.15.123:0/88432357 >> v2:172.21.15.130:3300/0 conn(0x7f977c06f5c0 msgr2=0x7f977c1642b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:14.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.414+0000 7f9779400640 1 --2- 172.21.15.123:0/88432357 >> v2:172.21.15.130:3300/0 conn(0x7f977c06f5c0 0x7f977c1642b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.414+0000 7f9779400640 1 -- 172.21.15.123:0/88432357 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f977c0700f0 con 0x7f977c167db0 2024-04-25T13:42:14.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.414+0000 7fe7fe200640 1 Processor -- start 2024-04-25T13:42:14.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.414+0000 7ff3c6a00640 1 --2- 172.21.15.123:0/2612067802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3c80ccc10 0x7ff3c80cd020 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff3c80d1c40 tx=0x7ff3b401c1b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a65427c524bfec0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.414+0000 7fe7fe200640 1 -- start start 2024-04-25T13:42:14.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.418+0000 7fe7fe200640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe7f0038310 0x7fe7f0053670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.418+0000 7f9779400640 1 --2- 172.21.15.123:0/88432357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f977c167db0 0x7f977c1681c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f977c069b70 tx=0x7f976801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb134e4834d0751 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.418+0000 7fe7fe200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe7f0053fc0 0x7fe7f00ebde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.418+0000 7ff3c6000640 1 -- 172.21.15.123:0/2612067802 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b40b0070 con 0x7ff3c80ccc10 2024-04-25T13:42:14.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.418+0000 7ff3c6000640 1 -- 172.21.15.123:0/2612067802 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b40ab600 con 0x7ff3c80ccc10 2024-04-25T13:42:14.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.418+0000 7ff3c6000640 1 -- 172.21.15.123:0/2612067802 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b40ab9d0 con 0x7ff3c80ccc10 2024-04-25T13:42:14.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.418+0000 7fe7f7e00640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe7f0053bb0 0x7fe7f00eb6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.123:51536/0 (socket says 172.21.15.123:51536) 2024-04-25T13:42:14.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.418+0000 7fe7fce00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe7f0038310 0x7fe7f0053670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.418+0000 7fe7fce00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe7f0038310 0x7fe7f0053670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:53536/0 (socket says 172.21.15.123:53536) 2024-04-25T13:42:14.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.418+0000 7f9778a00640 1 -- 172.21.15.123:0/88432357 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97680ab430 con 0x7f977c167db0 2024-04-25T13:42:14.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.418+0000 7f9778a00640 1 -- 172.21.15.123:0/88432357 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97680b0070 con 0x7f977c167db0 2024-04-25T13:42:14.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.418+0000 7f9778a00640 1 -- 172.21.15.123:0/88432357 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97680ab7f0 con 0x7f977c167db0 2024-04-25T13:42:14.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.418+0000 7fe7fd800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe7f0053fc0 0x7fe7f00ebde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.418+0000 7ff3ce200640 1 -- 172.21.15.123:0/2612067802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3c80ccc10 msgr2=0x7ff3c80cd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.418+0000 7ff3ce200640 1 --2- 172.21.15.123:0/2612067802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3c80ccc10 0x7ff3c80cd020 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff3c80d1c40 tx=0x7ff3b401c1b0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.418+0000 7ff3ce200640 1 -- 172.21.15.123:0/2612067802 shutdown_connections 2024-04-25T13:42:14.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.418+0000 7ff3ce200640 1 --2- 172.21.15.123:0/2612067802 >> v2:172.21.15.123:3300/0 conn(0x7ff3c80cd560 0x7ff3c8168630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.418+0000 7fe7fd800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe7f0053fc0 0x7fe7f00ebde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37426/0 (socket says 172.21.15.123:37426) 2024-04-25T13:42:14.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.418+0000 7fe7fe200640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7f0053280 con 0x7fe7f0053bb0 2024-04-25T13:42:14.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.418+0000 7ff3ce200640 1 --2- 172.21.15.123:0/2612067802 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3c80ccc10 0x7ff3c80cd020 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.418+0000 7ff3ce200640 1 -- 172.21.15.123:0/2612067802 >> 172.21.15.123:0/2612067802 conn(0x7ff3c80d25c0 msgr2=0x7ff3c80d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:14.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.418+0000 7fe7fe200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe7f0007ea0 con 0x7fe7f0053fc0 2024-04-25T13:42:14.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.418+0000 7fe7fe200640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fe7f00e7fc0 con 0x7fe7f0038310 2024-04-25T13:42:14.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.422+0000 7f9781200640 1 -- 172.21.15.123:0/88432357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f977c167db0 msgr2=0x7f977c1681c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.422+0000 7f9781200640 1 --2- 172.21.15.123:0/88432357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f977c167db0 0x7f977c1681c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f977c069b70 tx=0x7f976801c450 comp rx=0 tx=0).stop 2024-04-25T13:42:14.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.422+0000 7ff3ce200640 1 -- 172.21.15.123:0/2612067802 shutdown_connections 2024-04-25T13:42:14.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.422+0000 7fe7fce00640 1 -- 172.21.15.123:0/2026891479 learned_addr learned my addr 172.21.15.123:0/2026891479 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:14.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.422+0000 7fe7fce00640 1 -- 172.21.15.123:0/2026891479 >> v2:172.21.15.123:3300/0 conn(0x7fe7f0053fc0 msgr2=0x7fe7f00ebde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:14.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.422+0000 7fe7fce00640 1 --2- 172.21.15.123:0/2026891479 >> v2:172.21.15.123:3300/0 conn(0x7fe7f0053fc0 0x7fe7f00ebde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.422+0000 7fe7fce00640 1 -- 172.21.15.123:0/2026891479 >> v1:172.21.15.130:6789/0 conn(0x7fe7f0053bb0 legacy=0x7fe7f00eb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.422+0000 7fe7fce00640 1 -- 172.21.15.123:0/2026891479 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f0034840 con 0x7fe7f0038310 2024-04-25T13:42:14.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.422+0000 7f9781200640 1 -- 172.21.15.123:0/88432357 shutdown_connections 2024-04-25T13:42:14.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.422+0000 7f9781200640 1 --2- 172.21.15.123:0/88432357 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f977c168700 0x7f977c072fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.422+0000 7f9781200640 1 --2- 172.21.15.123:0/88432357 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f977c167db0 0x7f977c1681c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.422+0000 7f9781200640 1 --2- 172.21.15.123:0/88432357 >> v2:172.21.15.130:3300/0 conn(0x7f977c06f5c0 0x7f977c1642b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.422+0000 7f9781200640 1 -- 172.21.15.123:0/88432357 >> 172.21.15.123:0/88432357 conn(0x7f977c0b37d0 msgr2=0x7f977c0b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:14.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.422+0000 7ff3ce200640 1 -- 172.21.15.123:0/2612067802 wait complete. 2024-04-25T13:42:14.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.422+0000 7f9781200640 1 -- 172.21.15.123:0/88432357 shutdown_connections 2024-04-25T13:42:14.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.426+0000 7fe7fce00640 1 --2- 172.21.15.123:0/2026891479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7f0038310 0x7fe7f0053670 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0052cd0 tx=0x7fe7e401c400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be6c21936072ffa7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.426+0000 7ff3ce200640 1 Processor -- start 2024-04-25T13:42:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.426+0000 7ff3ce200640 1 -- start start 2024-04-25T13:42:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.422+0000 7f209f600640 1 Processor -- start 2024-04-25T13:42:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.426+0000 7f209f600640 1 -- start start 2024-04-25T13:42:14.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.426+0000 7f209f600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f209806c670 0x7f209806ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.422+0000 7f9781200640 1 -- 172.21.15.123:0/88432357 wait complete. 2024-04-25T13:42:14.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.426+0000 7f9781200640 1 Processor -- start 2024-04-25T13:42:14.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7f9781200640 1 -- start start 2024-04-25T13:42:14.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7f209f600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20981648d0 con 0x7f2098161e40 2024-04-25T13:42:14.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7f209f600640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f209806cfc0 con 0x7f2098073d70 2024-04-25T13:42:14.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7f209f600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2098164b40 con 0x7f209806c670 2024-04-25T13:42:14.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7fe7f7400640 1 -- 172.21.15.123:0/2026891479 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e40b0070 con 0x7fe7f0038310 2024-04-25T13:42:14.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7f209cc00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2098161e40 0x7f20980cf990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53288/0 (socket says 172.21.15.123:53288) 2024-04-25T13:42:14.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7f209cc00640 1 -- 172.21.15.123:0/955213349 learned_addr learned my addr 172.21.15.123:0/955213349 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:14.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7fe7f7400640 1 -- 172.21.15.123:0/2026891479 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7e40ab600 con 0x7fe7f0038310 2024-04-25T13:42:14.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7f2097e00640 1 --2- 172.21.15.123:0/955213349 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f209806c670 0x7f209806ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7fe7f7400640 1 -- 172.21.15.123:0/2026891479 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e40ab9d0 con 0x7fe7f0038310 2024-04-25T13:42:14.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7f2097400640 1 -- 172.21.15.123:0/955213349 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3124137394 0 0) 0x7f20981648d0 con 0x7f2098161e40 2024-04-25T13:42:14.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7f2097400640 1 -- 172.21.15.123:0/955213349 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2080003530 con 0x7f2098161e40 2024-04-25T13:42:14.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7fe7fe200640 1 -- 172.21.15.123:0/2026891479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7f0038310 msgr2=0x7fe7f0053670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7fe7fe200640 1 --2- 172.21.15.123:0/2026891479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7f0038310 0x7fe7f0053670 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0052cd0 tx=0x7fe7e401c400 comp rx=0 tx=0).stop 2024-04-25T13:42:14.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7ff3ce200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3c80ccc10 0x7ff3c81492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7ff3ce200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3c80cd560 0x7ff3c814c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7f2097400640 1 -- 172.21.15.123:0/955213349 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2895388747 0 0) 0x7f20900013d0 con 0x7f2098073d70 2024-04-25T13:42:14.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7fe7fe200640 1 -- 172.21.15.123:0/2026891479 shutdown_connections 2024-04-25T13:42:14.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7ff3ce200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c80d1f50 0x7ff3c81613d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7f18cd200640 1 Processor -- start 2024-04-25T13:42:14.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7ff3ce200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c80cf0e0 con 0x7ff3c80d1f50 2024-04-25T13:42:14.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7fe7fe200640 1 --2- 172.21.15.123:0/2026891479 >> v2:172.21.15.123:3300/0 conn(0x7fe7f0053fc0 0x7fe7f00ebde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7fe7fe200640 1 --2- 172.21.15.123:0/2026891479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7f0038310 0x7fe7f0053670 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7fe7fe200640 1 -- 172.21.15.123:0/2026891479 >> 172.21.15.123:0/2026891479 conn(0x7fe7f0055150 msgr2=0x7fe7f0055560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:14.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7ff3c6a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3c80cd560 0x7ff3c814c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7ff3c7400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3c80ccc10 0x7ff3c81492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7ff3c7400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3c80ccc10 0x7ff3c81492b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:53552/0 (socket says 172.21.15.123:53552) 2024-04-25T13:42:14.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7ff3c6a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3c80cd560 0x7ff3c814c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:37782/0 (socket says 172.21.15.123:37782) 2024-04-25T13:42:14.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7ff3c7400640 1 -- 172.21.15.123:0/1319138254 learned_addr learned my addr 172.21.15.123:0/1319138254 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:14.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7ff3ce200640 1 -- 172.21.15.123:0/1319138254 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c80cef60 con 0x7ff3c80ccc10 2024-04-25T13:42:14.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7ff3ce200640 1 -- 172.21.15.123:0/1319138254 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c80d30e0 con 0x7ff3c80cd560 2024-04-25T13:42:14.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7f2097400640 1 -- 172.21.15.123:0/955213349 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20981648d0 con 0x7f2098073d70 2024-04-25T13:42:14.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7f2097400640 1 -- 172.21.15.123:0/955213349 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2795163457 0 0) 0x7f2080003530 con 0x7f2098161e40 2024-04-25T13:42:14.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7ff3c7e00640 1 --2- 172.21.15.123:0/1319138254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c80d1f50 0x7ff3c81613d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7f2097400640 1 -- 172.21.15.123:0/955213349 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f209806c670 msgr2=0x7f209806ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:14.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7f2097400640 1 --2- 172.21.15.123:0/955213349 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f209806c670 0x7f209806ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7ff3c6a00640 1 -- 172.21.15.123:0/1319138254 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3c80ccc10 msgr2=0x7ff3c81492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7ff3c6a00640 1 --2- 172.21.15.123:0/1319138254 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3c80ccc10 0x7ff3c81492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7f2097400640 1 -- 172.21.15.123:0/955213349 >> v1:172.21.15.130:6789/0 conn(0x7f2098073d70 legacy=0x7f2098074180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7ff3c6a00640 1 -- 172.21.15.123:0/1319138254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c80d1f50 msgr2=0x7ff3c81613d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7f2097400640 1 -- 172.21.15.123:0/955213349 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2098164e20 con 0x7f2098161e40 2024-04-25T13:42:14.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7f2097400640 1 -- 172.21.15.123:0/955213349 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7f208c001680 con 0x7f2098161e40 2024-04-25T13:42:14.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f2097400640 1 -- 172.21.15.123:0/955213349 >> v1:172.21.15.123:6789/0 conn(0x7f2098161e40 legacy=0x7f20980cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7ff3c6a00640 1 --2- 172.21.15.123:0/1319138254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c80d1f50 0x7ff3c81613d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7ff3c6a00640 1 -- 172.21.15.123:0/1319138254 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c814ca60 con 0x7ff3c80cd560 2024-04-25T13:42:14.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7ff3c7e00640 1 --2- 172.21.15.123:0/1319138254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c80d1f50 0x7ff3c81613d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:14.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f2097400640 1 --2- 172.21.15.123:0/955213349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2080003cb0 0x7f2080004100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7ff3c6a00640 1 --2- 172.21.15.123:0/1319138254 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3c80cd560 0x7ff3c814c520 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff3b40ab000 tx=0x7ff3b4018f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f2097400640 1 --2- 172.21.15.123:0/955213349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2080004810 0x7f2080004ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f2097400640 1 --2- 172.21.15.123:0/955213349 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2080005310 0x7f208000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f2097400640 1 -- 172.21.15.123:0/955213349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2098164b40 con 0x7f2080004810 2024-04-25T13:42:14.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f2097400640 1 -- 172.21.15.123:0/955213349 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f208000c220 con 0x7f2080003cb0 2024-04-25T13:42:14.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f2097400640 1 -- 172.21.15.123:0/955213349 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f208000c420 con 0x7f2080005310 2024-04-25T13:42:14.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.430+0000 7f18cd200640 1 -- start start 2024-04-25T13:42:14.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f209cc00640 1 --2- 172.21.15.123:0/955213349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2080003cb0 0x7f2080004100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7ff3bf400640 1 -- 172.21.15.123:0/1319138254 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b40b9020 con 0x7ff3c80cd560 2024-04-25T13:42:14.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7ff3bf400640 1 -- 172.21.15.123:0/1319138254 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b40b1040 con 0x7ff3c80cd560 2024-04-25T13:42:14.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7ff3ce200640 1 -- 172.21.15.123:0/1319138254 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c80af570 con 0x7ff3c80cd560 2024-04-25T13:42:14.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7ff3ce200640 1 -- 172.21.15.123:0/1319138254 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c80b1790 con 0x7ff3c80cd560 2024-04-25T13:42:14.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f209d600640 1 --2- 172.21.15.123:0/955213349 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2080005310 0x7f208000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7ff3bf400640 1 -- 172.21.15.123:0/1319138254 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b40b0050 con 0x7ff3c80cd560 2024-04-25T13:42:14.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f18cd200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f18c80d1b20 0x7f18c8168950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f18cd200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18c80b0ed0 con 0x7f18c8073530 2024-04-25T13:42:14.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f18cd200640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18c8164fc0 con 0x7f18c8168540 2024-04-25T13:42:14.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f18cd200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f18c8167dd0 con 0x7f18c80d1b20 2024-04-25T13:42:14.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f18c7400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f18c8073530 0x7f18c81647e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53290/0 (socket says 172.21.15.123:53290) 2024-04-25T13:42:14.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f18c7400640 1 -- 172.21.15.123:0/769419971 learned_addr learned my addr 172.21.15.123:0/769419971 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:14.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f9781200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f977c06f5c0 0x7f977c15aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7ff3ce200640 1 -- 172.21.15.123:0/1319138254 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3a00052a0 con 0x7ff3c80cd560 2024-04-25T13:42:14.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f9781200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f977c167db0 0x7f977c209410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f9781200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f977c168700 0x7f977c209950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f9781200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f977c0cc5c0 con 0x7f977c06f5c0 2024-04-25T13:42:14.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f9781200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f977c0cc440 con 0x7f977c168700 2024-04-25T13:42:14.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f9781200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f977c0cc740 con 0x7f977c167db0 2024-04-25T13:42:14.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7f977a800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f977c168700 0x7f977c209950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7ff3bf400640 1 -- 172.21.15.123:0/1319138254 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff3b40bc020 con 0x7ff3c80cd560 2024-04-25T13:42:14.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7ff3bf400640 1 --2- 172.21.15.123:0/1319138254 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff3a806f400 0x7ff3a8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7ff3bf400640 1 -- 172.21.15.123:0/1319138254 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff3b41292b0 con 0x7ff3c80cd560 2024-04-25T13:42:14.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f2097e00640 1 --2- 172.21.15.123:0/955213349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2080004810 0x7f2080004ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f209cc00640 1 -- 172.21.15.123:0/955213349 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2080005310 msgr2=0x7f208000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:14.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f209cc00640 1 --2- 172.21.15.123:0/955213349 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2080005310 0x7f208000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f209cc00640 1 -- 172.21.15.123:0/955213349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2080004810 msgr2=0x7f2080004ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:14.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f209cc00640 1 --2- 172.21.15.123:0/955213349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2080004810 0x7f2080004ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f209cc00640 1 -- 172.21.15.123:0/955213349 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2080003530 con 0x7f2080003cb0 2024-04-25T13:42:14.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7f18c6000640 1 -- 172.21.15.123:0/769419971 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3025369748 0 0) 0x7f18c80b0ed0 con 0x7f18c8073530 2024-04-25T13:42:14.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7f18c6000640 1 -- 172.21.15.123:0/769419971 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18ac003530 con 0x7f18c8073530 2024-04-25T13:42:14.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7f18c6000640 1 -- 172.21.15.123:0/769419971 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3945795875 0 0) 0x7f18ac003530 con 0x7f18c8073530 2024-04-25T13:42:14.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7f18c6000640 1 -- 172.21.15.123:0/769419971 >> v2:172.21.15.123:3300/0 conn(0x7f18c80d1b20 msgr2=0x7f18c8168950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:14.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7f18c6000640 1 --2- 172.21.15.123:0/769419971 >> v2:172.21.15.123:3300/0 conn(0x7f18c80d1b20 0x7f18c8168950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7f18c6000640 1 -- 172.21.15.123:0/769419971 >> v1:172.21.15.130:6789/0 conn(0x7f18c8168540 legacy=0x7f18c80d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:14.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7f18c6000640 1 -- 172.21.15.123:0/769419971 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c81652a0 con 0x7f18c8073530 2024-04-25T13:42:14.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7f18c6000640 1 -- 172.21.15.123:0/769419971 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7f18b8001680 con 0x7f18c8073530 2024-04-25T13:42:14.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7f18c6000640 1 -- 172.21.15.123:0/769419971 >> v1:172.21.15.123:6789/0 conn(0x7f18c8073530 legacy=0x7f18c81647e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7f18c6000640 1 --2- 172.21.15.123:0/769419971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18ac0039c0 0x7f18ac003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7f18c6000640 1 --2- 172.21.15.123:0/769419971 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f18ac004810 0x7f18ac004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7f18c6000640 1 --2- 172.21.15.123:0/769419971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18ac005400 0x7f18ac00bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7f18c6000640 1 -- 172.21.15.123:0/769419971 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f18c8167dd0 con 0x7f18ac0039c0 2024-04-25T13:42:14.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7f18c6000640 1 -- 172.21.15.123:0/769419971 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f18ac00c3a0 con 0x7f18ac005400 2024-04-25T13:42:14.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7f18c6000640 1 -- 172.21.15.123:0/769419971 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f18ac00c5a0 con 0x7f18ac004810 2024-04-25T13:42:14.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7f18c6a00640 1 --2- 172.21.15.123:0/769419971 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f18ac004810 0x7f18ac004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7f18c7e00640 1 --2- 172.21.15.123:0/769419971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18ac005400 0x7f18ac00bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7f18c6a00640 1 -- 172.21.15.123:0/769419971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18ac005400 msgr2=0x7f18ac00bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:14.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7f18c6a00640 1 --2- 172.21.15.123:0/769419971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18ac005400 0x7f18ac00bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7f18c6a00640 1 -- 172.21.15.123:0/769419971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18ac0039c0 msgr2=0x7f18ac003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:14.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7f18c6a00640 1 --2- 172.21.15.123:0/769419971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18ac0039c0 0x7f18ac003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7f18c6a00640 1 -- 172.21.15.123:0/769419971 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c81652a0 con 0x7f18ac004810 2024-04-25T13:42:14.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7fe7fe200640 1 -- 172.21.15.123:0/2026891479 shutdown_connections 2024-04-25T13:42:14.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.434+0000 7fe7fe200640 1 -- 172.21.15.123:0/2026891479 wait complete. 2024-04-25T13:42:14.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7f977a800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f977c168700 0x7f977c209950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:53568/0 (socket says 172.21.15.123:53568) 2024-04-25T13:42:14.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7f977a800640 1 -- 172.21.15.123:0/2201120689 learned_addr learned my addr 172.21.15.123:0/2201120689 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:14.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.438+0000 7f9779400640 1 --2- 172.21.15.123:0/2201120689 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f977c167db0 0x7f977c209410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7fe7fe200640 1 Processor -- start 2024-04-25T13:42:14.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7f9779e00640 1 --2- 172.21.15.123:0/2201120689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f977c06f5c0 0x7f977c15aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7fe7fe200640 1 -- start start 2024-04-25T13:42:14.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7f977a800640 1 -- 172.21.15.123:0/2201120689 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f977c167db0 msgr2=0x7f977c209410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7f977a800640 1 --2- 172.21.15.123:0/2201120689 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f977c167db0 0x7f977c209410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7f977a800640 1 -- 172.21.15.123:0/2201120689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f977c06f5c0 msgr2=0x7f977c15aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7f977a800640 1 --2- 172.21.15.123:0/2201120689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f977c06f5c0 0x7f977c15aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7f977a800640 1 -- 172.21.15.123:0/2201120689 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f977c15bb10 con 0x7f977c168700 2024-04-25T13:42:14.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7f9779e00640 1 --2- 172.21.15.123:0/2201120689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f977c06f5c0 0x7f977c15aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:14.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7f977a800640 1 --2- 172.21.15.123:0/2201120689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f977c168700 0x7f977c209950 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f976c00e7f0 tx=0x7f976c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7f18c7e00640 1 -- 172.21.15.123:0/769419971 reap_dead start 2024-04-25T13:42:14.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7ff3c7400640 1 --2- 172.21.15.123:0/1319138254 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff3a806f400 0x7ff3a8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7f9772000640 1 -- 172.21.15.123:0/2201120689 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976c017070 con 0x7f977c168700 2024-04-25T13:42:14.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7f9772000640 1 -- 172.21.15.123:0/2201120689 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f976c00c730 con 0x7f977c168700 2024-04-25T13:42:14.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7f9772000640 1 -- 172.21.15.123:0/2201120689 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976c00cb00 con 0x7f977c168700 2024-04-25T13:42:14.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7ff3c7400640 1 --2- 172.21.15.123:0/1319138254 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff3a806f400 0x7ff3a8071910 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff3b80018b0 tx=0x7ff3b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7f9781200640 1 -- 172.21.15.123:0/2201120689 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f977c15b550 con 0x7f977c168700 2024-04-25T13:42:14.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7f9781200640 1 -- 172.21.15.123:0/2201120689 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f977c0b4810 con 0x7f977c168700 2024-04-25T13:42:14.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7fe7fe200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f0038310 0x7fe7f0039ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7fe7fe200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7f0053bb0 0x7fe7f00d8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7fe7fe200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7f0053fc0 0x7fe7f004e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7fe7fe200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f0006970 con 0x7fe7f0038310 2024-04-25T13:42:14.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7fe7fe200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f0006690 con 0x7fe7f0053bb0 2024-04-25T13:42:14.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7fe7fe200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe7f00543d0 con 0x7fe7f0053fc0 2024-04-25T13:42:14.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7fe7f7e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7f0053bb0 0x7fe7f00d8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7fe7fd800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7f0053fc0 0x7fe7f004e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7fe7fd800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7f0053fc0 0x7fe7f004e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:37814/0 (socket says 172.21.15.123:37814) 2024-04-25T13:42:14.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7fe7f7e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7f0053bb0 0x7fe7f00d8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:53596/0 (socket says 172.21.15.123:53596) 2024-04-25T13:42:14.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.442+0000 7fe7fd800640 1 -- 172.21.15.123:0/3291988890 learned_addr learned my addr 172.21.15.123:0/3291988890 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:14.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.446+0000 7fe7fd800640 1 -- 172.21.15.123:0/3291988890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7f0053bb0 msgr2=0x7fe7f00d8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.446+0000 7fe7fd800640 1 --2- 172.21.15.123:0/3291988890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7f0053bb0 0x7fe7f00d8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.446+0000 7fe7fd800640 1 -- 172.21.15.123:0/3291988890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f0038310 msgr2=0x7fe7f0039ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.446+0000 7fe7fd800640 1 --2- 172.21.15.123:0/3291988890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f0038310 0x7fe7f0039ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.446+0000 7fe7fd800640 1 -- 172.21.15.123:0/3291988890 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f004cc20 con 0x7fe7f0053fc0 2024-04-25T13:42:14.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.446+0000 7f9781200640 1 -- 172.21.15.123:0/2201120689 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f977c050750 con 0x7f977c168700 2024-04-25T13:42:14.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.446+0000 7ff3bf400640 1 -- 172.21.15.123:0/1319138254 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff3c814ca60 con 0x7ff3c80cd560 2024-04-25T13:42:14.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.446+0000 7f209cc00640 1 --2- 172.21.15.123:0/955213349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2080003cb0 0x7f2080004100 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f208c00c0e0 tx=0x7f208c01cb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=657671bdf072cb3e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.446+0000 7f2097400640 1 -- 172.21.15.123:0/955213349 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c007c30 con 0x7f2080003cb0 2024-04-25T13:42:14.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.446+0000 7f2097400640 1 -- 172.21.15.123:0/955213349 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f208c0a9070 con 0x7f2080003cb0 2024-04-25T13:42:14.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.446+0000 7f2097400640 1 -- 172.21.15.123:0/955213349 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c005dc0 con 0x7f2080003cb0 2024-04-25T13:42:14.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.446+0000 7f209f600640 1 -- 172.21.15.123:0/955213349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2080003cb0 msgr2=0x7f2080004100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.446+0000 7f209f600640 1 --2- 172.21.15.123:0/955213349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2080003cb0 0x7f2080004100 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f208c00c0e0 tx=0x7f208c01cb80 comp rx=0 tx=0).stop 2024-04-25T13:42:14.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.446+0000 7f209d600640 1 -- 172.21.15.123:0/955213349 reap_dead start 2024-04-25T13:42:14.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.446+0000 7f209f600640 1 -- 172.21.15.123:0/955213349 shutdown_connections 2024-04-25T13:42:14.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.446+0000 7f209f600640 1 -- 172.21.15.123:0/955213349 >> 172.21.15.123:0/955213349 conn(0x7f209806e120 msgr2=0x7f20980b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:14.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.446+0000 7fe7fd800640 1 --2- 172.21.15.123:0/3291988890 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7f0053fc0 0x7fe7f004e3a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe7f80660c0 tx=0x7fe7f806da50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.446+0000 7fe7f4c00640 1 -- 172.21.15.123:0/3291988890 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f809a070 con 0x7fe7f0053fc0 2024-04-25T13:42:14.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.446+0000 7fe7f4c00640 1 -- 172.21.15.123:0/3291988890 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7f80745d0 con 0x7fe7f0053fc0 2024-04-25T13:42:14.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.446+0000 7f18c6a00640 1 --2- 172.21.15.123:0/769419971 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f18ac004810 0x7f18ac004c20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f18b4001780 tx=0x7f18b401c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2b07785b42f45b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.446+0000 7f18c6000640 1 -- 172.21.15.123:0/769419971 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b40013a0 con 0x7f18ac004810 2024-04-25T13:42:14.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.446+0000 7f18c6000640 1 -- 172.21.15.123:0/769419971 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b40052f0 con 0x7f18ac004810 2024-04-25T13:42:14.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.446+0000 7f18c6000640 1 -- 172.21.15.123:0/769419971 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b4003840 con 0x7f18ac004810 2024-04-25T13:42:14.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.446+0000 7fe7f4c00640 1 -- 172.21.15.123:0/3291988890 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f80749c0 con 0x7fe7f0053fc0 2024-04-25T13:42:14.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.446+0000 7f9772000640 1 -- 172.21.15.123:0/2201120689 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f976c01a070 con 0x7f977c168700 2024-04-25T13:42:14.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.450+0000 7f18cd200640 1 -- 172.21.15.123:0/769419971 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f18ac004810 msgr2=0x7f18ac004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.450+0000 7f18cd200640 1 --2- 172.21.15.123:0/769419971 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f18ac004810 0x7f18ac004c20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f18b4001780 tx=0x7f18b401c440 comp rx=0 tx=0).stop 2024-04-25T13:42:14.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.450+0000 7f9772000640 1 --2- 172.21.15.123:0/2201120689 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f975c06f4d0 0x7f975c0719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.450+0000 7f9772000640 1 -- 172.21.15.123:0/2201120689 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f976c08efe0 con 0x7f977c168700 2024-04-25T13:42:14.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.446+0000 7f209f600640 1 -- 172.21.15.123:0/955213349 shutdown_connections 2024-04-25T13:42:14.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.446+0000 7f209f600640 1 -- 172.21.15.123:0/955213349 wait complete. 2024-04-25T13:42:14.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.450+0000 7f209f600640 1 Processor -- start 2024-04-25T13:42:14.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.450+0000 7f18cd200640 1 -- 172.21.15.123:0/769419971 shutdown_connections 2024-04-25T13:42:14.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.450+0000 7f18cd200640 1 --2- 172.21.15.123:0/769419971 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f18ac004810 0x7f18ac004c20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.450+0000 7f18cd200640 1 -- 172.21.15.123:0/769419971 >> 172.21.15.123:0/769419971 conn(0x7f18c806c840 msgr2=0x7f18c806cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:14.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.450+0000 7f209f600640 1 -- start start 2024-04-25T13:42:14.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.450+0000 7f18cd200640 1 -- 172.21.15.123:0/769419971 shutdown_connections 2024-04-25T13:42:14.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.450+0000 7f18cd200640 1 -- 172.21.15.123:0/769419971 wait complete. 2024-04-25T13:42:14.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.450+0000 7fe7fe200640 1 -- 172.21.15.123:0/3291988890 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7f00dff50 con 0x7fe7f0053fc0 2024-04-25T13:42:14.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.450+0000 7fe7fe200640 1 -- 172.21.15.123:0/3291988890 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7f00d8f80 con 0x7fe7f0053fc0 2024-04-25T13:42:14.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.450+0000 7fe7ea000640 1 -- 172.21.15.123:0/3291988890 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7f004c990 con 0x7fe7f0053fc0 2024-04-25T13:42:14.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.454+0000 7f9779e00640 1 --2- 172.21.15.123:0/2201120689 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f975c06f4d0 0x7f975c0719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.454+0000 7f9779e00640 1 --2- 172.21.15.123:0/2201120689 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f975c06f4d0 0x7f975c0719e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9774007440 tx=0x7f977400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.454+0000 7f9772000640 1 -- 172.21.15.123:0/2201120689 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f976c05b860 con 0x7f977c168700 2024-04-25T13:42:14.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.454+0000 7f18cd200640 1 Processor -- start 2024-04-25T13:42:14.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.454+0000 7f18cd200640 1 -- start start 2024-04-25T13:42:14.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.454+0000 7fe7f4c00640 1 -- 172.21.15.123:0/3291988890 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe7f8074b60 con 0x7fe7f0053fc0 2024-04-25T13:42:14.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.458+0000 7fe7f4c00640 1 --2- 172.21.15.123:0/3291988890 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe7d806f450 0x7fe7d8071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.458+0000 7f209f600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2080003cb0 0x7f20980b7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.458+0000 7f209f600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20980b5390 0x7f2098203db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.458+0000 7f209f600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f209815e070 0x7f209815cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.458+0000 7f209f600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f20981656c0 con 0x7f209815e070 2024-04-25T13:42:14.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.458+0000 7f209f600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f20981653e0 con 0x7f2080003cb0 2024-04-25T13:42:14.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.458+0000 7f209f600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2098162250 con 0x7f20980b5390 2024-04-25T13:42:14.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.458+0000 7f2097e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20980b5390 0x7f2098203db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.458+0000 7f209cc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2080003cb0 0x7f20980b7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.458+0000 7f209cc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2080003cb0 0x7f20980b7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:53606/0 (socket says 172.21.15.123:53606) 2024-04-25T13:42:14.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.458+0000 7f209cc00640 1 -- 172.21.15.123:0/1723376647 learned_addr learned my addr 172.21.15.123:0/1723376647 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:14.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.458+0000 7f209d600640 1 --2- 172.21.15.123:0/1723376647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f209815e070 0x7f209815cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.458+0000 7f2097e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20980b5390 0x7f2098203db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:37830/0 (socket says 172.21.15.123:37830) 2024-04-25T13:42:14.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.458+0000 7f209cc00640 1 -- 172.21.15.123:0/1723376647 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20980b5390 msgr2=0x7f2098203db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.458+0000 7f209cc00640 1 --2- 172.21.15.123:0/1723376647 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20980b5390 0x7f2098203db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.458+0000 7f209cc00640 1 -- 172.21.15.123:0/1723376647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f209815e070 msgr2=0x7f209815cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.458+0000 7f209cc00640 1 --2- 172.21.15.123:0/1723376647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f209815e070 0x7f209815cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.458+0000 7f209cc00640 1 -- 172.21.15.123:0/1723376647 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20982042f0 con 0x7f2080003cb0 2024-04-25T13:42:14.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.458+0000 7f209cc00640 1 --2- 172.21.15.123:0/1723376647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2080003cb0 0x7f20980b7df0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f208c01c9b0 tx=0x7f2080005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.458+0000 7fe7fce00640 1 --2- 172.21.15.123:0/3291988890 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe7d806f450 0x7fe7d8071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.458+0000 7f2097e00640 1 --2- 172.21.15.123:0/1723376647 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20980b5390 0x7f2098203db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:14.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.458+0000 7f2094c00640 1 -- 172.21.15.123:0/1723376647 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c007c30 con 0x7f2080003cb0 2024-04-25T13:42:14.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.458+0000 7f2094c00640 1 -- 172.21.15.123:0/1723376647 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f208c000ee0 con 0x7f2080003cb0 2024-04-25T13:42:14.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.458+0000 7f2094c00640 1 -- 172.21.15.123:0/1723376647 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c0049f0 con 0x7f2080003cb0 2024-04-25T13:42:14.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.458+0000 7f209f600640 1 -- 172.21.15.123:0/1723376647 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20980b5970 con 0x7f2080003cb0 2024-04-25T13:42:14.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.462+0000 7fe7f4c00640 1 -- 172.21.15.123:0/3291988890 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe7f80d4bd0 con 0x7fe7f0053fc0 2024-04-25T13:42:14.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.462+0000 7fe7f4c00640 1 -- 172.21.15.123:0/3291988890 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe7f8092070 con 0x7fe7f0053fc0 2024-04-25T13:42:14.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.458+0000 7f209f600640 1 -- 172.21.15.123:0/1723376647 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20980b7610 con 0x7f2080003cb0 2024-04-25T13:42:14.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.462+0000 7fe7fce00640 1 --2- 172.21.15.123:0/3291988890 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe7d806f450 0x7fe7d8071960 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe7e40ad000 tx=0x7fe7e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.462+0000 7f2086000640 1 -- 172.21.15.123:0/1723376647 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2098050750 con 0x7f2080003cb0 2024-04-25T13:42:14.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.462+0000 7f18cd200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18ac004810 0x7f18c80d06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.462+0000 7f2094c00640 1 -- 172.21.15.123:0/1723376647 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f208c004b90 con 0x7f2080003cb0 2024-04-25T13:42:14.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.466+0000 7f18cd200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18c81523e0 0x7f18c815b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.466+0000 7f18cd200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f18c815be30 0x7f18c80cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.466+0000 7f18cd200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f18c8168ce0 con 0x7f18ac004810 2024-04-25T13:42:14.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.466+0000 7f18cd200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f18c8168b60 con 0x7f18c81523e0 2024-04-25T13:42:14.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.466+0000 7f18cd200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f18c815e720 con 0x7f18c815be30 2024-04-25T13:42:14.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.466+0000 7f18c7400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18ac004810 0x7f18c80d06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.466+0000 7f18c7400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18ac004810 0x7f18c80d06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37496/0 (socket says 172.21.15.123:37496) 2024-04-25T13:42:14.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.466+0000 7f18c7400640 1 -- 172.21.15.123:0/719713683 learned_addr learned my addr 172.21.15.123:0/719713683 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:14.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.466+0000 7f18c6a00640 1 --2- 172.21.15.123:0/719713683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18c81523e0 0x7f18c815b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.466+0000 7f18c7400640 1 -- 172.21.15.123:0/719713683 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f18c815be30 msgr2=0x7f18c80cecb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T13:42:14.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.466+0000 7f18c7400640 1 --2- 172.21.15.123:0/719713683 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f18c815be30 0x7f18c80cecb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.466+0000 7f18c7400640 1 -- 172.21.15.123:0/719713683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18c81523e0 msgr2=0x7f18c815b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.466+0000 7f2094c00640 1 --2- 172.21.15.123:0/1723376647 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f207c06f450 0x7f207c071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.466+0000 7f2094c00640 1 -- 172.21.15.123:0/1723376647 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f208c128bb0 con 0x7f2080003cb0 2024-04-25T13:42:14.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.466+0000 7f2097e00640 1 --2- 172.21.15.123:0/1723376647 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f207c06f450 0x7f207c071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.466+0000 7f18c7400640 1 --2- 172.21.15.123:0/719713683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18c81523e0 0x7f18c815b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.466+0000 7f18c7400640 1 -- 172.21.15.123:0/719713683 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c815c240 con 0x7f18ac004810 2024-04-25T13:42:14.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.466+0000 7f18c7400640 1 --2- 172.21.15.123:0/719713683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18ac004810 0x7f18c80d06b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f18b800c870 tx=0x7f18b800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.466+0000 7f18bf400640 1 -- 172.21.15.123:0/719713683 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b8018070 con 0x7f18ac004810 2024-04-25T13:42:14.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.466+0000 7f18bf400640 1 -- 172.21.15.123:0/719713683 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b80074e0 con 0x7f18ac004810 2024-04-25T13:42:14.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.466+0000 7f18bf400640 1 -- 172.21.15.123:0/719713683 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b800ce60 con 0x7f18ac004810 2024-04-25T13:42:14.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.470+0000 7f18cd200640 1 -- 172.21.15.123:0/719713683 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c8158bc0 con 0x7f18ac004810 2024-04-25T13:42:14.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.470+0000 7f18cd200640 1 -- 172.21.15.123:0/719713683 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c81588e0 con 0x7f18ac004810 2024-04-25T13:42:14.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.470+0000 7f2097e00640 1 --2- 172.21.15.123:0/1723376647 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f207c06f450 0x7f207c071960 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f20980b4840 tx=0x7f2088008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.470+0000 7f18cd200640 1 -- 172.21.15.123:0/719713683 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18a00052a0 con 0x7f18ac004810 2024-04-25T13:42:14.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.470+0000 7f2094c00640 1 -- 172.21.15.123:0/1723376647 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f20982042f0 con 0x7f2080003cb0 2024-04-25T13:42:14.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.474+0000 7f18bf400640 1 -- 172.21.15.123:0/719713683 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f18b801b070 con 0x7f18ac004810 2024-04-25T13:42:14.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.474+0000 7f18bf400640 1 --2- 172.21.15.123:0/719713683 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f18a806f500 0x7f18a8071a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.474+0000 7f18bf400640 1 -- 172.21.15.123:0/719713683 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f18b808e9a0 con 0x7f18ac004810 2024-04-25T13:42:14.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.474+0000 7f18c6a00640 1 --2- 172.21.15.123:0/719713683 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f18a806f500 0x7f18a8071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.478+0000 7f18c6a00640 1 --2- 172.21.15.123:0/719713683 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f18a806f500 0x7f18a8071a10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f18b4001750 tx=0x7f18b40011a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.486+0000 7fe87f200640 1 Processor -- start 2024-04-25T13:42:14.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.486+0000 7f18bf400640 1 -- 172.21.15.123:0/719713683 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f18c815c240 con 0x7f18ac004810 2024-04-25T13:42:14.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.486+0000 7fe87f200640 1 -- start start 2024-04-25T13:42:14.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.486+0000 7fe87f200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe87806dc50 0x7fe87809ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.490+0000 7fe877e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe87806dc50 0x7fe87809ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.490+0000 7fe87f200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8780c6610 0x7fe8780c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.490+0000 7fe87f200640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8780c6f60 con 0x7fe878167e40 2024-04-25T13:42:14.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.490+0000 7fe87f200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe87809bf40 con 0x7fe87806dc50 2024-04-25T13:42:14.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.490+0000 7fe87f200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe8780b66c0 con 0x7fe8780c6610 2024-04-25T13:42:14.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.490+0000 7fe87d200640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe878167e40 0x7fe878168250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.123:51552/0 (socket says 172.21.15.123:51552) 2024-04-25T13:42:14.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.490+0000 7fe87d200640 1 -- 172.21.15.123:0/3010404742 learned_addr learned my addr 172.21.15.123:0/3010404742 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:14.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.490+0000 7fe877400640 1 --2- 172.21.15.123:0/3010404742 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8780c6610 0x7fe8780c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.490+0000 7fe876a00640 1 -- 172.21.15.123:0/3010404742 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2082822185 0 0) 0x7fe8700014a0 con 0x7fe878167e40 2024-04-25T13:42:14.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.490+0000 7fe876a00640 1 -- 172.21.15.123:0/3010404742 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe85c003530 con 0x7fe878167e40 2024-04-25T13:42:14.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.490+0000 7fe877400640 1 -- 172.21.15.123:0/3010404742 >> v2:172.21.15.123:3300/0 conn(0x7fe87806dc50 msgr2=0x7fe87809ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:14.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.490+0000 7fe877400640 1 --2- 172.21.15.123:0/3010404742 >> v2:172.21.15.123:3300/0 conn(0x7fe87806dc50 0x7fe87809ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.490+0000 7fe877400640 1 -- 172.21.15.123:0/3010404742 >> v1:172.21.15.130:6789/0 conn(0x7fe878167e40 legacy=0x7fe878168250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.490+0000 7fe877400640 1 -- 172.21.15.123:0/3010404742 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87806e060 con 0x7fe8780c6610 2024-04-25T13:42:14.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.494+0000 7fe877400640 1 --2- 172.21.15.123:0/3010404742 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8780c6610 0x7fe8780c6a20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe8640097c0 tx=0x7fe86401c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd338db0b26ba97e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.494+0000 7ff26a000640 1 Processor -- start 2024-04-25T13:42:14.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.498+0000 7ff26a000640 1 -- start start 2024-04-25T13:42:14.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.498+0000 7fe876a00640 1 -- 172.21.15.123:0/3010404742 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8640b0070 con 0x7fe8780c6610 2024-04-25T13:42:14.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.498+0000 7fe876a00640 1 -- 172.21.15.123:0/3010404742 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8640ab600 con 0x7fe8780c6610 2024-04-25T13:42:14.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.498+0000 7fe876a00640 1 -- 172.21.15.123:0/3010404742 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8640ab9d0 con 0x7fe8780c6610 2024-04-25T13:42:14.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7fe87f200640 1 -- 172.21.15.123:0/3010404742 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8780c6610 msgr2=0x7fe8780c6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7fe87f200640 1 --2- 172.21.15.123:0/3010404742 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8780c6610 0x7fe8780c6a20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe8640097c0 tx=0x7fe86401c460 comp rx=0 tx=0).stop 2024-04-25T13:42:14.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7fe87f200640 1 -- 172.21.15.123:0/3010404742 shutdown_connections 2024-04-25T13:42:14.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7fe87f200640 1 --2- 172.21.15.123:0/3010404742 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8780c6610 0x7fe8780c6a20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7fe87f200640 1 --2- 172.21.15.123:0/3010404742 >> v2:172.21.15.123:3300/0 conn(0x7fe87806dc50 0x7fe87809ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7fe87f200640 1 -- 172.21.15.123:0/3010404742 >> 172.21.15.123:0/3010404742 conn(0x7fe8780b5130 msgr2=0x7fe8780b5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:14.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7fe87f200640 1 -- 172.21.15.123:0/3010404742 shutdown_connections 2024-04-25T13:42:14.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7ff26a000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2640d4e40 0x7ff2640d5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7ff26a000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2640d61a0 con 0x7ff2640d5d90 2024-04-25T13:42:14.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7ff26a000640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2641608d0 con 0x7ff2640d1040 2024-04-25T13:42:14.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7ff26a000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff264161450 con 0x7ff2640d4e40 2024-04-25T13:42:14.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7ff263e00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff2640d5d90 0x7ff264163dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53294/0 (socket says 172.21.15.123:53294) 2024-04-25T13:42:14.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7ff263e00640 1 -- 172.21.15.123:0/708011114 learned_addr learned my addr 172.21.15.123:0/708011114 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:14.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7fe87f200640 1 -- 172.21.15.123:0/3010404742 wait complete. 2024-04-25T13:42:14.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7ff262000640 1 -- 172.21.15.123:0/708011114 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1831785354 0 0) 0x7ff2641608d0 con 0x7ff2640d1040 2024-04-25T13:42:14.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7ff262000640 1 -- 172.21.15.123:0/708011114 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff248003530 con 0x7ff2640d1040 2024-04-25T13:42:14.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7ff262000640 1 -- 172.21.15.123:0/708011114 <== mon.1 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1130264872 0 0) 0x7ff248003530 con 0x7ff2640d1040 2024-04-25T13:42:14.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7ff262000640 1 -- 172.21.15.123:0/708011114 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2640d4e40 msgr2=0x7ff2640d5850 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T13:42:14.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7ff262000640 1 --2- 172.21.15.123:0/708011114 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2640d4e40 0x7ff2640d5850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7ff262000640 1 -- 172.21.15.123:0/708011114 >> v1:172.21.15.123:6789/0 conn(0x7ff2640d5d90 legacy=0x7ff264163dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:14.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7ff262000640 1 -- 172.21.15.123:0/708011114 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff264160bb0 con 0x7ff2640d1040 2024-04-25T13:42:14.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7ff262000640 1 -- 172.21.15.123:0/708011114 <== mon.1 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7ff25c001a00 con 0x7ff2640d1040 2024-04-25T13:42:14.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7ff262000640 1 -- 172.21.15.123:0/708011114 >> v1:172.21.15.130:6789/0 conn(0x7ff2640d1040 legacy=0x7ff2640d42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7ff262000640 1 --2- 172.21.15.123:0/708011114 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff248003aa0 0x7ff248003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7ff262000640 1 --2- 172.21.15.123:0/708011114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff248004810 0x7ff248004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7ff262000640 1 --2- 172.21.15.123:0/708011114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2480099c0 0x7ff24800bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7ff262000640 1 -- 172.21.15.123:0/708011114 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff264161450 con 0x7ff2480099c0 2024-04-25T13:42:14.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7ff262000640 1 -- 172.21.15.123:0/708011114 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff24800c3d0 con 0x7ff248004810 2024-04-25T13:42:14.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7ff262000640 1 -- 172.21.15.123:0/708011114 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff24800c5d0 con 0x7ff248003aa0 2024-04-25T13:42:14.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7ff263e00640 1 --2- 172.21.15.123:0/708011114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2480099c0 0x7ff24800bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.502+0000 7ff263400640 1 --2- 172.21.15.123:0/708011114 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff248003aa0 0x7ff248003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.506+0000 7ff263400640 1 -- 172.21.15.123:0/708011114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff248004810 msgr2=0x7ff248004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:14.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.506+0000 7ff262a00640 1 --2- 172.21.15.123:0/708011114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff248004810 0x7ff248004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.506+0000 7ff263400640 1 --2- 172.21.15.123:0/708011114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff248004810 0x7ff248004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.506+0000 7ff263400640 1 -- 172.21.15.123:0/708011114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2480099c0 msgr2=0x7ff24800bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:14.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.506+0000 7ff263400640 1 --2- 172.21.15.123:0/708011114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2480099c0 0x7ff24800bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.506+0000 7ff263400640 1 -- 172.21.15.123:0/708011114 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff264160bb0 con 0x7ff248003aa0 2024-04-25T13:42:14.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.506+0000 7fe87f200640 1 Processor -- start 2024-04-25T13:42:14.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.506+0000 7fe87f200640 1 -- start start 2024-04-25T13:42:14.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.510+0000 7fe87f200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe87806dc50 0x7fe878158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.510+0000 7ff262a00640 1 --2- 172.21.15.123:0/708011114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff248004810 0x7ff248004c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:14.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.510+0000 7fe87f200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8780c6610 0x7fe878165ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.510+0000 7fe87f200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe878167e40 0x7fe878160e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.510+0000 7fe87f200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe878171b70 con 0x7fe87806dc50 2024-04-25T13:42:14.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.510+0000 7fe87f200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe8781719f0 con 0x7fe8780c6610 2024-04-25T13:42:14.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.510+0000 7fe87f200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe878171cf0 con 0x7fe878167e40 2024-04-25T13:42:14.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.510+0000 7ff263400640 1 --2- 172.21.15.123:0/708011114 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff248003aa0 0x7ff248003ef0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff25c002240 tx=0x7ff25c01f740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7827dbbaa0f7f88d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.510+0000 7fe877400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8780c6610 0x7fe878165ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.510+0000 7fe877400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8780c6610 0x7fe878165ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:53638/0 (socket says 172.21.15.123:53638) 2024-04-25T13:42:14.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.510+0000 7fe877400640 1 -- 172.21.15.123:0/1465198122 learned_addr learned my addr 172.21.15.123:0/1465198122 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:14.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.510+0000 7ff262000640 1 -- 172.21.15.123:0/708011114 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25c00c100 con 0x7ff248003aa0 2024-04-25T13:42:14.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.510+0000 7ff262000640 1 -- 172.21.15.123:0/708011114 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff25c006d80 con 0x7ff248003aa0 2024-04-25T13:42:14.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.510+0000 7fe87d200640 1 --2- 172.21.15.123:0/1465198122 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe878167e40 0x7fe878160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.510+0000 7fe877e00640 1 --2- 172.21.15.123:0/1465198122 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe87806dc50 0x7fe878158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.510+0000 7ff26a000640 1 -- 172.21.15.123:0/708011114 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff248003aa0 msgr2=0x7ff248003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.510+0000 7ff26a000640 1 --2- 172.21.15.123:0/708011114 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff248003aa0 0x7ff248003ef0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff25c002240 tx=0x7ff25c01f740 comp rx=0 tx=0).stop 2024-04-25T13:42:14.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.510+0000 7ff263e00640 1 -- 172.21.15.123:0/708011114 reap_dead start 2024-04-25T13:42:14.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.510+0000 7ff26a000640 1 -- 172.21.15.123:0/708011114 shutdown_connections 2024-04-25T13:42:14.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.510+0000 7ff26a000640 1 -- 172.21.15.123:0/708011114 >> 172.21.15.123:0/708011114 conn(0x7ff26406d920 msgr2=0x7ff26406dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:14.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.510+0000 7ff26a000640 1 -- 172.21.15.123:0/708011114 shutdown_connections 2024-04-25T13:42:14.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.510+0000 7ff26a000640 1 -- 172.21.15.123:0/708011114 wait complete. 2024-04-25T13:42:14.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.514+0000 7fe87d200640 1 -- 172.21.15.123:0/1465198122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8780c6610 msgr2=0x7fe878165ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.514+0000 7fe87d200640 1 --2- 172.21.15.123:0/1465198122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8780c6610 0x7fe878165ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.514+0000 7fe87d200640 1 -- 172.21.15.123:0/1465198122 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe87806dc50 msgr2=0x7fe878158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.514+0000 7fe87d200640 1 --2- 172.21.15.123:0/1465198122 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe87806dc50 0x7fe878158cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.514+0000 7fe87d200640 1 -- 172.21.15.123:0/1465198122 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8781674d0 con 0x7fe878167e40 2024-04-25T13:42:14.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.514+0000 7fe877400640 1 --2- 172.21.15.123:0/1465198122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8780c6610 0x7fe878165ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:14.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.514+0000 7fe877e00640 1 --2- 172.21.15.123:0/1465198122 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe87806dc50 0x7fe878158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:14.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.514+0000 7fe87d200640 1 --2- 172.21.15.123:0/1465198122 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe878167e40 0x7fe878160e30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe87000c750 tx=0x7fe87000cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.514+0000 7fe86fe00640 1 -- 172.21.15.123:0/1465198122 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe870018070 con 0x7fe878167e40 2024-04-25T13:42:14.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.514+0000 7fe86fe00640 1 -- 172.21.15.123:0/1465198122 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe870004d80 con 0x7fe878167e40 2024-04-25T13:42:14.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.514+0000 7fe86fe00640 1 -- 172.21.15.123:0/1465198122 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87000a820 con 0x7fe878167e40 2024-04-25T13:42:14.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.514+0000 7fe87f200640 1 -- 172.21.15.123:0/1465198122 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8781666a0 con 0x7fe878167e40 2024-04-25T13:42:14.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.514+0000 7fe87f200640 1 -- 172.21.15.123:0/1465198122 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe878166c60 con 0x7fe878167e40 2024-04-25T13:42:14.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.514+0000 7ff26a000640 1 Processor -- start 2024-04-25T13:42:14.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.518+0000 7ff26a000640 1 -- start start 2024-04-25T13:42:14.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.518+0000 7fe86fe00640 1 -- 172.21.15.123:0/1465198122 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe87001b070 con 0x7fe878167e40 2024-04-25T13:42:14.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.518+0000 7ff26a000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2641571d0 0x7ff2641485b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.518+0000 7ff26a000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2640c80b0 0x7ff26415cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.518+0000 7fe87f200640 1 -- 172.21.15.123:0/1465198122 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8500052a0 con 0x7fe878167e40 2024-04-25T13:42:14.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.522+0000 7fe86fe00640 1 --2- 172.21.15.123:0/1465198122 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe85806f4d0 0x7fe8580719e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.522+0000 7ff263400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2641571d0 0x7ff2641485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.524 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.522+0000 7ff263400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2641571d0 0x7ff2641485b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:37890/0 (socket says 172.21.15.123:37890) 2024-04-25T13:42:14.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.522+0000 7fe86fe00640 1 -- 172.21.15.123:0/1465198122 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe87008e7c0 con 0x7fe878167e40 2024-04-25T13:42:14.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.522+0000 7ff26a000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2640c84c0 0x7ff26415d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.522+0000 7ff263400640 1 -- 172.21.15.123:0/2959237767 learned_addr learned my addr 172.21.15.123:0/2959237767 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:14.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.522+0000 7ff26a000640 1 -- 172.21.15.123:0/2959237767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff2640d1450 con 0x7ff2640c80b0 2024-04-25T13:42:14.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.522+0000 7ff26a000640 1 -- 172.21.15.123:0/2959237767 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff264161170 con 0x7ff2640c84c0 2024-04-25T13:42:14.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.522+0000 7ff26a000640 1 -- 172.21.15.123:0/2959237767 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff2640d5250 con 0x7ff2641571d0 2024-04-25T13:42:14.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.522+0000 7ff262a00640 1 --2- 172.21.15.123:0/2959237767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2640c80b0 0x7ff26415cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.522+0000 7ff263e00640 1 --2- 172.21.15.123:0/2959237767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2640c84c0 0x7ff26415d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.522+0000 7fe877e00640 1 --2- 172.21.15.123:0/1465198122 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe85806f4d0 0x7fe8580719e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.522+0000 7ff262a00640 1 -- 172.21.15.123:0/2959237767 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2641571d0 msgr2=0x7ff2641485b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.522+0000 7ff262a00640 1 --2- 172.21.15.123:0/2959237767 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2641571d0 0x7ff2641485b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.522+0000 7ff262a00640 1 -- 172.21.15.123:0/2959237767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2640c84c0 msgr2=0x7ff26415d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.522+0000 7ff262a00640 1 --2- 172.21.15.123:0/2959237767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2640c84c0 0x7ff26415d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.522+0000 7ff262a00640 1 -- 172.21.15.123:0/2959237767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff264148cb0 con 0x7ff2640c80b0 2024-04-25T13:42:14.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.522+0000 7ff263e00640 1 --2- 172.21.15.123:0/2959237767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2640c84c0 0x7ff26415d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:14.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.522+0000 7ff262a00640 1 --2- 172.21.15.123:0/2959237767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2640c80b0 0x7ff26415cda0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff2640b4eb0 tx=0x7ff25400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.522+0000 7ff25b400640 1 -- 172.21.15.123:0/2959237767 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff254015070 con 0x7ff2640c80b0 2024-04-25T13:42:14.528 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.522+0000 7ff25b400640 1 -- 172.21.15.123:0/2959237767 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff254011840 con 0x7ff2640c80b0 2024-04-25T13:42:14.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.526+0000 7fe877e00640 1 --2- 172.21.15.123:0/1465198122 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe85806f4d0 0x7fe8580719e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe878167da0 tx=0x7fe868008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.522+0000 7ff25b400640 1 -- 172.21.15.123:0/2959237767 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff254011c30 con 0x7ff2640c80b0 2024-04-25T13:42:14.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.522+0000 7ff26a000640 1 -- 172.21.15.123:0/2959237767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff264148f90 con 0x7ff2640c80b0 2024-04-25T13:42:14.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.522+0000 7ff26a000640 1 -- 172.21.15.123:0/2959237767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff264149550 con 0x7ff2640c80b0 2024-04-25T13:42:14.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.526+0000 7ff26a000640 1 -- 172.21.15.123:0/2959237767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff264050750 con 0x7ff2640c80b0 2024-04-25T13:42:14.530 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.526+0000 7ff25b400640 1 -- 172.21.15.123:0/2959237767 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff254018070 con 0x7ff2640c80b0 2024-04-25T13:42:14.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.530+0000 7ff25b400640 1 --2- 172.21.15.123:0/2959237767 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff24406f400 0x7ff244071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:14.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.530+0000 7ff25b400640 1 -- 172.21.15.123:0/2959237767 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff25408f320 con 0x7ff2640c80b0 2024-04-25T13:42:14.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.530+0000 7ff263400640 1 --2- 172.21.15.123:0/2959237767 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff24406f400 0x7ff244071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:14.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.530+0000 7fe86fe00640 1 -- 172.21.15.123:0/1465198122 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe8781674d0 con 0x7fe878167e40 2024-04-25T13:42:14.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.530+0000 7ff263400640 1 --2- 172.21.15.123:0/2959237767 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff24406f400 0x7ff244071910 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff2641f9ab0 tx=0x7ff25c0b3040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:14.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.534+0000 7ff25b400640 1 -- 172.21.15.123:0/2959237767 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff25405bc30 con 0x7ff2640c80b0 2024-04-25T13:42:14.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.742+0000 7fdf3fe00640 1 -- 172.21.15.123:0/616593119 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fdf5406f4a0 con 0x7fdf541f4ea0 2024-04-25T13:42:14.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.742+0000 7fdf4aa00640 1 -- 172.21.15.123:0/616593119 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdf4c0fde20 con 0x7fdf541f4ea0 2024-04-25T13:42:14.750 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2024-04-25T13:42:14.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.746+0000 7fdf3fe00640 1 -- 172.21.15.123:0/616593119 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdf3406f400 msgr2=0x7fdf34071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.746+0000 7fdf3fe00640 1 --2- 172.21.15.123:0/616593119 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdf3406f400 0x7fdf34071910 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdf44006aa0 tx=0x7fdf44008040 comp rx=0 tx=0).stop 2024-04-25T13:42:14.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.746+0000 7fdf3fe00640 1 -- 172.21.15.123:0/616593119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf541f4ea0 msgr2=0x7fdf541f52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.746+0000 7fdf3fe00640 1 --2- 172.21.15.123:0/616593119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf541f4ea0 0x7fdf541f52b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c0ab000 tx=0x7fdf38004830 comp rx=0 tx=0).stop 2024-04-25T13:42:14.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.746+0000 7fdf3fe00640 1 -- 172.21.15.123:0/616593119 shutdown_connections 2024-04-25T13:42:14.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.746+0000 7fdf3fe00640 1 --2- 172.21.15.123:0/616593119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdf541f4ea0 0x7fdf541f52b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.746+0000 7fdf3fe00640 1 --2- 172.21.15.123:0/616593119 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdf3406f400 0x7fdf34071910 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.746+0000 7fdf3fe00640 1 --2- 172.21.15.123:0/616593119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdf5415a650 0x7fdf5415aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.746+0000 7fdf3fe00640 1 --2- 172.21.15.123:0/616593119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdf38004100 0x7fdf540aa770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.746+0000 7fdf3fe00640 1 -- 172.21.15.123:0/616593119 >> 172.21.15.123:0/616593119 conn(0x7fdf5406c670 msgr2=0x7fdf540b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:14.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.746+0000 7fdf3fe00640 1 -- 172.21.15.123:0/616593119 shutdown_connections 2024-04-25T13:42:14.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.750+0000 7fdf3fe00640 1 -- 172.21.15.123:0/616593119 wait complete. 2024-04-25T13:42:14.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2024-04-25T13:42:14.783 DEBUG:teuthology.parallel:result is None 2024-04-25T13:42:14.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.782+0000 7ff3ce200640 1 -- 172.21.15.123:0/1319138254 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff3a0005860 con 0x7ff3c80cd560 2024-04-25T13:42:14.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.782+0000 7ff3bf400640 1 -- 172.21.15.123:0/1319138254 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff3b40160f0 con 0x7ff3c80cd560 2024-04-25T13:42:14.788 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2024-04-25T13:42:14.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.786+0000 7ff3ce200640 1 -- 172.21.15.123:0/1319138254 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff3a806f400 msgr2=0x7ff3a8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.786+0000 7ff3ce200640 1 --2- 172.21.15.123:0/1319138254 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff3a806f400 0x7ff3a8071910 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff3b80018b0 tx=0x7ff3b8009040 comp rx=0 tx=0).stop 2024-04-25T13:42:14.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.786+0000 7ff3ce200640 1 -- 172.21.15.123:0/1319138254 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3c80cd560 msgr2=0x7ff3c814c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.786+0000 7ff3ce200640 1 --2- 172.21.15.123:0/1319138254 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3c80cd560 0x7ff3c814c520 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff3b40ab000 tx=0x7ff3b4018f50 comp rx=0 tx=0).stop 2024-04-25T13:42:14.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.786+0000 7ff3ce200640 1 -- 172.21.15.123:0/1319138254 shutdown_connections 2024-04-25T13:42:14.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.786+0000 7ff3ce200640 1 --2- 172.21.15.123:0/1319138254 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff3a806f400 0x7ff3a8071910 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.786+0000 7ff3ce200640 1 --2- 172.21.15.123:0/1319138254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3c80d1f50 0x7ff3c81613d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.786+0000 7ff3ce200640 1 --2- 172.21.15.123:0/1319138254 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3c80cd560 0x7ff3c814c520 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.786+0000 7ff3ce200640 1 --2- 172.21.15.123:0/1319138254 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3c80ccc10 0x7ff3c81492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.786+0000 7ff3ce200640 1 -- 172.21.15.123:0/1319138254 >> 172.21.15.123:0/1319138254 conn(0x7ff3c80d25c0 msgr2=0x7ff3c8071160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:14.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.790+0000 7ff3ce200640 1 -- 172.21.15.123:0/1319138254 shutdown_connections 2024-04-25T13:42:14.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.790+0000 7ff3ce200640 1 -- 172.21.15.123:0/1319138254 wait complete. 2024-04-25T13:42:14.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.790+0000 7f9781200640 1 -- 172.21.15.123:0/2201120689 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f977c069030 con 0x7f977c168700 2024-04-25T13:42:14.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.790+0000 7f9772000640 1 -- 172.21.15.123:0/2201120689 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f976c05fb60 con 0x7f977c168700 2024-04-25T13:42:14.795 INFO:teuthology.orchestra.run.smithi123.stdout:55834574854 2024-04-25T13:42:14.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.794+0000 7fe7ea000640 1 -- 172.21.15.123:0/3291988890 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fe7f00059d0 con 0x7fe7f0053fc0 2024-04-25T13:42:14.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.794+0000 7fe7f4c00640 1 -- 172.21.15.123:0/3291988890 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe7f80d85e0 con 0x7fe7f0053fc0 2024-04-25T13:42:14.798 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2024-04-25T13:42:14.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.794+0000 7f9781200640 1 -- 172.21.15.123:0/2201120689 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f975c06f4d0 msgr2=0x7f975c0719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.794+0000 7f9781200640 1 --2- 172.21.15.123:0/2201120689 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f975c06f4d0 0x7f975c0719e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9774007440 tx=0x7f977400b040 comp rx=0 tx=0).stop 2024-04-25T13:42:14.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.794+0000 7f9781200640 1 -- 172.21.15.123:0/2201120689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f977c168700 msgr2=0x7f977c209950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.794+0000 7f9781200640 1 --2- 172.21.15.123:0/2201120689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f977c168700 0x7f977c209950 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f976c00e7f0 tx=0x7f976c00ecb0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.794+0000 7f9781200640 1 -- 172.21.15.123:0/2201120689 shutdown_connections 2024-04-25T13:42:14.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.794+0000 7f9781200640 1 --2- 172.21.15.123:0/2201120689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f977c168700 0x7f977c209950 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.794+0000 7f9781200640 1 --2- 172.21.15.123:0/2201120689 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f975c06f4d0 0x7f975c0719e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.794+0000 7f9781200640 1 --2- 172.21.15.123:0/2201120689 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f977c167db0 0x7f977c209410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.794+0000 7f9781200640 1 --2- 172.21.15.123:0/2201120689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f977c06f5c0 0x7f977c15aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.794+0000 7f9781200640 1 -- 172.21.15.123:0/2201120689 >> 172.21.15.123:0/2201120689 conn(0x7f977c0b37d0 msgr2=0x7f977c0b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:14.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.794+0000 7f9781200640 1 -- 172.21.15.123:0/2201120689 shutdown_connections 2024-04-25T13:42:14.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.794+0000 7f9781200640 1 -- 172.21.15.123:0/2201120689 wait complete. 2024-04-25T13:42:14.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.798+0000 7fe7ea000640 1 -- 172.21.15.123:0/3291988890 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe7d806f450 msgr2=0x7fe7d8071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.798+0000 7fe7ea000640 1 --2- 172.21.15.123:0/3291988890 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe7d806f450 0x7fe7d8071960 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe7e40ad000 tx=0x7fe7e4008040 comp rx=0 tx=0).stop 2024-04-25T13:42:14.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.798+0000 7fe7ea000640 1 -- 172.21.15.123:0/3291988890 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7f0053fc0 msgr2=0x7fe7f004e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.798+0000 7fe7ea000640 1 --2- 172.21.15.123:0/3291988890 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7f0053fc0 0x7fe7f004e3a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe7f80660c0 tx=0x7fe7f806da50 comp rx=0 tx=0).stop 2024-04-25T13:42:14.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.798+0000 7fe7ea000640 1 -- 172.21.15.123:0/3291988890 shutdown_connections 2024-04-25T13:42:14.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.798+0000 7fe7ea000640 1 --2- 172.21.15.123:0/3291988890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7f0053bb0 0x7fe7f00d8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.798+0000 7fe7ea000640 1 --2- 172.21.15.123:0/3291988890 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe7d806f450 0x7fe7d8071960 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.798+0000 7fe7ea000640 1 --2- 172.21.15.123:0/3291988890 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7f0053fc0 0x7fe7f004e3a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.798+0000 7fe7ea000640 1 --2- 172.21.15.123:0/3291988890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7f0038310 0x7fe7f0039ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.798+0000 7fe7ea000640 1 -- 172.21.15.123:0/3291988890 >> 172.21.15.123:0/3291988890 conn(0x7fe7f0055150 msgr2=0x7fe7f0036bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:14.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.798+0000 7fe7ea000640 1 -- 172.21.15.123:0/3291988890 shutdown_connections 2024-04-25T13:42:14.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.798+0000 7fe7ea000640 1 -- 172.21.15.123:0/3291988890 wait complete. 2024-04-25T13:42:14.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.810+0000 7f2086000640 1 -- 172.21.15.123:0/1723376647 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f20980d1430 con 0x7f2080003cb0 2024-04-25T13:42:14.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.810+0000 7f2094c00640 1 -- 172.21.15.123:0/1723376647 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f208c016890 con 0x7f2080003cb0 2024-04-25T13:42:14.813 INFO:teuthology.orchestra.run.smithi123.stdout:55834574856 2024-04-25T13:42:14.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.814+0000 7f2086000640 1 -- 172.21.15.123:0/1723376647 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f207c06f450 msgr2=0x7f207c071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.814+0000 7f2086000640 1 --2- 172.21.15.123:0/1723376647 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f207c06f450 0x7f207c071960 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f20980b4840 tx=0x7f2088008040 comp rx=0 tx=0).stop 2024-04-25T13:42:14.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.814+0000 7f2086000640 1 -- 172.21.15.123:0/1723376647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2080003cb0 msgr2=0x7f20980b7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.814+0000 7f2086000640 1 --2- 172.21.15.123:0/1723376647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2080003cb0 0x7f20980b7df0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f208c01c9b0 tx=0x7f2080005840 comp rx=0 tx=0).stop 2024-04-25T13:42:14.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.814+0000 7f2086000640 1 -- 172.21.15.123:0/1723376647 shutdown_connections 2024-04-25T13:42:14.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.814+0000 7f2086000640 1 --2- 172.21.15.123:0/1723376647 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f207c06f450 0x7f207c071960 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.814+0000 7f2086000640 1 --2- 172.21.15.123:0/1723376647 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f209815e070 0x7f209815cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.814+0000 7f2086000640 1 --2- 172.21.15.123:0/1723376647 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20980b5390 0x7f2098203db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.814+0000 7f2086000640 1 --2- 172.21.15.123:0/1723376647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2080003cb0 0x7f20980b7df0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.814+0000 7f2086000640 1 -- 172.21.15.123:0/1723376647 >> 172.21.15.123:0/1723376647 conn(0x7f209806e120 msgr2=0x7f20980d2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:14.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.814+0000 7f2086000640 1 -- 172.21.15.123:0/1723376647 shutdown_connections 2024-04-25T13:42:14.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.814+0000 7f2086000640 1 -- 172.21.15.123:0/1723376647 wait complete. 2024-04-25T13:42:14.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.822+0000 7f18cd200640 1 -- 172.21.15.123:0/719713683 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f18a0005590 con 0x7f18ac004810 2024-04-25T13:42:14.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.826+0000 7f18bf400640 1 -- 172.21.15.123:0/719713683 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f18b805b900 con 0x7f18ac004810 2024-04-25T13:42:14.827 INFO:teuthology.orchestra.run.smithi123.stdout:55834574853 2024-04-25T13:42:14.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-04-25T13:42:14.828 DEBUG:teuthology.parallel:result is None 2024-04-25T13:42:14.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.826+0000 7f18cd200640 1 -- 172.21.15.123:0/719713683 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f18a806f500 msgr2=0x7f18a8071a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.826+0000 7f18cd200640 1 --2- 172.21.15.123:0/719713683 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f18a806f500 0x7f18a8071a10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f18b4001750 tx=0x7f18b40011a0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.826+0000 7f18cd200640 1 -- 172.21.15.123:0/719713683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18ac004810 msgr2=0x7f18c80d06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.830+0000 7f18cd200640 1 --2- 172.21.15.123:0/719713683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18ac004810 0x7f18c80d06b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f18b800c870 tx=0x7f18b800cd30 comp rx=0 tx=0).stop 2024-04-25T13:42:14.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.830+0000 7f18cd200640 1 -- 172.21.15.123:0/719713683 shutdown_connections 2024-04-25T13:42:14.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.830+0000 7f18cd200640 1 --2- 172.21.15.123:0/719713683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f18c81523e0 0x7f18c815b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.830+0000 7f18cd200640 1 --2- 172.21.15.123:0/719713683 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f18a806f500 0x7f18a8071a10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.830+0000 7f18cd200640 1 --2- 172.21.15.123:0/719713683 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f18c815be30 0x7f18c80cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.830+0000 7f18cd200640 1 --2- 172.21.15.123:0/719713683 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f18ac004810 0x7f18c80d06b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.830+0000 7f18cd200640 1 -- 172.21.15.123:0/719713683 >> 172.21.15.123:0/719713683 conn(0x7f18c806c840 msgr2=0x7f18c806f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:14.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.830+0000 7f18cd200640 1 -- 172.21.15.123:0/719713683 shutdown_connections 2024-04-25T13:42:14.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.830+0000 7f18cd200640 1 -- 172.21.15.123:0/719713683 wait complete. 2024-04-25T13:42:14.835 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2024-04-25T13:42:14.835 DEBUG:teuthology.parallel:result is None 2024-04-25T13:42:14.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2024-04-25T13:42:14.836 DEBUG:teuthology.parallel:result is None 2024-04-25T13:42:14.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.838+0000 7ff26a000640 1 -- 172.21.15.123:0/2959237767 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7ff2640d3d30 con 0x7ff2640c80b0 2024-04-25T13:42:14.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.838+0000 7ff25b400640 1 -- 172.21.15.123:0/2959237767 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff25405ff30 con 0x7ff2640c80b0 2024-04-25T13:42:14.842 INFO:teuthology.orchestra.run.smithi123.stdout:55834574853 2024-04-25T13:42:14.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.842+0000 7ff26a000640 1 -- 172.21.15.123:0/2959237767 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff24406f400 msgr2=0x7ff244071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.842+0000 7ff26a000640 1 --2- 172.21.15.123:0/2959237767 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff24406f400 0x7ff244071910 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff2641f9ab0 tx=0x7ff25c0b3040 comp rx=0 tx=0).stop 2024-04-25T13:42:14.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.842+0000 7ff26a000640 1 -- 172.21.15.123:0/2959237767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2640c80b0 msgr2=0x7ff26415cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.842+0000 7ff26a000640 1 --2- 172.21.15.123:0/2959237767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2640c80b0 0x7ff26415cda0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff2640b4eb0 tx=0x7ff25400c890 comp rx=0 tx=0).stop 2024-04-25T13:42:14.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.842+0000 7ff26a000640 1 -- 172.21.15.123:0/2959237767 shutdown_connections 2024-04-25T13:42:14.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.842+0000 7ff26a000640 1 --2- 172.21.15.123:0/2959237767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2640c84c0 0x7ff26415d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.842+0000 7ff26a000640 1 --2- 172.21.15.123:0/2959237767 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff24406f400 0x7ff244071910 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.842+0000 7ff26a000640 1 --2- 172.21.15.123:0/2959237767 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2640c80b0 0x7ff26415cda0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.842+0000 7ff26a000640 1 --2- 172.21.15.123:0/2959237767 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2641571d0 0x7ff2641485b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.842+0000 7ff26a000640 1 -- 172.21.15.123:0/2959237767 >> 172.21.15.123:0/2959237767 conn(0x7ff26406d920 msgr2=0x7ff2640b9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:14.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.842+0000 7ff26a000640 1 -- 172.21.15.123:0/2959237767 shutdown_connections 2024-04-25T13:42:14.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.842+0000 7ff26a000640 1 -- 172.21.15.123:0/2959237767 wait complete. 2024-04-25T13:42:14.846 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2024-04-25T13:42:14.847 DEBUG:teuthology.parallel:result is None 2024-04-25T13:42:14.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.862+0000 7fe87f200640 1 -- 172.21.15.123:0/1465198122 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fe850005590 con 0x7fe878167e40 2024-04-25T13:42:14.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.862+0000 7fe86fe00640 1 -- 172.21.15.123:0/1465198122 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe8780c6f60 con 0x7fe878167e40 2024-04-25T13:42:14.866 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2024-04-25T13:42:14.866 INFO:teuthology.orchestra.run.smithi123.stdout:55834574855 2024-04-25T13:42:14.866 DEBUG:teuthology.parallel:result is None 2024-04-25T13:42:14.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2024-04-25T13:42:14.867 DEBUG:teuthology.parallel:result is None 2024-04-25T13:42:14.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.862+0000 7fe87f200640 1 -- 172.21.15.123:0/1465198122 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe85806f4d0 msgr2=0x7fe8580719e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.862+0000 7fe87f200640 1 --2- 172.21.15.123:0/1465198122 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe85806f4d0 0x7fe8580719e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe878167da0 tx=0x7fe868008040 comp rx=0 tx=0).stop 2024-04-25T13:42:14.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.862+0000 7fe87f200640 1 -- 172.21.15.123:0/1465198122 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe878167e40 msgr2=0x7fe878160e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:14.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.862+0000 7fe87f200640 1 --2- 172.21.15.123:0/1465198122 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe878167e40 0x7fe878160e30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe87000c750 tx=0x7fe87000cc10 comp rx=0 tx=0).stop 2024-04-25T13:42:14.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.862+0000 7fe87f200640 1 -- 172.21.15.123:0/1465198122 shutdown_connections 2024-04-25T13:42:14.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.862+0000 7fe87f200640 1 --2- 172.21.15.123:0/1465198122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8780c6610 0x7fe878165ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.862+0000 7fe87f200640 1 --2- 172.21.15.123:0/1465198122 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe85806f4d0 0x7fe8580719e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.862+0000 7fe87f200640 1 --2- 172.21.15.123:0/1465198122 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe878167e40 0x7fe878160e30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.862+0000 7fe87f200640 1 --2- 172.21.15.123:0/1465198122 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe87806dc50 0x7fe878158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:14.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.862+0000 7fe87f200640 1 -- 172.21.15.123:0/1465198122 >> 172.21.15.123:0/1465198122 conn(0x7fe8780b5130 msgr2=0x7fe878071d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:14.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.866+0000 7fe87f200640 1 -- 172.21.15.123:0/1465198122 shutdown_connections 2024-04-25T13:42:14.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:14.866+0000 7fe87f200640 1 -- 172.21.15.123:0/1465198122 wait complete. 2024-04-25T13:42:14.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-04-25T13:42:14.887 DEBUG:teuthology.parallel:result is None 2024-04-25T13:42:14.887 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T13:42:14.887 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:42:15.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.074+0000 7f9e4c400640 1 Processor -- start 2024-04-25T13:42:15.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.074+0000 7f9e4c400640 1 -- start start 2024-04-25T13:42:15.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.074+0000 7f9e4c400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9e4406cd80 0x7f9e440b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.074+0000 7f9e4c400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e440b2e20 con 0x7f9e440ce9d0 2024-04-25T13:42:15.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.074+0000 7f9e4c400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e440b2580 con 0x7f9e440d30a0 2024-04-25T13:42:15.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.074+0000 7f9e4c400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9e440b2320 con 0x7f9e4406cd80 2024-04-25T13:42:15.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.074+0000 7f9e49000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9e4406cd80 0x7f9e440b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.074+0000 7f9e4a400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9e440ce9d0 0x7f9e440cede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53308/0 (socket says 172.21.15.123:53308) 2024-04-25T13:42:15.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.074+0000 7f9e4a400640 1 -- 172.21.15.123:0/785764781 learned_addr learned my addr 172.21.15.123:0/785764781 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:15.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.078+0000 7f9e49000640 1 -- 172.21.15.123:0/785764781 >> v1:172.21.15.130:6789/0 conn(0x7f9e440d30a0 legacy=0x7f9e4406c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.078+0000 7f9e49000640 1 -- 172.21.15.123:0/785764781 >> v1:172.21.15.123:6789/0 conn(0x7f9e440ce9d0 legacy=0x7f9e440cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.078+0000 7f9e49000640 1 -- 172.21.15.123:0/785764781 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e440b2860 con 0x7f9e4406cd80 2024-04-25T13:42:15.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.078+0000 7f9e43e00640 1 -- 172.21.15.123:0/785764781 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2991959153 0 0) 0x7f9e440b2e20 con 0x7f9e440ce9d0 2024-04-25T13:42:15.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.078+0000 7f9e49000640 1 --2- 172.21.15.123:0/785764781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e4406cd80 0x7f9e440b1de0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9e300097c0 tx=0x7f9e3001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2eba0496b250887 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:15.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.078+0000 7f9e43e00640 1 -- 172.21.15.123:0/785764781 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e300b0070 con 0x7f9e4406cd80 2024-04-25T13:42:15.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.078+0000 7f9e43e00640 1 -- 172.21.15.123:0/785764781 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e300ab600 con 0x7f9e4406cd80 2024-04-25T13:42:15.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.078+0000 7f9e43e00640 1 -- 172.21.15.123:0/785764781 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e440cfd00 con 0x7f9e4406cd80 2024-04-25T13:42:15.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.078+0000 7f9e4c400640 1 -- 172.21.15.123:0/785764781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e4406cd80 msgr2=0x7f9e440b1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.078+0000 7f9e4c400640 1 --2- 172.21.15.123:0/785764781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e4406cd80 0x7f9e440b1de0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9e300097c0 tx=0x7f9e3001c4a0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.078+0000 7f9e4c400640 1 -- 172.21.15.123:0/785764781 shutdown_connections 2024-04-25T13:42:15.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.078+0000 7f9e4c400640 1 --2- 172.21.15.123:0/785764781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e4406cd80 0x7f9e440b1de0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.078+0000 7f9e4c400640 1 -- 172.21.15.123:0/785764781 >> 172.21.15.123:0/785764781 conn(0x7f9e440d2580 msgr2=0x7f9e440d2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:15.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.078+0000 7f9e4c400640 1 -- 172.21.15.123:0/785764781 shutdown_connections 2024-04-25T13:42:15.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.078+0000 7f9e4c400640 1 -- 172.21.15.123:0/785764781 wait complete. 2024-04-25T13:42:15.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.082+0000 7f9e4c400640 1 Processor -- start 2024-04-25T13:42:15.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.082+0000 7f9e4c400640 1 -- start start 2024-04-25T13:42:15.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.082+0000 7f9e4c400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e440ce9d0 0x7f9e441545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.082+0000 7f9e4c400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e440d30a0 0x7f9e440caf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.082+0000 7f9e4c400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e440d1120 0x7f9e440d1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.082+0000 7f9e4c400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4416bd90 con 0x7f9e440d1120 2024-04-25T13:42:15.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.082+0000 7f9e4c400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4416bc10 con 0x7f9e440ce9d0 2024-04-25T13:42:15.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.082+0000 7f9e4c400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9e4416bf10 con 0x7f9e440d30a0 2024-04-25T13:42:15.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.082+0000 7f9e4a400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e440d1120 0x7f9e440d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.086+0000 7f9e4a400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e440d1120 0x7f9e440d1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37560/0 (socket says 172.21.15.123:37560) 2024-04-25T13:42:15.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.086+0000 7f9e4a400640 1 -- 172.21.15.123:0/2684781392 learned_addr learned my addr 172.21.15.123:0/2684781392 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:15.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.086+0000 7f9e49a00640 1 --2- 172.21.15.123:0/2684781392 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e440ce9d0 0x7f9e441545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.086+0000 7f9e49000640 1 --2- 172.21.15.123:0/2684781392 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e440d30a0 0x7f9e440caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.086+0000 7f9e4a400640 1 -- 172.21.15.123:0/2684781392 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e440d30a0 msgr2=0x7f9e440caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.086+0000 7f9e4a400640 1 --2- 172.21.15.123:0/2684781392 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e440d30a0 0x7f9e440caf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.086+0000 7f9e4a400640 1 -- 172.21.15.123:0/2684781392 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e440ce9d0 msgr2=0x7f9e441545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.086+0000 7f9e4a400640 1 --2- 172.21.15.123:0/2684781392 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e440ce9d0 0x7f9e441545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.086+0000 7f9e4a400640 1 -- 172.21.15.123:0/2684781392 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e440d1a70 con 0x7f9e440d1120 2024-04-25T13:42:15.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.086+0000 7f9e4a400640 1 --2- 172.21.15.123:0/2684781392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e440d1120 0x7f9e440d1530 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00c700 tx=0x7f9e3c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:15.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.086+0000 7f9e41600640 1 -- 172.21.15.123:0/2684781392 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c018070 con 0x7f9e440d1120 2024-04-25T13:42:15.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.086+0000 7f9e41600640 1 -- 172.21.15.123:0/2684781392 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e3c00ce10 con 0x7f9e440d1120 2024-04-25T13:42:15.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.086+0000 7f9e41600640 1 -- 172.21.15.123:0/2684781392 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c00a820 con 0x7f9e440d1120 2024-04-25T13:42:15.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.086+0000 7f9e4c400640 1 -- 172.21.15.123:0/2684781392 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e440cbae0 con 0x7f9e440d1120 2024-04-25T13:42:15.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.086+0000 7f9e4c400640 1 -- 172.21.15.123:0/2684781392 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e440af520 con 0x7f9e440d1120 2024-04-25T13:42:15.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.086+0000 7f9e4c400640 1 -- 172.21.15.123:0/2684781392 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e440cb850 con 0x7f9e440d1120 2024-04-25T13:42:15.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.086+0000 7f9e41600640 1 -- 172.21.15.123:0/2684781392 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9e3c00a9c0 con 0x7f9e440d1120 2024-04-25T13:42:15.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.090+0000 7f9e41600640 1 --2- 172.21.15.123:0/2684781392 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9e2406f430 0x7f9e24071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.090+0000 7f9e41600640 1 -- 172.21.15.123:0/2684781392 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9e3c08e700 con 0x7f9e440d1120 2024-04-25T13:42:15.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.090+0000 7f9e49a00640 1 --2- 172.21.15.123:0/2684781392 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9e2406f430 0x7f9e24071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.090+0000 7f9e49a00640 1 --2- 172.21.15.123:0/2684781392 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9e2406f430 0x7f9e24071940 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9e38000fc0 tx=0x7f9e38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:15.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.094+0000 7f9e41600640 1 -- 172.21.15.123:0/2684781392 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9e440d1a70 con 0x7f9e440d1120 2024-04-25T13:42:15.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.246+0000 7f9e4c400640 1 -- 172.21.15.123:0/2684781392 --> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9e440d1f90 con 0x7f9e2406f430 2024-04-25T13:42:15.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.254+0000 7f9e41600640 1 -- 172.21.15.123:0/2684781392 <== mgr.4107 v2:172.21.15.123:6832/715752891 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251873 (secure 0 0 0) 0x7f9e440d1f90 con 0x7f9e2406f430 2024-04-25T13:42:15.259 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:15.261 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-04-25T13:42:15.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.258+0000 7f9e4c400640 1 -- 172.21.15.123:0/2684781392 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9e2406f430 msgr2=0x7f9e24071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.258+0000 7f9e4c400640 1 --2- 172.21.15.123:0/2684781392 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9e2406f430 0x7f9e24071940 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9e38000fc0 tx=0x7f9e38009040 comp rx=0 tx=0).stop 2024-04-25T13:42:15.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.258+0000 7f9e4c400640 1 -- 172.21.15.123:0/2684781392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e440d1120 msgr2=0x7f9e440d1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.258+0000 7f9e4c400640 1 --2- 172.21.15.123:0/2684781392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e440d1120 0x7f9e440d1530 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00c700 tx=0x7f9e3c00cbc0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.258+0000 7f9e4c400640 1 -- 172.21.15.123:0/2684781392 shutdown_connections 2024-04-25T13:42:15.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.258+0000 7f9e4c400640 1 --2- 172.21.15.123:0/2684781392 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9e2406f430 0x7f9e24071940 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.258+0000 7f9e4c400640 1 --2- 172.21.15.123:0/2684781392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e440d1120 0x7f9e440d1530 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.258+0000 7f9e4c400640 1 --2- 172.21.15.123:0/2684781392 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9e440d30a0 0x7f9e440caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.258+0000 7f9e4c400640 1 --2- 172.21.15.123:0/2684781392 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9e440ce9d0 0x7f9e441545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.258+0000 7f9e4c400640 1 -- 172.21.15.123:0/2684781392 >> 172.21.15.123:0/2684781392 conn(0x7f9e440d2580 msgr2=0x7f9e44070760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:15.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.258+0000 7f9e4c400640 1 -- 172.21.15.123:0/2684781392 shutdown_connections 2024-04-25T13:42:15.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.258+0000 7f9e4c400640 1 -- 172.21.15.123:0/2684781392 wait complete. 2024-04-25T13:42:15.280 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-25T13:42:13.577750+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219108,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755612,"statfs":{"total":773094113280,"available":772869746688,"internally_reserved":0,"allocated":2990080,"data_stored":1793484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001861"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185435+0000","last_change":"2024-04-25T13:42:06.439729+0000","last_active":"2024-04-25T13:42:09.185435+0000","last_peered":"2024-04-25T13:42:09.185435+0000","last_clean":"2024-04-25T13:42:09.185435+0000","last_became_active":"2024-04-25T13:42:06.439449+0000","last_became_peered":"2024-04-25T13:42:06.439449+0000","last_unstale":"2024-04-25T13:42:09.185435+0000","last_undegraded":"2024-04-25T13:42:09.185435+0000","last_fullsized":"2024-04-25T13:42:09.185435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:32:17.132420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414744+0000","last_change":"2024-04-25T13:42:06.425008+0000","last_active":"2024-04-25T13:42:07.414744+0000","last_peered":"2024-04-25T13:42:07.414744+0000","last_clean":"2024-04-25T13:42:07.414744+0000","last_became_active":"2024-04-25T13:42:06.424669+0000","last_became_peered":"2024-04-25T13:42:06.424669+0000","last_unstale":"2024-04-25T13:42:07.414744+0000","last_undegraded":"2024-04-25T13:42:07.414744+0000","last_fullsized":"2024-04-25T13:42:07.414744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.382442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.152496+0000","last_change":"2024-04-25T13:42:06.425220+0000","last_active":"2024-04-25T13:42:09.152496+0000","last_peered":"2024-04-25T13:42:09.152496+0000","last_clean":"2024-04-25T13:42:09.152496+0000","last_became_active":"2024-04-25T13:42:06.424908+0000","last_became_peered":"2024-04-25T13:42:06.424908+0000","last_unstale":"2024-04-25T13:42:09.152496+0000","last_undegraded":"2024-04-25T13:42:09.152496+0000","last_fullsized":"2024-04-25T13:42:09.152496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:38.216116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416285+0000","last_change":"2024-04-25T13:42:06.437672+0000","last_active":"2024-04-25T13:42:07.416285+0000","last_peered":"2024-04-25T13:42:07.416285+0000","last_clean":"2024-04-25T13:42:07.416285+0000","last_became_active":"2024-04-25T13:42:06.425596+0000","last_became_peered":"2024-04-25T13:42:06.425596+0000","last_unstale":"2024-04-25T13:42:07.416285+0000","last_undegraded":"2024-04-25T13:42:07.416285+0000","last_fullsized":"2024-04-25T13:42:07.416285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:37.549411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185015+0000","last_change":"2024-04-25T13:42:06.435739+0000","last_active":"2024-04-25T13:42:09.185015+0000","last_peered":"2024-04-25T13:42:09.185015+0000","last_clean":"2024-04-25T13:42:09.185015+0000","last_became_active":"2024-04-25T13:42:06.435439+0000","last_became_peered":"2024-04-25T13:42:06.435439+0000","last_unstale":"2024-04-25T13:42:09.185015+0000","last_undegraded":"2024-04-25T13:42:09.185015+0000","last_fullsized":"2024-04-25T13:42:09.185015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:02.934983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415289+0000","last_change":"2024-04-25T13:42:06.442430+0000","last_active":"2024-04-25T13:42:07.415289+0000","last_peered":"2024-04-25T13:42:07.415289+0000","last_clean":"2024-04-25T13:42:07.415289+0000","last_became_active":"2024-04-25T13:42:06.442052+0000","last_became_peered":"2024-04-25T13:42:06.442052+0000","last_unstale":"2024-04-25T13:42:07.415289+0000","last_undegraded":"2024-04-25T13:42:07.415289+0000","last_fullsized":"2024-04-25T13:42:07.415289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.382442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.184820+0000","last_change":"2024-04-25T13:42:06.435115+0000","last_active":"2024-04-25T13:42:09.184820+0000","last_peered":"2024-04-25T13:42:09.184820+0000","last_clean":"2024-04-25T13:42:09.184820+0000","last_became_active":"2024-04-25T13:42:06.434872+0000","last_became_peered":"2024-04-25T13:42:06.434872+0000","last_unstale":"2024-04-25T13:42:09.184820+0000","last_undegraded":"2024-04-25T13:42:09.184820+0000","last_fullsized":"2024-04-25T13:42:09.184820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:37.549411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695416+0000","last_change":"2024-04-25T13:42:06.447825+0000","last_active":"2024-04-25T13:42:07.695416+0000","last_peered":"2024-04-25T13:42:07.695416+0000","last_clean":"2024-04-25T13:42:07.695416+0000","last_became_active":"2024-04-25T13:42:06.447512+0000","last_became_peered":"2024-04-25T13:42:06.447512+0000","last_unstale":"2024-04-25T13:42:07.695416+0000","last_undegraded":"2024-04-25T13:42:07.695416+0000","last_fullsized":"2024-04-25T13:42:07.695416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:54.457915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185496+0000","last_change":"2024-04-25T13:42:06.449425+0000","last_active":"2024-04-25T13:42:09.185496+0000","last_peered":"2024-04-25T13:42:09.185496+0000","last_clean":"2024-04-25T13:42:09.185496+0000","last_became_active":"2024-04-25T13:42:06.449116+0000","last_became_peered":"2024-04-25T13:42:06.449116+0000","last_unstale":"2024-04-25T13:42:09.185496+0000","last_undegraded":"2024-04-25T13:42:09.185496+0000","last_fullsized":"2024-04-25T13:42:09.185496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:02.944734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414743+0000","last_change":"2024-04-25T13:42:06.444979+0000","last_active":"2024-04-25T13:42:07.414743+0000","last_peered":"2024-04-25T13:42:07.414743+0000","last_clean":"2024-04-25T13:42:07.414743+0000","last_became_active":"2024-04-25T13:42:06.444648+0000","last_became_peered":"2024-04-25T13:42:06.444648+0000","last_unstale":"2024-04-25T13:42:07.414743+0000","last_undegraded":"2024-04-25T13:42:07.414743+0000","last_fullsized":"2024-04-25T13:42:07.414743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:45.608285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414435+0000","last_change":"2024-04-25T13:42:06.445383+0000","last_active":"2024-04-25T13:42:07.414435+0000","last_peered":"2024-04-25T13:42:07.414435+0000","last_clean":"2024-04-25T13:42:07.414435+0000","last_became_active":"2024-04-25T13:42:06.445066+0000","last_became_peered":"2024-04-25T13:42:06.445066+0000","last_unstale":"2024-04-25T13:42:07.414435+0000","last_undegraded":"2024-04-25T13:42:07.414435+0000","last_fullsized":"2024-04-25T13:42:07.414435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:43.073677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.870052+0000","last_change":"2024-04-25T13:42:06.436929+0000","last_active":"2024-04-25T13:42:07.870052+0000","last_peered":"2024-04-25T13:42:07.870052+0000","last_clean":"2024-04-25T13:42:07.870052+0000","last_became_active":"2024-04-25T13:42:06.436642+0000","last_became_peered":"2024-04-25T13:42:06.436642+0000","last_unstale":"2024-04-25T13:42:07.870052+0000","last_undegraded":"2024-04-25T13:42:07.870052+0000","last_fullsized":"2024-04-25T13:42:07.870052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:59.508605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695711+0000","last_change":"2024-04-25T13:42:06.421115+0000","last_active":"2024-04-25T13:42:07.695711+0000","last_peered":"2024-04-25T13:42:07.695711+0000","last_clean":"2024-04-25T13:42:07.695711+0000","last_became_active":"2024-04-25T13:42:06.420817+0000","last_became_peered":"2024-04-25T13:42:06.420817+0000","last_unstale":"2024-04-25T13:42:07.695711+0000","last_undegraded":"2024-04-25T13:42:07.695711+0000","last_fullsized":"2024-04-25T13:42:07.695711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:45.608285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.152320+0000","last_change":"2024-04-25T13:42:06.430965+0000","last_active":"2024-04-25T13:42:09.152320+0000","last_peered":"2024-04-25T13:42:09.152320+0000","last_clean":"2024-04-25T13:42:09.152320+0000","last_became_active":"2024-04-25T13:42:06.430586+0000","last_became_peered":"2024-04-25T13:42:06.430586+0000","last_unstale":"2024-04-25T13:42:09.152320+0000","last_undegraded":"2024-04-25T13:42:09.152320+0000","last_fullsized":"2024-04-25T13:42:09.152320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:44.638274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414156+0000","last_change":"2024-04-25T13:42:06.414901+0000","last_active":"2024-04-25T13:42:07.414156+0000","last_peered":"2024-04-25T13:42:07.414156+0000","last_clean":"2024-04-25T13:42:07.414156+0000","last_became_active":"2024-04-25T13:42:06.414422+0000","last_became_peered":"2024-04-25T13:42:06.414422+0000","last_unstale":"2024-04-25T13:42:07.414156+0000","last_undegraded":"2024-04-25T13:42:07.414156+0000","last_fullsized":"2024-04-25T13:42:07.414156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:43.073677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414538+0000","last_change":"2024-04-25T13:42:06.429527+0000","last_active":"2024-04-25T13:42:07.414538+0000","last_peered":"2024-04-25T13:42:07.414538+0000","last_clean":"2024-04-25T13:42:07.414538+0000","last_became_active":"2024-04-25T13:42:06.428862+0000","last_became_peered":"2024-04-25T13:42:06.428862+0000","last_unstale":"2024-04-25T13:42:07.414538+0000","last_undegraded":"2024-04-25T13:42:07.414538+0000","last_fullsized":"2024-04-25T13:42:07.414538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:21.556056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416688+0000","last_change":"2024-04-25T13:42:06.445283+0000","last_active":"2024-04-25T13:42:07.416688+0000","last_peered":"2024-04-25T13:42:07.416688+0000","last_clean":"2024-04-25T13:42:07.416688+0000","last_became_active":"2024-04-25T13:42:06.445004+0000","last_became_peered":"2024-04-25T13:42:06.445004+0000","last_unstale":"2024-04-25T13:42:07.416688+0000","last_undegraded":"2024-04-25T13:42:07.416688+0000","last_fullsized":"2024-04-25T13:42:07.416688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:36:55.456363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185195+0000","last_change":"2024-04-25T13:42:06.427048+0000","last_active":"2024-04-25T13:42:09.185195+0000","last_peered":"2024-04-25T13:42:09.185195+0000","last_clean":"2024-04-25T13:42:09.185195+0000","last_became_active":"2024-04-25T13:42:06.426733+0000","last_became_peered":"2024-04-25T13:42:06.426733+0000","last_unstale":"2024-04-25T13:42:09.185195+0000","last_undegraded":"2024-04-25T13:42:09.185195+0000","last_fullsized":"2024-04-25T13:42:09.185195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:59.508605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185536+0000","last_change":"2024-04-25T13:42:06.440148+0000","last_active":"2024-04-25T13:42:09.185536+0000","last_peered":"2024-04-25T13:42:09.185536+0000","last_clean":"2024-04-25T13:42:09.185536+0000","last_became_active":"2024-04-25T13:42:06.439713+0000","last_became_peered":"2024-04-25T13:42:06.439713+0000","last_unstale":"2024-04-25T13:42:09.185536+0000","last_undegraded":"2024-04-25T13:42:09.185536+0000","last_fullsized":"2024-04-25T13:42:09.185536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:42:09.245771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415435+0000","last_change":"2024-04-25T13:42:06.420914+0000","last_active":"2024-04-25T13:42:07.415435+0000","last_peered":"2024-04-25T13:42:07.415435+0000","last_clean":"2024-04-25T13:42:07.415435+0000","last_became_active":"2024-04-25T13:42:06.420671+0000","last_became_peered":"2024-04-25T13:42:06.420671+0000","last_unstale":"2024-04-25T13:42:07.415435+0000","last_undegraded":"2024-04-25T13:42:07.415435+0000","last_fullsized":"2024-04-25T13:42:07.415435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.382442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.152542+0000","last_change":"2024-04-25T13:42:06.436778+0000","last_active":"2024-04-25T13:42:09.152542+0000","last_peered":"2024-04-25T13:42:09.152542+0000","last_clean":"2024-04-25T13:42:09.152542+0000","last_became_active":"2024-04-25T13:42:06.436267+0000","last_became_peered":"2024-04-25T13:42:06.436267+0000","last_unstale":"2024-04-25T13:42:09.152542+0000","last_undegraded":"2024-04-25T13:42:09.152542+0000","last_fullsized":"2024-04-25T13:42:09.152542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:45.608285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415476+0000","last_change":"2024-04-25T13:42:06.426502+0000","last_active":"2024-04-25T13:42:07.415476+0000","last_peered":"2024-04-25T13:42:07.415476+0000","last_clean":"2024-04-25T13:42:07.415476+0000","last_became_active":"2024-04-25T13:42:06.426235+0000","last_became_peered":"2024-04-25T13:42:06.426235+0000","last_unstale":"2024-04-25T13:42:07.415476+0000","last_undegraded":"2024-04-25T13:42:07.415476+0000","last_fullsized":"2024-04-25T13:42:07.415476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:38.780588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695449+0000","last_change":"2024-04-25T13:42:06.415204+0000","last_active":"2024-04-25T13:42:07.695449+0000","last_peered":"2024-04-25T13:42:07.695449+0000","last_clean":"2024-04-25T13:42:07.695449+0000","last_became_active":"2024-04-25T13:42:06.414815+0000","last_became_peered":"2024-04-25T13:42:06.414815+0000","last_unstale":"2024-04-25T13:42:07.695449+0000","last_undegraded":"2024-04-25T13:42:07.695449+0000","last_fullsized":"2024-04-25T13:42:07.695449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:38.216116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414732+0000","last_change":"2024-04-25T13:42:06.429164+0000","last_active":"2024-04-25T13:42:07.414732+0000","last_peered":"2024-04-25T13:42:07.414732+0000","last_clean":"2024-04-25T13:42:07.414732+0000","last_became_active":"2024-04-25T13:42:06.428466+0000","last_became_peered":"2024-04-25T13:42:06.428466+0000","last_unstale":"2024-04-25T13:42:07.414732+0000","last_undegraded":"2024-04-25T13:42:07.414732+0000","last_fullsized":"2024-04-25T13:42:07.414732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:45.608285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695932+0000","last_change":"2024-04-25T13:42:06.416633+0000","last_active":"2024-04-25T13:42:07.695932+0000","last_peered":"2024-04-25T13:42:07.695932+0000","last_clean":"2024-04-25T13:42:07.695932+0000","last_became_active":"2024-04-25T13:42:06.415982+0000","last_became_peered":"2024-04-25T13:42:06.415982+0000","last_unstale":"2024-04-25T13:42:07.695932+0000","last_undegraded":"2024-04-25T13:42:07.695932+0000","last_fullsized":"2024-04-25T13:42:07.695932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:37.549411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414733+0000","last_change":"2024-04-25T13:42:06.429813+0000","last_active":"2024-04-25T13:42:07.414733+0000","last_peered":"2024-04-25T13:42:07.414733+0000","last_clean":"2024-04-25T13:42:07.414733+0000","last_became_active":"2024-04-25T13:42:06.429201+0000","last_became_peered":"2024-04-25T13:42:06.429201+0000","last_unstale":"2024-04-25T13:42:07.414733+0000","last_undegraded":"2024-04-25T13:42:07.414733+0000","last_fullsized":"2024-04-25T13:42:07.414733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:21.556056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414552+0000","last_change":"2024-04-25T13:42:06.423487+0000","last_active":"2024-04-25T13:42:07.414552+0000","last_peered":"2024-04-25T13:42:07.414552+0000","last_clean":"2024-04-25T13:42:07.414552+0000","last_became_active":"2024-04-25T13:42:06.423175+0000","last_became_peered":"2024-04-25T13:42:06.423175+0000","last_unstale":"2024-04-25T13:42:07.414552+0000","last_undegraded":"2024-04-25T13:42:07.414552+0000","last_fullsized":"2024-04-25T13:42:07.414552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:45.608285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695845+0000","last_change":"2024-04-25T13:42:06.419669+0000","last_active":"2024-04-25T13:42:07.695845+0000","last_peered":"2024-04-25T13:42:07.695845+0000","last_clean":"2024-04-25T13:42:07.695845+0000","last_became_active":"2024-04-25T13:42:06.419352+0000","last_became_peered":"2024-04-25T13:42:06.419352+0000","last_unstale":"2024-04-25T13:42:07.695845+0000","last_undegraded":"2024-04-25T13:42:07.695845+0000","last_fullsized":"2024-04-25T13:42:07.695845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:38.780588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.152539+0000","last_change":"2024-04-25T13:42:06.424606+0000","last_active":"2024-04-25T13:42:09.152539+0000","last_peered":"2024-04-25T13:42:09.152539+0000","last_clean":"2024-04-25T13:42:09.152539+0000","last_became_active":"2024-04-25T13:42:06.424286+0000","last_became_peered":"2024-04-25T13:42:06.424286+0000","last_unstale":"2024-04-25T13:42:09.152539+0000","last_undegraded":"2024-04-25T13:42:09.152539+0000","last_fullsized":"2024-04-25T13:42:09.152539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:21.556056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415714+0000","last_change":"2024-04-25T13:42:06.437956+0000","last_active":"2024-04-25T13:42:07.415714+0000","last_peered":"2024-04-25T13:42:07.415714+0000","last_clean":"2024-04-25T13:42:07.415714+0000","last_became_active":"2024-04-25T13:42:06.437530+0000","last_became_peered":"2024-04-25T13:42:06.437530+0000","last_unstale":"2024-04-25T13:42:07.415714+0000","last_undegraded":"2024-04-25T13:42:07.415714+0000","last_fullsized":"2024-04-25T13:42:07.415714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:32.855388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185050+0000","last_change":"2024-04-25T13:42:06.420035+0000","last_active":"2024-04-25T13:42:09.185050+0000","last_peered":"2024-04-25T13:42:09.185050+0000","last_clean":"2024-04-25T13:42:09.185050+0000","last_became_active":"2024-04-25T13:42:06.419452+0000","last_became_peered":"2024-04-25T13:42:06.419452+0000","last_unstale":"2024-04-25T13:42:09.185050+0000","last_undegraded":"2024-04-25T13:42:09.185050+0000","last_fullsized":"2024-04-25T13:42:09.185050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:22.596123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414133+0000","last_change":"2024-04-25T13:42:06.428858+0000","last_active":"2024-04-25T13:42:07.414133+0000","last_peered":"2024-04-25T13:42:07.414133+0000","last_clean":"2024-04-25T13:42:07.414133+0000","last_became_active":"2024-04-25T13:42:06.428622+0000","last_became_peered":"2024-04-25T13:42:06.428622+0000","last_unstale":"2024-04-25T13:42:07.414133+0000","last_undegraded":"2024-04-25T13:42:07.414133+0000","last_fullsized":"2024-04-25T13:42:07.414133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:54.457915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.869806+0000","last_change":"2024-04-25T13:42:06.412033+0000","last_active":"2024-04-25T13:42:07.869806+0000","last_peered":"2024-04-25T13:42:07.869806+0000","last_clean":"2024-04-25T13:42:07.869806+0000","last_became_active":"2024-04-25T13:42:06.411702+0000","last_became_peered":"2024-04-25T13:42:06.411702+0000","last_unstale":"2024-04-25T13:42:07.869806+0000","last_undegraded":"2024-04-25T13:42:07.869806+0000","last_fullsized":"2024-04-25T13:42:07.869806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:21.415710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695870+0000","last_change":"2024-04-25T13:42:05.426545+0000","last_active":"2024-04-25T13:42:07.695870+0000","last_peered":"2024-04-25T13:42:07.695870+0000","last_clean":"2024-04-25T13:42:07.695870+0000","last_became_active":"2024-04-25T13:42:05.425486+0000","last_became_peered":"2024-04-25T13:42:05.425486+0000","last_unstale":"2024-04-25T13:42:07.695870+0000","last_undegraded":"2024-04-25T13:42:07.695870+0000","last_fullsized":"2024-04-25T13:42:07.695870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:38.792763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.152691+0000","last_change":"2024-04-25T13:42:06.424104+0000","last_active":"2024-04-25T13:42:09.152691+0000","last_peered":"2024-04-25T13:42:09.152691+0000","last_clean":"2024-04-25T13:42:09.152691+0000","last_became_active":"2024-04-25T13:42:06.423795+0000","last_became_peered":"2024-04-25T13:42:06.423795+0000","last_unstale":"2024-04-25T13:42:09.152691+0000","last_undegraded":"2024-04-25T13:42:09.152691+0000","last_fullsized":"2024-04-25T13:42:09.152691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:38.780588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414254+0000","last_change":"2024-04-25T13:42:05.412559+0000","last_active":"2024-04-25T13:42:07.414254+0000","last_peered":"2024-04-25T13:42:07.414254+0000","last_clean":"2024-04-25T13:42:07.414254+0000","last_became_active":"2024-04-25T13:42:05.412190+0000","last_became_peered":"2024-04-25T13:42:05.412190+0000","last_unstale":"2024-04-25T13:42:07.414254+0000","last_undegraded":"2024-04-25T13:42:07.414254+0000","last_fullsized":"2024-04-25T13:42:07.414254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:20.409104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695565+0000","last_change":"2024-04-25T13:42:05.425544+0000","last_active":"2024-04-25T13:42:07.695565+0000","last_peered":"2024-04-25T13:42:07.695565+0000","last_clean":"2024-04-25T13:42:07.695565+0000","last_became_active":"2024-04-25T13:42:05.425115+0000","last_became_peered":"2024-04-25T13:42:05.425115+0000","last_unstale":"2024-04-25T13:42:07.695565+0000","last_undegraded":"2024-04-25T13:42:07.695565+0000","last_fullsized":"2024-04-25T13:42:07.695565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:25.873825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695674+0000","last_change":"2024-04-25T13:42:06.428073+0000","last_active":"2024-04-25T13:42:07.695674+0000","last_peered":"2024-04-25T13:42:07.695674+0000","last_clean":"2024-04-25T13:42:07.695674+0000","last_became_active":"2024-04-25T13:42:06.427682+0000","last_became_peered":"2024-04-25T13:42:06.427682+0000","last_unstale":"2024-04-25T13:42:07.695674+0000","last_undegraded":"2024-04-25T13:42:07.695674+0000","last_fullsized":"2024-04-25T13:42:07.695674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:21.556056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414858+0000","last_change":"2024-04-25T13:42:05.409548+0000","last_active":"2024-04-25T13:42:07.414858+0000","last_peered":"2024-04-25T13:42:07.414858+0000","last_clean":"2024-04-25T13:42:07.414858+0000","last_became_active":"2024-04-25T13:42:05.409160+0000","last_became_peered":"2024-04-25T13:42:05.409160+0000","last_unstale":"2024-04-25T13:42:07.414858+0000","last_undegraded":"2024-04-25T13:42:07.414858+0000","last_fullsized":"2024-04-25T13:42:07.414858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:42.956198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414147+0000","last_change":"2024-04-25T13:42:06.417091+0000","last_active":"2024-04-25T13:42:07.414147+0000","last_peered":"2024-04-25T13:42:07.414147+0000","last_clean":"2024-04-25T13:42:07.414147+0000","last_became_active":"2024-04-25T13:42:06.416569+0000","last_became_peered":"2024-04-25T13:42:06.416569+0000","last_unstale":"2024-04-25T13:42:07.414147+0000","last_undegraded":"2024-04-25T13:42:07.414147+0000","last_fullsized":"2024-04-25T13:42:07.414147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:38.216116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414775+0000","last_change":"2024-04-25T13:42:05.418974+0000","last_active":"2024-04-25T13:42:07.414775+0000","last_peered":"2024-04-25T13:42:07.414775+0000","last_clean":"2024-04-25T13:42:07.414775+0000","last_became_active":"2024-04-25T13:42:05.418671+0000","last_became_peered":"2024-04-25T13:42:05.418671+0000","last_unstale":"2024-04-25T13:42:07.414775+0000","last_undegraded":"2024-04-25T13:42:07.414775+0000","last_fullsized":"2024-04-25T13:42:07.414775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:50.166504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416407+0000","last_change":"2024-04-25T13:42:06.439202+0000","last_active":"2024-04-25T13:42:07.416407+0000","last_peered":"2024-04-25T13:42:07.416407+0000","last_clean":"2024-04-25T13:42:07.416407+0000","last_became_active":"2024-04-25T13:42:06.438901+0000","last_became_peered":"2024-04-25T13:42:06.438901+0000","last_unstale":"2024-04-25T13:42:07.416407+0000","last_undegraded":"2024-04-25T13:42:07.416407+0000","last_fullsized":"2024-04-25T13:42:07.416407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:02.934983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416416+0000","last_change":"2024-04-25T13:42:05.418579+0000","last_active":"2024-04-25T13:42:07.416416+0000","last_peered":"2024-04-25T13:42:07.416416+0000","last_clean":"2024-04-25T13:42:07.416416+0000","last_became_active":"2024-04-25T13:42:05.418233+0000","last_became_peered":"2024-04-25T13:42:05.418233+0000","last_unstale":"2024-04-25T13:42:07.416416+0000","last_undegraded":"2024-04-25T13:42:07.416416+0000","last_fullsized":"2024-04-25T13:42:07.416416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:20.409104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.152525+0000","last_change":"2024-04-25T13:42:06.449721+0000","last_active":"2024-04-25T13:42:09.152525+0000","last_peered":"2024-04-25T13:42:09.152525+0000","last_clean":"2024-04-25T13:42:09.152525+0000","last_became_active":"2024-04-25T13:42:06.449373+0000","last_became_peered":"2024-04-25T13:42:06.449373+0000","last_unstale":"2024-04-25T13:42:09.152525+0000","last_undegraded":"2024-04-25T13:42:09.152525+0000","last_fullsized":"2024-04-25T13:42:09.152525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:00.017229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414570+0000","last_change":"2024-04-25T13:42:05.418805+0000","last_active":"2024-04-25T13:42:07.414570+0000","last_peered":"2024-04-25T13:42:07.414570+0000","last_clean":"2024-04-25T13:42:07.414570+0000","last_became_active":"2024-04-25T13:42:05.418384+0000","last_became_peered":"2024-04-25T13:42:05.418384+0000","last_unstale":"2024-04-25T13:42:07.414570+0000","last_undegraded":"2024-04-25T13:42:07.414570+0000","last_fullsized":"2024-04-25T13:42:07.414570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:21.589517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.870107+0000","last_change":"2024-04-25T13:42:06.415649+0000","last_active":"2024-04-25T13:42:07.870107+0000","last_peered":"2024-04-25T13:42:07.870107+0000","last_clean":"2024-04-25T13:42:07.870107+0000","last_became_active":"2024-04-25T13:42:06.411373+0000","last_became_peered":"2024-04-25T13:42:06.411373+0000","last_unstale":"2024-04-25T13:42:07.870107+0000","last_undegraded":"2024-04-25T13:42:07.870107+0000","last_fullsized":"2024-04-25T13:42:07.870107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:04.702886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415602+0000","last_change":"2024-04-25T13:42:05.423758+0000","last_active":"2024-04-25T13:42:07.415602+0000","last_peered":"2024-04-25T13:42:07.415602+0000","last_clean":"2024-04-25T13:42:07.415602+0000","last_became_active":"2024-04-25T13:42:05.423343+0000","last_became_peered":"2024-04-25T13:42:05.423343+0000","last_unstale":"2024-04-25T13:42:07.415602+0000","last_undegraded":"2024-04-25T13:42:07.415602+0000","last_fullsized":"2024-04-25T13:42:07.415602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:42.956198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185169+0000","last_change":"2024-04-25T13:42:06.438756+0000","last_active":"2024-04-25T13:42:09.185169+0000","last_peered":"2024-04-25T13:42:09.185169+0000","last_clean":"2024-04-25T13:42:09.185169+0000","last_became_active":"2024-04-25T13:42:06.432572+0000","last_became_peered":"2024-04-25T13:42:06.432572+0000","last_unstale":"2024-04-25T13:42:09.185169+0000","last_undegraded":"2024-04-25T13:42:09.185169+0000","last_fullsized":"2024-04-25T13:42:09.185169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:33:49.773341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.152670+0000","last_change":"2024-04-25T13:42:05.405101+0000","last_active":"2024-04-25T13:42:09.152670+0000","last_peered":"2024-04-25T13:42:09.152670+0000","last_clean":"2024-04-25T13:42:09.152670+0000","last_became_active":"2024-04-25T13:42:05.404246+0000","last_became_peered":"2024-04-25T13:42:05.404246+0000","last_unstale":"2024-04-25T13:42:09.152670+0000","last_undegraded":"2024-04-25T13:42:09.152670+0000","last_fullsized":"2024-04-25T13:42:09.152670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:25.873825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.152327+0000","last_change":"2024-04-25T13:42:06.436678+0000","last_active":"2024-04-25T13:42:09.152327+0000","last_peered":"2024-04-25T13:42:09.152327+0000","last_clean":"2024-04-25T13:42:09.152327+0000","last_became_active":"2024-04-25T13:42:06.436287+0000","last_became_peered":"2024-04-25T13:42:06.436287+0000","last_unstale":"2024-04-25T13:42:09.152327+0000","last_undegraded":"2024-04-25T13:42:09.152327+0000","last_fullsized":"2024-04-25T13:42:09.152327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:54.457915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415802+0000","last_change":"2024-04-25T13:42:05.417191+0000","last_active":"2024-04-25T13:42:07.415802+0000","last_peered":"2024-04-25T13:42:07.415802+0000","last_clean":"2024-04-25T13:42:07.415802+0000","last_became_active":"2024-04-25T13:42:05.416840+0000","last_became_peered":"2024-04-25T13:42:05.416840+0000","last_unstale":"2024-04-25T13:42:07.415802+0000","last_undegraded":"2024-04-25T13:42:07.415802+0000","last_fullsized":"2024-04-25T13:42:07.415802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:50.166504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185168+0000","last_change":"2024-04-25T13:42:06.444118+0000","last_active":"2024-04-25T13:42:09.185168+0000","last_peered":"2024-04-25T13:42:09.185168+0000","last_clean":"2024-04-25T13:42:09.185168+0000","last_became_active":"2024-04-25T13:42:06.443524+0000","last_became_peered":"2024-04-25T13:42:06.443524+0000","last_unstale":"2024-04-25T13:42:09.185168+0000","last_undegraded":"2024-04-25T13:42:09.185168+0000","last_fullsized":"2024-04-25T13:42:09.185168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:55.637014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414098+0000","last_change":"2024-04-25T13:42:05.414280+0000","last_active":"2024-04-25T13:42:07.414098+0000","last_peered":"2024-04-25T13:42:07.414098+0000","last_clean":"2024-04-25T13:42:07.414098+0000","last_became_active":"2024-04-25T13:42:05.413281+0000","last_became_peered":"2024-04-25T13:42:05.413281+0000","last_unstale":"2024-04-25T13:42:07.414098+0000","last_undegraded":"2024-04-25T13:42:07.414098+0000","last_fullsized":"2024-04-25T13:42:07.414098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:13.973644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414504+0000","last_change":"2024-04-25T13:42:06.430703+0000","last_active":"2024-04-25T13:42:07.414504+0000","last_peered":"2024-04-25T13:42:07.414504+0000","last_clean":"2024-04-25T13:42:07.414504+0000","last_became_active":"2024-04-25T13:42:06.428292+0000","last_became_peered":"2024-04-25T13:42:06.428292+0000","last_unstale":"2024-04-25T13:42:07.414504+0000","last_undegraded":"2024-04-25T13:42:07.414504+0000","last_fullsized":"2024-04-25T13:42:07.414504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:00.017229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.184968+0000","last_change":"2024-04-25T13:42:05.423359+0000","last_active":"2024-04-25T13:42:09.184968+0000","last_peered":"2024-04-25T13:42:09.184968+0000","last_clean":"2024-04-25T13:42:09.184968+0000","last_became_active":"2024-04-25T13:42:05.418070+0000","last_became_peered":"2024-04-25T13:42:05.418070+0000","last_unstale":"2024-04-25T13:42:09.184968+0000","last_undegraded":"2024-04-25T13:42:09.184968+0000","last_fullsized":"2024-04-25T13:42:09.184968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:38.792763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.184862+0000","last_change":"2024-04-25T13:42:06.438416+0000","last_active":"2024-04-25T13:42:09.184862+0000","last_peered":"2024-04-25T13:42:09.184862+0000","last_clean":"2024-04-25T13:42:09.184862+0000","last_became_active":"2024-04-25T13:42:06.436122+0000","last_became_peered":"2024-04-25T13:42:06.436122+0000","last_unstale":"2024-04-25T13:42:09.184862+0000","last_undegraded":"2024-04-25T13:42:09.184862+0000","last_fullsized":"2024-04-25T13:42:09.184862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:54:07.642118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.870073+0000","last_change":"2024-04-25T13:42:05.411439+0000","last_active":"2024-04-25T13:42:07.870073+0000","last_peered":"2024-04-25T13:42:07.870073+0000","last_clean":"2024-04-25T13:42:07.870073+0000","last_became_active":"2024-04-25T13:42:05.411041+0000","last_became_peered":"2024-04-25T13:42:05.411041+0000","last_unstale":"2024-04-25T13:42:07.870073+0000","last_undegraded":"2024-04-25T13:42:07.870073+0000","last_fullsized":"2024-04-25T13:42:07.870073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:29.973848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185443+0000","last_change":"2024-04-25T13:42:06.440980+0000","last_active":"2024-04-25T13:42:09.185443+0000","last_peered":"2024-04-25T13:42:09.185443+0000","last_clean":"2024-04-25T13:42:09.185443+0000","last_became_active":"2024-04-25T13:42:06.440605+0000","last_became_peered":"2024-04-25T13:42:06.440605+0000","last_unstale":"2024-04-25T13:42:09.185443+0000","last_undegraded":"2024-04-25T13:42:09.185443+0000","last_fullsized":"2024-04-25T13:42:09.185443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:36:55.456363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185145+0000","last_change":"2024-04-25T13:42:05.420768+0000","last_active":"2024-04-25T13:42:09.185145+0000","last_peered":"2024-04-25T13:42:09.185145+0000","last_clean":"2024-04-25T13:42:09.185145+0000","last_became_active":"2024-04-25T13:42:05.420338+0000","last_became_peered":"2024-04-25T13:42:05.420338+0000","last_unstale":"2024-04-25T13:42:09.185145+0000","last_undegraded":"2024-04-25T13:42:09.185145+0000","last_fullsized":"2024-04-25T13:42:09.185145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:50.166504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185664+0000","last_change":"2024-04-25T13:42:06.440909+0000","last_active":"2024-04-25T13:42:09.185664+0000","last_peered":"2024-04-25T13:42:09.185664+0000","last_clean":"2024-04-25T13:42:09.185664+0000","last_became_active":"2024-04-25T13:42:06.440517+0000","last_became_peered":"2024-04-25T13:42:06.440517+0000","last_unstale":"2024-04-25T13:42:09.185664+0000","last_undegraded":"2024-04-25T13:42:09.185664+0000","last_fullsized":"2024-04-25T13:42:09.185664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:02.920503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414647+0000","last_change":"2024-04-25T13:42:05.421815+0000","last_active":"2024-04-25T13:42:07.414647+0000","last_peered":"2024-04-25T13:42:07.414647+0000","last_clean":"2024-04-25T13:42:07.414647+0000","last_became_active":"2024-04-25T13:42:05.421468+0000","last_became_peered":"2024-04-25T13:42:05.421468+0000","last_unstale":"2024-04-25T13:42:07.414647+0000","last_undegraded":"2024-04-25T13:42:07.414647+0000","last_fullsized":"2024-04-25T13:42:07.414647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:58.501999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416541+0000","last_change":"2024-04-25T13:42:06.425480+0000","last_active":"2024-04-25T13:42:07.416541+0000","last_peered":"2024-04-25T13:42:07.416541+0000","last_clean":"2024-04-25T13:42:07.416541+0000","last_became_active":"2024-04-25T13:42:06.424666+0000","last_became_peered":"2024-04-25T13:42:06.424666+0000","last_unstale":"2024-04-25T13:42:07.416541+0000","last_undegraded":"2024-04-25T13:42:07.416541+0000","last_fullsized":"2024-04-25T13:42:07.416541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:28.530411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185126+0000","last_change":"2024-04-25T13:42:05.414975+0000","last_active":"2024-04-25T13:42:09.185126+0000","last_peered":"2024-04-25T13:42:09.185126+0000","last_clean":"2024-04-25T13:42:09.185126+0000","last_became_active":"2024-04-25T13:42:05.413273+0000","last_became_peered":"2024-04-25T13:42:05.413273+0000","last_unstale":"2024-04-25T13:42:09.185126+0000","last_undegraded":"2024-04-25T13:42:09.185126+0000","last_fullsized":"2024-04-25T13:42:09.185126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:18.167829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185258+0000","last_change":"2024-04-25T13:42:06.447253+0000","last_active":"2024-04-25T13:42:09.185258+0000","last_peered":"2024-04-25T13:42:09.185258+0000","last_clean":"2024-04-25T13:42:09.185258+0000","last_became_active":"2024-04-25T13:42:06.446721+0000","last_became_peered":"2024-04-25T13:42:06.446721+0000","last_unstale":"2024-04-25T13:42:09.185258+0000","last_undegraded":"2024-04-25T13:42:09.185258+0000","last_fullsized":"2024-04-25T13:42:09.185258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:28.530411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.184796+0000","last_change":"2024-04-25T13:41:56.890628+0000","last_active":"2024-04-25T13:42:09.184796+0000","last_peered":"2024-04-25T13:42:09.184796+0000","last_clean":"2024-04-25T13:42:09.184796+0000","last_became_active":"2024-04-25T13:41:56.889261+0000","last_became_peered":"2024-04-25T13:41:56.889261+0000","last_unstale":"2024-04-25T13:42:09.184796+0000","last_undegraded":"2024-04-25T13:42:09.184796+0000","last_fullsized":"2024-04-25T13:42:09.184796+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:53.940471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:53.940471+0000","last_clean_scrub_stamp":"2024-04-25T13:41:53.940471+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:06.164380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416047+0000","last_change":"2024-04-25T13:42:05.413945+0000","last_active":"2024-04-25T13:42:07.416047+0000","last_peered":"2024-04-25T13:42:07.416047+0000","last_clean":"2024-04-25T13:42:07.416047+0000","last_became_active":"2024-04-25T13:42:05.413653+0000","last_became_peered":"2024-04-25T13:42:05.413653+0000","last_unstale":"2024-04-25T13:42:07.416047+0000","last_undegraded":"2024-04-25T13:42:07.416047+0000","last_fullsized":"2024-04-25T13:42:07.416047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:18.167829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695600+0000","last_change":"2024-04-25T13:42:06.447412+0000","last_active":"2024-04-25T13:42:07.695600+0000","last_peered":"2024-04-25T13:42:07.695600+0000","last_clean":"2024-04-25T13:42:07.695600+0000","last_became_active":"2024-04-25T13:42:06.447163+0000","last_became_peered":"2024-04-25T13:42:06.447163+0000","last_unstale":"2024-04-25T13:42:07.695600+0000","last_undegraded":"2024-04-25T13:42:07.695600+0000","last_fullsized":"2024-04-25T13:42:07.695600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:43.073677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.184670+0000","last_change":"2024-04-25T13:42:05.425468+0000","last_active":"2024-04-25T13:42:09.184670+0000","last_peered":"2024-04-25T13:42:09.184670+0000","last_clean":"2024-04-25T13:42:09.184670+0000","last_became_active":"2024-04-25T13:42:05.425039+0000","last_became_peered":"2024-04-25T13:42:05.425039+0000","last_unstale":"2024-04-25T13:42:09.184670+0000","last_undegraded":"2024-04-25T13:42:09.184670+0000","last_fullsized":"2024-04-25T13:42:09.184670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:13.973644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.152226+0000","last_change":"2024-04-25T13:42:06.423330+0000","last_active":"2024-04-25T13:42:09.152226+0000","last_peered":"2024-04-25T13:42:09.152226+0000","last_clean":"2024-04-25T13:42:09.152226+0000","last_became_active":"2024-04-25T13:42:06.422548+0000","last_became_peered":"2024-04-25T13:42:06.422548+0000","last_unstale":"2024-04-25T13:42:09.152226+0000","last_undegraded":"2024-04-25T13:42:09.152226+0000","last_fullsized":"2024-04-25T13:42:09.152226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:06.506569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185079+0000","last_change":"2024-04-25T13:42:05.416592+0000","last_active":"2024-04-25T13:42:09.185079+0000","last_peered":"2024-04-25T13:42:09.185079+0000","last_clean":"2024-04-25T13:42:09.185079+0000","last_became_active":"2024-04-25T13:42:05.416251+0000","last_became_peered":"2024-04-25T13:42:05.416251+0000","last_unstale":"2024-04-25T13:42:09.185079+0000","last_undegraded":"2024-04-25T13:42:09.185079+0000","last_fullsized":"2024-04-25T13:42:09.185079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:39.013905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414307+0000","last_change":"2024-04-25T13:42:06.405128+0000","last_active":"2024-04-25T13:42:07.414307+0000","last_peered":"2024-04-25T13:42:07.414307+0000","last_clean":"2024-04-25T13:42:07.414307+0000","last_became_active":"2024-04-25T13:42:06.404786+0000","last_became_peered":"2024-04-25T13:42:06.404786+0000","last_unstale":"2024-04-25T13:42:07.414307+0000","last_undegraded":"2024-04-25T13:42:07.414307+0000","last_fullsized":"2024-04-25T13:42:07.414307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:00.017229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415847+0000","last_change":"2024-04-25T13:42:05.417435+0000","last_active":"2024-04-25T13:42:07.415847+0000","last_peered":"2024-04-25T13:42:07.415847+0000","last_clean":"2024-04-25T13:42:07.415847+0000","last_became_active":"2024-04-25T13:42:05.417069+0000","last_became_peered":"2024-04-25T13:42:05.417069+0000","last_unstale":"2024-04-25T13:42:07.415847+0000","last_undegraded":"2024-04-25T13:42:07.415847+0000","last_fullsized":"2024-04-25T13:42:07.415847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:39.013905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.869855+0000","last_change":"2024-04-25T13:42:06.435494+0000","last_active":"2024-04-25T13:42:07.869855+0000","last_peered":"2024-04-25T13:42:07.869855+0000","last_clean":"2024-04-25T13:42:07.869855+0000","last_became_active":"2024-04-25T13:42:06.425605+0000","last_became_peered":"2024-04-25T13:42:06.425605+0000","last_unstale":"2024-04-25T13:42:07.869855+0000","last_undegraded":"2024-04-25T13:42:07.869855+0000","last_fullsized":"2024-04-25T13:42:07.869855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:14.980250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414503+0000","last_change":"2024-04-25T13:42:05.419749+0000","last_active":"2024-04-25T13:42:07.414503+0000","last_peered":"2024-04-25T13:42:07.414503+0000","last_clean":"2024-04-25T13:42:07.414503+0000","last_became_active":"2024-04-25T13:42:05.419446+0000","last_became_peered":"2024-04-25T13:42:05.419446+0000","last_unstale":"2024-04-25T13:42:07.414503+0000","last_undegraded":"2024-04-25T13:42:07.414503+0000","last_fullsized":"2024-04-25T13:42:07.414503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:39.013905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416544+0000","last_change":"2024-04-25T13:42:06.438221+0000","last_active":"2024-04-25T13:42:07.416544+0000","last_peered":"2024-04-25T13:42:07.416544+0000","last_clean":"2024-04-25T13:42:07.416544+0000","last_became_active":"2024-04-25T13:42:06.430658+0000","last_became_peered":"2024-04-25T13:42:06.430658+0000","last_unstale":"2024-04-25T13:42:07.416544+0000","last_undegraded":"2024-04-25T13:42:07.416544+0000","last_fullsized":"2024-04-25T13:42:07.416544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:55.637014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185523+0000","last_change":"2024-04-25T13:42:05.427944+0000","last_active":"2024-04-25T13:42:09.185523+0000","last_peered":"2024-04-25T13:42:09.185523+0000","last_clean":"2024-04-25T13:42:09.185523+0000","last_became_active":"2024-04-25T13:42:05.427721+0000","last_became_peered":"2024-04-25T13:42:05.427721+0000","last_unstale":"2024-04-25T13:42:09.185523+0000","last_undegraded":"2024-04-25T13:42:09.185523+0000","last_fullsized":"2024-04-25T13:42:09.185523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:27.584535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414350+0000","last_change":"2024-04-25T13:42:06.410624+0000","last_active":"2024-04-25T13:42:07.414350+0000","last_peered":"2024-04-25T13:42:07.414350+0000","last_clean":"2024-04-25T13:42:07.414350+0000","last_became_active":"2024-04-25T13:42:06.410260+0000","last_became_peered":"2024-04-25T13:42:06.410260+0000","last_unstale":"2024-04-25T13:42:07.414350+0000","last_undegraded":"2024-04-25T13:42:07.414350+0000","last_fullsized":"2024-04-25T13:42:07.414350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:21.556056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:08.407723+0000","last_change":"2024-04-25T13:42:05.420418+0000","last_active":"2024-04-25T13:42:08.407723+0000","last_peered":"2024-04-25T13:42:08.407723+0000","last_clean":"2024-04-25T13:42:08.407723+0000","last_became_active":"2024-04-25T13:42:05.420002+0000","last_became_peered":"2024-04-25T13:42:05.420002+0000","last_unstale":"2024-04-25T13:42:08.407723+0000","last_undegraded":"2024-04-25T13:42:08.407723+0000","last_fullsized":"2024-04-25T13:42:08.407723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:20.409104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.696037+0000","last_change":"2024-04-25T13:42:06.429612+0000","last_active":"2024-04-25T13:42:07.696037+0000","last_peered":"2024-04-25T13:42:07.696037+0000","last_clean":"2024-04-25T13:42:07.696037+0000","last_became_active":"2024-04-25T13:42:06.429281+0000","last_became_peered":"2024-04-25T13:42:06.429281+0000","last_unstale":"2024-04-25T13:42:07.696037+0000","last_undegraded":"2024-04-25T13:42:07.696037+0000","last_fullsized":"2024-04-25T13:42:07.696037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:54:07.642118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414966+0000","last_change":"2024-04-25T13:42:05.420871+0000","last_active":"2024-04-25T13:42:07.414966+0000","last_peered":"2024-04-25T13:42:07.414966+0000","last_clean":"2024-04-25T13:42:07.414966+0000","last_became_active":"2024-04-25T13:42:05.420493+0000","last_became_peered":"2024-04-25T13:42:05.420493+0000","last_unstale":"2024-04-25T13:42:07.414966+0000","last_undegraded":"2024-04-25T13:42:07.414966+0000","last_fullsized":"2024-04-25T13:42:07.414966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:39.013905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.152648+0000","last_change":"2024-04-25T13:42:06.430453+0000","last_active":"2024-04-25T13:42:09.152648+0000","last_peered":"2024-04-25T13:42:09.152648+0000","last_clean":"2024-04-25T13:42:09.152648+0000","last_became_active":"2024-04-25T13:42:06.430092+0000","last_became_peered":"2024-04-25T13:42:06.430092+0000","last_unstale":"2024-04-25T13:42:09.152648+0000","last_undegraded":"2024-04-25T13:42:09.152648+0000","last_fullsized":"2024-04-25T13:42:09.152648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.382442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.184651+0000","last_change":"2024-04-25T13:42:05.431023+0000","last_active":"2024-04-25T13:42:09.184651+0000","last_peered":"2024-04-25T13:42:09.184651+0000","last_clean":"2024-04-25T13:42:09.184651+0000","last_became_active":"2024-04-25T13:42:05.430721+0000","last_became_peered":"2024-04-25T13:42:05.430721+0000","last_unstale":"2024-04-25T13:42:09.184651+0000","last_undegraded":"2024-04-25T13:42:09.184651+0000","last_fullsized":"2024-04-25T13:42:09.184651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:20.409104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.869878+0000","last_change":"2024-04-25T13:42:06.409401+0000","last_active":"2024-04-25T13:42:07.869878+0000","last_peered":"2024-04-25T13:42:07.869878+0000","last_clean":"2024-04-25T13:42:07.869878+0000","last_became_active":"2024-04-25T13:42:06.409057+0000","last_became_peered":"2024-04-25T13:42:06.409057+0000","last_unstale":"2024-04-25T13:42:07.869878+0000","last_undegraded":"2024-04-25T13:42:07.869878+0000","last_fullsized":"2024-04-25T13:42:07.869878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:22.596123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414245+0000","last_change":"2024-04-25T13:42:05.421504+0000","last_active":"2024-04-25T13:42:07.414245+0000","last_peered":"2024-04-25T13:42:07.414245+0000","last_clean":"2024-04-25T13:42:07.414245+0000","last_became_active":"2024-04-25T13:42:05.421220+0000","last_became_peered":"2024-04-25T13:42:05.421220+0000","last_unstale":"2024-04-25T13:42:07.414245+0000","last_undegraded":"2024-04-25T13:42:07.414245+0000","last_fullsized":"2024-04-25T13:42:07.414245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:13.973644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695605+0000","last_change":"2024-04-25T13:42:06.431990+0000","last_active":"2024-04-25T13:42:07.695605+0000","last_peered":"2024-04-25T13:42:07.695605+0000","last_clean":"2024-04-25T13:42:07.695605+0000","last_became_active":"2024-04-25T13:42:06.431692+0000","last_became_peered":"2024-04-25T13:42:06.431692+0000","last_unstale":"2024-04-25T13:42:07.695605+0000","last_undegraded":"2024-04-25T13:42:07.695605+0000","last_fullsized":"2024-04-25T13:42:07.695605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:00.017229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414280+0000","last_change":"2024-04-25T13:42:05.432614+0000","last_active":"2024-04-25T13:42:07.414280+0000","last_peered":"2024-04-25T13:42:07.414280+0000","last_clean":"2024-04-25T13:42:07.414280+0000","last_became_active":"2024-04-25T13:42:05.432253+0000","last_became_peered":"2024-04-25T13:42:05.432253+0000","last_unstale":"2024-04-25T13:42:07.414280+0000","last_undegraded":"2024-04-25T13:42:07.414280+0000","last_fullsized":"2024-04-25T13:42:07.414280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:42.956198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695726+0000","last_change":"2024-04-25T13:42:06.425502+0000","last_active":"2024-04-25T13:42:07.695726+0000","last_peered":"2024-04-25T13:42:07.695726+0000","last_clean":"2024-04-25T13:42:07.695726+0000","last_became_active":"2024-04-25T13:42:06.425046+0000","last_became_peered":"2024-04-25T13:42:06.425046+0000","last_unstale":"2024-04-25T13:42:07.695726+0000","last_undegraded":"2024-04-25T13:42:07.695726+0000","last_fullsized":"2024-04-25T13:42:07.695726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.382442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185202+0000","last_change":"2024-04-25T13:42:05.423955+0000","last_active":"2024-04-25T13:42:09.185202+0000","last_peered":"2024-04-25T13:42:09.185202+0000","last_clean":"2024-04-25T13:42:09.185202+0000","last_became_active":"2024-04-25T13:42:05.423590+0000","last_became_peered":"2024-04-25T13:42:05.423590+0000","last_unstale":"2024-04-25T13:42:09.185202+0000","last_undegraded":"2024-04-25T13:42:09.185202+0000","last_fullsized":"2024-04-25T13:42:09.185202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:21.589517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414130+0000","last_change":"2024-04-25T13:42:06.425907+0000","last_active":"2024-04-25T13:42:07.414130+0000","last_peered":"2024-04-25T13:42:07.414130+0000","last_clean":"2024-04-25T13:42:07.414130+0000","last_became_active":"2024-04-25T13:42:06.421536+0000","last_became_peered":"2024-04-25T13:42:06.421536+0000","last_unstale":"2024-04-25T13:42:07.414130+0000","last_undegraded":"2024-04-25T13:42:07.414130+0000","last_fullsized":"2024-04-25T13:42:07.414130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:38.216116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416472+0000","last_change":"2024-04-25T13:42:06.412858+0000","last_active":"2024-04-25T13:42:07.416472+0000","last_peered":"2024-04-25T13:42:07.416472+0000","last_clean":"2024-04-25T13:42:07.416472+0000","last_became_active":"2024-04-25T13:42:06.412522+0000","last_became_peered":"2024-04-25T13:42:06.412522+0000","last_unstale":"2024-04-25T13:42:07.416472+0000","last_undegraded":"2024-04-25T13:42:07.416472+0000","last_fullsized":"2024-04-25T13:42:07.416472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:33:49.773341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185086+0000","last_change":"2024-04-25T13:42:05.426488+0000","last_active":"2024-04-25T13:42:09.185086+0000","last_peered":"2024-04-25T13:42:09.185086+0000","last_clean":"2024-04-25T13:42:09.185086+0000","last_became_active":"2024-04-25T13:42:05.426101+0000","last_became_peered":"2024-04-25T13:42:05.426101+0000","last_unstale":"2024-04-25T13:42:09.185086+0000","last_undegraded":"2024-04-25T13:42:09.185086+0000","last_fullsized":"2024-04-25T13:42:09.185086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:58.501999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416286+0000","last_change":"2024-04-25T13:42:06.420385+0000","last_active":"2024-04-25T13:42:07.416286+0000","last_peered":"2024-04-25T13:42:07.416286+0000","last_clean":"2024-04-25T13:42:07.416286+0000","last_became_active":"2024-04-25T13:42:06.419988+0000","last_became_peered":"2024-04-25T13:42:06.419988+0000","last_unstale":"2024-04-25T13:42:07.416286+0000","last_undegraded":"2024-04-25T13:42:07.416286+0000","last_fullsized":"2024-04-25T13:42:07.416286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:54:07.642118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185307+0000","last_change":"2024-04-25T13:42:05.430513+0000","last_active":"2024-04-25T13:42:09.185307+0000","last_peered":"2024-04-25T13:42:09.185307+0000","last_clean":"2024-04-25T13:42:09.185307+0000","last_became_active":"2024-04-25T13:42:05.430211+0000","last_became_peered":"2024-04-25T13:42:05.430211+0000","last_unstale":"2024-04-25T13:42:09.185307+0000","last_undegraded":"2024-04-25T13:42:09.185307+0000","last_fullsized":"2024-04-25T13:42:09.185307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:03.696280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.152490+0000","last_change":"2024-04-25T13:42:06.446137+0000","last_active":"2024-04-25T13:42:09.152490+0000","last_peered":"2024-04-25T13:42:09.152490+0000","last_clean":"2024-04-25T13:42:09.152490+0000","last_became_active":"2024-04-25T13:42:06.445789+0000","last_became_peered":"2024-04-25T13:42:06.445789+0000","last_unstale":"2024-04-25T13:42:09.152490+0000","last_undegraded":"2024-04-25T13:42:09.152490+0000","last_fullsized":"2024-04-25T13:42:09.152490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:43.073677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695972+0000","last_change":"2024-04-25T13:42:05.423990+0000","last_active":"2024-04-25T13:42:07.695972+0000","last_peered":"2024-04-25T13:42:07.695972+0000","last_clean":"2024-04-25T13:42:07.695972+0000","last_became_active":"2024-04-25T13:42:05.420047+0000","last_became_peered":"2024-04-25T13:42:05.420047+0000","last_unstale":"2024-04-25T13:42:07.695972+0000","last_undegraded":"2024-04-25T13:42:07.695972+0000","last_fullsized":"2024-04-25T13:42:07.695972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:18.167829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695905+0000","last_change":"2024-04-25T13:42:06.429258+0000","last_active":"2024-04-25T13:42:07.695905+0000","last_peered":"2024-04-25T13:42:07.695905+0000","last_clean":"2024-04-25T13:42:07.695905+0000","last_became_active":"2024-04-25T13:42:06.428574+0000","last_became_peered":"2024-04-25T13:42:06.428574+0000","last_unstale":"2024-04-25T13:42:07.695905+0000","last_undegraded":"2024-04-25T13:42:07.695905+0000","last_fullsized":"2024-04-25T13:42:07.695905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:32.855388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.152612+0000","last_change":"2024-04-25T13:42:05.418742+0000","last_active":"2024-04-25T13:42:09.152612+0000","last_peered":"2024-04-25T13:42:09.152612+0000","last_clean":"2024-04-25T13:42:09.152612+0000","last_became_active":"2024-04-25T13:42:05.418017+0000","last_became_peered":"2024-04-25T13:42:05.418017+0000","last_unstale":"2024-04-25T13:42:09.152612+0000","last_undegraded":"2024-04-25T13:42:09.152612+0000","last_fullsized":"2024-04-25T13:42:09.152612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:38.792763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":75991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":76151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:42:15.285 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:42:15.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.466+0000 7face5a00640 1 Processor -- start 2024-04-25T13:42:15.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.466+0000 7face5a00640 1 -- start start 2024-04-25T13:42:15.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.466+0000 7face5a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7face00d0f80 0x7face0160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.466+0000 7face5a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7face00b32f0 0x7face00b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.466+0000 7face5a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7face00b3c40 con 0x7face0073be0 2024-04-25T13:42:15.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.466+0000 7face5a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7face015cfe0 con 0x7face00b32f0 2024-04-25T13:42:15.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.466+0000 7face5a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7face0161520 con 0x7face00d0f80 2024-04-25T13:42:15.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.466+0000 7facd6000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7face00b32f0 0x7face00b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.466+0000 7facdf400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7face0073be0 0x7face0073ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53318/0 (socket says 172.21.15.123:53318) 2024-04-25T13:42:15.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.466+0000 7facdf400640 1 -- 172.21.15.123:0/3490887022 learned_addr learned my addr 172.21.15.123:0/3490887022 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:15.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.466+0000 7facdea00640 1 --2- 172.21.15.123:0/3490887022 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7face00d0f80 0x7face0160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.466+0000 7facd6000640 1 -- 172.21.15.123:0/3490887022 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7face00d0f80 msgr2=0x7face0160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:15.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.466+0000 7facd6000640 1 --2- 172.21.15.123:0/3490887022 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7face00d0f80 0x7face0160fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.466+0000 7facd6000640 1 -- 172.21.15.123:0/3490887022 >> v1:172.21.15.123:6789/0 conn(0x7face0073be0 legacy=0x7face0073ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.466+0000 7facd6000640 1 -- 172.21.15.123:0/3490887022 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face015d240 con 0x7face00b32f0 2024-04-25T13:42:15.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.466+0000 7facde000640 1 -- 172.21.15.123:0/3490887022 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4071721171 0 0) 0x7facd80014a0 con 0x7face0073be0 2024-04-25T13:42:15.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.470+0000 7facd6000640 1 --2- 172.21.15.123:0/3490887022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7face00b32f0 0x7face00b3700 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7facc80097c0 tx=0x7facc801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90179334b726ca05 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:15.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.470+0000 7facde000640 1 -- 172.21.15.123:0/3490887022 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc80b1070 con 0x7face00b32f0 2024-04-25T13:42:15.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.470+0000 7facde000640 1 -- 172.21.15.123:0/3490887022 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facc80a8050 con 0x7face00b32f0 2024-04-25T13:42:15.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.470+0000 7facde000640 1 -- 172.21.15.123:0/3490887022 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc80ac860 con 0x7face00b32f0 2024-04-25T13:42:15.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.470+0000 7face5a00640 1 -- 172.21.15.123:0/3490887022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7face00b32f0 msgr2=0x7face00b3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.470+0000 7face5a00640 1 --2- 172.21.15.123:0/3490887022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7face00b32f0 0x7face00b3700 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7facc80097c0 tx=0x7facc801c3e0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.470+0000 7face5a00640 1 -- 172.21.15.123:0/3490887022 shutdown_connections 2024-04-25T13:42:15.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.470+0000 7face5a00640 1 --2- 172.21.15.123:0/3490887022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7face00b32f0 0x7face00b3700 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.470+0000 7face5a00640 1 --2- 172.21.15.123:0/3490887022 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7face00d0f80 0x7face0160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.470+0000 7face5a00640 1 -- 172.21.15.123:0/3490887022 >> 172.21.15.123:0/3490887022 conn(0x7face006d210 msgr2=0x7face006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:15.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.470+0000 7face5a00640 1 -- 172.21.15.123:0/3490887022 shutdown_connections 2024-04-25T13:42:15.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.470+0000 7face5a00640 1 -- 172.21.15.123:0/3490887022 wait complete. 2024-04-25T13:42:15.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.474+0000 7face5a00640 1 Processor -- start 2024-04-25T13:42:15.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.474+0000 7face5a00640 1 -- start start 2024-04-25T13:42:15.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.474+0000 7face5a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7face0073be0 0x7face01587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.474+0000 7face5a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7face00b32f0 0x7face0155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.474+0000 7face5a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7face00d0f80 0x7face0156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.474+0000 7face5a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7face00b6020 con 0x7face0073be0 2024-04-25T13:42:15.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.474+0000 7face5a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7face015ddc0 con 0x7face00b32f0 2024-04-25T13:42:15.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.474+0000 7face5a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7face00b6470 con 0x7face00d0f80 2024-04-25T13:42:15.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.474+0000 7facdea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7face0073be0 0x7face01587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.474+0000 7facdea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7face0073be0 0x7face01587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37572/0 (socket says 172.21.15.123:37572) 2024-04-25T13:42:15.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.474+0000 7facdea00640 1 -- 172.21.15.123:0/4208912194 learned_addr learned my addr 172.21.15.123:0/4208912194 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:15.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.474+0000 7facdea00640 1 -- 172.21.15.123:0/4208912194 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7face00d0f80 msgr2=0x7face0156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.474+0000 7facdea00640 1 --2- 172.21.15.123:0/4208912194 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7face00d0f80 0x7face0156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.474+0000 7facdea00640 1 -- 172.21.15.123:0/4208912194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7face00b32f0 msgr2=0x7face0155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.474+0000 7facdea00640 1 --2- 172.21.15.123:0/4208912194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7face00b32f0 0x7face0155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.474+0000 7facdea00640 1 -- 172.21.15.123:0/4208912194 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face00b4650 con 0x7face0073be0 2024-04-25T13:42:15.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.478+0000 7facdea00640 1 --2- 172.21.15.123:0/4208912194 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7face0073be0 0x7face01587d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7facd000d600 tx=0x7facd000dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:15.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.478+0000 7facd7400640 1 -- 172.21.15.123:0/4208912194 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd0004240 con 0x7face0073be0 2024-04-25T13:42:15.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.478+0000 7facd7400640 1 -- 172.21.15.123:0/4208912194 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facd00043e0 con 0x7face0073be0 2024-04-25T13:42:15.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.478+0000 7facd7400640 1 -- 172.21.15.123:0/4208912194 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd0003840 con 0x7face0073be0 2024-04-25T13:42:15.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.478+0000 7face5a00640 1 -- 172.21.15.123:0/4208912194 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7face014eba0 con 0x7face0073be0 2024-04-25T13:42:15.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.478+0000 7face5a00640 1 -- 172.21.15.123:0/4208912194 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7face0158480 con 0x7face0073be0 2024-04-25T13:42:15.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.478+0000 7face5a00640 1 -- 172.21.15.123:0/4208912194 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7face00507c0 con 0x7face0073be0 2024-04-25T13:42:15.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.478+0000 7facd7400640 1 -- 172.21.15.123:0/4208912194 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7facd00039e0 con 0x7face0073be0 2024-04-25T13:42:15.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.482+0000 7facd7400640 1 --2- 172.21.15.123:0/4208912194 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7facbc06f400 0x7facbc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.482+0000 7facd7400640 1 -- 172.21.15.123:0/4208912194 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7facd008f610 con 0x7face0073be0 2024-04-25T13:42:15.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.482+0000 7facd6000640 1 --2- 172.21.15.123:0/4208912194 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7facbc06f400 0x7facbc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.482+0000 7facd6000640 1 --2- 172.21.15.123:0/4208912194 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7facbc06f400 0x7facbc071910 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7facc80ae000 tx=0x7facc8004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:15.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.486+0000 7facd7400640 1 -- 172.21.15.123:0/4208912194 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7facd005c460 con 0x7face0073be0 2024-04-25T13:42:15.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.638+0000 7face5a00640 1 -- 172.21.15.123:0/4208912194 --> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7face0157f50 con 0x7facbc06f400 2024-04-25T13:42:15.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.646+0000 7facd7400640 1 -- 172.21.15.123:0/4208912194 <== mgr.4107 v2:172.21.15.123:6832/715752891 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251825 (secure 0 0 0) 0x7face0157f50 con 0x7facbc06f400 2024-04-25T13:42:15.652 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:15.654 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-04-25T13:42:15.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.650+0000 7face5a00640 1 -- 172.21.15.123:0/4208912194 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7facbc06f400 msgr2=0x7facbc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.650+0000 7face5a00640 1 --2- 172.21.15.123:0/4208912194 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7facbc06f400 0x7facbc071910 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7facc80ae000 tx=0x7facc8004740 comp rx=0 tx=0).stop 2024-04-25T13:42:15.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.650+0000 7face5a00640 1 -- 172.21.15.123:0/4208912194 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7face0073be0 msgr2=0x7face01587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.650+0000 7face5a00640 1 --2- 172.21.15.123:0/4208912194 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7face0073be0 0x7face01587d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7facd000d600 tx=0x7facd000dac0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.650+0000 7face5a00640 1 -- 172.21.15.123:0/4208912194 shutdown_connections 2024-04-25T13:42:15.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.650+0000 7face5a00640 1 --2- 172.21.15.123:0/4208912194 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7face00b32f0 0x7face0155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.650+0000 7face5a00640 1 --2- 172.21.15.123:0/4208912194 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7facbc06f400 0x7facbc071910 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.650+0000 7face5a00640 1 --2- 172.21.15.123:0/4208912194 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7face00d0f80 0x7face0156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.650+0000 7face5a00640 1 --2- 172.21.15.123:0/4208912194 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7face0073be0 0x7face01587d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.650+0000 7face5a00640 1 -- 172.21.15.123:0/4208912194 >> 172.21.15.123:0/4208912194 conn(0x7face006d210 msgr2=0x7face0073ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:15.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.650+0000 7face5a00640 1 -- 172.21.15.123:0/4208912194 shutdown_connections 2024-04-25T13:42:15.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.650+0000 7face5a00640 1 -- 172.21.15.123:0/4208912194 wait complete. 2024-04-25T13:42:15.674 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-25T13:42:15.578369+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219108,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755612,"statfs":{"total":773094113280,"available":772869746688,"internally_reserved":0,"allocated":2990080,"data_stored":1793484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.182905"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185435+0000","last_change":"2024-04-25T13:42:06.439729+0000","last_active":"2024-04-25T13:42:09.185435+0000","last_peered":"2024-04-25T13:42:09.185435+0000","last_clean":"2024-04-25T13:42:09.185435+0000","last_became_active":"2024-04-25T13:42:06.439449+0000","last_became_peered":"2024-04-25T13:42:06.439449+0000","last_unstale":"2024-04-25T13:42:09.185435+0000","last_undegraded":"2024-04-25T13:42:09.185435+0000","last_fullsized":"2024-04-25T13:42:09.185435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:32:17.132420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414744+0000","last_change":"2024-04-25T13:42:06.425008+0000","last_active":"2024-04-25T13:42:07.414744+0000","last_peered":"2024-04-25T13:42:07.414744+0000","last_clean":"2024-04-25T13:42:07.414744+0000","last_became_active":"2024-04-25T13:42:06.424669+0000","last_became_peered":"2024-04-25T13:42:06.424669+0000","last_unstale":"2024-04-25T13:42:07.414744+0000","last_undegraded":"2024-04-25T13:42:07.414744+0000","last_fullsized":"2024-04-25T13:42:07.414744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.382442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.152496+0000","last_change":"2024-04-25T13:42:06.425220+0000","last_active":"2024-04-25T13:42:09.152496+0000","last_peered":"2024-04-25T13:42:09.152496+0000","last_clean":"2024-04-25T13:42:09.152496+0000","last_became_active":"2024-04-25T13:42:06.424908+0000","last_became_peered":"2024-04-25T13:42:06.424908+0000","last_unstale":"2024-04-25T13:42:09.152496+0000","last_undegraded":"2024-04-25T13:42:09.152496+0000","last_fullsized":"2024-04-25T13:42:09.152496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:38.216116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416285+0000","last_change":"2024-04-25T13:42:06.437672+0000","last_active":"2024-04-25T13:42:07.416285+0000","last_peered":"2024-04-25T13:42:07.416285+0000","last_clean":"2024-04-25T13:42:07.416285+0000","last_became_active":"2024-04-25T13:42:06.425596+0000","last_became_peered":"2024-04-25T13:42:06.425596+0000","last_unstale":"2024-04-25T13:42:07.416285+0000","last_undegraded":"2024-04-25T13:42:07.416285+0000","last_fullsized":"2024-04-25T13:42:07.416285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:37.549411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185015+0000","last_change":"2024-04-25T13:42:06.435739+0000","last_active":"2024-04-25T13:42:09.185015+0000","last_peered":"2024-04-25T13:42:09.185015+0000","last_clean":"2024-04-25T13:42:09.185015+0000","last_became_active":"2024-04-25T13:42:06.435439+0000","last_became_peered":"2024-04-25T13:42:06.435439+0000","last_unstale":"2024-04-25T13:42:09.185015+0000","last_undegraded":"2024-04-25T13:42:09.185015+0000","last_fullsized":"2024-04-25T13:42:09.185015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:02.934983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415289+0000","last_change":"2024-04-25T13:42:06.442430+0000","last_active":"2024-04-25T13:42:07.415289+0000","last_peered":"2024-04-25T13:42:07.415289+0000","last_clean":"2024-04-25T13:42:07.415289+0000","last_became_active":"2024-04-25T13:42:06.442052+0000","last_became_peered":"2024-04-25T13:42:06.442052+0000","last_unstale":"2024-04-25T13:42:07.415289+0000","last_undegraded":"2024-04-25T13:42:07.415289+0000","last_fullsized":"2024-04-25T13:42:07.415289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.382442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.184820+0000","last_change":"2024-04-25T13:42:06.435115+0000","last_active":"2024-04-25T13:42:09.184820+0000","last_peered":"2024-04-25T13:42:09.184820+0000","last_clean":"2024-04-25T13:42:09.184820+0000","last_became_active":"2024-04-25T13:42:06.434872+0000","last_became_peered":"2024-04-25T13:42:06.434872+0000","last_unstale":"2024-04-25T13:42:09.184820+0000","last_undegraded":"2024-04-25T13:42:09.184820+0000","last_fullsized":"2024-04-25T13:42:09.184820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:37.549411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695416+0000","last_change":"2024-04-25T13:42:06.447825+0000","last_active":"2024-04-25T13:42:07.695416+0000","last_peered":"2024-04-25T13:42:07.695416+0000","last_clean":"2024-04-25T13:42:07.695416+0000","last_became_active":"2024-04-25T13:42:06.447512+0000","last_became_peered":"2024-04-25T13:42:06.447512+0000","last_unstale":"2024-04-25T13:42:07.695416+0000","last_undegraded":"2024-04-25T13:42:07.695416+0000","last_fullsized":"2024-04-25T13:42:07.695416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:54.457915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185496+0000","last_change":"2024-04-25T13:42:06.449425+0000","last_active":"2024-04-25T13:42:09.185496+0000","last_peered":"2024-04-25T13:42:09.185496+0000","last_clean":"2024-04-25T13:42:09.185496+0000","last_became_active":"2024-04-25T13:42:06.449116+0000","last_became_peered":"2024-04-25T13:42:06.449116+0000","last_unstale":"2024-04-25T13:42:09.185496+0000","last_undegraded":"2024-04-25T13:42:09.185496+0000","last_fullsized":"2024-04-25T13:42:09.185496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:02.944734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414743+0000","last_change":"2024-04-25T13:42:06.444979+0000","last_active":"2024-04-25T13:42:07.414743+0000","last_peered":"2024-04-25T13:42:07.414743+0000","last_clean":"2024-04-25T13:42:07.414743+0000","last_became_active":"2024-04-25T13:42:06.444648+0000","last_became_peered":"2024-04-25T13:42:06.444648+0000","last_unstale":"2024-04-25T13:42:07.414743+0000","last_undegraded":"2024-04-25T13:42:07.414743+0000","last_fullsized":"2024-04-25T13:42:07.414743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:45.608285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414435+0000","last_change":"2024-04-25T13:42:06.445383+0000","last_active":"2024-04-25T13:42:07.414435+0000","last_peered":"2024-04-25T13:42:07.414435+0000","last_clean":"2024-04-25T13:42:07.414435+0000","last_became_active":"2024-04-25T13:42:06.445066+0000","last_became_peered":"2024-04-25T13:42:06.445066+0000","last_unstale":"2024-04-25T13:42:07.414435+0000","last_undegraded":"2024-04-25T13:42:07.414435+0000","last_fullsized":"2024-04-25T13:42:07.414435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:43.073677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.870052+0000","last_change":"2024-04-25T13:42:06.436929+0000","last_active":"2024-04-25T13:42:07.870052+0000","last_peered":"2024-04-25T13:42:07.870052+0000","last_clean":"2024-04-25T13:42:07.870052+0000","last_became_active":"2024-04-25T13:42:06.436642+0000","last_became_peered":"2024-04-25T13:42:06.436642+0000","last_unstale":"2024-04-25T13:42:07.870052+0000","last_undegraded":"2024-04-25T13:42:07.870052+0000","last_fullsized":"2024-04-25T13:42:07.870052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:59.508605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695711+0000","last_change":"2024-04-25T13:42:06.421115+0000","last_active":"2024-04-25T13:42:07.695711+0000","last_peered":"2024-04-25T13:42:07.695711+0000","last_clean":"2024-04-25T13:42:07.695711+0000","last_became_active":"2024-04-25T13:42:06.420817+0000","last_became_peered":"2024-04-25T13:42:06.420817+0000","last_unstale":"2024-04-25T13:42:07.695711+0000","last_undegraded":"2024-04-25T13:42:07.695711+0000","last_fullsized":"2024-04-25T13:42:07.695711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:45.608285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.152320+0000","last_change":"2024-04-25T13:42:06.430965+0000","last_active":"2024-04-25T13:42:09.152320+0000","last_peered":"2024-04-25T13:42:09.152320+0000","last_clean":"2024-04-25T13:42:09.152320+0000","last_became_active":"2024-04-25T13:42:06.430586+0000","last_became_peered":"2024-04-25T13:42:06.430586+0000","last_unstale":"2024-04-25T13:42:09.152320+0000","last_undegraded":"2024-04-25T13:42:09.152320+0000","last_fullsized":"2024-04-25T13:42:09.152320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:22:44.638274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414156+0000","last_change":"2024-04-25T13:42:06.414901+0000","last_active":"2024-04-25T13:42:07.414156+0000","last_peered":"2024-04-25T13:42:07.414156+0000","last_clean":"2024-04-25T13:42:07.414156+0000","last_became_active":"2024-04-25T13:42:06.414422+0000","last_became_peered":"2024-04-25T13:42:06.414422+0000","last_unstale":"2024-04-25T13:42:07.414156+0000","last_undegraded":"2024-04-25T13:42:07.414156+0000","last_fullsized":"2024-04-25T13:42:07.414156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:43.073677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414538+0000","last_change":"2024-04-25T13:42:06.429527+0000","last_active":"2024-04-25T13:42:07.414538+0000","last_peered":"2024-04-25T13:42:07.414538+0000","last_clean":"2024-04-25T13:42:07.414538+0000","last_became_active":"2024-04-25T13:42:06.428862+0000","last_became_peered":"2024-04-25T13:42:06.428862+0000","last_unstale":"2024-04-25T13:42:07.414538+0000","last_undegraded":"2024-04-25T13:42:07.414538+0000","last_fullsized":"2024-04-25T13:42:07.414538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:21.556056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416688+0000","last_change":"2024-04-25T13:42:06.445283+0000","last_active":"2024-04-25T13:42:07.416688+0000","last_peered":"2024-04-25T13:42:07.416688+0000","last_clean":"2024-04-25T13:42:07.416688+0000","last_became_active":"2024-04-25T13:42:06.445004+0000","last_became_peered":"2024-04-25T13:42:06.445004+0000","last_unstale":"2024-04-25T13:42:07.416688+0000","last_undegraded":"2024-04-25T13:42:07.416688+0000","last_fullsized":"2024-04-25T13:42:07.416688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:36:55.456363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185195+0000","last_change":"2024-04-25T13:42:06.427048+0000","last_active":"2024-04-25T13:42:09.185195+0000","last_peered":"2024-04-25T13:42:09.185195+0000","last_clean":"2024-04-25T13:42:09.185195+0000","last_became_active":"2024-04-25T13:42:06.426733+0000","last_became_peered":"2024-04-25T13:42:06.426733+0000","last_unstale":"2024-04-25T13:42:09.185195+0000","last_undegraded":"2024-04-25T13:42:09.185195+0000","last_fullsized":"2024-04-25T13:42:09.185195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:59.508605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185536+0000","last_change":"2024-04-25T13:42:06.440148+0000","last_active":"2024-04-25T13:42:09.185536+0000","last_peered":"2024-04-25T13:42:09.185536+0000","last_clean":"2024-04-25T13:42:09.185536+0000","last_became_active":"2024-04-25T13:42:06.439713+0000","last_became_peered":"2024-04-25T13:42:06.439713+0000","last_unstale":"2024-04-25T13:42:09.185536+0000","last_undegraded":"2024-04-25T13:42:09.185536+0000","last_fullsized":"2024-04-25T13:42:09.185536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:42:09.245771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415435+0000","last_change":"2024-04-25T13:42:06.420914+0000","last_active":"2024-04-25T13:42:07.415435+0000","last_peered":"2024-04-25T13:42:07.415435+0000","last_clean":"2024-04-25T13:42:07.415435+0000","last_became_active":"2024-04-25T13:42:06.420671+0000","last_became_peered":"2024-04-25T13:42:06.420671+0000","last_unstale":"2024-04-25T13:42:07.415435+0000","last_undegraded":"2024-04-25T13:42:07.415435+0000","last_fullsized":"2024-04-25T13:42:07.415435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.382442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.152542+0000","last_change":"2024-04-25T13:42:06.436778+0000","last_active":"2024-04-25T13:42:09.152542+0000","last_peered":"2024-04-25T13:42:09.152542+0000","last_clean":"2024-04-25T13:42:09.152542+0000","last_became_active":"2024-04-25T13:42:06.436267+0000","last_became_peered":"2024-04-25T13:42:06.436267+0000","last_unstale":"2024-04-25T13:42:09.152542+0000","last_undegraded":"2024-04-25T13:42:09.152542+0000","last_fullsized":"2024-04-25T13:42:09.152542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:45.608285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415476+0000","last_change":"2024-04-25T13:42:06.426502+0000","last_active":"2024-04-25T13:42:07.415476+0000","last_peered":"2024-04-25T13:42:07.415476+0000","last_clean":"2024-04-25T13:42:07.415476+0000","last_became_active":"2024-04-25T13:42:06.426235+0000","last_became_peered":"2024-04-25T13:42:06.426235+0000","last_unstale":"2024-04-25T13:42:07.415476+0000","last_undegraded":"2024-04-25T13:42:07.415476+0000","last_fullsized":"2024-04-25T13:42:07.415476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:38.780588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695449+0000","last_change":"2024-04-25T13:42:06.415204+0000","last_active":"2024-04-25T13:42:07.695449+0000","last_peered":"2024-04-25T13:42:07.695449+0000","last_clean":"2024-04-25T13:42:07.695449+0000","last_became_active":"2024-04-25T13:42:06.414815+0000","last_became_peered":"2024-04-25T13:42:06.414815+0000","last_unstale":"2024-04-25T13:42:07.695449+0000","last_undegraded":"2024-04-25T13:42:07.695449+0000","last_fullsized":"2024-04-25T13:42:07.695449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:38.216116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414732+0000","last_change":"2024-04-25T13:42:06.429164+0000","last_active":"2024-04-25T13:42:07.414732+0000","last_peered":"2024-04-25T13:42:07.414732+0000","last_clean":"2024-04-25T13:42:07.414732+0000","last_became_active":"2024-04-25T13:42:06.428466+0000","last_became_peered":"2024-04-25T13:42:06.428466+0000","last_unstale":"2024-04-25T13:42:07.414732+0000","last_undegraded":"2024-04-25T13:42:07.414732+0000","last_fullsized":"2024-04-25T13:42:07.414732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:45.608285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695932+0000","last_change":"2024-04-25T13:42:06.416633+0000","last_active":"2024-04-25T13:42:07.695932+0000","last_peered":"2024-04-25T13:42:07.695932+0000","last_clean":"2024-04-25T13:42:07.695932+0000","last_became_active":"2024-04-25T13:42:06.415982+0000","last_became_peered":"2024-04-25T13:42:06.415982+0000","last_unstale":"2024-04-25T13:42:07.695932+0000","last_undegraded":"2024-04-25T13:42:07.695932+0000","last_fullsized":"2024-04-25T13:42:07.695932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:37.549411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414733+0000","last_change":"2024-04-25T13:42:06.429813+0000","last_active":"2024-04-25T13:42:07.414733+0000","last_peered":"2024-04-25T13:42:07.414733+0000","last_clean":"2024-04-25T13:42:07.414733+0000","last_became_active":"2024-04-25T13:42:06.429201+0000","last_became_peered":"2024-04-25T13:42:06.429201+0000","last_unstale":"2024-04-25T13:42:07.414733+0000","last_undegraded":"2024-04-25T13:42:07.414733+0000","last_fullsized":"2024-04-25T13:42:07.414733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:21.556056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414552+0000","last_change":"2024-04-25T13:42:06.423487+0000","last_active":"2024-04-25T13:42:07.414552+0000","last_peered":"2024-04-25T13:42:07.414552+0000","last_clean":"2024-04-25T13:42:07.414552+0000","last_became_active":"2024-04-25T13:42:06.423175+0000","last_became_peered":"2024-04-25T13:42:06.423175+0000","last_unstale":"2024-04-25T13:42:07.414552+0000","last_undegraded":"2024-04-25T13:42:07.414552+0000","last_fullsized":"2024-04-25T13:42:07.414552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:45.608285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695845+0000","last_change":"2024-04-25T13:42:06.419669+0000","last_active":"2024-04-25T13:42:07.695845+0000","last_peered":"2024-04-25T13:42:07.695845+0000","last_clean":"2024-04-25T13:42:07.695845+0000","last_became_active":"2024-04-25T13:42:06.419352+0000","last_became_peered":"2024-04-25T13:42:06.419352+0000","last_unstale":"2024-04-25T13:42:07.695845+0000","last_undegraded":"2024-04-25T13:42:07.695845+0000","last_fullsized":"2024-04-25T13:42:07.695845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:38.780588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.152539+0000","last_change":"2024-04-25T13:42:06.424606+0000","last_active":"2024-04-25T13:42:09.152539+0000","last_peered":"2024-04-25T13:42:09.152539+0000","last_clean":"2024-04-25T13:42:09.152539+0000","last_became_active":"2024-04-25T13:42:06.424286+0000","last_became_peered":"2024-04-25T13:42:06.424286+0000","last_unstale":"2024-04-25T13:42:09.152539+0000","last_undegraded":"2024-04-25T13:42:09.152539+0000","last_fullsized":"2024-04-25T13:42:09.152539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:21.556056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415714+0000","last_change":"2024-04-25T13:42:06.437956+0000","last_active":"2024-04-25T13:42:07.415714+0000","last_peered":"2024-04-25T13:42:07.415714+0000","last_clean":"2024-04-25T13:42:07.415714+0000","last_became_active":"2024-04-25T13:42:06.437530+0000","last_became_peered":"2024-04-25T13:42:06.437530+0000","last_unstale":"2024-04-25T13:42:07.415714+0000","last_undegraded":"2024-04-25T13:42:07.415714+0000","last_fullsized":"2024-04-25T13:42:07.415714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:32.855388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185050+0000","last_change":"2024-04-25T13:42:06.420035+0000","last_active":"2024-04-25T13:42:09.185050+0000","last_peered":"2024-04-25T13:42:09.185050+0000","last_clean":"2024-04-25T13:42:09.185050+0000","last_became_active":"2024-04-25T13:42:06.419452+0000","last_became_peered":"2024-04-25T13:42:06.419452+0000","last_unstale":"2024-04-25T13:42:09.185050+0000","last_undegraded":"2024-04-25T13:42:09.185050+0000","last_fullsized":"2024-04-25T13:42:09.185050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:22.596123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414133+0000","last_change":"2024-04-25T13:42:06.428858+0000","last_active":"2024-04-25T13:42:07.414133+0000","last_peered":"2024-04-25T13:42:07.414133+0000","last_clean":"2024-04-25T13:42:07.414133+0000","last_became_active":"2024-04-25T13:42:06.428622+0000","last_became_peered":"2024-04-25T13:42:06.428622+0000","last_unstale":"2024-04-25T13:42:07.414133+0000","last_undegraded":"2024-04-25T13:42:07.414133+0000","last_fullsized":"2024-04-25T13:42:07.414133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:54.457915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.869806+0000","last_change":"2024-04-25T13:42:06.412033+0000","last_active":"2024-04-25T13:42:07.869806+0000","last_peered":"2024-04-25T13:42:07.869806+0000","last_clean":"2024-04-25T13:42:07.869806+0000","last_became_active":"2024-04-25T13:42:06.411702+0000","last_became_peered":"2024-04-25T13:42:06.411702+0000","last_unstale":"2024-04-25T13:42:07.869806+0000","last_undegraded":"2024-04-25T13:42:07.869806+0000","last_fullsized":"2024-04-25T13:42:07.869806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:21.415710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695870+0000","last_change":"2024-04-25T13:42:05.426545+0000","last_active":"2024-04-25T13:42:07.695870+0000","last_peered":"2024-04-25T13:42:07.695870+0000","last_clean":"2024-04-25T13:42:07.695870+0000","last_became_active":"2024-04-25T13:42:05.425486+0000","last_became_peered":"2024-04-25T13:42:05.425486+0000","last_unstale":"2024-04-25T13:42:07.695870+0000","last_undegraded":"2024-04-25T13:42:07.695870+0000","last_fullsized":"2024-04-25T13:42:07.695870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:38.792763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.152691+0000","last_change":"2024-04-25T13:42:06.424104+0000","last_active":"2024-04-25T13:42:09.152691+0000","last_peered":"2024-04-25T13:42:09.152691+0000","last_clean":"2024-04-25T13:42:09.152691+0000","last_became_active":"2024-04-25T13:42:06.423795+0000","last_became_peered":"2024-04-25T13:42:06.423795+0000","last_unstale":"2024-04-25T13:42:09.152691+0000","last_undegraded":"2024-04-25T13:42:09.152691+0000","last_fullsized":"2024-04-25T13:42:09.152691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:38.780588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414254+0000","last_change":"2024-04-25T13:42:05.412559+0000","last_active":"2024-04-25T13:42:07.414254+0000","last_peered":"2024-04-25T13:42:07.414254+0000","last_clean":"2024-04-25T13:42:07.414254+0000","last_became_active":"2024-04-25T13:42:05.412190+0000","last_became_peered":"2024-04-25T13:42:05.412190+0000","last_unstale":"2024-04-25T13:42:07.414254+0000","last_undegraded":"2024-04-25T13:42:07.414254+0000","last_fullsized":"2024-04-25T13:42:07.414254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:20.409104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695565+0000","last_change":"2024-04-25T13:42:05.425544+0000","last_active":"2024-04-25T13:42:07.695565+0000","last_peered":"2024-04-25T13:42:07.695565+0000","last_clean":"2024-04-25T13:42:07.695565+0000","last_became_active":"2024-04-25T13:42:05.425115+0000","last_became_peered":"2024-04-25T13:42:05.425115+0000","last_unstale":"2024-04-25T13:42:07.695565+0000","last_undegraded":"2024-04-25T13:42:07.695565+0000","last_fullsized":"2024-04-25T13:42:07.695565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:25.873825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695674+0000","last_change":"2024-04-25T13:42:06.428073+0000","last_active":"2024-04-25T13:42:07.695674+0000","last_peered":"2024-04-25T13:42:07.695674+0000","last_clean":"2024-04-25T13:42:07.695674+0000","last_became_active":"2024-04-25T13:42:06.427682+0000","last_became_peered":"2024-04-25T13:42:06.427682+0000","last_unstale":"2024-04-25T13:42:07.695674+0000","last_undegraded":"2024-04-25T13:42:07.695674+0000","last_fullsized":"2024-04-25T13:42:07.695674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:21.556056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414858+0000","last_change":"2024-04-25T13:42:05.409548+0000","last_active":"2024-04-25T13:42:07.414858+0000","last_peered":"2024-04-25T13:42:07.414858+0000","last_clean":"2024-04-25T13:42:07.414858+0000","last_became_active":"2024-04-25T13:42:05.409160+0000","last_became_peered":"2024-04-25T13:42:05.409160+0000","last_unstale":"2024-04-25T13:42:07.414858+0000","last_undegraded":"2024-04-25T13:42:07.414858+0000","last_fullsized":"2024-04-25T13:42:07.414858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:42.956198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414147+0000","last_change":"2024-04-25T13:42:06.417091+0000","last_active":"2024-04-25T13:42:07.414147+0000","last_peered":"2024-04-25T13:42:07.414147+0000","last_clean":"2024-04-25T13:42:07.414147+0000","last_became_active":"2024-04-25T13:42:06.416569+0000","last_became_peered":"2024-04-25T13:42:06.416569+0000","last_unstale":"2024-04-25T13:42:07.414147+0000","last_undegraded":"2024-04-25T13:42:07.414147+0000","last_fullsized":"2024-04-25T13:42:07.414147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:38.216116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414775+0000","last_change":"2024-04-25T13:42:05.418974+0000","last_active":"2024-04-25T13:42:07.414775+0000","last_peered":"2024-04-25T13:42:07.414775+0000","last_clean":"2024-04-25T13:42:07.414775+0000","last_became_active":"2024-04-25T13:42:05.418671+0000","last_became_peered":"2024-04-25T13:42:05.418671+0000","last_unstale":"2024-04-25T13:42:07.414775+0000","last_undegraded":"2024-04-25T13:42:07.414775+0000","last_fullsized":"2024-04-25T13:42:07.414775+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:50.166504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416407+0000","last_change":"2024-04-25T13:42:06.439202+0000","last_active":"2024-04-25T13:42:07.416407+0000","last_peered":"2024-04-25T13:42:07.416407+0000","last_clean":"2024-04-25T13:42:07.416407+0000","last_became_active":"2024-04-25T13:42:06.438901+0000","last_became_peered":"2024-04-25T13:42:06.438901+0000","last_unstale":"2024-04-25T13:42:07.416407+0000","last_undegraded":"2024-04-25T13:42:07.416407+0000","last_fullsized":"2024-04-25T13:42:07.416407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:02.934983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416416+0000","last_change":"2024-04-25T13:42:05.418579+0000","last_active":"2024-04-25T13:42:07.416416+0000","last_peered":"2024-04-25T13:42:07.416416+0000","last_clean":"2024-04-25T13:42:07.416416+0000","last_became_active":"2024-04-25T13:42:05.418233+0000","last_became_peered":"2024-04-25T13:42:05.418233+0000","last_unstale":"2024-04-25T13:42:07.416416+0000","last_undegraded":"2024-04-25T13:42:07.416416+0000","last_fullsized":"2024-04-25T13:42:07.416416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:20.409104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.152525+0000","last_change":"2024-04-25T13:42:06.449721+0000","last_active":"2024-04-25T13:42:09.152525+0000","last_peered":"2024-04-25T13:42:09.152525+0000","last_clean":"2024-04-25T13:42:09.152525+0000","last_became_active":"2024-04-25T13:42:06.449373+0000","last_became_peered":"2024-04-25T13:42:06.449373+0000","last_unstale":"2024-04-25T13:42:09.152525+0000","last_undegraded":"2024-04-25T13:42:09.152525+0000","last_fullsized":"2024-04-25T13:42:09.152525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:00.017229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414570+0000","last_change":"2024-04-25T13:42:05.418805+0000","last_active":"2024-04-25T13:42:07.414570+0000","last_peered":"2024-04-25T13:42:07.414570+0000","last_clean":"2024-04-25T13:42:07.414570+0000","last_became_active":"2024-04-25T13:42:05.418384+0000","last_became_peered":"2024-04-25T13:42:05.418384+0000","last_unstale":"2024-04-25T13:42:07.414570+0000","last_undegraded":"2024-04-25T13:42:07.414570+0000","last_fullsized":"2024-04-25T13:42:07.414570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:21.589517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.870107+0000","last_change":"2024-04-25T13:42:06.415649+0000","last_active":"2024-04-25T13:42:07.870107+0000","last_peered":"2024-04-25T13:42:07.870107+0000","last_clean":"2024-04-25T13:42:07.870107+0000","last_became_active":"2024-04-25T13:42:06.411373+0000","last_became_peered":"2024-04-25T13:42:06.411373+0000","last_unstale":"2024-04-25T13:42:07.870107+0000","last_undegraded":"2024-04-25T13:42:07.870107+0000","last_fullsized":"2024-04-25T13:42:07.870107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:04.702886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415602+0000","last_change":"2024-04-25T13:42:05.423758+0000","last_active":"2024-04-25T13:42:07.415602+0000","last_peered":"2024-04-25T13:42:07.415602+0000","last_clean":"2024-04-25T13:42:07.415602+0000","last_became_active":"2024-04-25T13:42:05.423343+0000","last_became_peered":"2024-04-25T13:42:05.423343+0000","last_unstale":"2024-04-25T13:42:07.415602+0000","last_undegraded":"2024-04-25T13:42:07.415602+0000","last_fullsized":"2024-04-25T13:42:07.415602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:42.956198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185169+0000","last_change":"2024-04-25T13:42:06.438756+0000","last_active":"2024-04-25T13:42:09.185169+0000","last_peered":"2024-04-25T13:42:09.185169+0000","last_clean":"2024-04-25T13:42:09.185169+0000","last_became_active":"2024-04-25T13:42:06.432572+0000","last_became_peered":"2024-04-25T13:42:06.432572+0000","last_unstale":"2024-04-25T13:42:09.185169+0000","last_undegraded":"2024-04-25T13:42:09.185169+0000","last_fullsized":"2024-04-25T13:42:09.185169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:33:49.773341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.152670+0000","last_change":"2024-04-25T13:42:05.405101+0000","last_active":"2024-04-25T13:42:09.152670+0000","last_peered":"2024-04-25T13:42:09.152670+0000","last_clean":"2024-04-25T13:42:09.152670+0000","last_became_active":"2024-04-25T13:42:05.404246+0000","last_became_peered":"2024-04-25T13:42:05.404246+0000","last_unstale":"2024-04-25T13:42:09.152670+0000","last_undegraded":"2024-04-25T13:42:09.152670+0000","last_fullsized":"2024-04-25T13:42:09.152670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:25.873825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.152327+0000","last_change":"2024-04-25T13:42:06.436678+0000","last_active":"2024-04-25T13:42:09.152327+0000","last_peered":"2024-04-25T13:42:09.152327+0000","last_clean":"2024-04-25T13:42:09.152327+0000","last_became_active":"2024-04-25T13:42:06.436287+0000","last_became_peered":"2024-04-25T13:42:06.436287+0000","last_unstale":"2024-04-25T13:42:09.152327+0000","last_undegraded":"2024-04-25T13:42:09.152327+0000","last_fullsized":"2024-04-25T13:42:09.152327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:54.457915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415802+0000","last_change":"2024-04-25T13:42:05.417191+0000","last_active":"2024-04-25T13:42:07.415802+0000","last_peered":"2024-04-25T13:42:07.415802+0000","last_clean":"2024-04-25T13:42:07.415802+0000","last_became_active":"2024-04-25T13:42:05.416840+0000","last_became_peered":"2024-04-25T13:42:05.416840+0000","last_unstale":"2024-04-25T13:42:07.415802+0000","last_undegraded":"2024-04-25T13:42:07.415802+0000","last_fullsized":"2024-04-25T13:42:07.415802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:50.166504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185168+0000","last_change":"2024-04-25T13:42:06.444118+0000","last_active":"2024-04-25T13:42:09.185168+0000","last_peered":"2024-04-25T13:42:09.185168+0000","last_clean":"2024-04-25T13:42:09.185168+0000","last_became_active":"2024-04-25T13:42:06.443524+0000","last_became_peered":"2024-04-25T13:42:06.443524+0000","last_unstale":"2024-04-25T13:42:09.185168+0000","last_undegraded":"2024-04-25T13:42:09.185168+0000","last_fullsized":"2024-04-25T13:42:09.185168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:55.637014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414098+0000","last_change":"2024-04-25T13:42:05.414280+0000","last_active":"2024-04-25T13:42:07.414098+0000","last_peered":"2024-04-25T13:42:07.414098+0000","last_clean":"2024-04-25T13:42:07.414098+0000","last_became_active":"2024-04-25T13:42:05.413281+0000","last_became_peered":"2024-04-25T13:42:05.413281+0000","last_unstale":"2024-04-25T13:42:07.414098+0000","last_undegraded":"2024-04-25T13:42:07.414098+0000","last_fullsized":"2024-04-25T13:42:07.414098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:13.973644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414504+0000","last_change":"2024-04-25T13:42:06.430703+0000","last_active":"2024-04-25T13:42:07.414504+0000","last_peered":"2024-04-25T13:42:07.414504+0000","last_clean":"2024-04-25T13:42:07.414504+0000","last_became_active":"2024-04-25T13:42:06.428292+0000","last_became_peered":"2024-04-25T13:42:06.428292+0000","last_unstale":"2024-04-25T13:42:07.414504+0000","last_undegraded":"2024-04-25T13:42:07.414504+0000","last_fullsized":"2024-04-25T13:42:07.414504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:00.017229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.184968+0000","last_change":"2024-04-25T13:42:05.423359+0000","last_active":"2024-04-25T13:42:09.184968+0000","last_peered":"2024-04-25T13:42:09.184968+0000","last_clean":"2024-04-25T13:42:09.184968+0000","last_became_active":"2024-04-25T13:42:05.418070+0000","last_became_peered":"2024-04-25T13:42:05.418070+0000","last_unstale":"2024-04-25T13:42:09.184968+0000","last_undegraded":"2024-04-25T13:42:09.184968+0000","last_fullsized":"2024-04-25T13:42:09.184968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:38.792763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.184862+0000","last_change":"2024-04-25T13:42:06.438416+0000","last_active":"2024-04-25T13:42:09.184862+0000","last_peered":"2024-04-25T13:42:09.184862+0000","last_clean":"2024-04-25T13:42:09.184862+0000","last_became_active":"2024-04-25T13:42:06.436122+0000","last_became_peered":"2024-04-25T13:42:06.436122+0000","last_unstale":"2024-04-25T13:42:09.184862+0000","last_undegraded":"2024-04-25T13:42:09.184862+0000","last_fullsized":"2024-04-25T13:42:09.184862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:54:07.642118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.870073+0000","last_change":"2024-04-25T13:42:05.411439+0000","last_active":"2024-04-25T13:42:07.870073+0000","last_peered":"2024-04-25T13:42:07.870073+0000","last_clean":"2024-04-25T13:42:07.870073+0000","last_became_active":"2024-04-25T13:42:05.411041+0000","last_became_peered":"2024-04-25T13:42:05.411041+0000","last_unstale":"2024-04-25T13:42:07.870073+0000","last_undegraded":"2024-04-25T13:42:07.870073+0000","last_fullsized":"2024-04-25T13:42:07.870073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:29.973848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185443+0000","last_change":"2024-04-25T13:42:06.440980+0000","last_active":"2024-04-25T13:42:09.185443+0000","last_peered":"2024-04-25T13:42:09.185443+0000","last_clean":"2024-04-25T13:42:09.185443+0000","last_became_active":"2024-04-25T13:42:06.440605+0000","last_became_peered":"2024-04-25T13:42:06.440605+0000","last_unstale":"2024-04-25T13:42:09.185443+0000","last_undegraded":"2024-04-25T13:42:09.185443+0000","last_fullsized":"2024-04-25T13:42:09.185443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:36:55.456363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185145+0000","last_change":"2024-04-25T13:42:05.420768+0000","last_active":"2024-04-25T13:42:09.185145+0000","last_peered":"2024-04-25T13:42:09.185145+0000","last_clean":"2024-04-25T13:42:09.185145+0000","last_became_active":"2024-04-25T13:42:05.420338+0000","last_became_peered":"2024-04-25T13:42:05.420338+0000","last_unstale":"2024-04-25T13:42:09.185145+0000","last_undegraded":"2024-04-25T13:42:09.185145+0000","last_fullsized":"2024-04-25T13:42:09.185145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:25:50.166504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185664+0000","last_change":"2024-04-25T13:42:06.440909+0000","last_active":"2024-04-25T13:42:09.185664+0000","last_peered":"2024-04-25T13:42:09.185664+0000","last_clean":"2024-04-25T13:42:09.185664+0000","last_became_active":"2024-04-25T13:42:06.440517+0000","last_became_peered":"2024-04-25T13:42:06.440517+0000","last_unstale":"2024-04-25T13:42:09.185664+0000","last_undegraded":"2024-04-25T13:42:09.185664+0000","last_fullsized":"2024-04-25T13:42:09.185664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:02.920503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414647+0000","last_change":"2024-04-25T13:42:05.421815+0000","last_active":"2024-04-25T13:42:07.414647+0000","last_peered":"2024-04-25T13:42:07.414647+0000","last_clean":"2024-04-25T13:42:07.414647+0000","last_became_active":"2024-04-25T13:42:05.421468+0000","last_became_peered":"2024-04-25T13:42:05.421468+0000","last_unstale":"2024-04-25T13:42:07.414647+0000","last_undegraded":"2024-04-25T13:42:07.414647+0000","last_fullsized":"2024-04-25T13:42:07.414647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:58.501999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416541+0000","last_change":"2024-04-25T13:42:06.425480+0000","last_active":"2024-04-25T13:42:07.416541+0000","last_peered":"2024-04-25T13:42:07.416541+0000","last_clean":"2024-04-25T13:42:07.416541+0000","last_became_active":"2024-04-25T13:42:06.424666+0000","last_became_peered":"2024-04-25T13:42:06.424666+0000","last_unstale":"2024-04-25T13:42:07.416541+0000","last_undegraded":"2024-04-25T13:42:07.416541+0000","last_fullsized":"2024-04-25T13:42:07.416541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:28.530411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185126+0000","last_change":"2024-04-25T13:42:05.414975+0000","last_active":"2024-04-25T13:42:09.185126+0000","last_peered":"2024-04-25T13:42:09.185126+0000","last_clean":"2024-04-25T13:42:09.185126+0000","last_became_active":"2024-04-25T13:42:05.413273+0000","last_became_peered":"2024-04-25T13:42:05.413273+0000","last_unstale":"2024-04-25T13:42:09.185126+0000","last_undegraded":"2024-04-25T13:42:09.185126+0000","last_fullsized":"2024-04-25T13:42:09.185126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:18.167829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185258+0000","last_change":"2024-04-25T13:42:06.447253+0000","last_active":"2024-04-25T13:42:09.185258+0000","last_peered":"2024-04-25T13:42:09.185258+0000","last_clean":"2024-04-25T13:42:09.185258+0000","last_became_active":"2024-04-25T13:42:06.446721+0000","last_became_peered":"2024-04-25T13:42:06.446721+0000","last_unstale":"2024-04-25T13:42:09.185258+0000","last_undegraded":"2024-04-25T13:42:09.185258+0000","last_fullsized":"2024-04-25T13:42:09.185258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:28.530411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.184796+0000","last_change":"2024-04-25T13:41:56.890628+0000","last_active":"2024-04-25T13:42:09.184796+0000","last_peered":"2024-04-25T13:42:09.184796+0000","last_clean":"2024-04-25T13:42:09.184796+0000","last_became_active":"2024-04-25T13:41:56.889261+0000","last_became_peered":"2024-04-25T13:41:56.889261+0000","last_unstale":"2024-04-25T13:42:09.184796+0000","last_undegraded":"2024-04-25T13:42:09.184796+0000","last_fullsized":"2024-04-25T13:42:09.184796+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:53.940471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:53.940471+0000","last_clean_scrub_stamp":"2024-04-25T13:41:53.940471+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:06.164380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416047+0000","last_change":"2024-04-25T13:42:05.413945+0000","last_active":"2024-04-25T13:42:07.416047+0000","last_peered":"2024-04-25T13:42:07.416047+0000","last_clean":"2024-04-25T13:42:07.416047+0000","last_became_active":"2024-04-25T13:42:05.413653+0000","last_became_peered":"2024-04-25T13:42:05.413653+0000","last_unstale":"2024-04-25T13:42:07.416047+0000","last_undegraded":"2024-04-25T13:42:07.416047+0000","last_fullsized":"2024-04-25T13:42:07.416047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:18.167829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695600+0000","last_change":"2024-04-25T13:42:06.447412+0000","last_active":"2024-04-25T13:42:07.695600+0000","last_peered":"2024-04-25T13:42:07.695600+0000","last_clean":"2024-04-25T13:42:07.695600+0000","last_became_active":"2024-04-25T13:42:06.447163+0000","last_became_peered":"2024-04-25T13:42:06.447163+0000","last_unstale":"2024-04-25T13:42:07.695600+0000","last_undegraded":"2024-04-25T13:42:07.695600+0000","last_fullsized":"2024-04-25T13:42:07.695600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:43.073677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.184670+0000","last_change":"2024-04-25T13:42:05.425468+0000","last_active":"2024-04-25T13:42:09.184670+0000","last_peered":"2024-04-25T13:42:09.184670+0000","last_clean":"2024-04-25T13:42:09.184670+0000","last_became_active":"2024-04-25T13:42:05.425039+0000","last_became_peered":"2024-04-25T13:42:05.425039+0000","last_unstale":"2024-04-25T13:42:09.184670+0000","last_undegraded":"2024-04-25T13:42:09.184670+0000","last_fullsized":"2024-04-25T13:42:09.184670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:13.973644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.152226+0000","last_change":"2024-04-25T13:42:06.423330+0000","last_active":"2024-04-25T13:42:09.152226+0000","last_peered":"2024-04-25T13:42:09.152226+0000","last_clean":"2024-04-25T13:42:09.152226+0000","last_became_active":"2024-04-25T13:42:06.422548+0000","last_became_peered":"2024-04-25T13:42:06.422548+0000","last_unstale":"2024-04-25T13:42:09.152226+0000","last_undegraded":"2024-04-25T13:42:09.152226+0000","last_fullsized":"2024-04-25T13:42:09.152226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:06.506569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185079+0000","last_change":"2024-04-25T13:42:05.416592+0000","last_active":"2024-04-25T13:42:09.185079+0000","last_peered":"2024-04-25T13:42:09.185079+0000","last_clean":"2024-04-25T13:42:09.185079+0000","last_became_active":"2024-04-25T13:42:05.416251+0000","last_became_peered":"2024-04-25T13:42:05.416251+0000","last_unstale":"2024-04-25T13:42:09.185079+0000","last_undegraded":"2024-04-25T13:42:09.185079+0000","last_fullsized":"2024-04-25T13:42:09.185079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:39.013905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414307+0000","last_change":"2024-04-25T13:42:06.405128+0000","last_active":"2024-04-25T13:42:07.414307+0000","last_peered":"2024-04-25T13:42:07.414307+0000","last_clean":"2024-04-25T13:42:07.414307+0000","last_became_active":"2024-04-25T13:42:06.404786+0000","last_became_peered":"2024-04-25T13:42:06.404786+0000","last_unstale":"2024-04-25T13:42:07.414307+0000","last_undegraded":"2024-04-25T13:42:07.414307+0000","last_fullsized":"2024-04-25T13:42:07.414307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:00.017229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.415847+0000","last_change":"2024-04-25T13:42:05.417435+0000","last_active":"2024-04-25T13:42:07.415847+0000","last_peered":"2024-04-25T13:42:07.415847+0000","last_clean":"2024-04-25T13:42:07.415847+0000","last_became_active":"2024-04-25T13:42:05.417069+0000","last_became_peered":"2024-04-25T13:42:05.417069+0000","last_unstale":"2024-04-25T13:42:07.415847+0000","last_undegraded":"2024-04-25T13:42:07.415847+0000","last_fullsized":"2024-04-25T13:42:07.415847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:39.013905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.869855+0000","last_change":"2024-04-25T13:42:06.435494+0000","last_active":"2024-04-25T13:42:07.869855+0000","last_peered":"2024-04-25T13:42:07.869855+0000","last_clean":"2024-04-25T13:42:07.869855+0000","last_became_active":"2024-04-25T13:42:06.425605+0000","last_became_peered":"2024-04-25T13:42:06.425605+0000","last_unstale":"2024-04-25T13:42:07.869855+0000","last_undegraded":"2024-04-25T13:42:07.869855+0000","last_fullsized":"2024-04-25T13:42:07.869855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:14.980250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414503+0000","last_change":"2024-04-25T13:42:05.419749+0000","last_active":"2024-04-25T13:42:07.414503+0000","last_peered":"2024-04-25T13:42:07.414503+0000","last_clean":"2024-04-25T13:42:07.414503+0000","last_became_active":"2024-04-25T13:42:05.419446+0000","last_became_peered":"2024-04-25T13:42:05.419446+0000","last_unstale":"2024-04-25T13:42:07.414503+0000","last_undegraded":"2024-04-25T13:42:07.414503+0000","last_fullsized":"2024-04-25T13:42:07.414503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:39.013905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416544+0000","last_change":"2024-04-25T13:42:06.438221+0000","last_active":"2024-04-25T13:42:07.416544+0000","last_peered":"2024-04-25T13:42:07.416544+0000","last_clean":"2024-04-25T13:42:07.416544+0000","last_became_active":"2024-04-25T13:42:06.430658+0000","last_became_peered":"2024-04-25T13:42:06.430658+0000","last_unstale":"2024-04-25T13:42:07.416544+0000","last_undegraded":"2024-04-25T13:42:07.416544+0000","last_fullsized":"2024-04-25T13:42:07.416544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:55.637014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185523+0000","last_change":"2024-04-25T13:42:05.427944+0000","last_active":"2024-04-25T13:42:09.185523+0000","last_peered":"2024-04-25T13:42:09.185523+0000","last_clean":"2024-04-25T13:42:09.185523+0000","last_became_active":"2024-04-25T13:42:05.427721+0000","last_became_peered":"2024-04-25T13:42:05.427721+0000","last_unstale":"2024-04-25T13:42:09.185523+0000","last_undegraded":"2024-04-25T13:42:09.185523+0000","last_fullsized":"2024-04-25T13:42:09.185523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:27.584535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414350+0000","last_change":"2024-04-25T13:42:06.410624+0000","last_active":"2024-04-25T13:42:07.414350+0000","last_peered":"2024-04-25T13:42:07.414350+0000","last_clean":"2024-04-25T13:42:07.414350+0000","last_became_active":"2024-04-25T13:42:06.410260+0000","last_became_peered":"2024-04-25T13:42:06.410260+0000","last_unstale":"2024-04-25T13:42:07.414350+0000","last_undegraded":"2024-04-25T13:42:07.414350+0000","last_fullsized":"2024-04-25T13:42:07.414350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:21.556056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:08.407723+0000","last_change":"2024-04-25T13:42:05.420418+0000","last_active":"2024-04-25T13:42:08.407723+0000","last_peered":"2024-04-25T13:42:08.407723+0000","last_clean":"2024-04-25T13:42:08.407723+0000","last_became_active":"2024-04-25T13:42:05.420002+0000","last_became_peered":"2024-04-25T13:42:05.420002+0000","last_unstale":"2024-04-25T13:42:08.407723+0000","last_undegraded":"2024-04-25T13:42:08.407723+0000","last_fullsized":"2024-04-25T13:42:08.407723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:20.409104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.696037+0000","last_change":"2024-04-25T13:42:06.429612+0000","last_active":"2024-04-25T13:42:07.696037+0000","last_peered":"2024-04-25T13:42:07.696037+0000","last_clean":"2024-04-25T13:42:07.696037+0000","last_became_active":"2024-04-25T13:42:06.429281+0000","last_became_peered":"2024-04-25T13:42:06.429281+0000","last_unstale":"2024-04-25T13:42:07.696037+0000","last_undegraded":"2024-04-25T13:42:07.696037+0000","last_fullsized":"2024-04-25T13:42:07.696037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:54:07.642118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414966+0000","last_change":"2024-04-25T13:42:05.420871+0000","last_active":"2024-04-25T13:42:07.414966+0000","last_peered":"2024-04-25T13:42:07.414966+0000","last_clean":"2024-04-25T13:42:07.414966+0000","last_became_active":"2024-04-25T13:42:05.420493+0000","last_became_peered":"2024-04-25T13:42:05.420493+0000","last_unstale":"2024-04-25T13:42:07.414966+0000","last_undegraded":"2024-04-25T13:42:07.414966+0000","last_fullsized":"2024-04-25T13:42:07.414966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:39.013905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.152648+0000","last_change":"2024-04-25T13:42:06.430453+0000","last_active":"2024-04-25T13:42:09.152648+0000","last_peered":"2024-04-25T13:42:09.152648+0000","last_clean":"2024-04-25T13:42:09.152648+0000","last_became_active":"2024-04-25T13:42:06.430092+0000","last_became_peered":"2024-04-25T13:42:06.430092+0000","last_unstale":"2024-04-25T13:42:09.152648+0000","last_undegraded":"2024-04-25T13:42:09.152648+0000","last_fullsized":"2024-04-25T13:42:09.152648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.382442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.184651+0000","last_change":"2024-04-25T13:42:05.431023+0000","last_active":"2024-04-25T13:42:09.184651+0000","last_peered":"2024-04-25T13:42:09.184651+0000","last_clean":"2024-04-25T13:42:09.184651+0000","last_became_active":"2024-04-25T13:42:05.430721+0000","last_became_peered":"2024-04-25T13:42:05.430721+0000","last_unstale":"2024-04-25T13:42:09.184651+0000","last_undegraded":"2024-04-25T13:42:09.184651+0000","last_fullsized":"2024-04-25T13:42:09.184651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:20.409104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.869878+0000","last_change":"2024-04-25T13:42:06.409401+0000","last_active":"2024-04-25T13:42:07.869878+0000","last_peered":"2024-04-25T13:42:07.869878+0000","last_clean":"2024-04-25T13:42:07.869878+0000","last_became_active":"2024-04-25T13:42:06.409057+0000","last_became_peered":"2024-04-25T13:42:06.409057+0000","last_unstale":"2024-04-25T13:42:07.869878+0000","last_undegraded":"2024-04-25T13:42:07.869878+0000","last_fullsized":"2024-04-25T13:42:07.869878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:22.596123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414245+0000","last_change":"2024-04-25T13:42:05.421504+0000","last_active":"2024-04-25T13:42:07.414245+0000","last_peered":"2024-04-25T13:42:07.414245+0000","last_clean":"2024-04-25T13:42:07.414245+0000","last_became_active":"2024-04-25T13:42:05.421220+0000","last_became_peered":"2024-04-25T13:42:05.421220+0000","last_unstale":"2024-04-25T13:42:07.414245+0000","last_undegraded":"2024-04-25T13:42:07.414245+0000","last_fullsized":"2024-04-25T13:42:07.414245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:13.973644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695605+0000","last_change":"2024-04-25T13:42:06.431990+0000","last_active":"2024-04-25T13:42:07.695605+0000","last_peered":"2024-04-25T13:42:07.695605+0000","last_clean":"2024-04-25T13:42:07.695605+0000","last_became_active":"2024-04-25T13:42:06.431692+0000","last_became_peered":"2024-04-25T13:42:06.431692+0000","last_unstale":"2024-04-25T13:42:07.695605+0000","last_undegraded":"2024-04-25T13:42:07.695605+0000","last_fullsized":"2024-04-25T13:42:07.695605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:58:00.017229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414280+0000","last_change":"2024-04-25T13:42:05.432614+0000","last_active":"2024-04-25T13:42:07.414280+0000","last_peered":"2024-04-25T13:42:07.414280+0000","last_clean":"2024-04-25T13:42:07.414280+0000","last_became_active":"2024-04-25T13:42:05.432253+0000","last_became_peered":"2024-04-25T13:42:05.432253+0000","last_unstale":"2024-04-25T13:42:07.414280+0000","last_undegraded":"2024-04-25T13:42:07.414280+0000","last_fullsized":"2024-04-25T13:42:07.414280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:42.956198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695726+0000","last_change":"2024-04-25T13:42:06.425502+0000","last_active":"2024-04-25T13:42:07.695726+0000","last_peered":"2024-04-25T13:42:07.695726+0000","last_clean":"2024-04-25T13:42:07.695726+0000","last_became_active":"2024-04-25T13:42:06.425046+0000","last_became_peered":"2024-04-25T13:42:06.425046+0000","last_unstale":"2024-04-25T13:42:07.695726+0000","last_undegraded":"2024-04-25T13:42:07.695726+0000","last_fullsized":"2024-04-25T13:42:07.695726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:01.382442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185202+0000","last_change":"2024-04-25T13:42:05.423955+0000","last_active":"2024-04-25T13:42:09.185202+0000","last_peered":"2024-04-25T13:42:09.185202+0000","last_clean":"2024-04-25T13:42:09.185202+0000","last_became_active":"2024-04-25T13:42:05.423590+0000","last_became_peered":"2024-04-25T13:42:05.423590+0000","last_unstale":"2024-04-25T13:42:09.185202+0000","last_undegraded":"2024-04-25T13:42:09.185202+0000","last_fullsized":"2024-04-25T13:42:09.185202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:42:21.589517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.414130+0000","last_change":"2024-04-25T13:42:06.425907+0000","last_active":"2024-04-25T13:42:07.414130+0000","last_peered":"2024-04-25T13:42:07.414130+0000","last_clean":"2024-04-25T13:42:07.414130+0000","last_became_active":"2024-04-25T13:42:06.421536+0000","last_became_peered":"2024-04-25T13:42:06.421536+0000","last_unstale":"2024-04-25T13:42:07.414130+0000","last_undegraded":"2024-04-25T13:42:07.414130+0000","last_fullsized":"2024-04-25T13:42:07.414130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:32:38.216116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416472+0000","last_change":"2024-04-25T13:42:06.412858+0000","last_active":"2024-04-25T13:42:07.416472+0000","last_peered":"2024-04-25T13:42:07.416472+0000","last_clean":"2024-04-25T13:42:07.416472+0000","last_became_active":"2024-04-25T13:42:06.412522+0000","last_became_peered":"2024-04-25T13:42:06.412522+0000","last_unstale":"2024-04-25T13:42:07.416472+0000","last_undegraded":"2024-04-25T13:42:07.416472+0000","last_fullsized":"2024-04-25T13:42:07.416472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:33:49.773341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185086+0000","last_change":"2024-04-25T13:42:05.426488+0000","last_active":"2024-04-25T13:42:09.185086+0000","last_peered":"2024-04-25T13:42:09.185086+0000","last_clean":"2024-04-25T13:42:09.185086+0000","last_became_active":"2024-04-25T13:42:05.426101+0000","last_became_peered":"2024-04-25T13:42:05.426101+0000","last_unstale":"2024-04-25T13:42:09.185086+0000","last_undegraded":"2024-04-25T13:42:09.185086+0000","last_fullsized":"2024-04-25T13:42:09.185086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:56:58.501999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.416286+0000","last_change":"2024-04-25T13:42:06.420385+0000","last_active":"2024-04-25T13:42:07.416286+0000","last_peered":"2024-04-25T13:42:07.416286+0000","last_clean":"2024-04-25T13:42:07.416286+0000","last_became_active":"2024-04-25T13:42:06.419988+0000","last_became_peered":"2024-04-25T13:42:06.419988+0000","last_unstale":"2024-04-25T13:42:07.416286+0000","last_undegraded":"2024-04-25T13:42:07.416286+0000","last_fullsized":"2024-04-25T13:42:07.416286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:54:07.642118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.185307+0000","last_change":"2024-04-25T13:42:05.430513+0000","last_active":"2024-04-25T13:42:09.185307+0000","last_peered":"2024-04-25T13:42:09.185307+0000","last_clean":"2024-04-25T13:42:09.185307+0000","last_became_active":"2024-04-25T13:42:05.430211+0000","last_became_peered":"2024-04-25T13:42:05.430211+0000","last_unstale":"2024-04-25T13:42:09.185307+0000","last_undegraded":"2024-04-25T13:42:09.185307+0000","last_fullsized":"2024-04-25T13:42:09.185307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:03.696280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.152490+0000","last_change":"2024-04-25T13:42:06.446137+0000","last_active":"2024-04-25T13:42:09.152490+0000","last_peered":"2024-04-25T13:42:09.152490+0000","last_clean":"2024-04-25T13:42:09.152490+0000","last_became_active":"2024-04-25T13:42:06.445789+0000","last_became_peered":"2024-04-25T13:42:06.445789+0000","last_unstale":"2024-04-25T13:42:09.152490+0000","last_undegraded":"2024-04-25T13:42:09.152490+0000","last_fullsized":"2024-04-25T13:42:09.152490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:50:43.073677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695972+0000","last_change":"2024-04-25T13:42:05.423990+0000","last_active":"2024-04-25T13:42:07.695972+0000","last_peered":"2024-04-25T13:42:07.695972+0000","last_clean":"2024-04-25T13:42:07.695972+0000","last_became_active":"2024-04-25T13:42:05.420047+0000","last_became_peered":"2024-04-25T13:42:05.420047+0000","last_unstale":"2024-04-25T13:42:07.695972+0000","last_undegraded":"2024-04-25T13:42:07.695972+0000","last_fullsized":"2024-04-25T13:42:07.695972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:18.167829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:07.695905+0000","last_change":"2024-04-25T13:42:06.429258+0000","last_active":"2024-04-25T13:42:07.695905+0000","last_peered":"2024-04-25T13:42:07.695905+0000","last_clean":"2024-04-25T13:42:07.695905+0000","last_became_active":"2024-04-25T13:42:06.428574+0000","last_became_peered":"2024-04-25T13:42:06.428574+0000","last_unstale":"2024-04-25T13:42:07.695905+0000","last_undegraded":"2024-04-25T13:42:07.695905+0000","last_fullsized":"2024-04-25T13:42:07.695905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:05.385026+0000","last_clean_scrub_stamp":"2024-04-25T13:42:05.385026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:32.855388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-25T13:42:09.152612+0000","last_change":"2024-04-25T13:42:05.418742+0000","last_active":"2024-04-25T13:42:09.152612+0000","last_peered":"2024-04-25T13:42:09.152612+0000","last_clean":"2024-04-25T13:42:09.152612+0000","last_became_active":"2024-04-25T13:42:05.418017+0000","last_became_peered":"2024-04-25T13:42:05.418017+0000","last_unstale":"2024-04-25T13:42:09.152612+0000","last_undegraded":"2024-04-25T13:42:09.152612+0000","last_fullsized":"2024-04-25T13:42:09.152612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:42:04.378420+0000","last_clean_scrub_stamp":"2024-04-25T13:42:04.378420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:48:38.792763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":221184,"data_stored":76081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":77603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":75991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":76151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":666997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:42:15.678 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T13:42:15.678 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T13:42:15.678 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T13:42:15.679 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T13:42:15.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.858+0000 7ff194600640 1 Processor -- start 2024-04-25T13:42:15.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.858+0000 7ff194600640 1 -- start start 2024-04-25T13:42:15.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.858+0000 7ff194600640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff18c1623a0 0x7ff18c1627b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.858+0000 7ff194600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff18c162cf0 0x7ff18c0b6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.858+0000 7ff194600640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff18c0b27b0 con 0x7ff18c0b6a60 2024-04-25T13:42:15.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.858+0000 7ff194600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff18c0d16b0 con 0x7ff18c162cf0 2024-04-25T13:42:15.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.858+0000 7ff194600640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7ff18c0b8e80 con 0x7ff18c1623a0 2024-04-25T13:42:15.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.858+0000 7ff191200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff18c162cf0 0x7ff18c0b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.858+0000 7ff191200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff18c162cf0 0x7ff18c0b6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37584/0 (socket says 172.21.15.123:37584) 2024-04-25T13:42:15.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.858+0000 7ff191200640 1 -- 172.21.15.123:0/2745570537 learned_addr learned my addr 172.21.15.123:0/2745570537 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:15.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.858+0000 7ff191c00640 1 --2- 172.21.15.123:0/2745570537 >> v2:172.21.15.130:3300/0 conn(0x7ff18c1623a0 0x7ff18c1627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.858+0000 7ff191200640 1 -- 172.21.15.123:0/2745570537 >> v2:172.21.15.130:3300/0 conn(0x7ff18c1623a0 msgr2=0x7ff18c1627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:15.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.858+0000 7ff191200640 1 --2- 172.21.15.123:0/2745570537 >> v2:172.21.15.130:3300/0 conn(0x7ff18c1623a0 0x7ff18c1627b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.858+0000 7ff191200640 1 -- 172.21.15.123:0/2745570537 >> v1:172.21.15.130:6789/0 conn(0x7ff18c0b6a60 legacy=0x7ff18c0b6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:15.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.858+0000 7ff191200640 1 -- 172.21.15.123:0/2745570537 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff18c0d1340 con 0x7ff18c162cf0 2024-04-25T13:42:15.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.862+0000 7ff191200640 1 --2- 172.21.15.123:0/2745570537 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff18c162cf0 0x7ff18c0b6520 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff18c073b50 tx=0x7ff17801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62aa867c481e014b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:15.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.862+0000 7ff18be00640 1 -- 172.21.15.123:0/2745570537 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1780b0070 con 0x7ff18c162cf0 2024-04-25T13:42:15.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.862+0000 7ff18be00640 1 -- 172.21.15.123:0/2745570537 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1780ab600 con 0x7ff18c162cf0 2024-04-25T13:42:15.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.862+0000 7ff18be00640 1 -- 172.21.15.123:0/2745570537 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1780ab9d0 con 0x7ff18c162cf0 2024-04-25T13:42:15.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.862+0000 7ff194600640 1 -- 172.21.15.123:0/2745570537 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff18c162cf0 msgr2=0x7ff18c0b6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.862+0000 7ff194600640 1 --2- 172.21.15.123:0/2745570537 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff18c162cf0 0x7ff18c0b6520 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff18c073b50 tx=0x7ff17801c4e0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.862+0000 7ff194600640 1 -- 172.21.15.123:0/2745570537 shutdown_connections 2024-04-25T13:42:15.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.862+0000 7ff194600640 1 --2- 172.21.15.123:0/2745570537 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff18c162cf0 0x7ff18c0b6520 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.862+0000 7ff194600640 1 --2- 172.21.15.123:0/2745570537 >> v2:172.21.15.130:3300/0 conn(0x7ff18c1623a0 0x7ff18c1627b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.862+0000 7ff194600640 1 -- 172.21.15.123:0/2745570537 >> 172.21.15.123:0/2745570537 conn(0x7ff18c0d0150 msgr2=0x7ff18c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:15.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.862+0000 7ff194600640 1 -- 172.21.15.123:0/2745570537 shutdown_connections 2024-04-25T13:42:15.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.862+0000 7ff194600640 1 -- 172.21.15.123:0/2745570537 wait complete. 2024-04-25T13:42:15.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.866+0000 7ff194600640 1 Processor -- start 2024-04-25T13:42:15.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.866+0000 7ff194600640 1 -- start start 2024-04-25T13:42:15.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.866+0000 7ff194600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff18c0b6a60 0x7ff18c0a0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.866+0000 7ff194600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff18c1623a0 0x7ff18c0b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.866+0000 7ff194600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff18c162cf0 0x7ff18c0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.866+0000 7ff194600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c0b88d0 con 0x7ff18c162cf0 2024-04-25T13:42:15.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.866+0000 7ff194600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c0b2a20 con 0x7ff18c0b6a60 2024-04-25T13:42:15.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.866+0000 7ff194600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff18c0b8a50 con 0x7ff18c1623a0 2024-04-25T13:42:15.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.866+0000 7ff192600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff18c162cf0 0x7ff18c0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.866+0000 7ff191c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff18c0b6a60 0x7ff18c0a0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.866+0000 7ff191c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff18c0b6a60 0x7ff18c0a0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:53668/0 (socket says 172.21.15.123:53668) 2024-04-25T13:42:15.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.866+0000 7ff191200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff18c1623a0 0x7ff18c0b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.866+0000 7ff191c00640 1 -- 172.21.15.123:0/1520127994 learned_addr learned my addr 172.21.15.123:0/1520127994 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:15.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.870+0000 7ff191c00640 1 -- 172.21.15.123:0/1520127994 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff18c1623a0 msgr2=0x7ff18c0b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.870+0000 7ff191c00640 1 --2- 172.21.15.123:0/1520127994 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff18c1623a0 0x7ff18c0b4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.870+0000 7ff191c00640 1 -- 172.21.15.123:0/1520127994 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff18c162cf0 msgr2=0x7ff18c0b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:15.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.870+0000 7ff191c00640 1 --2- 172.21.15.123:0/1520127994 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff18c162cf0 0x7ff18c0b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:15.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.870+0000 7ff191c00640 1 -- 172.21.15.123:0/1520127994 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff18c0b2d20 con 0x7ff18c0b6a60 2024-04-25T13:42:15.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.870+0000 7ff192600640 1 --2- 172.21.15.123:0/1520127994 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff18c162cf0 0x7ff18c0b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:15.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.870+0000 7ff191200640 1 --2- 172.21.15.123:0/1520127994 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff18c1623a0 0x7ff18c0b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:15.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.870+0000 7ff191c00640 1 --2- 172.21.15.123:0/1520127994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff18c0b6a60 0x7ff18c0a0f20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff180007e30 tx=0x7ff18000e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:15.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.870+0000 7ff189600640 1 -- 172.21.15.123:0/1520127994 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18001a070 con 0x7ff18c0b6a60 2024-04-25T13:42:15.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.870+0000 7ff189600640 1 -- 172.21.15.123:0/1520127994 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff180003ba0 con 0x7ff18c0b6a60 2024-04-25T13:42:15.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.870+0000 7ff189600640 1 -- 172.21.15.123:0/1520127994 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff18000ee30 con 0x7ff18c0b6a60 2024-04-25T13:42:15.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.870+0000 7ff194600640 1 -- 172.21.15.123:0/1520127994 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff18c0b2fe0 con 0x7ff18c0b6a60 2024-04-25T13:42:15.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.870+0000 7ff194600640 1 -- 172.21.15.123:0/1520127994 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff18c0b35a0 con 0x7ff18c0b6a60 2024-04-25T13:42:15.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.870+0000 7ff194600640 1 -- 172.21.15.123:0/1520127994 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff18c0507c0 con 0x7ff18c0b6a60 2024-04-25T13:42:15.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.870+0000 7ff189600640 1 -- 172.21.15.123:0/1520127994 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff18001d070 con 0x7ff18c0b6a60 2024-04-25T13:42:15.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.874+0000 7ff189600640 1 --2- 172.21.15.123:0/1520127994 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff16c06f430 0x7ff16c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:15.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.874+0000 7ff189600640 1 -- 172.21.15.123:0/1520127994 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff18008fd10 con 0x7ff18c0b6a60 2024-04-25T13:42:15.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.874+0000 7ff191200640 1 --2- 172.21.15.123:0/1520127994 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff16c06f430 0x7ff16c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:15.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.874+0000 7ff191200640 1 --2- 172.21.15.123:0/1520127994 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff16c06f430 0x7ff16c071940 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff1780ad000 tx=0x7ff178008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:15.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:15.878+0000 7ff189600640 1 -- 172.21.15.123:0/1520127994 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff18005c510 con 0x7ff18c0b6a60 2024-04-25T13:42:16.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.066+0000 7ff194600640 1 -- 172.21.15.123:0/1520127994 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff18c0b0ca0 con 0x7ff18c0b6a60 2024-04-25T13:42:16.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.070+0000 7ff189600640 1 -- 172.21.15.123:0/1520127994 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7ff180060810 con 0x7ff18c0b6a60 2024-04-25T13:42:16.072 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:16.072 INFO:teuthology.orchestra.run.smithi123.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T13:42:16.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.070+0000 7ff194600640 1 -- 172.21.15.123:0/1520127994 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff16c06f430 msgr2=0x7ff16c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:16.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.070+0000 7ff194600640 1 --2- 172.21.15.123:0/1520127994 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff16c06f430 0x7ff16c071940 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff1780ad000 tx=0x7ff178008040 comp rx=0 tx=0).stop 2024-04-25T13:42:16.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.070+0000 7ff194600640 1 -- 172.21.15.123:0/1520127994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff18c0b6a60 msgr2=0x7ff18c0a0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:16.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.070+0000 7ff194600640 1 --2- 172.21.15.123:0/1520127994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff18c0b6a60 0x7ff18c0a0f20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff180007e30 tx=0x7ff18000e4b0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.070+0000 7ff194600640 1 -- 172.21.15.123:0/1520127994 shutdown_connections 2024-04-25T13:42:16.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.070+0000 7ff194600640 1 --2- 172.21.15.123:0/1520127994 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff16c06f430 0x7ff16c071940 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.070+0000 7ff194600640 1 --2- 172.21.15.123:0/1520127994 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff18c162cf0 0x7ff18c0b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.070+0000 7ff194600640 1 --2- 172.21.15.123:0/1520127994 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff18c1623a0 0x7ff18c0b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.070+0000 7ff194600640 1 --2- 172.21.15.123:0/1520127994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff18c0b6a60 0x7ff18c0a0f20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.070+0000 7ff194600640 1 -- 172.21.15.123:0/1520127994 >> 172.21.15.123:0/1520127994 conn(0x7ff18c0d0150 msgr2=0x7ff18c167bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:16.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.070+0000 7ff194600640 1 -- 172.21.15.123:0/1520127994 shutdown_connections 2024-04-25T13:42:16.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.070+0000 7ff194600640 1 -- 172.21.15.123:0/1520127994 wait complete. 2024-04-25T13:42:16.094 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T13:42:16.094 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:16.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.234+0000 7fc75d000640 1 Processor -- start 2024-04-25T13:42:16.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.234+0000 7fc75d000640 1 -- start start 2024-04-25T13:42:16.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.238+0000 7fc75d000640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc7580758b0 0x7fc75815a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:16.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.238+0000 7fc75d000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc75806d680 0x7fc75806da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:16.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.238+0000 7fc75d000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc7580b4d60 0x7fc7580b5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:16.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.238+0000 7fc75d000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc75806dfd0 con 0x7fc7580b4d60 2024-04-25T13:42:16.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.238+0000 7fc75d000640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fc75815a9f0 con 0x7fc7580758b0 2024-04-25T13:42:16.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.238+0000 7fc75d000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc758160520 con 0x7fc75806d680 2024-04-25T13:42:16.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.238+0000 7fc756800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc7580b4d60 0x7fc7580b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:16.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.238+0000 7fc74d400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc75806d680 0x7fc75806da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:16.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.238+0000 7fc755e00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc7580758b0 0x7fc75815a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:16.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.238+0000 7fc74d400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc75806d680 0x7fc75806da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:37926/0 (socket says 172.21.15.123:37926) 2024-04-25T13:42:16.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.238+0000 7fc755e00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc7580758b0 0x7fc75815a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:53682/0 (socket says 172.21.15.123:53682) 2024-04-25T13:42:16.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.238+0000 7fc74d400640 1 -- 172.21.15.123:0/3170703424 learned_addr learned my addr 172.21.15.123:0/3170703424 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:16.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.238+0000 7fc756800640 1 -- 172.21.15.123:0/3170703424 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc75806d680 msgr2=0x7fc75806da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:16.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.238+0000 7fc756800640 1 --2- 172.21.15.123:0/3170703424 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc75806d680 0x7fc75806da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.238+0000 7fc756800640 1 -- 172.21.15.123:0/3170703424 >> v2:172.21.15.130:3300/0 conn(0x7fc7580758b0 msgr2=0x7fc75815a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:16.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.238+0000 7fc756800640 1 --2- 172.21.15.123:0/3170703424 >> v2:172.21.15.130:3300/0 conn(0x7fc7580758b0 0x7fc75815a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.238+0000 7fc756800640 1 -- 172.21.15.123:0/3170703424 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7581607e0 con 0x7fc7580b4d60 2024-04-25T13:42:16.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.242+0000 7fc756800640 1 --2- 172.21.15.123:0/3170703424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7580b4d60 0x7fc7580b5170 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc758072e60 tx=0x7fc75001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0b9cd8aca1e457 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:16.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.242+0000 7fc755400640 1 -- 172.21.15.123:0/3170703424 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7500ab640 con 0x7fc7580b4d60 2024-04-25T13:42:16.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.242+0000 7fc755400640 1 -- 172.21.15.123:0/3170703424 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7500b0070 con 0x7fc7580b4d60 2024-04-25T13:42:16.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.242+0000 7fc755400640 1 -- 172.21.15.123:0/3170703424 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7500aba00 con 0x7fc7580b4d60 2024-04-25T13:42:16.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.242+0000 7fc75d000640 1 -- 172.21.15.123:0/3170703424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7580b4d60 msgr2=0x7fc7580b5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:16.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.242+0000 7fc75d000640 1 --2- 172.21.15.123:0/3170703424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7580b4d60 0x7fc7580b5170 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc758072e60 tx=0x7fc75001c480 comp rx=0 tx=0).stop 2024-04-25T13:42:16.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.242+0000 7fc75d000640 1 -- 172.21.15.123:0/3170703424 shutdown_connections 2024-04-25T13:42:16.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.242+0000 7fc75d000640 1 --2- 172.21.15.123:0/3170703424 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7580b4d60 0x7fc7580b5170 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.242+0000 7fc75d000640 1 --2- 172.21.15.123:0/3170703424 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc75806d680 0x7fc75806da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.242+0000 7fc75d000640 1 --2- 172.21.15.123:0/3170703424 >> v2:172.21.15.130:3300/0 conn(0x7fc7580758b0 0x7fc75815a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.242+0000 7fc75d000640 1 -- 172.21.15.123:0/3170703424 >> 172.21.15.123:0/3170703424 conn(0x7fc7580733b0 msgr2=0x7fc7580737c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:16.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.242+0000 7fc75d000640 1 -- 172.21.15.123:0/3170703424 shutdown_connections 2024-04-25T13:42:16.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.242+0000 7fc75d000640 1 -- 172.21.15.123:0/3170703424 wait complete. 2024-04-25T13:42:16.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.246+0000 7fc75d000640 1 Processor -- start 2024-04-25T13:42:16.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.246+0000 7fc75d000640 1 -- start start 2024-04-25T13:42:16.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.246+0000 7fc75d000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc75806d680 0x7fc7580708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:16.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.246+0000 7fc75d000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7580758b0 0x7fc75815ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:16.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.246+0000 7fc75d000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7580b4d60 0x7fc75815ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:16.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.246+0000 7fc75d000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc758075e40 con 0x7fc7580b4d60 2024-04-25T13:42:16.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.246+0000 7fc75d000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc758075cc0 con 0x7fc75806d680 2024-04-25T13:42:16.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.246+0000 7fc75d000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc758164320 con 0x7fc7580758b0 2024-04-25T13:42:16.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.246+0000 7fc756800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7580b4d60 0x7fc75815ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:16.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.246+0000 7fc756800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7580b4d60 0x7fc75815ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37604/0 (socket says 172.21.15.123:37604) 2024-04-25T13:42:16.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.246+0000 7fc756800640 1 -- 172.21.15.123:0/2071798829 learned_addr learned my addr 172.21.15.123:0/2071798829 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:16.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.246+0000 7fc74d400640 1 --2- 172.21.15.123:0/2071798829 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7580758b0 0x7fc75815ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:16.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.246+0000 7fc755e00640 1 --2- 172.21.15.123:0/2071798829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc75806d680 0x7fc7580708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:16.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.246+0000 7fc756800640 1 -- 172.21.15.123:0/2071798829 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7580758b0 msgr2=0x7fc75815ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:16.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.246+0000 7fc756800640 1 --2- 172.21.15.123:0/2071798829 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7580758b0 0x7fc75815ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.246+0000 7fc756800640 1 -- 172.21.15.123:0/2071798829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc75806d680 msgr2=0x7fc7580708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:16.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.246+0000 7fc756800640 1 --2- 172.21.15.123:0/2071798829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc75806d680 0x7fc7580708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.246+0000 7fc756800640 1 -- 172.21.15.123:0/2071798829 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75806f850 con 0x7fc7580b4d60 2024-04-25T13:42:16.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.246+0000 7fc756800640 1 --2- 172.21.15.123:0/2071798829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7580b4d60 0x7fc75815ae30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc7500ad040 tx=0x7fc75001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:16.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.246+0000 7fc74ea00640 1 -- 172.21.15.123:0/2071798829 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7500abd70 con 0x7fc7580b4d60 2024-04-25T13:42:16.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.246+0000 7fc74ea00640 1 -- 172.21.15.123:0/2071798829 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7500bf410 con 0x7fc7580b4d60 2024-04-25T13:42:16.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.246+0000 7fc75d000640 1 -- 172.21.15.123:0/2071798829 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc75806fb30 con 0x7fc7580b4d60 2024-04-25T13:42:16.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.246+0000 7fc74ea00640 1 -- 172.21.15.123:0/2071798829 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7500bf7e0 con 0x7fc7580b4d60 2024-04-25T13:42:16.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.246+0000 7fc75d000640 1 -- 172.21.15.123:0/2071798829 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7580700f0 con 0x7fc7580b4d60 2024-04-25T13:42:16.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.250+0000 7fc75d000640 1 -- 172.21.15.123:0/2071798829 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc75806f5c0 con 0x7fc7580b4d60 2024-04-25T13:42:16.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.250+0000 7fc74ea00640 1 -- 172.21.15.123:0/2071798829 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc7500bd020 con 0x7fc7580b4d60 2024-04-25T13:42:16.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.250+0000 7fc74ea00640 1 --2- 172.21.15.123:0/2071798829 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fc73406f400 0x7fc734071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:16.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.250+0000 7fc74ea00640 1 -- 172.21.15.123:0/2071798829 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc7501297e0 con 0x7fc7580b4d60 2024-04-25T13:42:16.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.250+0000 7fc755e00640 1 --2- 172.21.15.123:0/2071798829 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fc73406f400 0x7fc734071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:16.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.250+0000 7fc755e00640 1 --2- 172.21.15.123:0/2071798829 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fc73406f400 0x7fc734071910 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc75806eea0 tx=0x7fc74800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:16.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.254+0000 7fc74ea00640 1 -- 172.21.15.123:0/2071798829 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc750016070 con 0x7fc7580b4d60 2024-04-25T13:42:16.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.410+0000 7fc75d000640 1 -- 172.21.15.123:0/2071798829 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc7580507c0 con 0x7fc7580b4d60 2024-04-25T13:42:16.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.414+0000 7fc74ea00640 1 -- 172.21.15.123:0/2071798829 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16629 (secure 0 0 0) 0x7fc7500f6070 con 0x7fc7580b4d60 2024-04-25T13:42:16.416 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:16.416 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:42:07.405529+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:03.949161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:04.755682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:16.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.414+0000 7fc75d000640 1 -- 172.21.15.123:0/2071798829 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fc73406f400 msgr2=0x7fc734071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:16.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.414+0000 7fc75d000640 1 --2- 172.21.15.123:0/2071798829 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fc73406f400 0x7fc734071910 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc75806eea0 tx=0x7fc74800b040 comp rx=0 tx=0).stop 2024-04-25T13:42:16.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.414+0000 7fc75d000640 1 -- 172.21.15.123:0/2071798829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7580b4d60 msgr2=0x7fc75815ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:16.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.414+0000 7fc75d000640 1 --2- 172.21.15.123:0/2071798829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7580b4d60 0x7fc75815ae30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc7500ad040 tx=0x7fc75001acc0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.414+0000 7fc75d000640 1 -- 172.21.15.123:0/2071798829 shutdown_connections 2024-04-25T13:42:16.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.414+0000 7fc75d000640 1 --2- 172.21.15.123:0/2071798829 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fc73406f400 0x7fc734071910 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.414+0000 7fc75d000640 1 --2- 172.21.15.123:0/2071798829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7580b4d60 0x7fc75815ae30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.414+0000 7fc75d000640 1 --2- 172.21.15.123:0/2071798829 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7580758b0 0x7fc75815ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.414+0000 7fc75d000640 1 --2- 172.21.15.123:0/2071798829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc75806d680 0x7fc7580708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.414+0000 7fc75d000640 1 -- 172.21.15.123:0/2071798829 >> 172.21.15.123:0/2071798829 conn(0x7fc7580733b0 msgr2=0x7fc7580cfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:16.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.414+0000 7fc75d000640 1 -- 172.21.15.123:0/2071798829 shutdown_connections 2024-04-25T13:42:16.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.414+0000 7fc75d000640 1 -- 172.21.15.123:0/2071798829 wait complete. 2024-04-25T13:42:16.438 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:41:53.602480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:42:03.949161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:42:04.755682+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:42:16.439 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:42:16.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.586+0000 7f2871600640 1 Processor -- start 2024-04-25T13:42:16.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.586+0000 7f2871600640 1 -- start start 2024-04-25T13:42:16.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.586+0000 7f2871600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f286c1571b0 0x7f286c0cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:16.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.586+0000 7f2871600640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f286c0b3870 0x7f286c0b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:16.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.586+0000 7f2871600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f286c0b41c0 con 0x7f286c0b4770 2024-04-25T13:42:16.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.586+0000 7f2871600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f286c0cdee0 con 0x7f286c1571b0 2024-04-25T13:42:16.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.586+0000 7f2871600640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f286c15d570 con 0x7f286c0b3870 2024-04-25T13:42:16.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.586+0000 7f286aa00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f286c1571b0 0x7f286c0cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:16.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.586+0000 7f286b400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f286c0b4770 0x7f286c0b4b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53332/0 (socket says 172.21.15.123:53332) 2024-04-25T13:42:16.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.586+0000 7f286b400640 1 -- 172.21.15.123:0/2777041302 learned_addr learned my addr 172.21.15.123:0/2777041302 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:16.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.586+0000 7f286a000640 1 --2- 172.21.15.123:0/2777041302 >> v2:172.21.15.130:3300/0 conn(0x7f286c0b3870 0x7f286c0b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:16.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.586+0000 7f286aa00640 1 -- 172.21.15.123:0/2777041302 >> v2:172.21.15.130:3300/0 conn(0x7f286c0b3870 msgr2=0x7f286c0b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:16.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.586+0000 7f286aa00640 1 --2- 172.21.15.123:0/2777041302 >> v2:172.21.15.130:3300/0 conn(0x7f286c0b3870 0x7f286c0b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.586+0000 7f286aa00640 1 -- 172.21.15.123:0/2777041302 >> v1:172.21.15.123:6789/0 conn(0x7f286c0b4770 legacy=0x7f286c0b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:16.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.590+0000 7f286aa00640 1 -- 172.21.15.123:0/2777041302 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f286c15d850 con 0x7f286c1571b0 2024-04-25T13:42:16.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.586+0000 7f2869600640 1 -- 172.21.15.123:0/2777041302 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3932057339 0 0) 0x7f2864001120 con 0x7f286c0b4770 2024-04-25T13:42:16.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.590+0000 7f286aa00640 1 --2- 172.21.15.123:0/2777041302 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f286c1571b0 0x7f286c0cd6b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f286c0c7720 tx=0x7f285c01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f894159e21e22c6f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:16.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.590+0000 7f2869600640 1 -- 172.21.15.123:0/2777041302 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285c0b2070 con 0x7f286c1571b0 2024-04-25T13:42:16.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.590+0000 7f2869600640 1 -- 172.21.15.123:0/2777041302 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f285c0a5830 con 0x7f286c1571b0 2024-04-25T13:42:16.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.590+0000 7f2869600640 1 -- 172.21.15.123:0/2777041302 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285c0a5c00 con 0x7f286c1571b0 2024-04-25T13:42:16.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.590+0000 7f2871600640 1 -- 172.21.15.123:0/2777041302 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f286c1571b0 msgr2=0x7f286c0cd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:16.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.590+0000 7f2871600640 1 --2- 172.21.15.123:0/2777041302 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f286c1571b0 0x7f286c0cd6b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f286c0c7720 tx=0x7f285c01c8a0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.590+0000 7f2871600640 1 -- 172.21.15.123:0/2777041302 shutdown_connections 2024-04-25T13:42:16.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.590+0000 7f2871600640 1 --2- 172.21.15.123:0/2777041302 >> v2:172.21.15.130:3300/0 conn(0x7f286c0b3870 0x7f286c0b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.590+0000 7f2871600640 1 --2- 172.21.15.123:0/2777041302 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f286c1571b0 0x7f286c0cd6b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.590+0000 7f2871600640 1 -- 172.21.15.123:0/2777041302 >> 172.21.15.123:0/2777041302 conn(0x7f286c06ca70 msgr2=0x7f286c06ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:16.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.590+0000 7f2871600640 1 -- 172.21.15.123:0/2777041302 shutdown_connections 2024-04-25T13:42:16.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.590+0000 7f2871600640 1 -- 172.21.15.123:0/2777041302 wait complete. 2024-04-25T13:42:16.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.594+0000 7f2871600640 1 Processor -- start 2024-04-25T13:42:16.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.594+0000 7f2871600640 1 -- start start 2024-04-25T13:42:16.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.594+0000 7f2871600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f286c0b3870 0x7f286c153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:16.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.594+0000 7f2871600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f286c0b4770 0x7f286c14b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:16.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.594+0000 7f2871600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f286c1571b0 0x7f286c15e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:16.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.594+0000 7f2871600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f286c15e050 con 0x7f286c0b4770 2024-04-25T13:42:16.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.594+0000 7f2871600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f286c1575c0 con 0x7f286c1571b0 2024-04-25T13:42:16.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.594+0000 7f2871600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f286c15f160 con 0x7f286c0b3870 2024-04-25T13:42:16.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.594+0000 7f286a000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f286c0b4770 0x7f286c14b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:16.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.598+0000 7f286a000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f286c0b4770 0x7f286c14b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37620/0 (socket says 172.21.15.123:37620) 2024-04-25T13:42:16.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.598+0000 7f286a000640 1 -- 172.21.15.123:0/683675375 learned_addr learned my addr 172.21.15.123:0/683675375 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:16.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.598+0000 7f286aa00640 1 --2- 172.21.15.123:0/683675375 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f286c0b3870 0x7f286c153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:16.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.598+0000 7f286b400640 1 --2- 172.21.15.123:0/683675375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f286c1571b0 0x7f286c15e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:16.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.598+0000 7f286a000640 1 -- 172.21.15.123:0/683675375 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f286c0b3870 msgr2=0x7f286c153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:16.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.598+0000 7f286a000640 1 --2- 172.21.15.123:0/683675375 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f286c0b3870 0x7f286c153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.598+0000 7f286a000640 1 -- 172.21.15.123:0/683675375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f286c1571b0 msgr2=0x7f286c15e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:16.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.598+0000 7f286a000640 1 --2- 172.21.15.123:0/683675375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f286c1571b0 0x7f286c15e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.598+0000 7f286a000640 1 -- 172.21.15.123:0/683675375 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f286c14be70 con 0x7f286c0b4770 2024-04-25T13:42:16.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.598+0000 7f286a000640 1 --2- 172.21.15.123:0/683675375 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f286c0b4770 0x7f286c14b930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f285800d800 tx=0x7f285800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:16.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.598+0000 7f2862a00640 1 -- 172.21.15.123:0/683675375 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285800b6c0 con 0x7f286c0b4770 2024-04-25T13:42:16.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.598+0000 7f2862a00640 1 -- 172.21.15.123:0/683675375 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2858019070 con 0x7f286c0b4770 2024-04-25T13:42:16.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.598+0000 7f2862a00640 1 -- 172.21.15.123:0/683675375 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f285800ba80 con 0x7f286c0b4770 2024-04-25T13:42:16.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.598+0000 7f2871600640 1 -- 172.21.15.123:0/683675375 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f286c14c2e0 con 0x7f286c0b4770 2024-04-25T13:42:16.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.598+0000 7f2871600640 1 -- 172.21.15.123:0/683675375 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f286c14c8a0 con 0x7f286c0b4770 2024-04-25T13:42:16.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.598+0000 7f2871600640 1 -- 172.21.15.123:0/683675375 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f286c153860 con 0x7f286c0b4770 2024-04-25T13:42:16.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.598+0000 7f2862a00640 1 -- 172.21.15.123:0/683675375 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f285800bc20 con 0x7f286c0b4770 2024-04-25T13:42:16.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.602+0000 7f2862a00640 1 --2- 172.21.15.123:0/683675375 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f284c06f430 0x7f284c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:16.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.602+0000 7f2862a00640 1 -- 172.21.15.123:0/683675375 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f285808f5e0 con 0x7f286c0b4770 2024-04-25T13:42:16.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.602+0000 7f286aa00640 1 --2- 172.21.15.123:0/683675375 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f284c06f430 0x7f284c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:16.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.602+0000 7f286aa00640 1 --2- 172.21.15.123:0/683675375 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f284c06f430 0x7f284c071940 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f285c0af000 tx=0x7f285c0a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:16.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.606+0000 7f2862a00640 1 -- 172.21.15.123:0/683675375 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f285805bde0 con 0x7f286c0b4770 2024-04-25T13:42:16.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.762+0000 7f2871600640 1 -- 172.21.15.123:0/683675375 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f286c050750 con 0x7f286c0b4770 2024-04-25T13:42:16.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.762+0000 7f2862a00640 1 -- 172.21.15.123:0/683675375 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f28580600e0 con 0x7f286c0b4770 2024-04-25T13:42:16.765 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-04-25T13:42:16.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.762+0000 7f2871600640 1 -- 172.21.15.123:0/683675375 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f284c06f430 msgr2=0x7f284c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:16.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.762+0000 7f2871600640 1 --2- 172.21.15.123:0/683675375 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f284c06f430 0x7f284c071940 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f285c0af000 tx=0x7f285c0a7070 comp rx=0 tx=0).stop 2024-04-25T13:42:16.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.762+0000 7f2871600640 1 -- 172.21.15.123:0/683675375 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f286c0b4770 msgr2=0x7f286c14b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:16.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.762+0000 7f2871600640 1 --2- 172.21.15.123:0/683675375 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f286c0b4770 0x7f286c14b930 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f285800d800 tx=0x7f285800dcc0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.762+0000 7f2871600640 1 -- 172.21.15.123:0/683675375 shutdown_connections 2024-04-25T13:42:16.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.762+0000 7f2871600640 1 --2- 172.21.15.123:0/683675375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f286c1571b0 0x7f286c15e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.762+0000 7f2871600640 1 --2- 172.21.15.123:0/683675375 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f284c06f430 0x7f284c071940 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.762+0000 7f2871600640 1 --2- 172.21.15.123:0/683675375 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f286c0b4770 0x7f286c14b930 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.762+0000 7f2871600640 1 --2- 172.21.15.123:0/683675375 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f286c0b3870 0x7f286c153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.762+0000 7f2871600640 1 -- 172.21.15.123:0/683675375 >> 172.21.15.123:0/683675375 conn(0x7f286c06ca70 msgr2=0x7f286c06ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:16.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.762+0000 7f2871600640 1 -- 172.21.15.123:0/683675375 shutdown_connections 2024-04-25T13:42:16.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.762+0000 7f2871600640 1 -- 172.21.15.123:0/683675375 wait complete. 2024-04-25T13:42:16.787 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:42:16.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.930+0000 7fcc5be00640 1 Processor -- start 2024-04-25T13:42:16.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.930+0000 7fcc5be00640 1 -- start start 2024-04-25T13:42:16.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.934+0000 7fcc5be00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcc540cb940 0x7fcc540cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:16.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.934+0000 7fcc5be00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcc5406c670 0x7fcc5406ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:16.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.934+0000 7fcc5be00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc5406cfc0 con 0x7fcc540d2f90 2024-04-25T13:42:16.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.934+0000 7fcc5be00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fcc540cf130 con 0x7fcc540cb940 2024-04-25T13:42:16.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.934+0000 7fcc5be00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fcc540d1770 con 0x7fcc5406c670 2024-04-25T13:42:16.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.934+0000 7fcc59400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fcc540d2f90 0x7fcc5415feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53334/0 (socket says 172.21.15.123:53334) 2024-04-25T13:42:16.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.934+0000 7fcc59400640 1 -- 172.21.15.123:0/2993922718 learned_addr learned my addr 172.21.15.123:0/2993922718 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:16.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.934+0000 7fcc58a00640 1 --2- 172.21.15.123:0/2993922718 >> v2:172.21.15.123:3300/0 conn(0x7fcc540cb940 0x7fcc540cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:16.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.934+0000 7fcc59e00640 1 --2- 172.21.15.123:0/2993922718 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcc5406c670 0x7fcc5406ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:16.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.934+0000 7fcc53e00640 1 -- 172.21.15.123:0/2993922718 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3247130463 0 0) 0x7fcc48001120 con 0x7fcc540d2f90 2024-04-25T13:42:16.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.934+0000 7fcc53e00640 1 -- 172.21.15.123:0/2993922718 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc3c003530 con 0x7fcc540d2f90 2024-04-25T13:42:16.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.934+0000 7fcc58a00640 1 -- 172.21.15.123:0/2993922718 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcc5406c670 msgr2=0x7fcc5406ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:16.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.934+0000 7fcc58a00640 1 --2- 172.21.15.123:0/2993922718 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcc5406c670 0x7fcc5406ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.934+0000 7fcc58a00640 1 -- 172.21.15.123:0/2993922718 >> v1:172.21.15.123:6789/0 conn(0x7fcc540d2f90 legacy=0x7fcc5415feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:16.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.934+0000 7fcc58a00640 1 -- 172.21.15.123:0/2993922718 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc540d33a0 con 0x7fcc540cb940 2024-04-25T13:42:16.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.938+0000 7fcc58a00640 1 --2- 172.21.15.123:0/2993922718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc540cb940 0x7fcc540cbd50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcc400097c0 tx=0x7fcc4001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3754e611f0467342 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:16.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.938+0000 7fcc53e00640 1 -- 172.21.15.123:0/2993922718 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc400a7070 con 0x7fcc540cb940 2024-04-25T13:42:16.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.938+0000 7fcc53e00640 1 -- 172.21.15.123:0/2993922718 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc400b0070 con 0x7fcc540cb940 2024-04-25T13:42:16.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.938+0000 7fcc53e00640 1 -- 172.21.15.123:0/2993922718 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc400ab890 con 0x7fcc540cb940 2024-04-25T13:42:16.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.938+0000 7fcc5be00640 1 -- 172.21.15.123:0/2993922718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc540cb940 msgr2=0x7fcc540cbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:16.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.938+0000 7fcc5be00640 1 --2- 172.21.15.123:0/2993922718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc540cb940 0x7fcc540cbd50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcc400097c0 tx=0x7fcc4001c470 comp rx=0 tx=0).stop 2024-04-25T13:42:16.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.938+0000 7fcc5be00640 1 -- 172.21.15.123:0/2993922718 shutdown_connections 2024-04-25T13:42:16.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.938+0000 7fcc5be00640 1 --2- 172.21.15.123:0/2993922718 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcc5406c670 0x7fcc5406ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.938+0000 7fcc5be00640 1 --2- 172.21.15.123:0/2993922718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc540cb940 0x7fcc540cbd50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.938+0000 7fcc5be00640 1 -- 172.21.15.123:0/2993922718 >> 172.21.15.123:0/2993922718 conn(0x7fcc5406e120 msgr2=0x7fcc540b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:16.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.938+0000 7fcc5be00640 1 -- 172.21.15.123:0/2993922718 shutdown_connections 2024-04-25T13:42:16.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.938+0000 7fcc5be00640 1 -- 172.21.15.123:0/2993922718 wait complete. 2024-04-25T13:42:16.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.942+0000 7fcc5be00640 1 Processor -- start 2024-04-25T13:42:16.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.942+0000 7fcc5be00640 1 -- start start 2024-04-25T13:42:16.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.942+0000 7fcc5be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc5406c670 0x7fcc5415d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:16.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.942+0000 7fcc5be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc540cb940 0x7fcc5414c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:16.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.942+0000 7fcc5be00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcc540d2f90 0x7fcc540b7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:16.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.942+0000 7fcc5be00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcc540d22b0 con 0x7fcc5406c670 2024-04-25T13:42:16.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.942+0000 7fcc5be00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcc54163c20 con 0x7fcc540cb940 2024-04-25T13:42:16.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.942+0000 7fcc5be00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fcc5416cf20 con 0x7fcc540d2f90 2024-04-25T13:42:16.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.942+0000 7fcc59400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc5406c670 0x7fcc5415d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.942+0000 7fcc59400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc5406c670 0x7fcc5415d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37644/0 (socket says 172.21.15.123:37644) 2024-04-25T13:42:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.942+0000 7fcc59400640 1 -- 172.21.15.123:0/3494685566 learned_addr learned my addr 172.21.15.123:0/3494685566 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.942+0000 7fcc59400640 1 -- 172.21.15.123:0/3494685566 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcc540d2f90 msgr2=0x7fcc540b7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.942+0000 7fcc59400640 1 --2- 172.21.15.123:0/3494685566 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcc540d2f90 0x7fcc540b7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.942+0000 7fcc59400640 1 -- 172.21.15.123:0/3494685566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc540cb940 msgr2=0x7fcc5414c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.942+0000 7fcc59400640 1 --2- 172.21.15.123:0/3494685566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc540cb940 0x7fcc5414c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.942+0000 7fcc59400640 1 -- 172.21.15.123:0/3494685566 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc54153190 con 0x7fcc5406c670 2024-04-25T13:42:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.942+0000 7fcc59400640 1 --2- 172.21.15.123:0/3494685566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc5406c670 0x7fcc5415d1e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcc4800c3f0 tx=0x7fcc4800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.942+0000 7fcc51600640 1 -- 172.21.15.123:0/3494685566 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc48017070 con 0x7fcc5406c670 2024-04-25T13:42:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.942+0000 7fcc51600640 1 -- 172.21.15.123:0/3494685566 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc48005cf0 con 0x7fcc5406c670 2024-04-25T13:42:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.942+0000 7fcc51600640 1 -- 172.21.15.123:0/3494685566 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc480072f0 con 0x7fcc5406c670 2024-04-25T13:42:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.942+0000 7fcc5be00640 1 -- 172.21.15.123:0/3494685566 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc5415f350 con 0x7fcc5406c670 2024-04-25T13:42:16.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.942+0000 7fcc5be00640 1 -- 172.21.15.123:0/3494685566 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc5415d8c0 con 0x7fcc5406c670 2024-04-25T13:42:16.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.946+0000 7fcc5be00640 1 -- 172.21.15.123:0/3494685566 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc54050750 con 0x7fcc5406c670 2024-04-25T13:42:16.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.946+0000 7fcc51600640 1 -- 172.21.15.123:0/3494685566 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fcc4801a070 con 0x7fcc5406c670 2024-04-25T13:42:16.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.946+0000 7fcc51600640 1 --2- 172.21.15.123:0/3494685566 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fcc3406f400 0x7fcc34071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:16.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.946+0000 7fcc51600640 1 -- 172.21.15.123:0/3494685566 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcc4808e5c0 con 0x7fcc5406c670 2024-04-25T13:42:16.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.946+0000 7fcc58a00640 1 --2- 172.21.15.123:0/3494685566 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fcc3406f400 0x7fcc34071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:16.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.946+0000 7fcc58a00640 1 --2- 172.21.15.123:0/3494685566 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fcc3406f400 0x7fcc34071910 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcc400af000 tx=0x7fcc40004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:16.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:16.950+0000 7fcc51600640 1 -- 172.21.15.123:0/3494685566 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcc5406cfc0 con 0x7fcc5406c670 2024-04-25T13:42:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.106+0000 7fcc5be00640 1 -- 172.21.15.123:0/3494685566 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fcc54070600 con 0x7fcc5406c670 2024-04-25T13:42:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.106+0000 7fcc51600640 1 -- 172.21.15.123:0/3494685566 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fcc4805b520 con 0x7fcc5406c670 2024-04-25T13:42:17.110 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-04-25T13:42:17.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.110+0000 7fcc5be00640 1 -- 172.21.15.123:0/3494685566 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fcc3406f400 msgr2=0x7fcc34071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:17.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.110+0000 7fcc5be00640 1 --2- 172.21.15.123:0/3494685566 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fcc3406f400 0x7fcc34071910 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcc400af000 tx=0x7fcc40004740 comp rx=0 tx=0).stop 2024-04-25T13:42:17.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.110+0000 7fcc5be00640 1 -- 172.21.15.123:0/3494685566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc5406c670 msgr2=0x7fcc5415d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:17.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.110+0000 7fcc5be00640 1 --2- 172.21.15.123:0/3494685566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc5406c670 0x7fcc5415d1e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcc4800c3f0 tx=0x7fcc4800c8b0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.110+0000 7fcc5be00640 1 -- 172.21.15.123:0/3494685566 shutdown_connections 2024-04-25T13:42:17.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.110+0000 7fcc5be00640 1 --2- 172.21.15.123:0/3494685566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc540cb940 0x7fcc5414c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.110+0000 7fcc5be00640 1 --2- 172.21.15.123:0/3494685566 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fcc3406f400 0x7fcc34071910 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.110+0000 7fcc5be00640 1 --2- 172.21.15.123:0/3494685566 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcc540d2f90 0x7fcc540b7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.110+0000 7fcc5be00640 1 --2- 172.21.15.123:0/3494685566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcc5406c670 0x7fcc5415d1e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.110+0000 7fcc5be00640 1 -- 172.21.15.123:0/3494685566 >> 172.21.15.123:0/3494685566 conn(0x7fcc5406e120 msgr2=0x7fcc540b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:17.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.110+0000 7fcc5be00640 1 -- 172.21.15.123:0/3494685566 shutdown_connections 2024-04-25T13:42:17.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.110+0000 7fcc5be00640 1 -- 172.21.15.123:0/3494685566 wait complete. 2024-04-25T13:42:17.132 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:42:17.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.278+0000 7f416a200640 1 Processor -- start 2024-04-25T13:42:17.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.278+0000 7f416a200640 1 -- start start 2024-04-25T13:42:17.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.278+0000 7f416a200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f416406df70 0x7f41640cff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:17.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.278+0000 7f416a200640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f41640d1b50 0x7f41640d04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:17.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.278+0000 7f416a200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41640d20e0 con 0x7f41640cf840 2024-04-25T13:42:17.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.278+0000 7f416a200640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f41640ced40 con 0x7f41640d1b50 2024-04-25T13:42:17.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.278+0000 7f416a200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f41640d23c0 con 0x7f416406df70 2024-04-25T13:42:17.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.278+0000 7f4163e00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f41640cf840 0x7f41640b4370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53344/0 (socket says 172.21.15.123:53344) 2024-04-25T13:42:17.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.278+0000 7f4163e00640 1 -- 172.21.15.123:0/1809059023 learned_addr learned my addr 172.21.15.123:0/1809059023 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:17.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.278+0000 7f4163400640 1 --2- 172.21.15.123:0/1809059023 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f416406df70 0x7f41640cff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:17.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.278+0000 7f415aa00640 1 --2- 172.21.15.123:0/1809059023 >> v2:172.21.15.130:3300/0 conn(0x7f41640d1b50 0x7f41640d04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:17.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.278+0000 7f4162a00640 1 -- 172.21.15.123:0/1809059023 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2524375475 0 0) 0x7f41640d20e0 con 0x7f41640cf840 2024-04-25T13:42:17.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.282+0000 7f4162a00640 1 -- 172.21.15.123:0/1809059023 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4148003530 con 0x7f41640cf840 2024-04-25T13:42:17.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.282+0000 7f4162a00640 1 -- 172.21.15.123:0/1809059023 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 798901641 0 0) 0x7f4148003530 con 0x7f41640cf840 2024-04-25T13:42:17.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.282+0000 7f4162a00640 1 -- 172.21.15.123:0/1809059023 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f416406df70 msgr2=0x7f41640cff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:17.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.282+0000 7f4162a00640 1 --2- 172.21.15.123:0/1809059023 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f416406df70 0x7f41640cff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.282+0000 7f4162a00640 1 -- 172.21.15.123:0/1809059023 >> v2:172.21.15.130:3300/0 conn(0x7f41640d1b50 msgr2=0x7f41640d04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:17.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.282+0000 7f4162a00640 1 --2- 172.21.15.123:0/1809059023 >> v2:172.21.15.130:3300/0 conn(0x7f41640d1b50 0x7f41640d04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.282+0000 7f4162a00640 1 -- 172.21.15.123:0/1809059023 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41640d26a0 con 0x7f41640cf840 2024-04-25T13:42:17.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.282+0000 7f4162a00640 1 -- 172.21.15.123:0/1809059023 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7f415c001a00 con 0x7f41640cf840 2024-04-25T13:42:17.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.282+0000 7f415aa00640 1 --2- 172.21.15.123:0/1809059023 >> v2:172.21.15.130:3300/0 conn(0x7f41640d1b50 0x7f41640d04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:17.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.282+0000 7f4162a00640 1 -- 172.21.15.123:0/1809059023 >> v1:172.21.15.123:6789/0 conn(0x7f41640cf840 legacy=0x7f41640b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:17.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.282+0000 7f4162a00640 1 --2- 172.21.15.123:0/1809059023 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f416406df70 0x7f4148003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:17.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.282+0000 7f4162a00640 1 --2- 172.21.15.123:0/1809059023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4148004020 0x7f4148004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:17.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.282+0000 7f4162a00640 1 --2- 172.21.15.123:0/1809059023 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4148004d50 0x7f4148005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:17.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.282+0000 7f4162a00640 1 -- 172.21.15.123:0/1809059023 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f41640ced40 con 0x7f4148004d50 2024-04-25T13:42:17.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.282+0000 7f4162a00640 1 -- 172.21.15.123:0/1809059023 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f41640d23c0 con 0x7f4148004020 2024-04-25T13:42:17.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.282+0000 7f4162a00640 1 -- 172.21.15.123:0/1809059023 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f414800bb30 con 0x7f416406df70 2024-04-25T13:42:17.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.282+0000 7f4163400640 1 --2- 172.21.15.123:0/1809059023 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f416406df70 0x7f4148003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:17.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.282+0000 7f415aa00640 1 --2- 172.21.15.123:0/1809059023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4148004020 0x7f4148004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:17.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.282+0000 7f4163e00640 1 --2- 172.21.15.123:0/1809059023 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4148004d50 0x7f4148005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:17.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.282+0000 7f415aa00640 1 -- 172.21.15.123:0/1809059023 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f416406df70 msgr2=0x7f4148003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:17.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.282+0000 7f415aa00640 1 --2- 172.21.15.123:0/1809059023 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f416406df70 0x7f4148003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.282+0000 7f415aa00640 1 -- 172.21.15.123:0/1809059023 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4148004d50 msgr2=0x7f4148005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:17.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.282+0000 7f415aa00640 1 --2- 172.21.15.123:0/1809059023 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4148004d50 0x7f4148005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.282+0000 7f415aa00640 1 -- 172.21.15.123:0/1809059023 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4148003530 con 0x7f4148004020 2024-04-25T13:42:17.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.282+0000 7f4163e00640 1 --2- 172.21.15.123:0/1809059023 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4148004d50 0x7f4148005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:17.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.286+0000 7f415aa00640 1 --2- 172.21.15.123:0/1809059023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4148004020 0x7f4148004810 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4164074530 tx=0x7f414c01cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59c45ce56e4dad84 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:17.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.286+0000 7f4162a00640 1 -- 172.21.15.123:0/1809059023 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f414c0b2070 con 0x7f4148004020 2024-04-25T13:42:17.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.286+0000 7f4162a00640 1 -- 172.21.15.123:0/1809059023 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f414c0a58f0 con 0x7f4148004020 2024-04-25T13:42:17.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.286+0000 7f4162a00640 1 -- 172.21.15.123:0/1809059023 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f414c009880 con 0x7f4148004020 2024-04-25T13:42:17.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.286+0000 7f416a200640 1 -- 172.21.15.123:0/1809059023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4148004020 msgr2=0x7f4148004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:17.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.286+0000 7f416a200640 1 --2- 172.21.15.123:0/1809059023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4148004020 0x7f4148004810 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4164074530 tx=0x7f414c01cc30 comp rx=0 tx=0).stop 2024-04-25T13:42:17.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.286+0000 7f4163e00640 1 -- 172.21.15.123:0/1809059023 reap_dead start 2024-04-25T13:42:17.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.286+0000 7f416a200640 1 -- 172.21.15.123:0/1809059023 shutdown_connections 2024-04-25T13:42:17.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.286+0000 7f416a200640 1 -- 172.21.15.123:0/1809059023 >> 172.21.15.123:0/1809059023 conn(0x7f41640d36e0 msgr2=0x7f41640d3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:17.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.286+0000 7f416a200640 1 -- 172.21.15.123:0/1809059023 shutdown_connections 2024-04-25T13:42:17.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.286+0000 7f416a200640 1 -- 172.21.15.123:0/1809059023 wait complete. 2024-04-25T13:42:17.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.286+0000 7f416a200640 1 Processor -- start 2024-04-25T13:42:17.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.286+0000 7f416a200640 1 -- start start 2024-04-25T13:42:17.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.290+0000 7f416a200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4148004020 0x7f41641f6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:17.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.290+0000 7f416a200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4164149ba0 0x7f4164149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:17.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.290+0000 7f416a200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4164071b60 0x7f4164071f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:17.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.290+0000 7f416a200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f41640d3180 con 0x7f4148004020 2024-04-25T13:42:17.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.290+0000 7f416a200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f41640d2c60 con 0x7f4164071b60 2024-04-25T13:42:17.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.290+0000 7f416a200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f41640cff60 con 0x7f4164149ba0 2024-04-25T13:42:17.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.290+0000 7f4163400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4148004020 0x7f41641f6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:17.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.290+0000 7f4163400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4148004020 0x7f41641f6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37664/0 (socket says 172.21.15.123:37664) 2024-04-25T13:42:17.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.290+0000 7f4163400640 1 -- 172.21.15.123:0/3028199105 learned_addr learned my addr 172.21.15.123:0/3028199105 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:17.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.290+0000 7f415aa00640 1 --2- 172.21.15.123:0/3028199105 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4164149ba0 0x7f4164149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:17.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.290+0000 7f4163e00640 1 --2- 172.21.15.123:0/3028199105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4164071b60 0x7f4164071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:17.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.290+0000 7f4163400640 1 -- 172.21.15.123:0/3028199105 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4164149ba0 msgr2=0x7f4164149fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:17.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.290+0000 7f4163400640 1 --2- 172.21.15.123:0/3028199105 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4164149ba0 0x7f4164149fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.290+0000 7f4163400640 1 -- 172.21.15.123:0/3028199105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4164071b60 msgr2=0x7f4164071f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:17.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.290+0000 7f4163400640 1 --2- 172.21.15.123:0/3028199105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4164071b60 0x7f4164071f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.290+0000 7f4163400640 1 -- 172.21.15.123:0/3028199105 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41640724b0 con 0x7f4148004020 2024-04-25T13:42:17.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.290+0000 7f415aa00640 1 --2- 172.21.15.123:0/3028199105 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4164149ba0 0x7f4164149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:17.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.290+0000 7f4163e00640 1 --2- 172.21.15.123:0/3028199105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4164071b60 0x7f4164071f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:17.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.290+0000 7f4163400640 1 --2- 172.21.15.123:0/3028199105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4148004020 0x7f41641f6530 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4154011a00 tx=0x7f4154011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:17.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.290+0000 7f415be00640 1 -- 172.21.15.123:0/3028199105 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4154005bb0 con 0x7f4148004020 2024-04-25T13:42:17.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.290+0000 7f415be00640 1 -- 172.21.15.123:0/3028199105 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4154005d50 con 0x7f4148004020 2024-04-25T13:42:17.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.290+0000 7f415be00640 1 -- 172.21.15.123:0/3028199105 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415400fb00 con 0x7f4148004020 2024-04-25T13:42:17.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.290+0000 7f416a200640 1 -- 172.21.15.123:0/3028199105 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f416414a7f0 con 0x7f4148004020 2024-04-25T13:42:17.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.290+0000 7f416a200640 1 -- 172.21.15.123:0/3028199105 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4164147bf0 con 0x7f4148004020 2024-04-25T13:42:17.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.290+0000 7f416a200640 1 -- 172.21.15.123:0/3028199105 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4164050750 con 0x7f4148004020 2024-04-25T13:42:17.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.294+0000 7f415be00640 1 -- 172.21.15.123:0/3028199105 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4154012040 con 0x7f4148004020 2024-04-25T13:42:17.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.294+0000 7f415be00640 1 --2- 172.21.15.123:0/3028199105 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f414006f430 0x7f4140071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:17.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.294+0000 7f415be00640 1 -- 172.21.15.123:0/3028199105 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f415408fd90 con 0x7f4148004020 2024-04-25T13:42:17.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.294+0000 7f415aa00640 1 --2- 172.21.15.123:0/3028199105 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f414006f430 0x7f4140071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:17.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.294+0000 7f415aa00640 1 --2- 172.21.15.123:0/3028199105 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f414006f430 0x7f4140071940 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f414c0af000 tx=0x7f414c0046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:17.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.298+0000 7f415be00640 1 -- 172.21.15.123:0/3028199105 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f415402a080 con 0x7f4148004020 2024-04-25T13:42:17.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.454+0000 7f416a200640 1 -- 172.21.15.123:0/3028199105 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f41640b9210 con 0x7f4148004020 2024-04-25T13:42:17.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.454+0000 7f415be00640 1 -- 172.21.15.123:0/3028199105 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f41640724b0 con 0x7f4148004020 2024-04-25T13:42:17.457 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-04-25T13:42:17.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.458+0000 7f416a200640 1 -- 172.21.15.123:0/3028199105 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f414006f430 msgr2=0x7f4140071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:17.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.458+0000 7f416a200640 1 --2- 172.21.15.123:0/3028199105 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f414006f430 0x7f4140071940 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f414c0af000 tx=0x7f414c0046d0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.458+0000 7f416a200640 1 -- 172.21.15.123:0/3028199105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4148004020 msgr2=0x7f41641f6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:17.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.458+0000 7f416a200640 1 --2- 172.21.15.123:0/3028199105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4148004020 0x7f41641f6530 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4154011a00 tx=0x7f4154011ec0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.458+0000 7f416a200640 1 -- 172.21.15.123:0/3028199105 shutdown_connections 2024-04-25T13:42:17.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.458+0000 7f416a200640 1 --2- 172.21.15.123:0/3028199105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4164071b60 0x7f4164071f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.458+0000 7f416a200640 1 --2- 172.21.15.123:0/3028199105 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f414006f430 0x7f4140071940 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.458+0000 7f416a200640 1 --2- 172.21.15.123:0/3028199105 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4164149ba0 0x7f4164149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.458+0000 7f416a200640 1 --2- 172.21.15.123:0/3028199105 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4148004020 0x7f41641f6530 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.458+0000 7f416a200640 1 -- 172.21.15.123:0/3028199105 >> 172.21.15.123:0/3028199105 conn(0x7f41640d36e0 msgr2=0x7f41640b6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:17.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.458+0000 7f416a200640 1 -- 172.21.15.123:0/3028199105 shutdown_connections 2024-04-25T13:42:17.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.458+0000 7f416a200640 1 -- 172.21.15.123:0/3028199105 wait complete. 2024-04-25T13:42:17.479 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:42:17.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.622+0000 7f008ac00640 1 Processor -- start 2024-04-25T13:42:17.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.622+0000 7f008ac00640 1 -- start start 2024-04-25T13:42:17.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.626+0000 7f008ac00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f00840d0f80 0x7f0084160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:17.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.626+0000 7f008ac00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f00840b32f0 0x7f00840b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:17.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.626+0000 7f008ac00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00840b3c40 con 0x7f0084073be0 2024-04-25T13:42:17.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.626+0000 7f008ac00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f008415cfe0 con 0x7f00840d0f80 2024-04-25T13:42:17.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.626+0000 7f008ac00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f0084161520 con 0x7f00840b32f0 2024-04-25T13:42:17.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.626+0000 7f0083e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f00840d0f80 0x7f0084160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.626+0000 7f0083e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f00840d0f80 0x7f0084160fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37674/0 (socket says 172.21.15.123:37674) 2024-04-25T13:42:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.626+0000 7f0083e00640 1 -- 172.21.15.123:0/1339751392 learned_addr learned my addr 172.21.15.123:0/1339751392 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.626+0000 7f007b400640 1 --2- 172.21.15.123:0/1339751392 >> v2:172.21.15.130:3300/0 conn(0x7f00840b32f0 0x7f00840b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:17.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.626+0000 7f0083e00640 1 -- 172.21.15.123:0/1339751392 >> v2:172.21.15.130:3300/0 conn(0x7f00840b32f0 msgr2=0x7f00840b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:17.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.626+0000 7f0083e00640 1 --2- 172.21.15.123:0/1339751392 >> v2:172.21.15.130:3300/0 conn(0x7f00840b32f0 0x7f00840b3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.626+0000 7f0083e00640 1 -- 172.21.15.123:0/1339751392 >> v1:172.21.15.130:6789/0 conn(0x7f0084073be0 legacy=0x7f0084073ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:17.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.626+0000 7f0083e00640 1 -- 172.21.15.123:0/1339751392 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008415d240 con 0x7f00840d0f80 2024-04-25T13:42:17.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.626+0000 7f007b400640 1 --2- 172.21.15.123:0/1339751392 >> v2:172.21.15.130:3300/0 conn(0x7f00840b32f0 0x7f00840b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:17.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.630+0000 7f0083e00640 1 --2- 172.21.15.123:0/1339751392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00840d0f80 0x7f0084160fe0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f00840b4420 tx=0x7f007401c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4577ad4c53c7f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:17.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.630+0000 7f0083400640 1 -- 172.21.15.123:0/1339751392 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00740b0070 con 0x7f00840d0f80 2024-04-25T13:42:17.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.630+0000 7f0083400640 1 -- 172.21.15.123:0/1339751392 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00740ab600 con 0x7f00840d0f80 2024-04-25T13:42:17.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.630+0000 7f0083400640 1 -- 172.21.15.123:0/1339751392 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00740ab9d0 con 0x7f00840d0f80 2024-04-25T13:42:17.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.630+0000 7f008ac00640 1 -- 172.21.15.123:0/1339751392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00840d0f80 msgr2=0x7f0084160fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:17.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.630+0000 7f008ac00640 1 --2- 172.21.15.123:0/1339751392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00840d0f80 0x7f0084160fe0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f00840b4420 tx=0x7f007401c240 comp rx=0 tx=0).stop 2024-04-25T13:42:17.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.630+0000 7f008ac00640 1 -- 172.21.15.123:0/1339751392 shutdown_connections 2024-04-25T13:42:17.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.630+0000 7f008ac00640 1 --2- 172.21.15.123:0/1339751392 >> v2:172.21.15.130:3300/0 conn(0x7f00840b32f0 0x7f00840b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.630+0000 7f008ac00640 1 --2- 172.21.15.123:0/1339751392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00840d0f80 0x7f0084160fe0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.630+0000 7f008ac00640 1 -- 172.21.15.123:0/1339751392 >> 172.21.15.123:0/1339751392 conn(0x7f008406d210 msgr2=0x7f008406ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:17.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.630+0000 7f008ac00640 1 -- 172.21.15.123:0/1339751392 shutdown_connections 2024-04-25T13:42:17.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.630+0000 7f008ac00640 1 -- 172.21.15.123:0/1339751392 wait complete. 2024-04-25T13:42:17.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.630+0000 7f008ac00640 1 Processor -- start 2024-04-25T13:42:17.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.630+0000 7f008ac00640 1 -- start start 2024-04-25T13:42:17.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.634+0000 7f008ac00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0084073be0 0x7f008414f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:17.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.634+0000 7f008ac00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00840b32f0 0x7f008415f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:17.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.634+0000 7f008ac00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00840d0f80 0x7f008414fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:17.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.634+0000 7f008ac00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f00840b6020 con 0x7f00840d0f80 2024-04-25T13:42:17.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.634+0000 7f008ac00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f008415ddc0 con 0x7f0084073be0 2024-04-25T13:42:17.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.634+0000 7f008ac00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f00840b6470 con 0x7f00840b32f0 2024-04-25T13:42:17.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.634+0000 7f0088c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00840d0f80 0x7f008414fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:17.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.634+0000 7f0088c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00840d0f80 0x7f008414fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37678/0 (socket says 172.21.15.123:37678) 2024-04-25T13:42:17.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.634+0000 7f0088c00640 1 -- 172.21.15.123:0/1411650615 learned_addr learned my addr 172.21.15.123:0/1411650615 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:17.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.634+0000 7f0083e00640 1 --2- 172.21.15.123:0/1411650615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0084073be0 0x7f008414f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:17.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.634+0000 7f007b400640 1 --2- 172.21.15.123:0/1411650615 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00840b32f0 0x7f008415f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:17.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.634+0000 7f0088c00640 1 -- 172.21.15.123:0/1411650615 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00840b32f0 msgr2=0x7f008415f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:17.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.634+0000 7f0088c00640 1 --2- 172.21.15.123:0/1411650615 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00840b32f0 0x7f008415f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.634+0000 7f0088c00640 1 -- 172.21.15.123:0/1411650615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0084073be0 msgr2=0x7f008414f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:17.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.634+0000 7f0088c00640 1 --2- 172.21.15.123:0/1411650615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0084073be0 0x7f008414f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.634+0000 7f0088c00640 1 -- 172.21.15.123:0/1411650615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008414f950 con 0x7f00840d0f80 2024-04-25T13:42:17.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.634+0000 7f007b400640 1 --2- 172.21.15.123:0/1411650615 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00840b32f0 0x7f008415f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:17.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.634+0000 7f0088c00640 1 --2- 172.21.15.123:0/1411650615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00840d0f80 0x7f008414fca0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f007c00b970 tx=0x7f007c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:17.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.634+0000 7f0080c00640 1 -- 172.21.15.123:0/1411650615 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f007c019070 con 0x7f00840d0f80 2024-04-25T13:42:17.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.634+0000 7f0080c00640 1 -- 172.21.15.123:0/1411650615 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f007c00cae0 con 0x7f00840d0f80 2024-04-25T13:42:17.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.634+0000 7f0080c00640 1 -- 172.21.15.123:0/1411650615 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f007c014440 con 0x7f00840d0f80 2024-04-25T13:42:17.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.634+0000 7f008ac00640 1 -- 172.21.15.123:0/1411650615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f008415fce0 con 0x7f00840d0f80 2024-04-25T13:42:17.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.634+0000 7f008ac00640 1 -- 172.21.15.123:0/1411650615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f008415c3c0 con 0x7f00840d0f80 2024-04-25T13:42:17.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.634+0000 7f008ac00640 1 -- 172.21.15.123:0/1411650615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00840507c0 con 0x7f00840d0f80 2024-04-25T13:42:17.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.638+0000 7f0080c00640 1 -- 172.21.15.123:0/1411650615 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f007c01c070 con 0x7f00840d0f80 2024-04-25T13:42:17.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.638+0000 7f0080c00640 1 --2- 172.21.15.123:0/1411650615 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f006006f430 0x7f0060071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:17.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.638+0000 7f0080c00640 1 -- 172.21.15.123:0/1411650615 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f007c08ef40 con 0x7f00840d0f80 2024-04-25T13:42:17.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.638+0000 7f0083e00640 1 --2- 172.21.15.123:0/1411650615 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f006006f430 0x7f0060071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:17.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.638+0000 7f0083e00640 1 --2- 172.21.15.123:0/1411650615 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f006006f430 0x7f0060071940 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f00740ad000 tx=0x7f00740a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:17.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.642+0000 7f0080c00640 1 -- 172.21.15.123:0/1411650615 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f007c05bd90 con 0x7f00840d0f80 2024-04-25T13:42:17.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.830+0000 7f008ac00640 1 -- 172.21.15.123:0/1411650615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00840739c0 con 0x7f00840d0f80 2024-04-25T13:42:17.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.834+0000 7f0080c00640 1 -- 172.21.15.123:0/1411650615 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f007c05b690 con 0x7f00840d0f80 2024-04-25T13:42:17.836 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:17.836 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6836/1018722177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1018722177},{"type":"v1","addr":"172.21.15.123:6836","nonce":1018722177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/606716425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":606716425},{"type":"v1","addr":"172.21.15.123:6837","nonce":606716425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/466677289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":466677289},{"type":"v1","addr":"172.21.15.130:6835","nonce":466677289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:42:05.806897+0000","modified":"2024-04-25T13:42:08.807565+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6834/1645626215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1645626215},{"type":"v1","addr":"172.21.15.130:6834","nonce":1645626215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T13:42:17.836 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 8 2024-04-25T13:42:17.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.834+0000 7f008ac00640 1 -- 172.21.15.123:0/1411650615 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f006006f430 msgr2=0x7f0060071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:17.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.834+0000 7f008ac00640 1 --2- 172.21.15.123:0/1411650615 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f006006f430 0x7f0060071940 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f00740ad000 tx=0x7f00740a6000 comp rx=0 tx=0).stop 2024-04-25T13:42:17.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.834+0000 7f008ac00640 1 -- 172.21.15.123:0/1411650615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00840d0f80 msgr2=0x7f008414fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:17.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.834+0000 7f008ac00640 1 --2- 172.21.15.123:0/1411650615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00840d0f80 0x7f008414fca0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f007c00b970 tx=0x7f007c00be30 comp rx=0 tx=0).stop 2024-04-25T13:42:17.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.834+0000 7f008ac00640 1 -- 172.21.15.123:0/1411650615 shutdown_connections 2024-04-25T13:42:17.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.834+0000 7f008ac00640 1 --2- 172.21.15.123:0/1411650615 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f006006f430 0x7f0060071940 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.834+0000 7f008ac00640 1 --2- 172.21.15.123:0/1411650615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f00840d0f80 0x7f008414fca0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.834+0000 7f008ac00640 1 --2- 172.21.15.123:0/1411650615 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00840b32f0 0x7f008415f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.834+0000 7f008ac00640 1 --2- 172.21.15.123:0/1411650615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0084073be0 0x7f008414f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:17.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.834+0000 7f008ac00640 1 -- 172.21.15.123:0/1411650615 >> 172.21.15.123:0/1411650615 conn(0x7f008406d210 msgr2=0x7f008406ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:17.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.834+0000 7f008ac00640 1 -- 172.21.15.123:0/1411650615 shutdown_connections 2024-04-25T13:42:17.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.834+0000 7f008ac00640 1 -- 172.21.15.123:0/1411650615 wait complete. 2024-04-25T13:42:17.857 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:18.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.998+0000 7fe8c6600640 1 Processor -- start 2024-04-25T13:42:18.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:17.998+0000 7fe8c6600640 1 -- start start 2024-04-25T13:42:18.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.002+0000 7fe8c6600640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe8c00747a0 0x7fe8c015fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:18.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.002+0000 7fe8c6600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8c00b5670 0x7fe8c00731e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:18.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.002+0000 7fe8c6600640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8c0145d70 con 0x7fe8c01602e0 2024-04-25T13:42:18.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.002+0000 7fe8c6600640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fe8c0074290 con 0x7fe8c00747a0 2024-04-25T13:42:18.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.002+0000 7fe8c6600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe8c01606f0 con 0x7fe8c00b5670 2024-04-25T13:42:18.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.002+0000 7fe8bfe00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8c00b5670 0x7fe8c00731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:18.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.002+0000 7fe8bf400640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe8c00747a0 0x7fe8c015fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:18.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.002+0000 7fe8bea00640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe8c01602e0 0x7fe8c0072ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.123:51604/0 (socket says 172.21.15.123:51604) 2024-04-25T13:42:18.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.002+0000 7fe8bea00640 1 -- 172.21.15.123:0/1775909948 learned_addr learned my addr 172.21.15.123:0/1775909948 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:18.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.002+0000 7fe8bfe00640 1 -- 172.21.15.123:0/1775909948 >> v2:172.21.15.130:3300/0 conn(0x7fe8c00747a0 msgr2=0x7fe8c015fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:18.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.002+0000 7fe8bfe00640 1 --2- 172.21.15.123:0/1775909948 >> v2:172.21.15.130:3300/0 conn(0x7fe8c00747a0 0x7fe8c015fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.002+0000 7fe8bfe00640 1 -- 172.21.15.123:0/1775909948 >> v1:172.21.15.130:6789/0 conn(0x7fe8c01602e0 legacy=0x7fe8c0072ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:18.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.002+0000 7fe8bfe00640 1 -- 172.21.15.123:0/1775909948 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c0073c80 con 0x7fe8c00b5670 2024-04-25T13:42:18.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.002+0000 7fe8bf400640 1 --2- 172.21.15.123:0/1775909948 >> v2:172.21.15.130:3300/0 conn(0x7fe8c00747a0 0x7fe8c015fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:18.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.006+0000 7fe8bfe00640 1 --2- 172.21.15.123:0/1775909948 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8c00b5670 0x7fe8c00731e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe8b80097c0 tx=0x7fe8b801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a80e4aab645a11a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:18.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.006+0000 7fe8be000640 1 -- 172.21.15.123:0/1775909948 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b80b1070 con 0x7fe8c00b5670 2024-04-25T13:42:18.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.006+0000 7fe8be000640 1 -- 172.21.15.123:0/1775909948 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8b80ac640 con 0x7fe8c00b5670 2024-04-25T13:42:18.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.006+0000 7fe8be000640 1 -- 172.21.15.123:0/1775909948 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b80aca10 con 0x7fe8c00b5670 2024-04-25T13:42:18.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.006+0000 7fe8c6600640 1 -- 172.21.15.123:0/1775909948 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8c00b5670 msgr2=0x7fe8c00731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:18.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.006+0000 7fe8c6600640 1 --2- 172.21.15.123:0/1775909948 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8c00b5670 0x7fe8c00731e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe8b80097c0 tx=0x7fe8b801c4a0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.006+0000 7fe8c6600640 1 -- 172.21.15.123:0/1775909948 shutdown_connections 2024-04-25T13:42:18.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.006+0000 7fe8c6600640 1 --2- 172.21.15.123:0/1775909948 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8c00b5670 0x7fe8c00731e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.006+0000 7fe8c6600640 1 --2- 172.21.15.123:0/1775909948 >> v2:172.21.15.130:3300/0 conn(0x7fe8c00747a0 0x7fe8c015fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.006+0000 7fe8c6600640 1 -- 172.21.15.123:0/1775909948 >> 172.21.15.123:0/1775909948 conn(0x7fe8c006d210 msgr2=0x7fe8c006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:18.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.006+0000 7fe8c6600640 1 -- 172.21.15.123:0/1775909948 shutdown_connections 2024-04-25T13:42:18.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.006+0000 7fe8c6600640 1 -- 172.21.15.123:0/1775909948 wait complete. 2024-04-25T13:42:18.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.010+0000 7fe8c6600640 1 Processor -- start 2024-04-25T13:42:18.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.010+0000 7fe8c6600640 1 -- start start 2024-04-25T13:42:18.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.010+0000 7fe8c6600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8c00747a0 0x7fe8c015bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:18.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.010+0000 7fe8c6600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8c00b5670 0x7fe8c0144660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:18.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.010+0000 7fe8c6600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8c01602e0 0x7fe8c013cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:18.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.010+0000 7fe8c6600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c00b6380 con 0x7fe8c01602e0 2024-04-25T13:42:18.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.010+0000 7fe8c6600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c0074bb0 con 0x7fe8c00b5670 2024-04-25T13:42:18.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.010+0000 7fe8c6600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe8c00b6500 con 0x7fe8c00747a0 2024-04-25T13:42:18.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.010+0000 7fe8bfe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8c01602e0 0x7fe8c013cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:18.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.010+0000 7fe8bfe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8c01602e0 0x7fe8c013cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37690/0 (socket says 172.21.15.123:37690) 2024-04-25T13:42:18.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.010+0000 7fe8bfe00640 1 -- 172.21.15.123:0/923434660 learned_addr learned my addr 172.21.15.123:0/923434660 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:18.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.010+0000 7fe8bea00640 1 --2- 172.21.15.123:0/923434660 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8c00b5670 0x7fe8c0144660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:18.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.010+0000 7fe8bf400640 1 --2- 172.21.15.123:0/923434660 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8c00747a0 0x7fe8c015bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:18.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.010+0000 7fe8bfe00640 1 -- 172.21.15.123:0/923434660 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8c00747a0 msgr2=0x7fe8c015bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:18.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.010+0000 7fe8bfe00640 1 --2- 172.21.15.123:0/923434660 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8c00747a0 0x7fe8c015bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.010+0000 7fe8bfe00640 1 -- 172.21.15.123:0/923434660 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8c00b5670 msgr2=0x7fe8c0144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:18.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.010+0000 7fe8bfe00640 1 --2- 172.21.15.123:0/923434660 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8c00b5670 0x7fe8c0144660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.010+0000 7fe8bfe00640 1 -- 172.21.15.123:0/923434660 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c01fe260 con 0x7fe8c01602e0 2024-04-25T13:42:18.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.010+0000 7fe8bfe00640 1 --2- 172.21.15.123:0/923434660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8c01602e0 0x7fe8c013cb50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe8b801ab50 tx=0x7fe8b8019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:18.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.010+0000 7fe8b7400640 1 -- 172.21.15.123:0/923434660 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b80b1040 con 0x7fe8c01602e0 2024-04-25T13:42:18.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.010+0000 7fe8b7400640 1 -- 172.21.15.123:0/923434660 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8b80b5410 con 0x7fe8c01602e0 2024-04-25T13:42:18.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.010+0000 7fe8b7400640 1 -- 172.21.15.123:0/923434660 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b80b57e0 con 0x7fe8c01602e0 2024-04-25T13:42:18.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.010+0000 7fe8c6600640 1 -- 172.21.15.123:0/923434660 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c01fd6e0 con 0x7fe8c01602e0 2024-04-25T13:42:18.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.010+0000 7fe8c6600640 1 -- 172.21.15.123:0/923434660 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c01fdca0 con 0x7fe8c01602e0 2024-04-25T13:42:18.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.014+0000 7fe8c6600640 1 -- 172.21.15.123:0/923434660 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8c00507c0 con 0x7fe8c01602e0 2024-04-25T13:42:18.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.014+0000 7fe8b7400640 1 -- 172.21.15.123:0/923434660 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe8b80bd020 con 0x7fe8c01602e0 2024-04-25T13:42:18.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.014+0000 7fe8b7400640 1 --2- 172.21.15.123:0/923434660 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe8a006f430 0x7fe8a0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:18.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.014+0000 7fe8b7400640 1 -- 172.21.15.123:0/923434660 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe8b8128780 con 0x7fe8c01602e0 2024-04-25T13:42:18.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.014+0000 7fe8bf400640 1 --2- 172.21.15.123:0/923434660 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe8a006f430 0x7fe8a0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:18.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.014+0000 7fe8bf400640 1 --2- 172.21.15.123:0/923434660 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe8a006f430 0x7fe8a0071940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0009bd0 tx=0x7fe8b000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:18.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.018+0000 7fe8b7400640 1 -- 172.21.15.123:0/923434660 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe8b80c4020 con 0x7fe8c01602e0 2024-04-25T13:42:18.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.178+0000 7fe8c6600640 1 -- 172.21.15.123:0/923434660 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe8c01453b0 con 0x7fe8c01602e0 2024-04-25T13:42:18.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.178+0000 7fe8b7400640 1 -- 172.21.15.123:0/923434660 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16629 (secure 0 0 0) 0x7fe8b8016090 con 0x7fe8c01602e0 2024-04-25T13:42:18.182 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:18.183 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:42:07.405529+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:03.949161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:04.755682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:18.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.182+0000 7fe8c6600640 1 -- 172.21.15.123:0/923434660 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe8a006f430 msgr2=0x7fe8a0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:18.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.182+0000 7fe8c6600640 1 --2- 172.21.15.123:0/923434660 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe8a006f430 0x7fe8a0071940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0009bd0 tx=0x7fe8b000b040 comp rx=0 tx=0).stop 2024-04-25T13:42:18.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.182+0000 7fe8c6600640 1 -- 172.21.15.123:0/923434660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8c01602e0 msgr2=0x7fe8c013cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:18.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.182+0000 7fe8c6600640 1 --2- 172.21.15.123:0/923434660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8c01602e0 0x7fe8c013cb50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe8b801ab50 tx=0x7fe8b8019240 comp rx=0 tx=0).stop 2024-04-25T13:42:18.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.182+0000 7fe8c6600640 1 -- 172.21.15.123:0/923434660 shutdown_connections 2024-04-25T13:42:18.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.182+0000 7fe8c6600640 1 --2- 172.21.15.123:0/923434660 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8c00b5670 0x7fe8c0144660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.182+0000 7fe8c6600640 1 --2- 172.21.15.123:0/923434660 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe8a006f430 0x7fe8a0071940 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.182+0000 7fe8c6600640 1 --2- 172.21.15.123:0/923434660 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe8c01602e0 0x7fe8c013cb50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.182+0000 7fe8c6600640 1 --2- 172.21.15.123:0/923434660 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8c00747a0 0x7fe8c015bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.182+0000 7fe8c6600640 1 -- 172.21.15.123:0/923434660 >> 172.21.15.123:0/923434660 conn(0x7fe8c006d210 msgr2=0x7fe8c00ae870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:18.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.182+0000 7fe8c6600640 1 -- 172.21.15.123:0/923434660 shutdown_connections 2024-04-25T13:42:18.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.182+0000 7fe8c6600640 1 -- 172.21.15.123:0/923434660 wait complete. 2024-04-25T13:42:18.204 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:41:53.602480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:42:03.949161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:42:04.755682+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:42:18.205 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:42:18.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.350+0000 7ff015000640 1 Processor -- start 2024-04-25T13:42:18.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.350+0000 7ff015000640 1 -- start start 2024-04-25T13:42:18.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.354+0000 7ff015000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff010165840 0x7ff010167c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:18.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.354+0000 7ff015000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0100cdee0 con 0x7ff0100b3870 2024-04-25T13:42:18.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.354+0000 7ff015000640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff01015d570 con 0x7ff0101571b0 2024-04-25T13:42:18.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.354+0000 7ff015000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff01015d850 con 0x7ff010165840 2024-04-25T13:42:18.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.354+0000 7ff00e800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff010165840 0x7ff010167c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:18.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.354+0000 7ff00d400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff0100b3870 0x7ff0100b3c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53348/0 (socket says 172.21.15.123:53348) 2024-04-25T13:42:18.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.354+0000 7ff00d400640 1 -- 172.21.15.123:0/278422645 learned_addr learned my addr 172.21.15.123:0/278422645 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:18.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.354+0000 7ff00e800640 1 -- 172.21.15.123:0/278422645 >> v1:172.21.15.130:6789/0 conn(0x7ff0101571b0 legacy=0x7ff0100cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:18.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.354+0000 7ff00e800640 1 -- 172.21.15.123:0/278422645 >> v1:172.21.15.123:6789/0 conn(0x7ff0100b3870 legacy=0x7ff0100b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:18.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.354+0000 7ff00e800640 1 -- 172.21.15.123:0/278422645 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff01015db30 con 0x7ff010165840 2024-04-25T13:42:18.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.358+0000 7ff00e800640 1 --2- 172.21.15.123:0/278422645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff010165840 0x7ff010167c60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff008009dc0 tx=0x7ff00801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913eed052f7c316 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:18.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.358+0000 7ff00ca00640 1 -- 172.21.15.123:0/278422645 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0080b2070 con 0x7ff010165840 2024-04-25T13:42:18.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.358+0000 7ff00ca00640 1 -- 172.21.15.123:0/278422645 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0080a5790 con 0x7ff010165840 2024-04-25T13:42:18.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.358+0000 7ff00ca00640 1 -- 172.21.15.123:0/278422645 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0080a5b60 con 0x7ff010165840 2024-04-25T13:42:18.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.358+0000 7ff015000640 1 -- 172.21.15.123:0/278422645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff010165840 msgr2=0x7ff010167c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:18.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.358+0000 7ff015000640 1 --2- 172.21.15.123:0/278422645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff010165840 0x7ff010167c60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff008009dc0 tx=0x7ff00801c8c0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.358+0000 7ff015000640 1 -- 172.21.15.123:0/278422645 shutdown_connections 2024-04-25T13:42:18.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.358+0000 7ff015000640 1 --2- 172.21.15.123:0/278422645 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff010165840 0x7ff010167c60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.358+0000 7ff015000640 1 -- 172.21.15.123:0/278422645 >> 172.21.15.123:0/278422645 conn(0x7ff01006ca70 msgr2=0x7ff01006ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:18.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.358+0000 7ff015000640 1 -- 172.21.15.123:0/278422645 shutdown_connections 2024-04-25T13:42:18.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.358+0000 7ff015000640 1 -- 172.21.15.123:0/278422645 wait complete. 2024-04-25T13:42:18.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.362+0000 7ff015000640 1 Processor -- start 2024-04-25T13:42:18.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.362+0000 7ff015000640 1 -- start start 2024-04-25T13:42:18.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.362+0000 7ff015000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0100b3870 0x7ff0101fd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:18.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.362+0000 7ff015000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0101571b0 0x7ff0100cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:18.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.362+0000 7ff015000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff010165840 0x7ff0100cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:18.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.362+0000 7ff015000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff01016ab40 con 0x7ff0100b3870 2024-04-25T13:42:18.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.362+0000 7ff015000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff01016a9c0 con 0x7ff010165840 2024-04-25T13:42:18.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.362+0000 7ff015000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff01016acc0 con 0x7ff0101571b0 2024-04-25T13:42:18.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.362+0000 7ff00de00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0100b3870 0x7ff0101fd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:18.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.362+0000 7ff00de00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0100b3870 0x7ff0101fd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37696/0 (socket says 172.21.15.123:37696) 2024-04-25T13:42:18.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.362+0000 7ff00de00640 1 -- 172.21.15.123:0/1724738278 learned_addr learned my addr 172.21.15.123:0/1724738278 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:18.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.362+0000 7ff00d400640 1 --2- 172.21.15.123:0/1724738278 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0101571b0 0x7ff0100cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:18.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.362+0000 7ff00e800640 1 --2- 172.21.15.123:0/1724738278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff010165840 0x7ff0100cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:18.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.362+0000 7ff00de00640 1 -- 172.21.15.123:0/1724738278 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0101571b0 msgr2=0x7ff0100cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:18.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.362+0000 7ff00de00640 1 --2- 172.21.15.123:0/1724738278 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0101571b0 0x7ff0100cb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.362+0000 7ff00de00640 1 -- 172.21.15.123:0/1724738278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff010165840 msgr2=0x7ff0100cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:18.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.362+0000 7ff00de00640 1 --2- 172.21.15.123:0/1724738278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff010165840 0x7ff0100cb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.362+0000 7ff00de00640 1 -- 172.21.15.123:0/1724738278 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff010073900 con 0x7ff0100b3870 2024-04-25T13:42:18.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.362+0000 7ff00de00640 1 --2- 172.21.15.123:0/1724738278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0100b3870 0x7ff0101fd1b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff00000c3a0 tx=0x7ff00000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:18.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.362+0000 7ff006000640 1 -- 172.21.15.123:0/1724738278 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0000052d0 con 0x7ff0100b3870 2024-04-25T13:42:18.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.362+0000 7ff006000640 1 -- 172.21.15.123:0/1724738278 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff000005470 con 0x7ff0100b3870 2024-04-25T13:42:18.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.362+0000 7ff006000640 1 -- 172.21.15.123:0/1724738278 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff000007260 con 0x7ff0100b3870 2024-04-25T13:42:18.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.362+0000 7ff015000640 1 -- 172.21.15.123:0/1724738278 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff010156130 con 0x7ff0100b3870 2024-04-25T13:42:18.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.362+0000 7ff015000640 1 -- 172.21.15.123:0/1724738278 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff010155880 con 0x7ff0100b3870 2024-04-25T13:42:18.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.366+0000 7ff015000640 1 -- 172.21.15.123:0/1724738278 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff010050750 con 0x7ff0100b3870 2024-04-25T13:42:18.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.366+0000 7ff006000640 1 -- 172.21.15.123:0/1724738278 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff000007400 con 0x7ff0100b3870 2024-04-25T13:42:18.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.366+0000 7ff006000640 1 --2- 172.21.15.123:0/1724738278 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7feff006f430 0x7feff0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:18.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.366+0000 7ff006000640 1 -- 172.21.15.123:0/1724738278 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff00008e6a0 con 0x7ff0100b3870 2024-04-25T13:42:18.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.366+0000 7ff00d400640 1 --2- 172.21.15.123:0/1724738278 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7feff006f430 0x7feff0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:18.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.366+0000 7ff00d400640 1 --2- 172.21.15.123:0/1724738278 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7feff006f430 0x7feff0071940 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff010154d20 tx=0x7feffc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:18.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.370+0000 7ff006000640 1 -- 172.21.15.123:0/1724738278 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff00005af40 con 0x7ff0100b3870 2024-04-25T13:42:18.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.530+0000 7ff015000640 1 -- 172.21.15.123:0/1724738278 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff010074cc0 con 0x7ff0100b3870 2024-04-25T13:42:18.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.530+0000 7ff006000640 1 -- 172.21.15.123:0/1724738278 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7ff00005f240 con 0x7ff0100b3870 2024-04-25T13:42:18.533 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-04-25T13:42:18.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.530+0000 7ff015000640 1 -- 172.21.15.123:0/1724738278 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7feff006f430 msgr2=0x7feff0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:18.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.530+0000 7ff015000640 1 --2- 172.21.15.123:0/1724738278 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7feff006f430 0x7feff0071940 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff010154d20 tx=0x7feffc009040 comp rx=0 tx=0).stop 2024-04-25T13:42:18.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.530+0000 7ff015000640 1 -- 172.21.15.123:0/1724738278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0100b3870 msgr2=0x7ff0101fd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:18.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.530+0000 7ff015000640 1 --2- 172.21.15.123:0/1724738278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0100b3870 0x7ff0101fd1b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff00000c3a0 tx=0x7ff00000c860 comp rx=0 tx=0).stop 2024-04-25T13:42:18.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.530+0000 7ff015000640 1 -- 172.21.15.123:0/1724738278 shutdown_connections 2024-04-25T13:42:18.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.530+0000 7ff015000640 1 --2- 172.21.15.123:0/1724738278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff010165840 0x7ff0100cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.530+0000 7ff015000640 1 --2- 172.21.15.123:0/1724738278 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7feff006f430 0x7feff0071940 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.530+0000 7ff015000640 1 --2- 172.21.15.123:0/1724738278 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0101571b0 0x7ff0100cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.530+0000 7ff015000640 1 --2- 172.21.15.123:0/1724738278 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0100b3870 0x7ff0101fd1b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.530+0000 7ff015000640 1 -- 172.21.15.123:0/1724738278 >> 172.21.15.123:0/1724738278 conn(0x7ff01006ca70 msgr2=0x7ff0100b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:18.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.530+0000 7ff015000640 1 -- 172.21.15.123:0/1724738278 shutdown_connections 2024-04-25T13:42:18.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.530+0000 7ff015000640 1 -- 172.21.15.123:0/1724738278 wait complete. 2024-04-25T13:42:18.554 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:42:18.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.702+0000 7f5f7ce00640 1 Processor -- start 2024-04-25T13:42:18.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.702+0000 7f5f7ce00640 1 -- start start 2024-04-25T13:42:18.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.702+0000 7f5f7ce00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5f78166940 0x7f5f78168d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:18.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.702+0000 7f5f7ce00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f780c6810 con 0x7f5f780ceac0 2024-04-25T13:42:18.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.702+0000 7f5f7ce00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f780c6af0 con 0x7f5f780b3870 2024-04-25T13:42:18.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.702+0000 7f5f7ce00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f5f780c7140 con 0x7f5f78166940 2024-04-25T13:42:18.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.702+0000 7f5f75e00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5f780ceac0 0x7f5f780c75d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53356/0 (socket says 172.21.15.123:53356) 2024-04-25T13:42:18.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.702+0000 7f5f75e00640 1 -- 172.21.15.123:0/1656313474 learned_addr learned my addr 172.21.15.123:0/1656313474 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:18.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.702+0000 7f5f74a00640 1 -- 172.21.15.123:0/1656313474 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1262550614 0 0) 0x7f5f780c6810 con 0x7f5f780ceac0 2024-04-25T13:42:18.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.702+0000 7f5f76800640 1 --2- 172.21.15.123:0/1656313474 >> v2:172.21.15.130:3300/0 conn(0x7f5f78166940 0x7f5f78168d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:18.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.702+0000 7f5f74a00640 1 -- 172.21.15.123:0/1656313474 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f5c003530 con 0x7f5f780ceac0 2024-04-25T13:42:18.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.702+0000 7f5f74a00640 1 -- 172.21.15.123:0/1656313474 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3502340947 0 0) 0x7f5f5c003530 con 0x7f5f780ceac0 2024-04-25T13:42:18.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.702+0000 7f5f74a00640 1 -- 172.21.15.123:0/1656313474 >> v2:172.21.15.130:3300/0 conn(0x7f5f78166940 msgr2=0x7f5f78168d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:18.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.702+0000 7f5f74a00640 1 --2- 172.21.15.123:0/1656313474 >> v2:172.21.15.130:3300/0 conn(0x7f5f78166940 0x7f5f78168d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.702+0000 7f5f74a00640 1 -- 172.21.15.123:0/1656313474 >> v1:172.21.15.130:6789/0 conn(0x7f5f780b3870 legacy=0x7f5f780b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:18.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.702+0000 7f5f74a00640 1 -- 172.21.15.123:0/1656313474 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f780c6dd0 con 0x7f5f780ceac0 2024-04-25T13:42:18.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.702+0000 7f5f74a00640 1 -- 172.21.15.123:0/1656313474 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7f5f68001680 con 0x7f5f780ceac0 2024-04-25T13:42:18.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.702+0000 7f5f74a00640 1 -- 172.21.15.123:0/1656313474 >> v1:172.21.15.123:6789/0 conn(0x7f5f780ceac0 legacy=0x7f5f780c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:18.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.702+0000 7f5f74a00640 1 --2- 172.21.15.123:0/1656313474 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5f5c003aa0 0x7f5f5c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:18.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.702+0000 7f5f74a00640 1 --2- 172.21.15.123:0/1656313474 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f5c004810 0x7f5f5c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:18.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.702+0000 7f5f74a00640 1 --2- 172.21.15.123:0/1656313474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f5c005360 0x7f5f5c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:18.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.702+0000 7f5f74a00640 1 -- 172.21.15.123:0/1656313474 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5f780c7140 con 0x7f5f5c005360 2024-04-25T13:42:18.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.702+0000 7f5f74a00640 1 -- 172.21.15.123:0/1656313474 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c00c2f0 con 0x7f5f5c004810 2024-04-25T13:42:18.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.702+0000 7f5f74a00640 1 -- 172.21.15.123:0/1656313474 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f5f5c00c4f0 con 0x7f5f5c003aa0 2024-04-25T13:42:18.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.706+0000 7f5f76800640 1 --2- 172.21.15.123:0/1656313474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f5c005360 0x7f5f5c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:18.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.706+0000 7f5f75e00640 1 --2- 172.21.15.123:0/1656313474 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5f5c003aa0 0x7f5f5c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:18.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.706+0000 7f5f75400640 1 --2- 172.21.15.123:0/1656313474 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f5c004810 0x7f5f5c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:18.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.706+0000 7f5f76800640 1 -- 172.21.15.123:0/1656313474 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5f5c003aa0 msgr2=0x7f5f5c003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:18.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.706+0000 7f5f76800640 1 --2- 172.21.15.123:0/1656313474 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5f5c003aa0 0x7f5f5c003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.706+0000 7f5f76800640 1 -- 172.21.15.123:0/1656313474 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f5c004810 msgr2=0x7f5f5c004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:18.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.706+0000 7f5f76800640 1 --2- 172.21.15.123:0/1656313474 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f5c004810 0x7f5f5c004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.706+0000 7f5f76800640 1 -- 172.21.15.123:0/1656313474 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f5c003530 con 0x7f5f5c005360 2024-04-25T13:42:18.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.706+0000 7f5f76800640 1 -- 172.21.15.123:0/1656313474 reap_dead start 2024-04-25T13:42:18.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.706+0000 7f5f76800640 1 --2- 172.21.15.123:0/1656313474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f5c005360 0x7f5f5c00ba10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009fc0 tx=0x7f5f7001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e607496438b283a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:18.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.706+0000 7f5f74a00640 1 -- 172.21.15.123:0/1656313474 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f70009c10 con 0x7f5f5c005360 2024-04-25T13:42:18.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.706+0000 7f5f74a00640 1 -- 172.21.15.123:0/1656313474 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f700a5bf0 con 0x7f5f5c005360 2024-04-25T13:42:18.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.706+0000 7f5f74a00640 1 -- 172.21.15.123:0/1656313474 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f700039a0 con 0x7f5f5c005360 2024-04-25T13:42:18.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.710+0000 7f5f7ce00640 1 -- 172.21.15.123:0/1656313474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f5c005360 msgr2=0x7f5f5c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:18.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.710+0000 7f5f7ce00640 1 --2- 172.21.15.123:0/1656313474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f5c005360 0x7f5f5c00ba10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009fc0 tx=0x7f5f7001ccc0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.710+0000 7f5f7ce00640 1 -- 172.21.15.123:0/1656313474 shutdown_connections 2024-04-25T13:42:18.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.710+0000 7f5f7ce00640 1 --2- 172.21.15.123:0/1656313474 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f5c005360 0x7f5f5c00ba10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.710+0000 7f5f7ce00640 1 -- 172.21.15.123:0/1656313474 >> 172.21.15.123:0/1656313474 conn(0x7f5f7806ca70 msgr2=0x7f5f7806ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:18.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.710+0000 7f5f7ce00640 1 -- 172.21.15.123:0/1656313474 shutdown_connections 2024-04-25T13:42:18.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.710+0000 7f5f7ce00640 1 -- 172.21.15.123:0/1656313474 wait complete. 2024-04-25T13:42:18.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.710+0000 7f5f7ce00640 1 Processor -- start 2024-04-25T13:42:18.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.710+0000 7f5f7ce00640 1 -- start start 2024-04-25T13:42:18.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.714+0000 7f5f7ce00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5f5c005360 0x7f5f780d03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:18.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.714+0000 7f5f7ce00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f780d0930 0x7f5f78151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:18.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.714+0000 7f5f7ce00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f78152020 0x7f5f78152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:18.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.714+0000 7f5f7ce00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5f780cf050 con 0x7f5f78152020 2024-04-25T13:42:18.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.714+0000 7f5f7ce00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5f780ceed0 con 0x7f5f780d0930 2024-04-25T13:42:18.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.714+0000 7f5f7ce00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f5f780c75d0 con 0x7f5f5c005360 2024-04-25T13:42:18.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.714+0000 7f5f76800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f78152020 0x7f5f78152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:18.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.714+0000 7f5f76800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f78152020 0x7f5f78152430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37716/0 (socket says 172.21.15.123:37716) 2024-04-25T13:42:18.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.714+0000 7f5f76800640 1 -- 172.21.15.123:0/3530705489 learned_addr learned my addr 172.21.15.123:0/3530705489 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:18.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.714+0000 7f5f75e00640 1 --2- 172.21.15.123:0/3530705489 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5f5c005360 0x7f5f780d03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:18.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.714+0000 7f5f75400640 1 --2- 172.21.15.123:0/3530705489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f780d0930 0x7f5f78151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:18.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.714+0000 7f5f76800640 1 -- 172.21.15.123:0/3530705489 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5f5c005360 msgr2=0x7f5f780d03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:18.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.714+0000 7f5f76800640 1 --2- 172.21.15.123:0/3530705489 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5f5c005360 0x7f5f780d03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.714+0000 7f5f76800640 1 -- 172.21.15.123:0/3530705489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f780d0930 msgr2=0x7f5f78151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:18.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.714+0000 7f5f76800640 1 --2- 172.21.15.123:0/3530705489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f780d0930 0x7f5f78151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.714+0000 7f5f76800640 1 -- 172.21.15.123:0/3530705489 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f780d0d40 con 0x7f5f78152020 2024-04-25T13:42:18.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.714+0000 7f5f76800640 1 --2- 172.21.15.123:0/3530705489 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f78152020 0x7f5f78152430 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5f70098710 tx=0x7f5f70009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:18.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.714+0000 7f5f6e000640 1 -- 172.21.15.123:0/3530705489 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f70009c10 con 0x7f5f78152020 2024-04-25T13:42:18.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.714+0000 7f5f6e000640 1 -- 172.21.15.123:0/3530705489 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f700bd070 con 0x7f5f78152020 2024-04-25T13:42:18.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.714+0000 7f5f6e000640 1 -- 172.21.15.123:0/3530705489 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f70003db0 con 0x7f5f78152020 2024-04-25T13:42:18.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.714+0000 7f5f7ce00640 1 -- 172.21.15.123:0/3530705489 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f781404e0 con 0x7f5f78152020 2024-04-25T13:42:18.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.714+0000 7f5f7ce00640 1 -- 172.21.15.123:0/3530705489 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f7815e4b0 con 0x7f5f78152020 2024-04-25T13:42:18.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.714+0000 7f5f7ce00640 1 -- 172.21.15.123:0/3530705489 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f7806d600 con 0x7f5f78152020 2024-04-25T13:42:18.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.714+0000 7f5f6e000640 1 -- 172.21.15.123:0/3530705489 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5f700ae950 con 0x7f5f78152020 2024-04-25T13:42:18.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.718+0000 7f5f6e000640 1 --2- 172.21.15.123:0/3530705489 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5f5806f400 0x7f5f58071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:18.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.718+0000 7f5f6e000640 1 -- 172.21.15.123:0/3530705489 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5f7012ab00 con 0x7f5f78152020 2024-04-25T13:42:18.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.718+0000 7f5f75e00640 1 --2- 172.21.15.123:0/3530705489 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5f5806f400 0x7f5f58071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:18.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.718+0000 7f5f75e00640 1 --2- 172.21.15.123:0/3530705489 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5f5806f400 0x7f5f58071910 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5f68000c10 tx=0x7f5f68007900 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:18.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.722+0000 7f5f6e000640 1 -- 172.21.15.123:0/3530705489 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5f780d0d40 con 0x7f5f78152020 2024-04-25T13:42:18.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.874+0000 7f5f7ce00640 1 -- 172.21.15.123:0/3530705489 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5f78050750 con 0x7f5f78152020 2024-04-25T13:42:18.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.878+0000 7f5f6e000640 1 -- 172.21.15.123:0/3530705489 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f5f700169d0 con 0x7f5f78152020 2024-04-25T13:42:18.880 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-04-25T13:42:18.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.878+0000 7f5f7ce00640 1 -- 172.21.15.123:0/3530705489 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5f5806f400 msgr2=0x7f5f58071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:18.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.878+0000 7f5f7ce00640 1 --2- 172.21.15.123:0/3530705489 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5f5806f400 0x7f5f58071910 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5f68000c10 tx=0x7f5f68007900 comp rx=0 tx=0).stop 2024-04-25T13:42:18.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.878+0000 7f5f7ce00640 1 -- 172.21.15.123:0/3530705489 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f78152020 msgr2=0x7f5f78152430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:18.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.878+0000 7f5f7ce00640 1 --2- 172.21.15.123:0/3530705489 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f78152020 0x7f5f78152430 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5f70098710 tx=0x7f5f70009750 comp rx=0 tx=0).stop 2024-04-25T13:42:18.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.878+0000 7f5f7ce00640 1 -- 172.21.15.123:0/3530705489 shutdown_connections 2024-04-25T13:42:18.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.878+0000 7f5f7ce00640 1 --2- 172.21.15.123:0/3530705489 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5f780d0930 0x7f5f78151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.878+0000 7f5f7ce00640 1 --2- 172.21.15.123:0/3530705489 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5f5806f400 0x7f5f58071910 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.878+0000 7f5f7ce00640 1 --2- 172.21.15.123:0/3530705489 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5f78152020 0x7f5f78152430 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.878+0000 7f5f7ce00640 1 --2- 172.21.15.123:0/3530705489 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5f5c005360 0x7f5f780d03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:18.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.878+0000 7f5f7ce00640 1 -- 172.21.15.123:0/3530705489 >> 172.21.15.123:0/3530705489 conn(0x7f5f7806ca70 msgr2=0x7f5f78068860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:18.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.878+0000 7f5f7ce00640 1 -- 172.21.15.123:0/3530705489 shutdown_connections 2024-04-25T13:42:18.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:18.878+0000 7f5f7ce00640 1 -- 172.21.15.123:0/3530705489 wait complete. 2024-04-25T13:42:18.901 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:42:19.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.046+0000 7f8cbb800640 1 Processor -- start 2024-04-25T13:42:19.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.046+0000 7f8cbb800640 1 -- start start 2024-04-25T13:42:19.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.050+0000 7f8cbb800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8cb415fe90 0x7f8cb40cb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:19.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.050+0000 7f8cbb800640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8cb406c670 0x7f8cb406ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:19.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.050+0000 7f8cbb800640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cb40cffd0 con 0x7f8cb4163e30 2024-04-25T13:42:19.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.050+0000 7f8cbb800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f8cb406cfc0 con 0x7f8cb415fe90 2024-04-25T13:42:19.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.050+0000 7f8cbb800640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f8cb40d2890 con 0x7f8cb406c670 2024-04-25T13:42:19.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.050+0000 7f8cb8e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8cb415fe90 0x7f8cb40cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:19.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.050+0000 7f8cb8e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f8cb415fe90 0x7f8cb40cb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37724/0 (socket says 172.21.15.123:37724) 2024-04-25T13:42:19.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.050+0000 7f8cb8e00640 1 -- 172.21.15.123:0/2387922392 learned_addr learned my addr 172.21.15.123:0/2387922392 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:19.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.050+0000 7f8cb3e00640 1 --2- 172.21.15.123:0/2387922392 >> v2:172.21.15.130:3300/0 conn(0x7f8cb406c670 0x7f8cb406ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:19.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.050+0000 7f8cb8e00640 1 -- 172.21.15.123:0/2387922392 >> v2:172.21.15.130:3300/0 conn(0x7f8cb406c670 msgr2=0x7f8cb406ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:19.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.050+0000 7f8cb8e00640 1 --2- 172.21.15.123:0/2387922392 >> v2:172.21.15.130:3300/0 conn(0x7f8cb406c670 0x7f8cb406ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.050+0000 7f8cb8e00640 1 -- 172.21.15.123:0/2387922392 >> v1:172.21.15.130:6789/0 conn(0x7f8cb4163e30 legacy=0x7f8cb4164240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:19.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.050+0000 7f8cb8e00640 1 -- 172.21.15.123:0/2387922392 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb40cbe80 con 0x7f8cb415fe90 2024-04-25T13:42:19.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.050+0000 7f8cb3e00640 1 --2- 172.21.15.123:0/2387922392 >> v2:172.21.15.130:3300/0 conn(0x7f8cb406c670 0x7f8cb406ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:19.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.054+0000 7f8cb8e00640 1 --2- 172.21.15.123:0/2387922392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8cb415fe90 0x7f8cb40cb940 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8cb40b4e00 tx=0x7f8ca401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26bfef87eb0e805c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:19.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.054+0000 7f8cb3400640 1 -- 172.21.15.123:0/2387922392 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca40b0070 con 0x7f8cb415fe90 2024-04-25T13:42:19.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.054+0000 7f8cb3400640 1 -- 172.21.15.123:0/2387922392 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca40ab600 con 0x7f8cb415fe90 2024-04-25T13:42:19.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.054+0000 7f8cb3400640 1 -- 172.21.15.123:0/2387922392 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca40ab9d0 con 0x7f8cb415fe90 2024-04-25T13:42:19.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.054+0000 7f8cbb800640 1 -- 172.21.15.123:0/2387922392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8cb415fe90 msgr2=0x7f8cb40cb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:19.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.054+0000 7f8cbb800640 1 --2- 172.21.15.123:0/2387922392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8cb415fe90 0x7f8cb40cb940 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8cb40b4e00 tx=0x7f8ca401c490 comp rx=0 tx=0).stop 2024-04-25T13:42:19.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.054+0000 7f8cbb800640 1 -- 172.21.15.123:0/2387922392 shutdown_connections 2024-04-25T13:42:19.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.054+0000 7f8cbb800640 1 --2- 172.21.15.123:0/2387922392 >> v2:172.21.15.130:3300/0 conn(0x7f8cb406c670 0x7f8cb406ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.054+0000 7f8cbb800640 1 --2- 172.21.15.123:0/2387922392 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8cb415fe90 0x7f8cb40cb940 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.054+0000 7f8cbb800640 1 -- 172.21.15.123:0/2387922392 >> 172.21.15.123:0/2387922392 conn(0x7f8cb406e120 msgr2=0x7f8cb40b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:19.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.054+0000 7f8cbb800640 1 -- 172.21.15.123:0/2387922392 shutdown_connections 2024-04-25T13:42:19.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.054+0000 7f8cbb800640 1 -- 172.21.15.123:0/2387922392 wait complete. 2024-04-25T13:42:19.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.054+0000 7f8cbb800640 1 Processor -- start 2024-04-25T13:42:19.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.054+0000 7f8cbb800640 1 -- start start 2024-04-25T13:42:19.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.058+0000 7f8cbb800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8cb406c670 0x7f8cb415f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:19.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.058+0000 7f8cbb800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8cb415fe90 0x7f8cb415ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:19.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.058+0000 7f8cbb800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cb4163e30 0x7f8cb415e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:19.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.058+0000 7f8cbb800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb41602a0 con 0x7f8cb415fe90 2024-04-25T13:42:19.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.058+0000 7f8cbb800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb40d2530 con 0x7f8cb4163e30 2024-04-25T13:42:19.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.058+0000 7f8cbb800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8cb4164950 con 0x7f8cb406c670 2024-04-25T13:42:19.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.058+0000 7f8cb3e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8cb415fe90 0x7f8cb415ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:19.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.058+0000 7f8cb3e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8cb415fe90 0x7f8cb415ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37738/0 (socket says 172.21.15.123:37738) 2024-04-25T13:42:19.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.058+0000 7f8cb3e00640 1 -- 172.21.15.123:0/2254459703 learned_addr learned my addr 172.21.15.123:0/2254459703 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:19.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.058+0000 7f8cb8e00640 1 --2- 172.21.15.123:0/2254459703 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8cb406c670 0x7f8cb415f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:19.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.058+0000 7f8cb9800640 1 --2- 172.21.15.123:0/2254459703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cb4163e30 0x7f8cb415e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:19.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.058+0000 7f8cb3e00640 1 -- 172.21.15.123:0/2254459703 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8cb406c670 msgr2=0x7f8cb415f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:19.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.058+0000 7f8cb3e00640 1 --2- 172.21.15.123:0/2254459703 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8cb406c670 0x7f8cb415f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.058+0000 7f8cb3e00640 1 -- 172.21.15.123:0/2254459703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cb4163e30 msgr2=0x7f8cb415e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:19.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.058+0000 7f8cb3e00640 1 --2- 172.21.15.123:0/2254459703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cb4163e30 0x7f8cb415e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.058+0000 7f8cb3e00640 1 -- 172.21.15.123:0/2254459703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb414b020 con 0x7f8cb415fe90 2024-04-25T13:42:19.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.058+0000 7f8cb3e00640 1 --2- 172.21.15.123:0/2254459703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8cb415fe90 0x7f8cb415ccc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000d830 tx=0x7f8ca000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:19.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.058+0000 7f8cb0c00640 1 -- 172.21.15.123:0/2254459703 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca00096a0 con 0x7f8cb415fe90 2024-04-25T13:42:19.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.058+0000 7f8cb0c00640 1 -- 172.21.15.123:0/2254459703 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ca0019070 con 0x7f8cb415fe90 2024-04-25T13:42:19.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.058+0000 7f8cb0c00640 1 -- 172.21.15.123:0/2254459703 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0009a80 con 0x7f8cb415fe90 2024-04-25T13:42:19.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.058+0000 7f8cbb800640 1 -- 172.21.15.123:0/2254459703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb414b300 con 0x7f8cb415fe90 2024-04-25T13:42:19.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.058+0000 7f8cbb800640 1 -- 172.21.15.123:0/2254459703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb414b8c0 con 0x7f8cb415fe90 2024-04-25T13:42:19.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.058+0000 7f8cbb800640 1 -- 172.21.15.123:0/2254459703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cb4050750 con 0x7f8cb415fe90 2024-04-25T13:42:19.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.062+0000 7f8cb0c00640 1 -- 172.21.15.123:0/2254459703 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8ca001e460 con 0x7f8cb415fe90 2024-04-25T13:42:19.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.062+0000 7f8cb0c00640 1 --2- 172.21.15.123:0/2254459703 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8c9406f400 0x7f8c94071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:19.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.062+0000 7f8cb0c00640 1 -- 172.21.15.123:0/2254459703 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8ca008f7d0 con 0x7f8cb415fe90 2024-04-25T13:42:19.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.062+0000 7f8cb8e00640 1 --2- 172.21.15.123:0/2254459703 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8c9406f400 0x7f8c94071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:19.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.062+0000 7f8cb8e00640 1 --2- 172.21.15.123:0/2254459703 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8c9406f400 0x7f8c94071910 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40ad000 tx=0x7f8ca4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:19.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.066+0000 7f8cb0c00640 1 -- 172.21.15.123:0/2254459703 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8ca005c060 con 0x7f8cb415fe90 2024-04-25T13:42:19.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.222+0000 7f8cbb800640 1 -- 172.21.15.123:0/2254459703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8cb40b4030 con 0x7f8cb415fe90 2024-04-25T13:42:19.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.222+0000 7f8cb0c00640 1 -- 172.21.15.123:0/2254459703 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f8ca0060360 con 0x7f8cb415fe90 2024-04-25T13:42:19.226 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-04-25T13:42:19.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.226+0000 7f8cbb800640 1 -- 172.21.15.123:0/2254459703 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8c9406f400 msgr2=0x7f8c94071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:19.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.226+0000 7f8cbb800640 1 --2- 172.21.15.123:0/2254459703 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8c9406f400 0x7f8c94071910 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40ad000 tx=0x7f8ca4008040 comp rx=0 tx=0).stop 2024-04-25T13:42:19.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.226+0000 7f8cbb800640 1 -- 172.21.15.123:0/2254459703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8cb415fe90 msgr2=0x7f8cb415ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:19.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.226+0000 7f8cbb800640 1 --2- 172.21.15.123:0/2254459703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8cb415fe90 0x7f8cb415ccc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000d830 tx=0x7f8ca000dcf0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.226+0000 7f8cbb800640 1 -- 172.21.15.123:0/2254459703 shutdown_connections 2024-04-25T13:42:19.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.226+0000 7f8cbb800640 1 --2- 172.21.15.123:0/2254459703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cb4163e30 0x7f8cb415e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.226+0000 7f8cbb800640 1 --2- 172.21.15.123:0/2254459703 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8c9406f400 0x7f8c94071910 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.226+0000 7f8cbb800640 1 --2- 172.21.15.123:0/2254459703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8cb415fe90 0x7f8cb415ccc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.226+0000 7f8cbb800640 1 --2- 172.21.15.123:0/2254459703 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8cb406c670 0x7f8cb415f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.226+0000 7f8cbb800640 1 -- 172.21.15.123:0/2254459703 >> 172.21.15.123:0/2254459703 conn(0x7f8cb406e120 msgr2=0x7f8cb40cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:19.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.226+0000 7f8cbb800640 1 -- 172.21.15.123:0/2254459703 shutdown_connections 2024-04-25T13:42:19.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.226+0000 7f8cbb800640 1 -- 172.21.15.123:0/2254459703 wait complete. 2024-04-25T13:42:19.248 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:42:19.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.390+0000 7fd0a7600640 1 Processor -- start 2024-04-25T13:42:19.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.390+0000 7fd0a7600640 1 -- start start 2024-04-25T13:42:19.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd0a7600640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd0a006c670 0x7fd0a006ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:19.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd0a7600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0a006cfc0 con 0x7fd0a00cf7d0 2024-04-25T13:42:19.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd0a7600640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0a00703d0 con 0x7fd0a006fd60 2024-04-25T13:42:19.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd0a7600640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fd0a0163c20 con 0x7fd0a006c670 2024-04-25T13:42:19.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd0a5600640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd0a00cf7d0 0x7fd0a00cfbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:53368/0 (socket says 172.21.15.123:53368) 2024-04-25T13:42:19.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd0a5600640 1 -- 172.21.15.123:0/2658692623 learned_addr learned my addr 172.21.15.123:0/2658692623 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:19.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd097e00640 1 --2- 172.21.15.123:0/2658692623 >> v2:172.21.15.130:3300/0 conn(0x7fd0a006c670 0x7fd0a006ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:19.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd09fe00640 1 -- 172.21.15.123:0/2658692623 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1905567673 0 0) 0x7fd0980014a0 con 0x7fd0a00cf7d0 2024-04-25T13:42:19.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd09fe00640 1 -- 172.21.15.123:0/2658692623 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd084003530 con 0x7fd0a00cf7d0 2024-04-25T13:42:19.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd09fe00640 1 -- 172.21.15.123:0/2658692623 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2164625154 0 0) 0x7fd0a00703d0 con 0x7fd0a006fd60 2024-04-25T13:42:19.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd09fe00640 1 -- 172.21.15.123:0/2658692623 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0980014a0 con 0x7fd0a006fd60 2024-04-25T13:42:19.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd09fe00640 1 -- 172.21.15.123:0/2658692623 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2371706344 0 0) 0x7fd084003530 con 0x7fd0a00cf7d0 2024-04-25T13:42:19.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd09fe00640 1 -- 172.21.15.123:0/2658692623 >> v2:172.21.15.130:3300/0 conn(0x7fd0a006c670 msgr2=0x7fd0a006ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:19.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd09fe00640 1 --2- 172.21.15.123:0/2658692623 >> v2:172.21.15.130:3300/0 conn(0x7fd0a006c670 0x7fd0a006ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd09fe00640 1 -- 172.21.15.123:0/2658692623 >> v1:172.21.15.130:6789/0 conn(0x7fd0a006fd60 legacy=0x7fd0a01640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:19.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd09fe00640 1 -- 172.21.15.123:0/2658692623 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a00706b0 con 0x7fd0a00cf7d0 2024-04-25T13:42:19.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd09fe00640 1 -- 172.21.15.123:0/2658692623 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7fd098001bd0 con 0x7fd0a00cf7d0 2024-04-25T13:42:19.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd097e00640 1 --2- 172.21.15.123:0/2658692623 >> v2:172.21.15.130:3300/0 conn(0x7fd0a006c670 0x7fd0a006ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:19.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd09fe00640 1 -- 172.21.15.123:0/2658692623 >> v1:172.21.15.123:6789/0 conn(0x7fd0a00cf7d0 legacy=0x7fd0a00cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:19.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd09fe00640 1 --2- 172.21.15.123:0/2658692623 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd084003bc0 0x7fd084004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:19.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd09fe00640 1 --2- 172.21.15.123:0/2658692623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd084004810 0x7fd084004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:19.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd09fe00640 1 --2- 172.21.15.123:0/2658692623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd084005220 0x7fd08400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:19.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd09fe00640 1 -- 172.21.15.123:0/2658692623 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a0163c20 con 0x7fd084005220 2024-04-25T13:42:19.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd09fe00640 1 -- 172.21.15.123:0/2658692623 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd08400c1c0 con 0x7fd084004810 2024-04-25T13:42:19.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd09fe00640 1 -- 172.21.15.123:0/2658692623 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fd08400c3c0 con 0x7fd084003bc0 2024-04-25T13:42:19.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd0a5600640 1 --2- 172.21.15.123:0/2658692623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd084005220 0x7fd08400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:19.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd097e00640 1 --2- 172.21.15.123:0/2658692623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd084004810 0x7fd084004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:19.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd0a4c00640 1 --2- 172.21.15.123:0/2658692623 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd084003bc0 0x7fd084004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:19.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd0a5600640 1 -- 172.21.15.123:0/2658692623 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd084003bc0 msgr2=0x7fd084004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:19.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd0a5600640 1 --2- 172.21.15.123:0/2658692623 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd084003bc0 0x7fd084004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd0a5600640 1 -- 172.21.15.123:0/2658692623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd084004810 msgr2=0x7fd084004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:19.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd0a5600640 1 --2- 172.21.15.123:0/2658692623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd084004810 0x7fd084004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.394+0000 7fd0a5600640 1 -- 172.21.15.123:0/2658692623 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd084003530 con 0x7fd084005220 2024-04-25T13:42:19.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.398+0000 7fd0a5600640 1 -- 172.21.15.123:0/2658692623 reap_dead start 2024-04-25T13:42:19.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.398+0000 7fd0a5600640 1 --2- 172.21.15.123:0/2658692623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd084005220 0x7fd08400b9d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00d2610 tx=0x7fd09801fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf5a4d8b25e2817 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:19.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.398+0000 7fd09fe00640 1 -- 172.21.15.123:0/2658692623 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09800a5e0 con 0x7fd084005220 2024-04-25T13:42:19.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.398+0000 7fd09fe00640 1 -- 172.21.15.123:0/2658692623 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0980aa630 con 0x7fd084005220 2024-04-25T13:42:19.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.398+0000 7fd09fe00640 1 -- 172.21.15.123:0/2658692623 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0980aaa20 con 0x7fd084005220 2024-04-25T13:42:19.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.398+0000 7fd0a7600640 1 -- 172.21.15.123:0/2658692623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd084005220 msgr2=0x7fd08400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:19.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.398+0000 7fd0a7600640 1 --2- 172.21.15.123:0/2658692623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd084005220 0x7fd08400b9d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00d2610 tx=0x7fd09801fa00 comp rx=0 tx=0).stop 2024-04-25T13:42:19.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.398+0000 7fd0a7600640 1 -- 172.21.15.123:0/2658692623 shutdown_connections 2024-04-25T13:42:19.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.398+0000 7fd0a7600640 1 --2- 172.21.15.123:0/2658692623 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd084005220 0x7fd08400b9d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.398+0000 7fd0a7600640 1 -- 172.21.15.123:0/2658692623 >> 172.21.15.123:0/2658692623 conn(0x7fd0a006d780 msgr2=0x7fd0a006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:19.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.398+0000 7fd0a7600640 1 -- 172.21.15.123:0/2658692623 shutdown_connections 2024-04-25T13:42:19.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.398+0000 7fd0a7600640 1 -- 172.21.15.123:0/2658692623 wait complete. 2024-04-25T13:42:19.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.402+0000 7fd0a7600640 1 Processor -- start 2024-04-25T13:42:19.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.402+0000 7fd0a7600640 1 -- start start 2024-04-25T13:42:19.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.402+0000 7fd0a7600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd084005220 0x7fd0a0155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:19.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.402+0000 7fd0a7600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0a01fa160 0x7fd0a014b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:19.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.402+0000 7fd0a7600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0a00cd180 0x7fd0a00cd590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:19.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.402+0000 7fd0a7600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a00b5c60 con 0x7fd084005220 2024-04-25T13:42:19.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.402+0000 7fd0a7600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a0070170 con 0x7fd0a01fa160 2024-04-25T13:42:19.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.402+0000 7fd0a7600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fd0a0160110 con 0x7fd0a00cd180 2024-04-25T13:42:19.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.402+0000 7fd0a4c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd084005220 0x7fd0a0155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:19.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.402+0000 7fd0a4c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd084005220 0x7fd0a0155e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37758/0 (socket says 172.21.15.123:37758) 2024-04-25T13:42:19.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.402+0000 7fd0a4c00640 1 -- 172.21.15.123:0/1043335774 learned_addr learned my addr 172.21.15.123:0/1043335774 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:19.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.402+0000 7fd097e00640 1 --2- 172.21.15.123:0/1043335774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0a01fa160 0x7fd0a014b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:19.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.402+0000 7fd0a5600640 1 --2- 172.21.15.123:0/1043335774 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0a00cd180 0x7fd0a00cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:19.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.402+0000 7fd0a4c00640 1 -- 172.21.15.123:0/1043335774 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0a00cd180 msgr2=0x7fd0a00cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:19.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.402+0000 7fd0a4c00640 1 --2- 172.21.15.123:0/1043335774 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0a00cd180 0x7fd0a00cd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.402+0000 7fd0a4c00640 1 -- 172.21.15.123:0/1043335774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0a01fa160 msgr2=0x7fd0a014b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:19.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.402+0000 7fd0a4c00640 1 --2- 172.21.15.123:0/1043335774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0a01fa160 0x7fd0a014b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.402+0000 7fd0a4c00640 1 -- 172.21.15.123:0/1043335774 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a014ba50 con 0x7fd084005220 2024-04-25T13:42:19.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.402+0000 7fd0a4c00640 1 --2- 172.21.15.123:0/1043335774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd084005220 0x7fd0a0155e90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd09000f770 tx=0x7fd09000fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:19.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.402+0000 7fd09d600640 1 -- 172.21.15.123:0/1043335774 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09001a070 con 0x7fd084005220 2024-04-25T13:42:19.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.402+0000 7fd09d600640 1 -- 172.21.15.123:0/1043335774 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd090005110 con 0x7fd084005220 2024-04-25T13:42:19.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.402+0000 7fd09d600640 1 -- 172.21.15.123:0/1043335774 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd090007030 con 0x7fd084005220 2024-04-25T13:42:19.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.402+0000 7fd0a7600640 1 -- 172.21.15.123:0/1043335774 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0a00cdad0 con 0x7fd084005220 2024-04-25T13:42:19.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.402+0000 7fd0a7600640 1 -- 172.21.15.123:0/1043335774 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0a01f9680 con 0x7fd084005220 2024-04-25T13:42:19.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.406+0000 7fd0a7600640 1 -- 172.21.15.123:0/1043335774 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0a00507c0 con 0x7fd084005220 2024-04-25T13:42:19.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.406+0000 7fd09d600640 1 -- 172.21.15.123:0/1043335774 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd0900073e0 con 0x7fd084005220 2024-04-25T13:42:19.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.406+0000 7fd09d600640 1 --2- 172.21.15.123:0/1043335774 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd07c06f400 0x7fd07c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:19.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.406+0000 7fd09d600640 1 -- 172.21.15.123:0/1043335774 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd09008ec00 con 0x7fd084005220 2024-04-25T13:42:19.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.406+0000 7fd097e00640 1 --2- 172.21.15.123:0/1043335774 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd07c06f400 0x7fd07c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:19.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.406+0000 7fd097e00640 1 --2- 172.21.15.123:0/1043335774 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd07c06f400 0x7fd07c071910 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00b3620 tx=0x7fd088009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:19.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.410+0000 7fd09d600640 1 -- 172.21.15.123:0/1043335774 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd0a014ba50 con 0x7fd084005220 2024-04-25T13:42:19.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.602+0000 7fd0a7600640 1 -- 172.21.15.123:0/1043335774 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0a00d2320 con 0x7fd084005220 2024-04-25T13:42:19.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.602+0000 7fd09d600640 1 -- 172.21.15.123:0/1043335774 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7fd09005b400 con 0x7fd084005220 2024-04-25T13:42:19.605 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:19.605 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6836/1018722177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1018722177},{"type":"v1","addr":"172.21.15.123:6836","nonce":1018722177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/606716425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":606716425},{"type":"v1","addr":"172.21.15.123:6837","nonce":606716425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/466677289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":466677289},{"type":"v1","addr":"172.21.15.130:6835","nonce":466677289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:42:05.806897+0000","modified":"2024-04-25T13:42:08.807565+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6834/1645626215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1645626215},{"type":"v1","addr":"172.21.15.130:6834","nonce":1645626215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T13:42:19.606 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 8 2024-04-25T13:42:19.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.602+0000 7fd0a7600640 1 -- 172.21.15.123:0/1043335774 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd07c06f400 msgr2=0x7fd07c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:19.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.602+0000 7fd0a7600640 1 --2- 172.21.15.123:0/1043335774 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd07c06f400 0x7fd07c071910 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00b3620 tx=0x7fd088009190 comp rx=0 tx=0).stop 2024-04-25T13:42:19.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.602+0000 7fd0a7600640 1 -- 172.21.15.123:0/1043335774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd084005220 msgr2=0x7fd0a0155e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:19.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.602+0000 7fd0a7600640 1 --2- 172.21.15.123:0/1043335774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd084005220 0x7fd0a0155e90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd09000f770 tx=0x7fd09000fc30 comp rx=0 tx=0).stop 2024-04-25T13:42:19.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.602+0000 7fd0a7600640 1 -- 172.21.15.123:0/1043335774 shutdown_connections 2024-04-25T13:42:19.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.602+0000 7fd0a7600640 1 --2- 172.21.15.123:0/1043335774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0a01fa160 0x7fd0a014b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.602+0000 7fd0a7600640 1 --2- 172.21.15.123:0/1043335774 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd07c06f400 0x7fd07c071910 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.602+0000 7fd0a7600640 1 --2- 172.21.15.123:0/1043335774 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0a00cd180 0x7fd0a00cd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.602+0000 7fd0a7600640 1 --2- 172.21.15.123:0/1043335774 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd084005220 0x7fd0a0155e90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.602+0000 7fd0a7600640 1 -- 172.21.15.123:0/1043335774 >> 172.21.15.123:0/1043335774 conn(0x7fd0a006d780 msgr2=0x7fd0a0160410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:19.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.602+0000 7fd0a7600640 1 -- 172.21.15.123:0/1043335774 shutdown_connections 2024-04-25T13:42:19.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.606+0000 7fd0a7600640 1 -- 172.21.15.123:0/1043335774 wait complete. 2024-04-25T13:42:19.627 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:19.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.770+0000 7f0e20800640 1 Processor -- start 2024-04-25T13:42:19.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.770+0000 7f0e20800640 1 -- start start 2024-04-25T13:42:19.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.774+0000 7f0e20800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0e180d0f80 0x7f0e18160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:19.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.774+0000 7f0e20800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e180b32f0 0x7f0e180b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:19.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.774+0000 7f0e20800640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e180b3c40 con 0x7f0e18073be0 2024-04-25T13:42:19.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.774+0000 7f0e20800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0e1815cfe0 con 0x7f0e180d0f80 2024-04-25T13:42:19.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.774+0000 7f0e20800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0e18161520 con 0x7f0e180b32f0 2024-04-25T13:42:19.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.774+0000 7f0e1de00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0e180d0f80 0x7f0e18160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:19.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.774+0000 7f0e1de00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0e180d0f80 0x7f0e18160fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33728/0 (socket says 172.21.15.123:33728) 2024-04-25T13:42:19.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.774+0000 7f0e1de00640 1 -- 172.21.15.123:0/2796419705 learned_addr learned my addr 172.21.15.123:0/2796419705 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:19.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.774+0000 7f0e1d400640 1 --2- 172.21.15.123:0/2796419705 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e180b32f0 0x7f0e180b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:19.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.774+0000 7f0e1de00640 1 -- 172.21.15.123:0/2796419705 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e180b32f0 msgr2=0x7f0e180b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:19.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.774+0000 7f0e1de00640 1 --2- 172.21.15.123:0/2796419705 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e180b32f0 0x7f0e180b3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.774+0000 7f0e1de00640 1 -- 172.21.15.123:0/2796419705 >> v1:172.21.15.130:6789/0 conn(0x7f0e18073be0 legacy=0x7f0e18073ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:19.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.774+0000 7f0e1de00640 1 -- 172.21.15.123:0/2796419705 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1815d240 con 0x7f0e180d0f80 2024-04-25T13:42:19.779 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.774+0000 7f0e1d400640 1 --2- 172.21.15.123:0/2796419705 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e180b32f0 0x7f0e180b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:19.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.774+0000 7f0e1de00640 1 --2- 172.21.15.123:0/2796419705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e180d0f80 0x7f0e18160fe0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c009870 tx=0x7f0e0c01c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=958a010d58709b56 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:19.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.774+0000 7f0e1ca00640 1 -- 172.21.15.123:0/2796419705 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c0b0070 con 0x7f0e180d0f80 2024-04-25T13:42:19.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.778+0000 7f0e1ca00640 1 -- 172.21.15.123:0/2796419705 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e0c0ab600 con 0x7f0e180d0f80 2024-04-25T13:42:19.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.778+0000 7f0e1ca00640 1 -- 172.21.15.123:0/2796419705 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c0ab9d0 con 0x7f0e180d0f80 2024-04-25T13:42:19.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.778+0000 7f0e20800640 1 -- 172.21.15.123:0/2796419705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e180d0f80 msgr2=0x7f0e18160fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:19.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.778+0000 7f0e20800640 1 --2- 172.21.15.123:0/2796419705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e180d0f80 0x7f0e18160fe0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c009870 tx=0x7f0e0c01c280 comp rx=0 tx=0).stop 2024-04-25T13:42:19.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.778+0000 7f0e20800640 1 -- 172.21.15.123:0/2796419705 shutdown_connections 2024-04-25T13:42:19.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.778+0000 7f0e20800640 1 --2- 172.21.15.123:0/2796419705 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e180b32f0 0x7f0e180b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.778+0000 7f0e20800640 1 --2- 172.21.15.123:0/2796419705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e180d0f80 0x7f0e18160fe0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.778+0000 7f0e20800640 1 -- 172.21.15.123:0/2796419705 >> 172.21.15.123:0/2796419705 conn(0x7f0e1806d210 msgr2=0x7f0e1806ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:19.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.778+0000 7f0e20800640 1 -- 172.21.15.123:0/2796419705 shutdown_connections 2024-04-25T13:42:19.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.778+0000 7f0e20800640 1 -- 172.21.15.123:0/2796419705 wait complete. 2024-04-25T13:42:19.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.778+0000 7f0e20800640 1 Processor -- start 2024-04-25T13:42:19.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.778+0000 7f0e20800640 1 -- start start 2024-04-25T13:42:19.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.782+0000 7f0e20800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e18073be0 0x7f0e1815f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:19.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.782+0000 7f0e20800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e180b32f0 0x7f0e1814e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:19.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.782+0000 7f0e20800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e180d0f80 0x7f0e180cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:19.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.782+0000 7f0e20800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0e180b6020 con 0x7f0e18073be0 2024-04-25T13:42:19.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.782+0000 7f0e20800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1815ddc0 con 0x7f0e180b32f0 2024-04-25T13:42:19.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.782+0000 7f0e20800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0e180b6470 con 0x7f0e180d0f80 2024-04-25T13:42:19.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.782+0000 7f0e1de00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e18073be0 0x7f0e1815f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:19.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.782+0000 7f0e1de00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e18073be0 0x7f0e1815f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33740/0 (socket says 172.21.15.123:33740) 2024-04-25T13:42:19.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.782+0000 7f0e1de00640 1 -- 172.21.15.123:0/1311232602 learned_addr learned my addr 172.21.15.123:0/1311232602 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:19.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.782+0000 7f0e1e800640 1 --2- 172.21.15.123:0/1311232602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e180d0f80 0x7f0e180cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:19.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.782+0000 7f0e1d400640 1 --2- 172.21.15.123:0/1311232602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e180b32f0 0x7f0e1814e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:19.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.782+0000 7f0e1de00640 1 -- 172.21.15.123:0/1311232602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e180d0f80 msgr2=0x7f0e180cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:19.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.782+0000 7f0e1de00640 1 --2- 172.21.15.123:0/1311232602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e180d0f80 0x7f0e180cf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.782+0000 7f0e1de00640 1 -- 172.21.15.123:0/1311232602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e180b32f0 msgr2=0x7f0e1814e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:19.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.782+0000 7f0e1de00640 1 --2- 172.21.15.123:0/1311232602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e180b32f0 0x7f0e1814e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.782+0000 7f0e1de00640 1 -- 172.21.15.123:0/1311232602 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1815fe30 con 0x7f0e18073be0 2024-04-25T13:42:19.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.782+0000 7f0e1e800640 1 --2- 172.21.15.123:0/1311232602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e180d0f80 0x7f0e180cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:19.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.782+0000 7f0e1d400640 1 --2- 172.21.15.123:0/1311232602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e180b32f0 0x7f0e1814e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:19.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.782+0000 7f0e1de00640 1 --2- 172.21.15.123:0/1311232602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e18073be0 0x7f0e1815f3b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c0ae040 tx=0x7f0e0c01aac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:19.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.782+0000 7f0e12000640 1 -- 172.21.15.123:0/1311232602 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c0ba020 con 0x7f0e18073be0 2024-04-25T13:42:19.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.782+0000 7f0e12000640 1 -- 172.21.15.123:0/1311232602 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e0c0b6620 con 0x7f0e18073be0 2024-04-25T13:42:19.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.782+0000 7f0e12000640 1 -- 172.21.15.123:0/1311232602 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e0c0b0040 con 0x7f0e18073be0 2024-04-25T13:42:19.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.782+0000 7f0e20800640 1 -- 172.21.15.123:0/1311232602 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e1815e420 con 0x7f0e18073be0 2024-04-25T13:42:19.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.782+0000 7f0e20800640 1 -- 172.21.15.123:0/1311232602 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e1815e9e0 con 0x7f0e18073be0 2024-04-25T13:42:19.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.782+0000 7f0e20800640 1 -- 172.21.15.123:0/1311232602 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e180507c0 con 0x7f0e18073be0 2024-04-25T13:42:19.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.786+0000 7f0e12000640 1 -- 172.21.15.123:0/1311232602 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0e0c0bd020 con 0x7f0e18073be0 2024-04-25T13:42:19.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.786+0000 7f0e12000640 1 --2- 172.21.15.123:0/1311232602 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f0dfc06f400 0x7f0dfc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:19.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.786+0000 7f0e12000640 1 -- 172.21.15.123:0/1311232602 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0e0c129660 con 0x7f0e18073be0 2024-04-25T13:42:19.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.786+0000 7f0e1d400640 1 --2- 172.21.15.123:0/1311232602 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f0dfc06f400 0x7f0dfc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:19.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.786+0000 7f0e1d400640 1 --2- 172.21.15.123:0/1311232602 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f0dfc06f400 0x7f0dfc071910 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0e18069940 tx=0x7f0e08008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:19.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.790+0000 7f0e12000640 1 -- 172.21.15.123:0/1311232602 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0e0c0c4030 con 0x7f0e18073be0 2024-04-25T13:42:19.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.946+0000 7f0e20800640 1 -- 172.21.15.123:0/1311232602 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e1815f8f0 con 0x7f0e18073be0 2024-04-25T13:42:19.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.950+0000 7f0e12000640 1 -- 172.21.15.123:0/1311232602 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16629 (secure 0 0 0) 0x7f0e180b3c40 con 0x7f0e18073be0 2024-04-25T13:42:19.952 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:19.952 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:42:07.405529+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:03.949161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:04.755682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:19.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.950+0000 7f0e20800640 1 -- 172.21.15.123:0/1311232602 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f0dfc06f400 msgr2=0x7f0dfc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:19.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.950+0000 7f0e20800640 1 --2- 172.21.15.123:0/1311232602 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f0dfc06f400 0x7f0dfc071910 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0e18069940 tx=0x7f0e08008040 comp rx=0 tx=0).stop 2024-04-25T13:42:19.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.950+0000 7f0e20800640 1 -- 172.21.15.123:0/1311232602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e18073be0 msgr2=0x7f0e1815f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:19.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.950+0000 7f0e20800640 1 --2- 172.21.15.123:0/1311232602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e18073be0 0x7f0e1815f3b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c0ae040 tx=0x7f0e0c01aac0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.950+0000 7f0e20800640 1 -- 172.21.15.123:0/1311232602 shutdown_connections 2024-04-25T13:42:19.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.950+0000 7f0e20800640 1 --2- 172.21.15.123:0/1311232602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e180b32f0 0x7f0e1814e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.950+0000 7f0e20800640 1 --2- 172.21.15.123:0/1311232602 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f0dfc06f400 0x7f0dfc071910 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.950+0000 7f0e20800640 1 --2- 172.21.15.123:0/1311232602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e180d0f80 0x7f0e180cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.950+0000 7f0e20800640 1 --2- 172.21.15.123:0/1311232602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e18073be0 0x7f0e1815f3b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.950+0000 7f0e20800640 1 -- 172.21.15.123:0/1311232602 >> 172.21.15.123:0/1311232602 conn(0x7f0e1806d210 msgr2=0x7f0e18073ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.950+0000 7f0e20800640 1 -- 172.21.15.123:0/1311232602 shutdown_connections 2024-04-25T13:42:19.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:19.950+0000 7f0e20800640 1 -- 172.21.15.123:0/1311232602 wait complete. 2024-04-25T13:42:19.973 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:42:20.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.114+0000 7fca2f600640 1 Processor -- start 2024-04-25T13:42:20.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.114+0000 7fca2f600640 1 -- start start 2024-04-25T13:42:20.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.118+0000 7fca2f600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fca281474f0 0x7fca2815eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.118+0000 7fca2f600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca2815f0d0 con 0x7fca280cd8e0 2024-04-25T13:42:20.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.118+0000 7fca2f600640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca28073400 con 0x7fca280b6970 2024-04-25T13:42:20.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.118+0000 7fca2f600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fca280d0d10 con 0x7fca281474f0 2024-04-25T13:42:20.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.118+0000 7fca2cc00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fca281474f0 0x7fca2815eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:20.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.118+0000 7fca2d600640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fca280cd8e0 0x7fca280cdcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38460/0 (socket says 172.21.15.123:38460) 2024-04-25T13:42:20.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.118+0000 7fca2d600640 1 -- 172.21.15.123:0/156212353 learned_addr learned my addr 172.21.15.123:0/156212353 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:20.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.118+0000 7fca2cc00640 1 -- 172.21.15.123:0/156212353 >> v1:172.21.15.130:6789/0 conn(0x7fca280b6970 legacy=0x7fca280b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:20.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.118+0000 7fca2cc00640 1 -- 172.21.15.123:0/156212353 >> v1:172.21.15.123:6789/0 conn(0x7fca280cd8e0 legacy=0x7fca280cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:20.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.118+0000 7fca2cc00640 1 -- 172.21.15.123:0/156212353 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca280736e0 con 0x7fca281474f0 2024-04-25T13:42:20.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.122+0000 7fca2cc00640 1 --2- 172.21.15.123:0/156212353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca281474f0 0x7fca2815eb90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fca180097c0 tx=0x7fca1801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b97fce9406eb4f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:20.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.122+0000 7fca27e00640 1 -- 172.21.15.123:0/156212353 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca180ab430 con 0x7fca281474f0 2024-04-25T13:42:20.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.122+0000 7fca27e00640 1 -- 172.21.15.123:0/156212353 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca180b0070 con 0x7fca281474f0 2024-04-25T13:42:20.124 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.122+0000 7fca27e00640 1 -- 172.21.15.123:0/156212353 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca180ab7f0 con 0x7fca281474f0 2024-04-25T13:42:20.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.122+0000 7fca2f600640 1 -- 172.21.15.123:0/156212353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca281474f0 msgr2=0x7fca2815eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:20.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.122+0000 7fca2f600640 1 --2- 172.21.15.123:0/156212353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca281474f0 0x7fca2815eb90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fca180097c0 tx=0x7fca1801c430 comp rx=0 tx=0).stop 2024-04-25T13:42:20.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.122+0000 7fca2f600640 1 -- 172.21.15.123:0/156212353 shutdown_connections 2024-04-25T13:42:20.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.122+0000 7fca2f600640 1 --2- 172.21.15.123:0/156212353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca281474f0 0x7fca2815eb90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.122+0000 7fca2f600640 1 -- 172.21.15.123:0/156212353 >> 172.21.15.123:0/156212353 conn(0x7fca2806d210 msgr2=0x7fca2806ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:20.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.122+0000 7fca2f600640 1 -- 172.21.15.123:0/156212353 shutdown_connections 2024-04-25T13:42:20.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.122+0000 7fca2f600640 1 -- 172.21.15.123:0/156212353 wait complete. 2024-04-25T13:42:20.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.122+0000 7fca2f600640 1 Processor -- start 2024-04-25T13:42:20.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.122+0000 7fca2f600640 1 -- start start 2024-04-25T13:42:20.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.126+0000 7fca2f600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca280b6970 0x7fca2815a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.126+0000 7fca2f600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fca280cd8e0 0x7fca281388f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.126+0000 7fca2f600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca281474f0 0x7fca28138e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.126+0000 7fca2f600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fca280744a0 con 0x7fca280b6970 2024-04-25T13:42:20.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.126+0000 7fca2f600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fca280ce810 con 0x7fca281474f0 2024-04-25T13:42:20.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.126+0000 7fca2f600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fca2816bf70 con 0x7fca280cd8e0 2024-04-25T13:42:20.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.126+0000 7fca2cc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca280b6970 0x7fca2815a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:20.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.126+0000 7fca2cc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca280b6970 0x7fca2815a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33762/0 (socket says 172.21.15.123:33762) 2024-04-25T13:42:20.129 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.126+0000 7fca2cc00640 1 -- 172.21.15.123:0/1687443974 learned_addr learned my addr 172.21.15.123:0/1687443974 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:20.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.126+0000 7fca2d600640 1 --2- 172.21.15.123:0/1687443974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca281474f0 0x7fca28138e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:20.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.126+0000 7fca1fe00640 1 --2- 172.21.15.123:0/1687443974 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fca280cd8e0 0x7fca281388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:20.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.126+0000 7fca2cc00640 1 -- 172.21.15.123:0/1687443974 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fca280cd8e0 msgr2=0x7fca281388f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:20.130 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.126+0000 7fca2cc00640 1 --2- 172.21.15.123:0/1687443974 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fca280cd8e0 0x7fca281388f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.126+0000 7fca2cc00640 1 -- 172.21.15.123:0/1687443974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca281474f0 msgr2=0x7fca28138e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:20.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.126+0000 7fca2cc00640 1 --2- 172.21.15.123:0/1687443974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca281474f0 0x7fca28138e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.126+0000 7fca2cc00640 1 -- 172.21.15.123:0/1687443974 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca2813a1b0 con 0x7fca280b6970 2024-04-25T13:42:20.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.126+0000 7fca2d600640 1 --2- 172.21.15.123:0/1687443974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca281474f0 0x7fca28138e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:20.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.126+0000 7fca1fe00640 1 --2- 172.21.15.123:0/1687443974 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fca280cd8e0 0x7fca281388f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:20.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.126+0000 7fca2cc00640 1 --2- 172.21.15.123:0/1687443974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca280b6970 0x7fca2815a370 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fca18019040 tx=0x7fca1801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:20.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.126+0000 7fca25600640 1 -- 172.21.15.123:0/1687443974 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca180bf610 con 0x7fca280b6970 2024-04-25T13:42:20.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.126+0000 7fca25600640 1 -- 172.21.15.123:0/1687443974 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca180bf7d0 con 0x7fca280b6970 2024-04-25T13:42:20.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.126+0000 7fca25600640 1 -- 172.21.15.123:0/1687443974 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca180bfbc0 con 0x7fca280b6970 2024-04-25T13:42:20.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.126+0000 7fca2f600640 1 -- 172.21.15.123:0/1687443974 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca281395a0 con 0x7fca280b6970 2024-04-25T13:42:20.131 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.126+0000 7fca2f600640 1 -- 172.21.15.123:0/1687443974 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca28139880 con 0x7fca280b6970 2024-04-25T13:42:20.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.126+0000 7fca2f600640 1 -- 172.21.15.123:0/1687443974 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca280507c0 con 0x7fca280b6970 2024-04-25T13:42:20.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.130+0000 7fca25600640 1 -- 172.21.15.123:0/1687443974 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fca180bd020 con 0x7fca280b6970 2024-04-25T13:42:20.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.130+0000 7fca25600640 1 --2- 172.21.15.123:0/1687443974 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fca0406f400 0x7fca04071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.130+0000 7fca25600640 1 -- 172.21.15.123:0/1687443974 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fca180a8020 con 0x7fca280b6970 2024-04-25T13:42:20.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.130+0000 7fca1fe00640 1 --2- 172.21.15.123:0/1687443974 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fca0406f400 0x7fca04071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:20.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.130+0000 7fca1fe00640 1 --2- 172.21.15.123:0/1687443974 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fca0406f400 0x7fca04071910 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fca2815ad30 tx=0x7fca10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:20.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.134+0000 7fca25600640 1 -- 172.21.15.123:0/1687443974 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fca18016050 con 0x7fca280b6970 2024-04-25T13:42:20.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.322+0000 7fca2f600640 1 -- 172.21.15.123:0/1687443974 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca280b15e0 con 0x7fca280b6970 2024-04-25T13:42:20.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.322+0000 7fca25600640 1 -- 172.21.15.123:0/1687443974 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7fca180f6300 con 0x7fca280b6970 2024-04-25T13:42:20.326 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:20.326 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6836/1018722177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1018722177},{"type":"v1","addr":"172.21.15.123:6836","nonce":1018722177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/606716425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":606716425},{"type":"v1","addr":"172.21.15.123:6837","nonce":606716425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/466677289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":466677289},{"type":"v1","addr":"172.21.15.130:6835","nonce":466677289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:42:05.806897+0000","modified":"2024-04-25T13:42:08.807565+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6834/1645626215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1645626215},{"type":"v1","addr":"172.21.15.130:6834","nonce":1645626215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T13:42:20.327 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 8 2024-04-25T13:42:20.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.326+0000 7fca2f600640 1 -- 172.21.15.123:0/1687443974 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fca0406f400 msgr2=0x7fca04071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:20.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.326+0000 7fca2f600640 1 --2- 172.21.15.123:0/1687443974 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fca0406f400 0x7fca04071910 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fca2815ad30 tx=0x7fca10008040 comp rx=0 tx=0).stop 2024-04-25T13:42:20.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.326+0000 7fca2f600640 1 -- 172.21.15.123:0/1687443974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca280b6970 msgr2=0x7fca2815a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:20.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.326+0000 7fca2f600640 1 --2- 172.21.15.123:0/1687443974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca280b6970 0x7fca2815a370 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fca18019040 tx=0x7fca1801ac70 comp rx=0 tx=0).stop 2024-04-25T13:42:20.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.326+0000 7fca2f600640 1 -- 172.21.15.123:0/1687443974 shutdown_connections 2024-04-25T13:42:20.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.326+0000 7fca2f600640 1 --2- 172.21.15.123:0/1687443974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca281474f0 0x7fca28138e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.326+0000 7fca2f600640 1 --2- 172.21.15.123:0/1687443974 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fca0406f400 0x7fca04071910 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.326+0000 7fca2f600640 1 --2- 172.21.15.123:0/1687443974 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fca280cd8e0 0x7fca281388f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.326+0000 7fca2f600640 1 --2- 172.21.15.123:0/1687443974 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fca280b6970 0x7fca2815a370 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.326+0000 7fca2f600640 1 -- 172.21.15.123:0/1687443974 >> 172.21.15.123:0/1687443974 conn(0x7fca2806d210 msgr2=0x7fca2813c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:20.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.326+0000 7fca2f600640 1 -- 172.21.15.123:0/1687443974 shutdown_connections 2024-04-25T13:42:20.329 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.326+0000 7fca2f600640 1 -- 172.21.15.123:0/1687443974 wait complete. 2024-04-25T13:42:20.750 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T13:42:05.806897+0000', 'modified': '2024-04-25T13:42:08.807565+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.130:6834/1645626215', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6832', 'nonce': 1645626215}, {'type': 'v1', 'addr': '172.21.15.130:6834', 'nonce': 1645626215}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4285, 'qdb_cluster': [4285]} 2024-04-25T13:42:20.751 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T13:42:20.751 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T13:42:20.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.894+0000 7f0034400640 1 Processor -- start 2024-04-25T13:42:20.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.894+0000 7f0034400640 1 -- start start 2024-04-25T13:42:20.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.898+0000 7f0034400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f002c1571b0 0x7f002c0cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.898+0000 7f0034400640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f002c0b3870 0x7f002c0b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.898+0000 7f0034400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f002c0b41c0 con 0x7f002c0b4770 2024-04-25T13:42:20.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.898+0000 7f0034400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f002c0cdee0 con 0x7f002c1571b0 2024-04-25T13:42:20.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.898+0000 7f0034400640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f002c15d570 con 0x7f002c0b3870 2024-04-25T13:42:20.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.898+0000 7f0031a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f002c1571b0 0x7f002c0cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:20.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.898+0000 7f0031a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f002c1571b0 0x7f002c0cd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33770/0 (socket says 172.21.15.123:33770) 2024-04-25T13:42:20.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.898+0000 7f0031a00640 1 -- 172.21.15.123:0/4132499951 learned_addr learned my addr 172.21.15.123:0/4132499951 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:20.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.898+0000 7f0031000640 1 --2- 172.21.15.123:0/4132499951 >> v2:172.21.15.130:3300/0 conn(0x7f002c0b3870 0x7f002c0b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:20.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.898+0000 7f0031a00640 1 -- 172.21.15.123:0/4132499951 >> v2:172.21.15.130:3300/0 conn(0x7f002c0b3870 msgr2=0x7f002c0b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:20.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.898+0000 7f0031a00640 1 --2- 172.21.15.123:0/4132499951 >> v2:172.21.15.130:3300/0 conn(0x7f002c0b3870 0x7f002c0b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.898+0000 7f0031a00640 1 -- 172.21.15.123:0/4132499951 >> v1:172.21.15.130:6789/0 conn(0x7f002c0b4770 legacy=0x7f002c0b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:20.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.898+0000 7f0031a00640 1 -- 172.21.15.123:0/4132499951 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f002c15d850 con 0x7f002c1571b0 2024-04-25T13:42:20.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.898+0000 7f0031000640 1 --2- 172.21.15.123:0/4132499951 >> v2:172.21.15.130:3300/0 conn(0x7f002c0b3870 0x7f002c0b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:20.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.902+0000 7f0031a00640 1 --2- 172.21.15.123:0/4132499951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f002c1571b0 0x7f002c0cd6b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f002c0c7720 tx=0x7f002001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4dea14f34e91633 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:20.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.902+0000 7f002be00640 1 -- 172.21.15.123:0/4132499951 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00200b2070 con 0x7f002c1571b0 2024-04-25T13:42:20.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.902+0000 7f002be00640 1 -- 172.21.15.123:0/4132499951 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00200a9070 con 0x7f002c1571b0 2024-04-25T13:42:20.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.902+0000 7f002be00640 1 -- 172.21.15.123:0/4132499951 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00200ad880 con 0x7f002c1571b0 2024-04-25T13:42:20.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.902+0000 7f0034400640 1 -- 172.21.15.123:0/4132499951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f002c1571b0 msgr2=0x7f002c0cd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:20.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.902+0000 7f0034400640 1 --2- 172.21.15.123:0/4132499951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f002c1571b0 0x7f002c0cd6b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f002c0c7720 tx=0x7f002001c490 comp rx=0 tx=0).stop 2024-04-25T13:42:20.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.902+0000 7f0034400640 1 -- 172.21.15.123:0/4132499951 shutdown_connections 2024-04-25T13:42:20.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.902+0000 7f0034400640 1 --2- 172.21.15.123:0/4132499951 >> v2:172.21.15.130:3300/0 conn(0x7f002c0b3870 0x7f002c0b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.902+0000 7f0034400640 1 --2- 172.21.15.123:0/4132499951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f002c1571b0 0x7f002c0cd6b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.902+0000 7f0034400640 1 -- 172.21.15.123:0/4132499951 >> 172.21.15.123:0/4132499951 conn(0x7f002c06ca70 msgr2=0x7f002c06ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:20.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.902+0000 7f0034400640 1 -- 172.21.15.123:0/4132499951 shutdown_connections 2024-04-25T13:42:20.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.902+0000 7f0034400640 1 -- 172.21.15.123:0/4132499951 wait complete. 2024-04-25T13:42:20.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.902+0000 7f0034400640 1 Processor -- start 2024-04-25T13:42:20.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.902+0000 7f0034400640 1 -- start start 2024-04-25T13:42:20.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.906+0000 7f0034400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f002c0b3870 0x7f002c15e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.906+0000 7f0034400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f002c0b4770 0x7f002c169570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.906+0000 7f0034400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f002c1571b0 0x7f002c169ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.906+0000 7f0034400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f002c15e050 con 0x7f002c1571b0 2024-04-25T13:42:20.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.906+0000 7f0034400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f002c1575c0 con 0x7f002c0b3870 2024-04-25T13:42:20.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.906+0000 7f0034400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f002c14f680 con 0x7f002c0b4770 2024-04-25T13:42:20.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.906+0000 7f0032400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f002c1571b0 0x7f002c169ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:20.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.906+0000 7f0032400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f002c1571b0 0x7f002c169ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33786/0 (socket says 172.21.15.123:33786) 2024-04-25T13:42:20.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.906+0000 7f0032400640 1 -- 172.21.15.123:0/1314762914 learned_addr learned my addr 172.21.15.123:0/1314762914 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:20.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.906+0000 7f0031a00640 1 --2- 172.21.15.123:0/1314762914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f002c0b3870 0x7f002c15e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:20.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.906+0000 7f0031000640 1 --2- 172.21.15.123:0/1314762914 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f002c0b4770 0x7f002c169570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:20.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.906+0000 7f0032400640 1 -- 172.21.15.123:0/1314762914 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f002c0b4770 msgr2=0x7f002c169570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:20.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.906+0000 7f0032400640 1 --2- 172.21.15.123:0/1314762914 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f002c0b4770 0x7f002c169570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.906+0000 7f0032400640 1 -- 172.21.15.123:0/1314762914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f002c0b3870 msgr2=0x7f002c15e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:20.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.906+0000 7f0032400640 1 --2- 172.21.15.123:0/1314762914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f002c0b3870 0x7f002c15e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.906+0000 7f0032400640 1 -- 172.21.15.123:0/1314762914 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f002c16a480 con 0x7f002c1571b0 2024-04-25T13:42:20.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.906+0000 7f0032400640 1 --2- 172.21.15.123:0/1314762914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f002c1571b0 0x7f002c169ab0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f002400c760 tx=0x7f002400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:20.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.906+0000 7f0029600640 1 -- 172.21.15.123:0/1314762914 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0024003b80 con 0x7f002c1571b0 2024-04-25T13:42:20.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.906+0000 7f0029600640 1 -- 172.21.15.123:0/1314762914 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0024003d20 con 0x7f002c1571b0 2024-04-25T13:42:20.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.906+0000 7f0029600640 1 -- 172.21.15.123:0/1314762914 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002400aa90 con 0x7f002c1571b0 2024-04-25T13:42:20.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.906+0000 7f0034400640 1 -- 172.21.15.123:0/1314762914 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f002c0d0c80 con 0x7f002c1571b0 2024-04-25T13:42:20.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.906+0000 7f0034400640 1 -- 172.21.15.123:0/1314762914 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f002c0d1240 con 0x7f002c1571b0 2024-04-25T13:42:20.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.910+0000 7f0029600640 1 -- 172.21.15.123:0/1314762914 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f002400ac30 con 0x7f002c1571b0 2024-04-25T13:42:20.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.910+0000 7f0029600640 1 --2- 172.21.15.123:0/1314762914 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f000c06f400 0x7f000c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.910+0000 7f0029600640 1 -- 172.21.15.123:0/1314762914 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f002408f1b0 con 0x7f002c1571b0 2024-04-25T13:42:20.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.910+0000 7f003ba29000 1 Processor -- start 2024-04-25T13:42:20.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.910+0000 7f0031a00640 1 --2- 172.21.15.123:0/1314762914 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f000c06f400 0x7f000c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:20.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.910+0000 7f003ba29000 1 -- start start 2024-04-25T13:42:20.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.910+0000 7f0031a00640 1 --2- 172.21.15.123:0/1314762914 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f000c06f400 0x7f000c071910 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f00200af000 tx=0x7f00200a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:20.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f003ba29000 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c10c38c20 0x557c10d96ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f003ba29000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c10c24ea0 0x557c10d97420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f003ba29000 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557c1081d280 0x557c10d97960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f003ba29000 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x557c10c06160 con 0x557c10c38c20 2024-04-25T13:42:20.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f003ba29000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557c10b9be20 con 0x557c10c24ea0 2024-04-25T13:42:20.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f003ba29000 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x557c10b54a20 con 0x557c1081d280 2024-04-25T13:42:20.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f0031a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c10c38c20 0x557c10d96ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:20.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f0031a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c10c38c20 0x557c10d96ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33788/0 (socket says 172.21.15.123:33788) 2024-04-25T13:42:20.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f0031a00640 1 -- 172.21.15.123:0/1661023902 learned_addr learned my addr 172.21.15.123:0/1661023902 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:20.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f0031000640 1 --2- 172.21.15.123:0/1661023902 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c10c24ea0 0x557c10d97420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:20.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f0032400640 1 --2- 172.21.15.123:0/1661023902 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557c1081d280 0x557c10d97960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:20.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f0031a00640 1 -- 172.21.15.123:0/1661023902 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557c1081d280 msgr2=0x557c10d97960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:20.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f0031a00640 1 --2- 172.21.15.123:0/1661023902 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557c1081d280 0x557c10d97960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f0031a00640 1 -- 172.21.15.123:0/1661023902 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c10c24ea0 msgr2=0x557c10d97420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:20.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f0031a00640 1 --2- 172.21.15.123:0/1661023902 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c10c24ea0 0x557c10d97420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f0031a00640 1 -- 172.21.15.123:0/1661023902 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c10b59100 con 0x557c10c38c20 2024-04-25T13:42:20.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f0031a00640 1 --2- 172.21.15.123:0/1661023902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c10c38c20 0x557c10d96ee0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f00200b0040 tx=0x7f0020004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4de8714a77656bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:20.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f001e000640 1 -- 172.21.15.123:0/1661023902 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00200b9570 con 0x557c10c38c20 2024-04-25T13:42:20.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f001e000640 1 -- 172.21.15.123:0/1661023902 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00200b3040 con 0x557c10c38c20 2024-04-25T13:42:20.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f001e000640 1 -- 172.21.15.123:0/1661023902 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00200b9950 con 0x557c10c38c20 2024-04-25T13:42:20.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f003ba29000 1 -- 172.21.15.123:0/1661023902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c10c38c20 msgr2=0x557c10d96ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:20.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f003ba29000 1 --2- 172.21.15.123:0/1661023902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c10c38c20 0x557c10d96ee0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f00200b0040 tx=0x7f0020004740 comp rx=0 tx=0).stop 2024-04-25T13:42:20.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f003ba29000 1 -- 172.21.15.123:0/1661023902 shutdown_connections 2024-04-25T13:42:20.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f003ba29000 1 --2- 172.21.15.123:0/1661023902 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c10c24ea0 0x557c10d97420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f003ba29000 1 --2- 172.21.15.123:0/1661023902 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557c1081d280 0x557c10d97960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f003ba29000 1 --2- 172.21.15.123:0/1661023902 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c10c38c20 0x557c10d96ee0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f003ba29000 1 -- 172.21.15.123:0/1661023902 >> 172.21.15.123:0/1661023902 conn(0x557c1085cff0 msgr2=0x557c10d4c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:20.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f003ba29000 1 -- 172.21.15.123:0/1661023902 shutdown_connections 2024-04-25T13:42:20.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f003ba29000 1 -- 172.21.15.123:0/1661023902 wait complete. 2024-04-25T13:42:20.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.914+0000 7f003ba29000 1 -- start start 2024-04-25T13:42:20.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f003ba29000 1 Processor -- start 2024-04-25T13:42:20.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f003ba29000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c1081d280 0x557c10d9de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f003ba29000 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557c10c24ea0 0x557c10d9e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f003ba29000 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c10c38c20 0x557c10d590c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f003ba29000 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x557c10ba9220 con 0x557c10c38c20 2024-04-25T13:42:20.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f003ba29000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557c10b3fea0 con 0x557c1081d280 2024-04-25T13:42:20.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f003ba29000 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x557c10b96b00 con 0x557c10c24ea0 2024-04-25T13:42:20.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f003ba29000 10 client.0 _ll_register_callbacks cb 0x557c10ba8dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:42:20.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f0032400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c10c38c20 0x557c10d590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:20.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f0032400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c10c38c20 0x557c10d590c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33792/0 (socket says 172.21.15.123:33792) 2024-04-25T13:42:20.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f0032400640 1 -- 172.21.15.123:0/666324379 learned_addr learned my addr 172.21.15.123:0/666324379 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:20.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f0031a00640 1 --2- 172.21.15.123:0/666324379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c1081d280 0x557c10d9de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:20.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f0031000640 1 --2- 172.21.15.123:0/666324379 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557c10c24ea0 0x557c10d9e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:20.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f0032400640 1 -- 172.21.15.123:0/666324379 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557c10c24ea0 msgr2=0x557c10d9e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:20.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f0032400640 1 --2- 172.21.15.123:0/666324379 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557c10c24ea0 0x557c10d9e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f0032400640 1 -- 172.21.15.123:0/666324379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c1081d280 msgr2=0x557c10d9de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:20.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f0032400640 1 --2- 172.21.15.123:0/666324379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c1081d280 0x557c10d9de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f0032400640 1 -- 172.21.15.123:0/666324379 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c10b3b500 con 0x557c10c38c20 2024-04-25T13:42:20.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f0032400640 1 --2- 172.21.15.123:0/666324379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c10c38c20 0x557c10d590c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f002400a430 tx=0x7f0024011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c0098e6667028d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:20.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f0012a00640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-04-25T13:42:20.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f0012a00640 1 -- 172.21.15.123:0/666324379 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0024074020 con 0x557c10c38c20 2024-04-25T13:42:20.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f0012a00640 1 -- 172.21.15.123:0/666324379 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f002405abf0 con 0x557c10c38c20 2024-04-25T13:42:20.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f003ba29000 1 -- 172.21.15.123:0/666324379 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00200b3040 con 0x557c10c38c20 2024-04-25T13:42:20.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f0012a00640 1 -- 172.21.15.123:0/666324379 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f002405c090 con 0x557c10c38c20 2024-04-25T13:42:20.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f003ba29000 10 client.4638 fetch_fsmap learned FSMap version 8 2024-04-25T13:42:20.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f003ba29000 1 -- 172.21.15.123:0/666324379 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x557c10b21ea0 con 0x557c10c38c20 2024-04-25T13:42:20.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f0012a00640 1 -- 172.21.15.123:0/666324379 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00200b3040 con 0x557c10c38c20 2024-04-25T13:42:20.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f0012a00640 1 -- 172.21.15.123:0/666324379 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7f0024057300 con 0x557c10c38c20 2024-04-25T13:42:20.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f003ba29000 10 client.4638 fetch_fsmap finished waiting for FSMap version 8 2024-04-25T13:42:20.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f003ba29000 10 client.4638 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T13:42:20.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f003ba29000 20 client.4638 populate_metadata read hostname 'smithi123' 2024-04-25T13:42:20.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f003ba29000 1 --2- 172.21.15.123:0/666324379 >> [v2:172.21.15.130:6832/1645626215,v1:172.21.15.130:6834/1645626215] conn(0x557c108417d0 0x557c10d59e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f003ba29000 4 client.4638 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:42:20.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f003ba29000 1 -- 172.21.15.123:0/666324379 --> [v2:172.21.15.130:6832/1645626215,v1:172.21.15.130:6834/1645626215] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c10b34be0 con 0x557c108417d0 2024-04-25T13:42:20.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.918+0000 7f0031a00640 1 --2- 172.21.15.123:0/666324379 >> [v2:172.21.15.130:6832/1645626215,v1:172.21.15.130:6834/1645626215] conn(0x557c108417d0 0x557c10d59e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:20.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.922+0000 7f0031a00640 1 --2- 172.21.15.123:0/666324379 >> [v2:172.21.15.130:6832/1645626215,v1:172.21.15.130:6834/1645626215] conn(0x557c108417d0 0x557c10d59e30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c51f7acf96f5092b server_cookie=c7362f734ff4ed12 in_seq=0 out_seq=0 2024-04-25T13:42:20.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.922+0000 7f0012a00640 10 client.4638 ms_handle_connect on v2:172.21.15.130:6832/1645626215 2024-04-25T13:42:20.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.922+0000 7f0012a00640 1 -- 172.21.15.123:0/666324379 <== mds.0 v2:172.21.15.130:6832/1645626215 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557c10b34be0 con 0x557c108417d0 2024-04-25T13:42:20.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.922+0000 7f0012a00640 10 client.4638 handle_command_reply: tid=0 2024-04-25T13:42:20.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.922+0000 7f003ba29000 1 client.4638 shutdown 2024-04-25T13:42:20.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.922+0000 7f003ba29000 1 -- 172.21.15.123:0/666324379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c10c38c20 msgr2=0x557c10d590c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:20.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.922+0000 7f003ba29000 1 --2- 172.21.15.123:0/666324379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c10c38c20 0x557c10d590c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f002400a430 tx=0x7f0024011000 comp rx=0 tx=0).stop 2024-04-25T13:42:20.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.922+0000 7f003ba29000 1 -- 172.21.15.123:0/666324379 shutdown_connections 2024-04-25T13:42:20.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.922+0000 7f003ba29000 1 --2- 172.21.15.123:0/666324379 >> [v2:172.21.15.130:6832/1645626215,v1:172.21.15.130:6834/1645626215] conn(0x557c108417d0 0x557c10d59e30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.922+0000 7f003ba29000 1 --2- 172.21.15.123:0/666324379 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c10c38c20 0x557c10d590c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.922+0000 7f003ba29000 1 --2- 172.21.15.123:0/666324379 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557c10c24ea0 0x557c10d9e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.922+0000 7f003ba29000 1 --2- 172.21.15.123:0/666324379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c1081d280 0x557c10d9de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.922+0000 7f0012a00640 0 client.4638 ms_handle_reset on v2:172.21.15.130:6832/1645626215 2024-04-25T13:42:20.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.922+0000 7f003ba29000 1 -- 172.21.15.123:0/666324379 >> 172.21.15.123:0/666324379 conn(0x557c1085cff0 msgr2=0x557c10d4cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:20.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.922+0000 7f003ba29000 1 -- 172.21.15.123:0/666324379 shutdown_connections 2024-04-25T13:42:20.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.922+0000 7f003ba29000 1 -- 172.21.15.123:0/666324379 wait complete. 2024-04-25T13:42:20.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.922+0000 7f003ba29000 20 client.4638 trim_cache size 0 max 16384 2024-04-25T13:42:20.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f003ba29000 1 Processor -- start 2024-04-25T13:42:20.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f003ba29000 1 -- start start 2024-04-25T13:42:20.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f003ba29000 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c1081d280 0x557c10da34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f003ba29000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c10c24ea0 0x557c10dacff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f003ba29000 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557c10c38c20 0x557c10dad530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f003ba29000 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f002c205140 con 0x557c1081d280 2024-04-25T13:42:20.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f003ba29000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f002c154a00 con 0x557c10c24ea0 2024-04-25T13:42:20.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f003ba29000 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f002c14f000 con 0x557c10c38c20 2024-04-25T13:42:20.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f0031a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c1081d280 0x557c10da34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:20.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f0031a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c1081d280 0x557c10da34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33800/0 (socket says 172.21.15.123:33800) 2024-04-25T13:42:20.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f0031a00640 1 -- 172.21.15.123:0/1651504888 learned_addr learned my addr 172.21.15.123:0/1651504888 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:20.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f0031000640 1 --2- 172.21.15.123:0/1651504888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c10c24ea0 0x557c10dacff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:20.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f0032400640 1 --2- 172.21.15.123:0/1651504888 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557c10c38c20 0x557c10dad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:20.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f0031a00640 1 -- 172.21.15.123:0/1651504888 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557c10c38c20 msgr2=0x557c10dad530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:20.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f0031a00640 1 --2- 172.21.15.123:0/1651504888 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557c10c38c20 0x557c10dad530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f0031a00640 1 -- 172.21.15.123:0/1651504888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c10c24ea0 msgr2=0x557c10dacff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:20.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f0031a00640 1 --2- 172.21.15.123:0/1651504888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c10c24ea0 0x557c10dacff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f0031a00640 1 -- 172.21.15.123:0/1651504888 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c10d59430 con 0x557c1081d280 2024-04-25T13:42:20.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f0031a00640 1 --2- 172.21.15.123:0/1651504888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c1081d280 0x557c10da34d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f002001c2c0 tx=0x7f00200b5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f975b78c58f7c622 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:20.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f001d600640 1 -- 172.21.15.123:0/1651504888 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00200b9a20 con 0x557c1081d280 2024-04-25T13:42:20.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f001d600640 1 -- 172.21.15.123:0/1651504888 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00200b3040 con 0x557c1081d280 2024-04-25T13:42:20.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f001d600640 1 -- 172.21.15.123:0/1651504888 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00200b9dc0 con 0x557c1081d280 2024-04-25T13:42:20.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f003ba29000 1 -- 172.21.15.123:0/1651504888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c1081d280 msgr2=0x557c10da34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:20.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f003ba29000 1 --2- 172.21.15.123:0/1651504888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c1081d280 0x557c10da34d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f002001c2c0 tx=0x7f00200b5000 comp rx=0 tx=0).stop 2024-04-25T13:42:20.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f003ba29000 1 -- 172.21.15.123:0/1651504888 shutdown_connections 2024-04-25T13:42:20.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f003ba29000 1 --2- 172.21.15.123:0/1651504888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c10c24ea0 0x557c10dacff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f003ba29000 1 --2- 172.21.15.123:0/1651504888 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557c10c38c20 0x557c10dad530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f003ba29000 1 --2- 172.21.15.123:0/1651504888 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c1081d280 0x557c10da34d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f003ba29000 1 -- 172.21.15.123:0/1651504888 >> 172.21.15.123:0/1651504888 conn(0x557c1085cff0 msgr2=0x557c10d54000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:20.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f003ba29000 1 -- 172.21.15.123:0/1651504888 shutdown_connections 2024-04-25T13:42:20.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.942+0000 7f003ba29000 1 -- 172.21.15.123:0/1651504888 wait complete. 2024-04-25T13:42:20.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f003ba29000 1 -- start start 2024-04-25T13:42:20.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f003ba29000 1 Processor -- start 2024-04-25T13:42:20.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f003ba29000 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c1081d280 0x557c10e097a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f003ba29000 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557c10c24ea0 0x557c10e09ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f003ba29000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c10c38c20 0x557c10da1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f003ba29000 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x557c10b9b130 con 0x557c1081d280 2024-04-25T13:42:20.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f003ba29000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557c10b317d0 con 0x557c10c38c20 2024-04-25T13:42:20.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f003ba29000 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x557c10ba0450 con 0x557c10c24ea0 2024-04-25T13:42:20.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f003ba29000 10 client.0 _ll_register_callbacks cb 0x7f002400af20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:42:20.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f0031a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c1081d280 0x557c10e097a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:20.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f0031a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c1081d280 0x557c10e097a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33802/0 (socket says 172.21.15.123:33802) 2024-04-25T13:42:20.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f0031a00640 1 -- 172.21.15.123:0/3109253627 learned_addr learned my addr 172.21.15.123:0/3109253627 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:20.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f0031000640 1 --2- 172.21.15.123:0/3109253627 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557c10c24ea0 0x557c10e09ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:20.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f0032400640 1 --2- 172.21.15.123:0/3109253627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c10c38c20 0x557c10da1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:20.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f0031a00640 1 -- 172.21.15.123:0/3109253627 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557c10c24ea0 msgr2=0x557c10e09ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:20.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f0031a00640 1 --2- 172.21.15.123:0/3109253627 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557c10c24ea0 0x557c10e09ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f0031a00640 1 -- 172.21.15.123:0/3109253627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c10c38c20 msgr2=0x557c10da1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:20.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f0031a00640 1 --2- 172.21.15.123:0/3109253627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c10c38c20 0x557c10da1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f0031a00640 1 -- 172.21.15.123:0/3109253627 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c10b54c70 con 0x557c1081d280 2024-04-25T13:42:20.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f0031a00640 1 --2- 172.21.15.123:0/3109253627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c1081d280 0x557c10e097a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0020009630 tx=0x7f002001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5133bc44724cd331 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:20.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f0012a00640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-04-25T13:42:20.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f0012a00640 1 -- 172.21.15.123:0/3109253627 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00200b9bd0 con 0x557c1081d280 2024-04-25T13:42:20.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f0012a00640 1 -- 172.21.15.123:0/3109253627 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f00200b9d70 con 0x557c1081d280 2024-04-25T13:42:20.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f003ba29000 1 -- 172.21.15.123:0/3109253627 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00200b3040 con 0x557c1081d280 2024-04-25T13:42:20.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f0012a00640 1 -- 172.21.15.123:0/3109253627 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f00200d2120 con 0x557c1081d280 2024-04-25T13:42:20.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f003ba29000 10 client.4644 fetch_fsmap learned FSMap version 8 2024-04-25T13:42:20.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f003ba29000 1 -- 172.21.15.123:0/3109253627 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x557c10c1e180 con 0x557c1081d280 2024-04-25T13:42:20.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.946+0000 7f0012a00640 1 -- 172.21.15.123:0/3109253627 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00200b3040 con 0x557c1081d280 2024-04-25T13:42:20.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f0012a00640 1 -- 172.21.15.123:0/3109253627 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7f00200d22c0 con 0x557c1081d280 2024-04-25T13:42:20.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f003ba29000 10 client.4644 fetch_fsmap finished waiting for FSMap version 8 2024-04-25T13:42:20.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f003ba29000 10 client.4644 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T13:42:20.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f003ba29000 20 client.4644 populate_metadata read hostname 'smithi123' 2024-04-25T13:42:20.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f003ba29000 1 --2- 172.21.15.123:0/3109253627 >> [v2:172.21.15.130:6832/1645626215,v1:172.21.15.130:6834/1645626215] conn(0x557c1082f830 0x557c10da21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:20.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f003ba29000 4 client.4644 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:42:20.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f003ba29000 1 -- 172.21.15.123:0/3109253627 --> [v2:172.21.15.130:6832/1645626215,v1:172.21.15.130:6834/1645626215] -- command(tid 0: {"prefix": "status"}) -- 0x557c10ba9a30 con 0x557c1082f830 2024-04-25T13:42:20.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f0031000640 1 --2- 172.21.15.123:0/3109253627 >> [v2:172.21.15.130:6832/1645626215,v1:172.21.15.130:6834/1645626215] conn(0x557c1082f830 0x557c10da21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:20.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f0031000640 1 --2- 172.21.15.123:0/3109253627 >> [v2:172.21.15.130:6832/1645626215,v1:172.21.15.130:6834/1645626215] conn(0x557c1082f830 0x557c10da21f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d82592e1b51a766 server_cookie=4a215ccb00220651 in_seq=0 out_seq=0 2024-04-25T13:42:20.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f0012a00640 10 client.4644 ms_handle_connect on v2:172.21.15.130:6832/1645626215 2024-04-25T13:42:20.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f0012a00640 1 -- 172.21.15.123:0/3109253627 <== mds.0 v2:172.21.15.130:6832/1645626215 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x557c10ba9a30 con 0x557c1082f830 2024-04-25T13:42:20.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f0012a00640 10 client.4644 handle_command_reply: tid=0 2024-04-25T13:42:20.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f003ba29000 1 client.4644 shutdown 2024-04-25T13:42:20.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f003ba29000 1 -- 172.21.15.123:0/3109253627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c1081d280 msgr2=0x557c10e097a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:20.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f003ba29000 1 --2- 172.21.15.123:0/3109253627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c1081d280 0x557c10e097a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0020009630 tx=0x7f002001acd0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f003ba29000 1 -- 172.21.15.123:0/3109253627 shutdown_connections 2024-04-25T13:42:20.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f003ba29000 1 --2- 172.21.15.123:0/3109253627 >> [v2:172.21.15.130:6832/1645626215,v1:172.21.15.130:6834/1645626215] conn(0x557c1082f830 0x557c10da21f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f003ba29000 1 --2- 172.21.15.123:0/3109253627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557c10c38c20 0x557c10da1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f003ba29000 1 --2- 172.21.15.123:0/3109253627 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557c10c24ea0 0x557c10e09ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f0012a00640 0 client.4644 ms_handle_reset on v2:172.21.15.130:6832/1645626215 2024-04-25T13:42:20.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f003ba29000 1 --2- 172.21.15.123:0/3109253627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557c1081d280 0x557c10e097a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f003ba29000 1 -- 172.21.15.123:0/3109253627 >> 172.21.15.123:0/3109253627 conn(0x557c1085cff0 msgr2=0x557c10d9c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:20.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f003ba29000 1 -- 172.21.15.123:0/3109253627 shutdown_connections 2024-04-25T13:42:20.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f003ba29000 1 -- 172.21.15.123:0/3109253627 wait complete. 2024-04-25T13:42:20.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f003ba29000 20 client.4644 trim_cache size 0 max 16384 2024-04-25T13:42:20.956 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-04-25T13:42:20.956 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "95274ccf-6ec8-480a-933e-b3986da91a7e", 2024-04-25T13:42:20.956 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-04-25T13:42:20.956 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 4285, 2024-04-25T13:42:20.957 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-04-25T13:42:20.957 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-04-25T13:42:20.957 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-04-25T13:42:20.957 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 14.559870327000001, 2024-04-25T13:42:20.957 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 8, 2024-04-25T13:42:20.957 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 21, 2024-04-25T13:42:20.957 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 21, 2024-04-25T13:42:20.957 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 21.718489806000001 2024-04-25T13:42:20.957 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-04-25T13:42:20.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f0034400640 1 -- 172.21.15.123:0/1314762914 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f000c06f400 msgr2=0x7f000c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:20.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f0034400640 1 --2- 172.21.15.123:0/1314762914 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f000c06f400 0x7f000c071910 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f00200af000 tx=0x7f00200a7000 comp rx=0 tx=0).stop 2024-04-25T13:42:20.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f0034400640 1 -- 172.21.15.123:0/1314762914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f002c1571b0 msgr2=0x7f002c169ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:20.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f0034400640 1 --2- 172.21.15.123:0/1314762914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f002c1571b0 0x7f002c169ab0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f002400c760 tx=0x7f002400cc20 comp rx=0 tx=0).stop 2024-04-25T13:42:20.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f0034400640 1 -- 172.21.15.123:0/1314762914 shutdown_connections 2024-04-25T13:42:20.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f0034400640 1 --2- 172.21.15.123:0/1314762914 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f000c06f400 0x7f000c071910 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f0034400640 1 --2- 172.21.15.123:0/1314762914 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f002c1571b0 0x7f002c169ab0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f0034400640 1 --2- 172.21.15.123:0/1314762914 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f002c0b4770 0x7f002c169570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f0034400640 1 --2- 172.21.15.123:0/1314762914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f002c0b3870 0x7f002c15e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:20.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f0034400640 1 -- 172.21.15.123:0/1314762914 >> 172.21.15.123:0/1314762914 conn(0x7f002c06ca70 msgr2=0x7f002c0b6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:20.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f0034400640 1 -- 172.21.15.123:0/1314762914 shutdown_connections 2024-04-25T13:42:20.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:20.950+0000 7f0034400640 1 -- 172.21.15.123:0/1314762914 wait complete. 2024-04-25T13:42:20.973 INFO:teuthology.run_tasks:Running task sequential... 2024-04-25T13:42:20.983 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-25T13:42:20.983 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-25T13:42:20.984 INFO:teuthology.task.print:Enabling mgr modules 2024-04-25T13:42:20.984 INFO:teuthology.run_tasks:Running task kclient... 2024-04-25T13:42:21.057 INFO:tasks.kclient:Mounting kernel clients... 2024-04-25T13:42:21.057 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-25T13:42:21.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:21.058 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-04-25T13:42:21.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:21.068 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2024-04-25T13:42:21.133 INFO:teuthology.orchestra.run.smithi123.stderr:Cannot find device "ceph-brx" 2024-04-25T13:42:21.135 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:42:21.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:21.136 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-04-25T13:42:21.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:21.192 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2024-04-25T13:42:21.257 INFO:teuthology.orchestra.run.smithi123.stderr:Cannot find device "ceph-brx" 2024-04-25T13:42:21.258 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:42:21.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:21.259 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2024-04-25T13:42:21.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:21.270 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link delete ceph-brx 2024-04-25T13:42:21.336 INFO:teuthology.orchestra.run.smithi130.stderr:Cannot find device "ceph-brx" 2024-04-25T13:42:21.339 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:42:21.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:21.339 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2024-04-25T13:42:21.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:21.389 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link delete ceph-brx 2024-04-25T13:42:21.455 INFO:teuthology.orchestra.run.smithi130.stderr:Cannot find device "ceph-brx" 2024-04-25T13:42:21.457 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:42:21.458 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-04-25T13:42:21.458 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T13:42:21.458 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T13:42:21.458 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T13:42:21.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.602+0000 7fdfaec00640 1 Processor -- start 2024-04-25T13:42:21.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.602+0000 7fdfaec00640 1 -- start start 2024-04-25T13:42:21.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.606+0000 7fdfaec00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfa80758b0 0x7fdfa815a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:21.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.606+0000 7fdfaec00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdfa80b4d60 0x7fdfa80b5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:21.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.606+0000 7fdfaec00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfa815a9f0 con 0x7fdfa806d680 2024-04-25T13:42:21.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.606+0000 7fdfaec00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fdfa8160520 con 0x7fdfa80b4d60 2024-04-25T13:42:21.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.606+0000 7fdfaec00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fdfa81607e0 con 0x7fdfa80758b0 2024-04-25T13:42:21.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.606+0000 7fdfacc00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdfa80b4d60 0x7fdfa80b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:21.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.606+0000 7fdfa7400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fdfa806d680 0x7fdfa806da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38474/0 (socket says 172.21.15.123:38474) 2024-04-25T13:42:21.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.606+0000 7fdfa7400640 1 -- 172.21.15.123:0/2940633055 learned_addr learned my addr 172.21.15.123:0/2940633055 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:21.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.606+0000 7fdfa7e00640 1 --2- 172.21.15.123:0/2940633055 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfa80758b0 0x7fdfa815a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:21.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.606+0000 7fdfa6a00640 1 -- 172.21.15.123:0/2940633055 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 700899278 0 0) 0x7fdfa815a9f0 con 0x7fdfa806d680 2024-04-25T13:42:21.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.606+0000 7fdfa6a00640 1 -- 172.21.15.123:0/2940633055 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf8c003530 con 0x7fdfa806d680 2024-04-25T13:42:21.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.606+0000 7fdfacc00640 1 -- 172.21.15.123:0/2940633055 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfa80758b0 msgr2=0x7fdfa815a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:21.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.606+0000 7fdfacc00640 1 --2- 172.21.15.123:0/2940633055 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfa80758b0 0x7fdfa815a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.606+0000 7fdfacc00640 1 -- 172.21.15.123:0/2940633055 >> v1:172.21.15.123:6789/0 conn(0x7fdfa806d680 legacy=0x7fdfa806da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:21.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.606+0000 7fdfacc00640 1 -- 172.21.15.123:0/2940633055 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa8160ac0 con 0x7fdfa80b4d60 2024-04-25T13:42:21.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.610+0000 7fdfacc00640 1 --2- 172.21.15.123:0/2940633055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfa80b4d60 0x7fdfa80b5170 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00097c0 tx=0x7fdfa001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f57a1d567277734 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:21.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.610+0000 7fdfa6a00640 1 -- 172.21.15.123:0/2940633055 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa00aa600 con 0x7fdfa80b4d60 2024-04-25T13:42:21.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.610+0000 7fdfa6a00640 1 -- 172.21.15.123:0/2940633055 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa00af070 con 0x7fdfa80b4d60 2024-04-25T13:42:21.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.610+0000 7fdfa6a00640 1 -- 172.21.15.123:0/2940633055 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa00aa9c0 con 0x7fdfa80b4d60 2024-04-25T13:42:21.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.610+0000 7fdfaec00640 1 -- 172.21.15.123:0/2940633055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfa80b4d60 msgr2=0x7fdfa80b5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:21.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.610+0000 7fdfaec00640 1 --2- 172.21.15.123:0/2940633055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfa80b4d60 0x7fdfa80b5170 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00097c0 tx=0x7fdfa001c4a0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.610+0000 7fdfaec00640 1 -- 172.21.15.123:0/2940633055 shutdown_connections 2024-04-25T13:42:21.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.610+0000 7fdfaec00640 1 --2- 172.21.15.123:0/2940633055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfa80b4d60 0x7fdfa80b5170 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.610+0000 7fdfaec00640 1 --2- 172.21.15.123:0/2940633055 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfa80758b0 0x7fdfa815a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.610+0000 7fdfaec00640 1 -- 172.21.15.123:0/2940633055 >> 172.21.15.123:0/2940633055 conn(0x7fdfa80733b0 msgr2=0x7fdfa80737c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:21.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.610+0000 7fdfaec00640 1 -- 172.21.15.123:0/2940633055 shutdown_connections 2024-04-25T13:42:21.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.610+0000 7fdfaec00640 1 -- 172.21.15.123:0/2940633055 wait complete. 2024-04-25T13:42:21.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.614+0000 7fdfaec00640 1 Processor -- start 2024-04-25T13:42:21.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.614+0000 7fdfaec00640 1 -- start start 2024-04-25T13:42:21.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.614+0000 7fdfaec00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfa806d680 0x7fdfa81566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:21.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.614+0000 7fdfaec00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfa80758b0 0x7fdfa8155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:21.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.614+0000 7fdfaec00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfa80b4d60 0x7fdfa81546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:21.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.614+0000 7fdfaec00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa80d07b0 con 0x7fdfa80758b0 2024-04-25T13:42:21.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.614+0000 7fdfaec00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa80d0630 con 0x7fdfa806d680 2024-04-25T13:42:21.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.614+0000 7fdfaec00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fdfa80d0930 con 0x7fdfa80b4d60 2024-04-25T13:42:21.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.614+0000 7fdfa7400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfa80758b0 0x7fdfa8155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:21.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.614+0000 7fdfa7400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfa80758b0 0x7fdfa8155ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33818/0 (socket says 172.21.15.123:33818) 2024-04-25T13:42:21.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.614+0000 7fdfa7400640 1 -- 172.21.15.123:0/1484775811 learned_addr learned my addr 172.21.15.123:0/1484775811 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:21.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.614+0000 7fdfa7e00640 1 --2- 172.21.15.123:0/1484775811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfa806d680 0x7fdfa81566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:21.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.614+0000 7fdfacc00640 1 --2- 172.21.15.123:0/1484775811 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfa80b4d60 0x7fdfa81546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:21.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.614+0000 7fdfa7400640 1 -- 172.21.15.123:0/1484775811 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfa80b4d60 msgr2=0x7fdfa81546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:21.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.614+0000 7fdfa7400640 1 --2- 172.21.15.123:0/1484775811 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfa80b4d60 0x7fdfa81546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.614+0000 7fdfa7400640 1 -- 172.21.15.123:0/1484775811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfa806d680 msgr2=0x7fdfa81566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:21.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.614+0000 7fdfa7400640 1 --2- 172.21.15.123:0/1484775811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfa806d680 0x7fdfa81566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.614+0000 7fdfa7400640 1 -- 172.21.15.123:0/1484775811 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa8164010 con 0x7fdfa80758b0 2024-04-25T13:42:21.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.614+0000 7fdfa7e00640 1 --2- 172.21.15.123:0/1484775811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfa806d680 0x7fdfa81566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:21.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.614+0000 7fdfacc00640 1 --2- 172.21.15.123:0/1484775811 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfa80b4d60 0x7fdfa81546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:21.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.614+0000 7fdfa7400640 1 --2- 172.21.15.123:0/1484775811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfa80758b0 0x7fdfa8155ac0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdf9400c3f0 tx=0x7fdf9400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:21.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.614+0000 7fdf9fe00640 1 -- 172.21.15.123:0/1484775811 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf94017070 con 0x7fdfa80758b0 2024-04-25T13:42:21.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.614+0000 7fdf9fe00640 1 -- 172.21.15.123:0/1484775811 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf94005cf0 con 0x7fdfa80758b0 2024-04-25T13:42:21.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.614+0000 7fdfaec00640 1 -- 172.21.15.123:0/1484775811 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfa81642f0 con 0x7fdfa80758b0 2024-04-25T13:42:21.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.614+0000 7fdf9fe00640 1 -- 172.21.15.123:0/1484775811 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf940072f0 con 0x7fdfa80758b0 2024-04-25T13:42:21.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.614+0000 7fdfaec00640 1 -- 172.21.15.123:0/1484775811 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfa81541a0 con 0x7fdfa80758b0 2024-04-25T13:42:21.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.618+0000 7fdfaec00640 1 -- 172.21.15.123:0/1484775811 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfa8163d80 con 0x7fdfa80758b0 2024-04-25T13:42:21.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.618+0000 7fdf9fe00640 1 -- 172.21.15.123:0/1484775811 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fdf9401a070 con 0x7fdfa80758b0 2024-04-25T13:42:21.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.618+0000 7fdf9fe00640 1 --2- 172.21.15.123:0/1484775811 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdf8806f450 0x7fdf88071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:21.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.618+0000 7fdf9fe00640 1 -- 172.21.15.123:0/1484775811 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdf9408ebf0 con 0x7fdfa80758b0 2024-04-25T13:42:21.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.618+0000 7fdfa7e00640 1 --2- 172.21.15.123:0/1484775811 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdf8806f450 0x7fdf88071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:21.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.618+0000 7fdfa7e00640 1 --2- 172.21.15.123:0/1484775811 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdf8806f450 0x7fdf88071960 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdfa806eea0 tx=0x7fdf9800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:21.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.622+0000 7fdf9fe00640 1 -- 172.21.15.123:0/1484775811 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdf94021020 con 0x7fdfa80758b0 2024-04-25T13:42:21.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.814+0000 7fdfaec00640 1 -- 172.21.15.123:0/1484775811 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdfa80507c0 con 0x7fdfa80758b0 2024-04-25T13:42:21.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.814+0000 7fdf9fe00640 1 -- 172.21.15.123:0/1484775811 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fdf9405bac0 con 0x7fdfa80758b0 2024-04-25T13:42:21.818 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T13:42:21.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.818+0000 7fdfaec00640 1 -- 172.21.15.123:0/1484775811 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdf8806f450 msgr2=0x7fdf88071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:21.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.818+0000 7fdfaec00640 1 --2- 172.21.15.123:0/1484775811 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdf8806f450 0x7fdf88071960 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdfa806eea0 tx=0x7fdf9800b040 comp rx=0 tx=0).stop 2024-04-25T13:42:21.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.818+0000 7fdfaec00640 1 -- 172.21.15.123:0/1484775811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfa80758b0 msgr2=0x7fdfa8155ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:21.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.818+0000 7fdfaec00640 1 --2- 172.21.15.123:0/1484775811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfa80758b0 0x7fdfa8155ac0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdf9400c3f0 tx=0x7fdf9400c8b0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.818+0000 7fdfaec00640 1 -- 172.21.15.123:0/1484775811 shutdown_connections 2024-04-25T13:42:21.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.818+0000 7fdfaec00640 1 --2- 172.21.15.123:0/1484775811 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdf8806f450 0x7fdf88071960 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.818+0000 7fdfaec00640 1 --2- 172.21.15.123:0/1484775811 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfa80b4d60 0x7fdfa81546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.818+0000 7fdfaec00640 1 --2- 172.21.15.123:0/1484775811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfa80758b0 0x7fdfa8155ac0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.818+0000 7fdfaec00640 1 --2- 172.21.15.123:0/1484775811 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfa806d680 0x7fdfa81566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:21.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.818+0000 7fdfaec00640 1 -- 172.21.15.123:0/1484775811 >> 172.21.15.123:0/1484775811 conn(0x7fdfa80733b0 msgr2=0x7fdfa80af760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:21.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.818+0000 7fdfaec00640 1 -- 172.21.15.123:0/1484775811 shutdown_connections 2024-04-25T13:42:21.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21.818+0000 7fdfaec00640 1 -- 172.21.15.123:0/1484775811 wait complete. 2024-04-25T13:42:21.839 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T13:42:21.839 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T13:42:21.839 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-04-25T13:42:21.840 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T13:42:21.840 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T13:42:21.840 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T13:42:21.840 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T13:42:21.840 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T13:42:21.840 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T13:42:21.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:21.840 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-04-25T13:42:21.849 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T13:42:21.849 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T13:42:21.849 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T13:42:21.849 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:21.850 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-04-25T13:42:21.850 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:21.850 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T13:42:21.850 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-04-25T13:42:21.850 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-04-25T13:42:21.850 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T13:42:21.850 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-04-25T13:42:21.850 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-04-25T13:42:21.850 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T13:42:21.850 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:42:21.850 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T13:42:21.850 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:42:21.850 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T13:42:21.851 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42484sec preferred_lft 42484sec 2024-04-25T13:42:21.851 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link 2024-04-25T13:42:21.851 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:21.851 INFO:teuthology.orchestra.run.smithi123.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T13:42:21.851 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 02:42:49:08:34:c5 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:42:21.851 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T13:42:21.851 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:21.851 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T13:42:21.851 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:42:21.851 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-04-25T13:42:21.851 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add name ceph-brx type bridge 2024-04-25T13:42:21.852 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr flush dev ceph-brx 2024-04-25T13:42:21.852 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set ceph-brx up 2024-04-25T13:42:21.852 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T13:42:21.852 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-04-25T13:42:21.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:42:22.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:22.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:22.006 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T13:42:22.025 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-04-25T13:42:22.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:22.027 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-04-25T13:42:22.100 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-04-25T13:42:22.100 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T13:42:22.101 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T13:42:22.101 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T13:42:22.101 INFO:teuthology.orchestra.run.smithi123.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T13:42:22.101 INFO:teuthology.orchestra.run.smithi123.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T13:42:22.101 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T13:42:22.101 INFO:teuthology.orchestra.run.smithi123.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T13:42:22.101 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T13:42:22.101 INFO:teuthology.orchestra.run.smithi123.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T13:42:22.101 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T13:42:22.102 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:42:22.102 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-04-25T13:42:22.102 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T13:42:22.102 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T13:42:22.102 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T13:42:22.102 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-04-25T13:42:22.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:42:22.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:22.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:22.236 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-04-25T13:42:22.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:22.246 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list-id 2024-04-25T13:42:22.300 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:42:22.300 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-04-25T13:42:22.300 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:42:22.300 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T13:42:22.300 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-04-25T13:42:22.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:42:22.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:22.427 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T13:42:22.427 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:42:22.427 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-04-25T13:42:22.427 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T13:42:22.427 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T13:42:22.427 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T13:42:22.428 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T13:42:22.428 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T13:42:22.428 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-04-25T13:42:22.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:42:22.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:22.589 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:42:22.589 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-04-25T13:42:22.589 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-04-25T13:42:22.589 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T13:42:22.589 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-04-25T13:42:22.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:42:22.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:22.672 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:42:22.673 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T13:42:22.681 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T13:42:22.681 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:42:22.681 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T13:42:22.730 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T13:42:22.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:22.730 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T13:42:22.830 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T13:42:22.830 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T13:42:22.830 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-04-25T13:42:23.418 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T13:42:23.418 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T13:42:23.418 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-04-25T13:42:23.418 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.130:3300,172.21.15.130:3301" 2024-04-25T13:42:23.418 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T13:42:23.432 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T13:42:23.432 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T13:42:23.432 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-04-25T13:42:23.432 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.130:3300,172.21.15.130:3301" 2024-04-25T13:42:23.432 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T13:42:23.432 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.130:6789,172.21.15.130:6790" 2024-04-25T13:42:23.432 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.130:6789,172.21.15.130:6790:/ 2024-04-25T13:42:23.432 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=95274ccf-6ec8-480a-933e-b3986da91a7e" will pass to kernel 2024-04-25T13:42:23.436 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T13:42:23.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:23.436 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T13:42:23.458 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T13:42:23.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T13:42:23.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:23.593 INFO:teuthology.orchestra.run.smithi123.stdout:client4656 2024-04-25T13:42:23.594 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:42:23.594 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:42:23.603 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T13:42:23.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T13:42:23.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:23.723 INFO:teuthology.orchestra.run.smithi123.stdout:client4656 2024-04-25T13:42:23.723 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T13:42:23.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T13:42:23.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:23.793 INFO:teuthology.orchestra.run.smithi123.stdout:client4656 2024-04-25T13:42:23.793 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/95274ccf-6ec8-480a-933e-b3986da91a7e.client4656/status') 2024-04-25T13:42:23.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:42:23.861 INFO:teuthology.orchestra.run.smithi123.stdout:instance: client.4656 (3)192.168.0.1:0/3979496007 2024-04-25T13:42:23.861 INFO:teuthology.orchestra.run.smithi123.stdout:blocklisted: false 2024-04-25T13:42:23.861 INFO:teuthology.orchestra.run.smithi123.stderr:0+1 records in 2024-04-25T13:42:23.861 INFO:teuthology.orchestra.run.smithi123.stderr:0+1 records out 2024-04-25T13:42:23.861 INFO:teuthology.orchestra.run.smithi123.stderr:69 bytes copied, 6.3723e-05 s, 1.1 MB/s 2024-04-25T13:42:23.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:23.870 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-04-25T13:42:23.870 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T13:42:23.870 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T13:42:23.871 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T13:42:24.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.018+0000 7f5442c00640 1 Processor -- start 2024-04-25T13:42:24.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.018+0000 7f5442c00640 1 -- start start 2024-04-25T13:42:24.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.018+0000 7f5442c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f543c0d0f80 0x7f543c160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:24.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.018+0000 7f5442c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f543c161520 con 0x7f543c0b5010 2024-04-25T13:42:24.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.018+0000 7f5442c00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f543c15d240 con 0x7f543c0b32f0 2024-04-25T13:42:24.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.018+0000 7f5442c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f543c15cfe0 con 0x7f543c0d0f80 2024-04-25T13:42:24.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.018+0000 7f5440c00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f543c0b5010 0x7f543c0b5420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38480/0 (socket says 172.21.15.123:38480) 2024-04-25T13:42:24.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.018+0000 7f5440c00640 1 -- 172.21.15.123:0/1591133997 learned_addr learned my addr 172.21.15.123:0/1591133997 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:24.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.018+0000 7f543be00640 1 --2- 172.21.15.123:0/1591133997 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f543c0d0f80 0x7f543c160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:24.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.018+0000 7f543aa00640 1 -- 172.21.15.123:0/1591133997 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2313818811 0 0) 0x7f543c161520 con 0x7f543c0b5010 2024-04-25T13:42:24.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.018+0000 7f543aa00640 1 -- 172.21.15.123:0/1591133997 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5420003530 con 0x7f543c0b5010 2024-04-25T13:42:24.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.018+0000 7f543aa00640 1 -- 172.21.15.123:0/1591133997 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1176090121 0 0) 0x7f543c15d240 con 0x7f543c0b32f0 2024-04-25T13:42:24.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.018+0000 7f543aa00640 1 -- 172.21.15.123:0/1591133997 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f543c161520 con 0x7f543c0b32f0 2024-04-25T13:42:24.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.022+0000 7f543be00640 1 -- 172.21.15.123:0/1591133997 >> v1:172.21.15.130:6789/0 conn(0x7f543c0b32f0 legacy=0x7f543c0b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:24.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.022+0000 7f543be00640 1 -- 172.21.15.123:0/1591133997 >> v1:172.21.15.123:6789/0 conn(0x7f543c0b5010 legacy=0x7f543c0b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:24.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.022+0000 7f543aa00640 1 -- 172.21.15.123:0/1591133997 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 862452693 0 0) 0x7f5420003530 con 0x7f543c0b5010 2024-04-25T13:42:24.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.022+0000 7f543be00640 1 -- 172.21.15.123:0/1591133997 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f543c15d520 con 0x7f543c0d0f80 2024-04-25T13:42:24.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.022+0000 7f543be00640 1 --2- 172.21.15.123:0/1591133997 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f543c0d0f80 0x7f543c160fe0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f542c0097f0 tx=0x7f542c01c340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c1629c175c77b7d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:24.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.022+0000 7f543aa00640 1 -- 172.21.15.123:0/1591133997 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f542c0b0070 con 0x7f543c0d0f80 2024-04-25T13:42:24.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.022+0000 7f543aa00640 1 -- 172.21.15.123:0/1591133997 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f542c0ab400 con 0x7f543c0d0f80 2024-04-25T13:42:24.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.022+0000 7f543aa00640 1 -- 172.21.15.123:0/1591133997 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5434001a00 con 0x7f543c0d0f80 2024-04-25T13:42:24.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.026+0000 7f5442c00640 1 -- 172.21.15.123:0/1591133997 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f543c0d0f80 msgr2=0x7f543c160fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:24.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.026+0000 7f5442c00640 1 --2- 172.21.15.123:0/1591133997 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f543c0d0f80 0x7f543c160fe0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f542c0097f0 tx=0x7f542c01c340 comp rx=0 tx=0).stop 2024-04-25T13:42:24.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.026+0000 7f5442c00640 1 -- 172.21.15.123:0/1591133997 shutdown_connections 2024-04-25T13:42:24.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.026+0000 7f5442c00640 1 --2- 172.21.15.123:0/1591133997 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f543c0d0f80 0x7f543c160fe0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.026+0000 7f5442c00640 1 -- 172.21.15.123:0/1591133997 >> 172.21.15.123:0/1591133997 conn(0x7f543c06d210 msgr2=0x7f543c06ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:24.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.026+0000 7f5442c00640 1 -- 172.21.15.123:0/1591133997 shutdown_connections 2024-04-25T13:42:24.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.026+0000 7f5442c00640 1 -- 172.21.15.123:0/1591133997 wait complete. 2024-04-25T13:42:24.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.026+0000 7f5442c00640 1 Processor -- start 2024-04-25T13:42:24.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.026+0000 7f5442c00640 1 -- start start 2024-04-25T13:42:24.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.026+0000 7f5442c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f543c0b32f0 0x7f543c167c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:24.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.026+0000 7f5442c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f543c0b5010 0x7f543c1fcd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:24.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.030+0000 7f5442c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f543c0d0f80 0x7f543c1fd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:24.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.030+0000 7f5442c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f543c0b5f40 con 0x7f543c0b5010 2024-04-25T13:42:24.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.030+0000 7f5442c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f543c0b6470 con 0x7f543c0b32f0 2024-04-25T13:42:24.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.030+0000 7f5442c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f543c0b60c0 con 0x7f543c0d0f80 2024-04-25T13:42:24.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.030+0000 7f543b400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f543c0b5010 0x7f543c1fcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:24.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.030+0000 7f543b400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f543c0b5010 0x7f543c1fcd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33824/0 (socket says 172.21.15.123:33824) 2024-04-25T13:42:24.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.030+0000 7f543b400640 1 -- 172.21.15.123:0/440023889 learned_addr learned my addr 172.21.15.123:0/440023889 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:24.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.030+0000 7f543be00640 1 --2- 172.21.15.123:0/440023889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f543c0b32f0 0x7f543c167c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:24.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.030+0000 7f5440c00640 1 --2- 172.21.15.123:0/440023889 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f543c0d0f80 0x7f543c1fd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:24.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.030+0000 7f543b400640 1 -- 172.21.15.123:0/440023889 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f543c0d0f80 msgr2=0x7f543c1fd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:24.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.030+0000 7f543b400640 1 --2- 172.21.15.123:0/440023889 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f543c0d0f80 0x7f543c1fd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.030+0000 7f543b400640 1 -- 172.21.15.123:0/440023889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f543c0b32f0 msgr2=0x7f543c167c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:24.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.030+0000 7f543b400640 1 --2- 172.21.15.123:0/440023889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f543c0b32f0 0x7f543c167c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.030+0000 7f543b400640 1 -- 172.21.15.123:0/440023889 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f543c15e1e0 con 0x7f543c0b5010 2024-04-25T13:42:24.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.030+0000 7f543b400640 1 --2- 172.21.15.123:0/440023889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f543c0b5010 0x7f543c1fcd50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f542800c390 tx=0x7f542800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:24.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.030+0000 7f5433e00640 1 -- 172.21.15.123:0/440023889 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5428017070 con 0x7f543c0b5010 2024-04-25T13:42:24.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.030+0000 7f5433e00640 1 -- 172.21.15.123:0/440023889 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54280052f0 con 0x7f543c0b5010 2024-04-25T13:42:24.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.030+0000 7f5442c00640 1 -- 172.21.15.123:0/440023889 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f543c15beb0 con 0x7f543c0b5010 2024-04-25T13:42:24.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.030+0000 7f5433e00640 1 -- 172.21.15.123:0/440023889 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5428003840 con 0x7f543c0b5010 2024-04-25T13:42:24.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.030+0000 7f5442c00640 1 -- 172.21.15.123:0/440023889 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f543c15c470 con 0x7f543c0b5010 2024-04-25T13:42:24.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.030+0000 7f5442c00640 1 -- 172.21.15.123:0/440023889 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f543c0ce050 con 0x7f543c0b5010 2024-04-25T13:42:24.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.030+0000 7f5433e00640 1 -- 172.21.15.123:0/440023889 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f542801a070 con 0x7f543c0b5010 2024-04-25T13:42:24.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.034+0000 7f5433e00640 1 --2- 172.21.15.123:0/440023889 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f541c06f430 0x7f541c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:24.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.034+0000 7f5433e00640 1 -- 172.21.15.123:0/440023889 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f542808e550 con 0x7f543c0b5010 2024-04-25T13:42:24.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.034+0000 7f543be00640 1 --2- 172.21.15.123:0/440023889 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f541c06f430 0x7f541c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:24.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.034+0000 7f543be00640 1 --2- 172.21.15.123:0/440023889 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f541c06f430 0x7f541c071940 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f542c0ad000 tx=0x7f542c0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:24.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.038+0000 7f5433e00640 1 -- 172.21.15.123:0/440023889 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f542805ae90 con 0x7f543c0b5010 2024-04-25T13:42:24.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.230+0000 7f5442c00640 1 -- 172.21.15.123:0/440023889 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f543c0507c0 con 0x7f543c0b5010 2024-04-25T13:42:24.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.230+0000 7f5433e00640 1 -- 172.21.15.123:0/440023889 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f542805f190 con 0x7f543c0b5010 2024-04-25T13:42:24.230 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T13:42:24.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.234+0000 7f5442c00640 1 -- 172.21.15.123:0/440023889 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f541c06f430 msgr2=0x7f541c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:24.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.234+0000 7f5442c00640 1 --2- 172.21.15.123:0/440023889 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f541c06f430 0x7f541c071940 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f542c0ad000 tx=0x7f542c0a6000 comp rx=0 tx=0).stop 2024-04-25T13:42:24.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.234+0000 7f5442c00640 1 -- 172.21.15.123:0/440023889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f543c0b5010 msgr2=0x7f543c1fcd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:24.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.234+0000 7f5442c00640 1 --2- 172.21.15.123:0/440023889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f543c0b5010 0x7f543c1fcd50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f542800c390 tx=0x7f542800c850 comp rx=0 tx=0).stop 2024-04-25T13:42:24.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.234+0000 7f5442c00640 1 -- 172.21.15.123:0/440023889 shutdown_connections 2024-04-25T13:42:24.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.234+0000 7f5442c00640 1 --2- 172.21.15.123:0/440023889 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f541c06f430 0x7f541c071940 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.234+0000 7f5442c00640 1 --2- 172.21.15.123:0/440023889 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f543c0d0f80 0x7f543c1fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.234+0000 7f5442c00640 1 --2- 172.21.15.123:0/440023889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f543c0b5010 0x7f543c1fcd50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.234+0000 7f5442c00640 1 --2- 172.21.15.123:0/440023889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f543c0b32f0 0x7f543c167c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:24.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.234+0000 7f5442c00640 1 -- 172.21.15.123:0/440023889 >> 172.21.15.123:0/440023889 conn(0x7f543c06d210 msgr2=0x7f543c0d0390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:24.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.234+0000 7f5442c00640 1 -- 172.21.15.123:0/440023889 shutdown_connections 2024-04-25T13:42:24.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24.234+0000 7f5442c00640 1 -- 172.21.15.123:0/440023889 wait complete. 2024-04-25T13:42:24.252 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T13:42:24.252 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T13:42:24.252 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-04-25T13:42:24.252 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-25T13:42:24.252 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T13:42:24.252 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T13:42:24.252 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T13:42:24.252 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T13:42:24.252 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-25T13:42:24.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:24.253 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-04-25T13:42:24.262 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T13:42:24.262 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T13:42:24.262 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T13:42:24.262 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:24.262 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-04-25T13:42:24.262 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:24.262 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T13:42:24.262 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-04-25T13:42:24.262 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-04-25T13:42:24.263 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T13:42:24.263 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-04-25T13:42:24.263 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-04-25T13:42:24.263 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T13:42:24.263 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:42:24.263 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T13:42:24.263 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:42:24.263 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T13:42:24.263 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42481sec preferred_lft 42481sec 2024-04-25T13:42:24.263 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link 2024-04-25T13:42:24.263 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:24.263 INFO:teuthology.orchestra.run.smithi123.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T13:42:24.263 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 02:42:49:08:34:c5 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:42:24.263 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T13:42:24.264 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:24.264 INFO:teuthology.orchestra.run.smithi123.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T13:42:24.264 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T13:42:24.264 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T13:42:24.264 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:24.264 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T13:42:24.264 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:24.264 INFO:teuthology.orchestra.run.smithi123.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T13:42:24.264 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:42:24.264 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T13:42:24.264 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:24.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:24.265 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T13:42:24.320 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-04-25T13:42:24.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:24.322 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-04-25T13:42:24.374 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-04-25T13:42:24.375 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T13:42:24.375 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T13:42:24.375 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T13:42:24.375 INFO:teuthology.orchestra.run.smithi123.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T13:42:24.375 INFO:teuthology.orchestra.run.smithi123.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T13:42:24.375 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T13:42:24.375 INFO:teuthology.orchestra.run.smithi123.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T13:42:24.375 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T13:42:24.375 INFO:teuthology.orchestra.run.smithi123.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T13:42:24.375 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T13:42:24.376 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:42:24.376 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-04-25T13:42:24.376 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T13:42:24.376 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T13:42:24.376 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T13:42:24.376 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-04-25T13:42:24.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:42:24.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:24.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:24.509 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-04-25T13:42:24.518 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T13:42:24.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:24.519 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list-id 2024-04-25T13:42:24.567 INFO:teuthology.orchestra.run.smithi123.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-25T13:42:24.568 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:42:24.568 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-04-25T13:42:24.568 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T13:42:24.568 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-25T13:42:24.568 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-04-25T13:42:24.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:42:24.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:24.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:24.694 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-25T13:42:24.755 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T13:42:24.755 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T13:42:24.755 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T13:42:24.755 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:24.756 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-04-25T13:42:24.756 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:24.756 INFO:teuthology.orchestra.run.smithi123.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T13:42:24.756 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether ae:2b:f0:8d:7e:14 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T13:42:24.756 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T13:42:24.756 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:24.756 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ac2b:f0ff:fe8d:7e14/64 scope link 2024-04-25T13:42:24.756 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:24.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:24.757 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-25T13:42:24.818 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T13:42:24.818 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T13:42:24.819 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T13:42:24.819 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:24.819 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-04-25T13:42:24.819 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:24.819 INFO:teuthology.orchestra.run.smithi123.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T13:42:24.819 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether ae:2b:f0:8d:7e:14 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T13:42:24.819 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T13:42:24.819 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:24.819 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ac2b:f0ff:fe8d:7e14/64 scope link 2024-04-25T13:42:24.819 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:24.820 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-25T13:42:24.821 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:42:24.821 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-04-25T13:42:24.821 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-25T13:42:24.821 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-25T13:42:24.821 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-25T13:42:24.821 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-25T13:42:24.821 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-25T13:42:24.821 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-04-25T13:42:24.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:42:24.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:25.001 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:42:25.001 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-04-25T13:42:25.001 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.1 up 2024-04-25T13:42:25.001 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set dev brx.1 master ceph-brx 2024-04-25T13:42:25.001 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-04-25T13:42:25.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:42:25.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:25.083 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:42:25.083 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-25T13:42:25.139 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-25T13:42:25.140 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:42:25.140 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-25T13:42:25.190 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T13:42:25.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:25.191 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T13:42:25.293 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T13:42:25.294 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T13:42:25.294 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-04-25T13:42:25.312 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T13:42:25.312 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T13:42:25.312 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-04-25T13:42:25.312 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.130:3300,172.21.15.130:3301" 2024-04-25T13:42:25.312 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T13:42:25.323 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T13:42:25.323 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T13:42:25.323 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-04-25T13:42:25.324 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.130:3300,172.21.15.130:3301" 2024-04-25T13:42:25.324 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T13:42:25.324 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.130:6789,172.21.15.130:6790" 2024-04-25T13:42:25.324 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.130:6789,172.21.15.130:6790:/ 2024-04-25T13:42:25.324 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=95274ccf-6ec8-480a-933e-b3986da91a7e" will pass to kernel 2024-04-25T13:42:25.327 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T13:42:25.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:25.328 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-25T13:42:25.347 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T13:42:25.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T13:42:25.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:25.449 INFO:teuthology.orchestra.run.smithi123.stdout:client4645 2024-04-25T13:42:25.450 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:42:25.450 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:42:25.459 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T13:42:25.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T13:42:25.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:25.558 INFO:teuthology.orchestra.run.smithi123.stdout:client4645 2024-04-25T13:42:25.558 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T13:42:25.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T13:42:25.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:25.616 INFO:teuthology.orchestra.run.smithi123.stdout:client4645 2024-04-25T13:42:25.616 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/95274ccf-6ec8-480a-933e-b3986da91a7e.client4645/status') 2024-04-25T13:42:25.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:42:25.674 INFO:teuthology.orchestra.run.smithi123.stdout:instance: client.4645 (3)172.21.15.123:0/21981445 2024-04-25T13:42:25.674 INFO:teuthology.orchestra.run.smithi123.stdout:blocklisted: false 2024-04-25T13:42:25.674 INFO:teuthology.orchestra.run.smithi123.stderr:0+1 records in 2024-04-25T13:42:25.674 INFO:teuthology.orchestra.run.smithi123.stderr:0+1 records out 2024-04-25T13:42:25.674 INFO:teuthology.orchestra.run.smithi123.stderr:69 bytes copied, 6.9274e-05 s, 996 kB/s 2024-04-25T13:42:25.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:25.682 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-04-25T13:42:25.682 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T13:42:25.682 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T13:42:25.683 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T13:42:25.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.874+0000 7f06e6400640 1 Processor -- start 2024-04-25T13:42:25.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.874+0000 7f06e6400640 1 -- start start 2024-04-25T13:42:25.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.874+0000 7f06e6400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06e01623a0 0x7f06e01627b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:25.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.874+0000 7f06e6400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f06e0162cf0 0x7f06e00b6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:25.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.874+0000 7f06e6400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06e00b27b0 con 0x7f06e00b6a60 2024-04-25T13:42:25.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.874+0000 7f06e6400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f06e00d16b0 con 0x7f06e0162cf0 2024-04-25T13:42:25.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.874+0000 7f06e6400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f06e00b8e80 con 0x7f06e01623a0 2024-04-25T13:42:25.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.874+0000 7f06d7e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f06e0162cf0 0x7f06e00b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:25.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.874+0000 7f06d7e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f06e0162cf0 0x7f06e00b6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33826/0 (socket says 172.21.15.123:33826) 2024-04-25T13:42:25.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.874+0000 7f06d7e00640 1 -- 172.21.15.123:0/1447564186 learned_addr learned my addr 172.21.15.123:0/1447564186 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:25.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.874+0000 7f06df400640 1 --2- 172.21.15.123:0/1447564186 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06e01623a0 0x7f06e01627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:25.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.874+0000 7f06d7e00640 1 -- 172.21.15.123:0/1447564186 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06e01623a0 msgr2=0x7f06e01627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:25.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.874+0000 7f06d7e00640 1 --2- 172.21.15.123:0/1447564186 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06e01623a0 0x7f06e01627b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:25.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.874+0000 7f06d7e00640 1 -- 172.21.15.123:0/1447564186 >> v1:172.21.15.130:6789/0 conn(0x7f06e00b6a60 legacy=0x7f06e00b6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:25.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.874+0000 7f06d7e00640 1 -- 172.21.15.123:0/1447564186 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e00d1340 con 0x7f06e0162cf0 2024-04-25T13:42:25.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.878+0000 7f06d7e00640 1 --2- 172.21.15.123:0/1447564186 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e0162cf0 0x7f06e00b6520 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f06c8009870 tx=0x7f06c801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e7aee4cd7b3a89 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:25.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.878+0000 7f06dea00640 1 -- 172.21.15.123:0/1447564186 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c80ab5f0 con 0x7f06e0162cf0 2024-04-25T13:42:25.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.878+0000 7f06dea00640 1 -- 172.21.15.123:0/1447564186 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06c80b0070 con 0x7f06e0162cf0 2024-04-25T13:42:25.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.878+0000 7f06dea00640 1 -- 172.21.15.123:0/1447564186 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06c80ab9b0 con 0x7f06e0162cf0 2024-04-25T13:42:25.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.878+0000 7f06e6400640 1 -- 172.21.15.123:0/1447564186 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e0162cf0 msgr2=0x7f06e00b6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:25.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.878+0000 7f06e6400640 1 --2- 172.21.15.123:0/1447564186 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e0162cf0 0x7f06e00b6520 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f06c8009870 tx=0x7f06c801c560 comp rx=0 tx=0).stop 2024-04-25T13:42:25.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.878+0000 7f06e6400640 1 -- 172.21.15.123:0/1447564186 shutdown_connections 2024-04-25T13:42:25.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.878+0000 7f06e6400640 1 --2- 172.21.15.123:0/1447564186 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e0162cf0 0x7f06e00b6520 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:25.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.878+0000 7f06e6400640 1 --2- 172.21.15.123:0/1447564186 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06e01623a0 0x7f06e01627b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:25.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.878+0000 7f06e6400640 1 -- 172.21.15.123:0/1447564186 >> 172.21.15.123:0/1447564186 conn(0x7f06e00d0150 msgr2=0x7f06e00d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:25.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.878+0000 7f06e6400640 1 -- 172.21.15.123:0/1447564186 shutdown_connections 2024-04-25T13:42:25.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.878+0000 7f06e6400640 1 -- 172.21.15.123:0/1447564186 wait complete. 2024-04-25T13:42:25.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.882+0000 7f06e6400640 1 Processor -- start 2024-04-25T13:42:25.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.882+0000 7f06e6400640 1 -- start start 2024-04-25T13:42:25.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.882+0000 7f06e6400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e00b6a60 0x7f06e00a1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:25.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.882+0000 7f06e6400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06e01623a0 0x7f06e009d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:25.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.882+0000 7f06e6400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06e0162cf0 0x7f06e015c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:25.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.882+0000 7f06e6400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f06e00b88d0 con 0x7f06e00b6a60 2024-04-25T13:42:25.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.882+0000 7f06e6400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f06e00b2a20 con 0x7f06e01623a0 2024-04-25T13:42:25.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.882+0000 7f06e6400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f06e00b8a50 con 0x7f06e0162cf0 2024-04-25T13:42:25.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.882+0000 7f06df400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e00b6a60 0x7f06e00a1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:25.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.882+0000 7f06df400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e00b6a60 0x7f06e00a1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33834/0 (socket says 172.21.15.123:33834) 2024-04-25T13:42:25.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.882+0000 7f06df400640 1 -- 172.21.15.123:0/1774768908 learned_addr learned my addr 172.21.15.123:0/1774768908 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:25.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.886+0000 7f06df400640 1 -- 172.21.15.123:0/1774768908 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06e0162cf0 msgr2=0x7f06e015c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:25.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.886+0000 7f06df400640 1 --2- 172.21.15.123:0/1774768908 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06e0162cf0 0x7f06e015c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:25.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.886+0000 7f06df400640 1 -- 172.21.15.123:0/1774768908 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06e01623a0 msgr2=0x7f06e009d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:25.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.886+0000 7f06df400640 1 --2- 172.21.15.123:0/1774768908 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06e01623a0 0x7f06e009d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:25.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.886+0000 7f06df400640 1 -- 172.21.15.123:0/1774768908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e009e380 con 0x7f06e00b6a60 2024-04-25T13:42:25.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.886+0000 7f06df400640 1 --2- 172.21.15.123:0/1774768908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e00b6a60 0x7f06e00a1080 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f06d000d5c0 tx=0x7f06d000da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:25.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.886+0000 7f06d7400640 1 -- 172.21.15.123:0/1774768908 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0004240 con 0x7f06e00b6a60 2024-04-25T13:42:25.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.886+0000 7f06d7400640 1 -- 172.21.15.123:0/1774768908 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d00043e0 con 0x7f06e00b6a60 2024-04-25T13:42:25.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.886+0000 7f06e6400640 1 -- 172.21.15.123:0/1774768908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e015f070 con 0x7f06e00b6a60 2024-04-25T13:42:25.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.886+0000 7f06d7400640 1 -- 172.21.15.123:0/1774768908 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0003840 con 0x7f06e00b6a60 2024-04-25T13:42:25.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.886+0000 7f06e6400640 1 -- 172.21.15.123:0/1774768908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e015d8b0 con 0x7f06e00b6a60 2024-04-25T13:42:25.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.886+0000 7f06e6400640 1 -- 172.21.15.123:0/1774768908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e00507c0 con 0x7f06e00b6a60 2024-04-25T13:42:25.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.886+0000 7f06d7400640 1 -- 172.21.15.123:0/1774768908 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f06d00039e0 con 0x7f06e00b6a60 2024-04-25T13:42:25.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.886+0000 7f06d7400640 1 --2- 172.21.15.123:0/1774768908 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f06bc06f400 0x7f06bc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:25.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.886+0000 7f06d7400640 1 -- 172.21.15.123:0/1774768908 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f06d008f600 con 0x7f06e00b6a60 2024-04-25T13:42:25.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.890+0000 7f06d7e00640 1 --2- 172.21.15.123:0/1774768908 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f06bc06f400 0x7f06bc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:25.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.890+0000 7f06d7e00640 1 --2- 172.21.15.123:0/1774768908 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f06bc06f400 0x7f06bc071910 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f06c80af000 tx=0x7f06c8004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:25.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:25.894+0000 7f06d7400640 1 -- 172.21.15.123:0/1774768908 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f06d005c4e0 con 0x7f06e00b6a60 2024-04-25T13:42:26.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:26.090+0000 7f06e6400640 1 -- 172.21.15.123:0/1774768908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f06e00714b0 con 0x7f06e00b6a60 2024-04-25T13:42:26.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:26.090+0000 7f06d7400640 1 -- 172.21.15.123:0/1774768908 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f06d005bde0 con 0x7f06e00b6a60 2024-04-25T13:42:26.089 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T13:42:26.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:26.090+0000 7f06e6400640 1 -- 172.21.15.123:0/1774768908 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f06bc06f400 msgr2=0x7f06bc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:26.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:26.090+0000 7f06e6400640 1 --2- 172.21.15.123:0/1774768908 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f06bc06f400 0x7f06bc071910 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f06c80af000 tx=0x7f06c8004740 comp rx=0 tx=0).stop 2024-04-25T13:42:26.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:26.090+0000 7f06e6400640 1 -- 172.21.15.123:0/1774768908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e00b6a60 msgr2=0x7f06e00a1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:26.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:26.090+0000 7f06e6400640 1 --2- 172.21.15.123:0/1774768908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e00b6a60 0x7f06e00a1080 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f06d000d5c0 tx=0x7f06d000da80 comp rx=0 tx=0).stop 2024-04-25T13:42:26.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:26.090+0000 7f06e6400640 1 -- 172.21.15.123:0/1774768908 shutdown_connections 2024-04-25T13:42:26.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:26.090+0000 7f06e6400640 1 --2- 172.21.15.123:0/1774768908 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f06e01623a0 0x7f06e009d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:26.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:26.090+0000 7f06e6400640 1 --2- 172.21.15.123:0/1774768908 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f06bc06f400 0x7f06bc071910 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:26.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:26.090+0000 7f06e6400640 1 --2- 172.21.15.123:0/1774768908 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f06e0162cf0 0x7f06e015c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:26.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:26.090+0000 7f06e6400640 1 --2- 172.21.15.123:0/1774768908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f06e00b6a60 0x7f06e00a1080 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:26.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:26.090+0000 7f06e6400640 1 -- 172.21.15.123:0/1774768908 >> 172.21.15.123:0/1774768908 conn(0x7f06e00d0150 msgr2=0x7f06e0071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:26.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:26.090+0000 7f06e6400640 1 -- 172.21.15.123:0/1774768908 shutdown_connections 2024-04-25T13:42:26.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:26.090+0000 7f06e6400640 1 -- 172.21.15.123:0/1774768908 wait complete. 2024-04-25T13:42:26.110 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T13:42:26.110 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T13:42:26.111 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi130.front.sepia.ceph.com 2024-04-25T13:42:26.111 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T13:42:26.111 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T13:42:26.111 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T13:42:26.111 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T13:42:26.111 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T13:42:26.111 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T13:42:26.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:26.111 DEBUG:teuthology.orchestra.run.smithi130:> ip addr 2024-04-25T13:42:26.121 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T13:42:26.121 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T13:42:26.121 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T13:42:26.121 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:26.121 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2024-04-25T13:42:26.121 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:26.121 INFO:teuthology.orchestra.run.smithi130.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T13:42:26.122 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:96 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:42:26.122 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f0 2024-04-25T13:42:26.122 INFO:teuthology.orchestra.run.smithi130.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T13:42:26.122 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:97 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:42:26.122 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f1 2024-04-25T13:42:26.122 INFO:teuthology.orchestra.run.smithi130.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T13:42:26.122 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:36 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:42:26.122 INFO:teuthology.orchestra.run.smithi130.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T13:42:26.122 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:37 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:42:26.122 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.21.15.130/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T13:42:26.122 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft 42473sec preferred_lft 42473sec 2024-04-25T13:42:26.122 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::ec4:7aff:fe88:7f37/64 scope link 2024-04-25T13:42:26.122 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:26.123 INFO:teuthology.orchestra.run.smithi130.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T13:42:26.123 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 02:42:a3:19:9f:9a brd ff:ff:ff:ff:ff:ff 2024-04-25T13:42:26.123 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T13:42:26.123 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:26.124 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T13:42:26.124 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:42:26.124 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2024-04-25T13:42:26.124 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link add name ceph-brx type bridge 2024-04-25T13:42:26.124 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip addr flush dev ceph-brx 2024-04-25T13:42:26.124 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set ceph-brx up 2024-04-25T13:42:26.124 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T13:42:26.124 DEBUG:teuthology.orchestra.run.smithi130:> ') 2024-04-25T13:42:26.220 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:42:26.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:26.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:26.288 DEBUG:teuthology.orchestra.run.smithi130:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T13:42:26.306 INFO:teuthology.orchestra.run.smithi130.stdout:1 2024-04-25T13:42:26.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:26.309 DEBUG:teuthology.orchestra.run.smithi130:> route 2024-04-25T13:42:26.397 INFO:teuthology.orchestra.run.smithi130.stdout:Kernel IP routing table 2024-04-25T13:42:26.397 INFO:teuthology.orchestra.run.smithi130.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T13:42:26.397 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T13:42:26.397 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T13:42:26.397 INFO:teuthology.orchestra.run.smithi130.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T13:42:26.397 INFO:teuthology.orchestra.run.smithi130.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T13:42:26.398 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T13:42:26.398 INFO:teuthology.orchestra.run.smithi130.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T13:42:26.398 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T13:42:26.398 INFO:teuthology.orchestra.run.smithi130.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T13:42:26.398 INFO:teuthology.orchestra.run.smithi130.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T13:42:26.398 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:42:26.398 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2024-04-25T13:42:26.398 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T13:42:26.398 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T13:42:26.398 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T13:42:26.399 DEBUG:teuthology.orchestra.run.smithi130:> ') 2024-04-25T13:42:26.486 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:42:26.529 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:26.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:26.535 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2024-04-25T13:42:26.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:26.544 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list-id 2024-04-25T13:42:26.600 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:42:26.600 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2024-04-25T13:42:26.600 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T13:42:26.600 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-25T13:42:26.600 DEBUG:teuthology.orchestra.run.smithi130:> ') 2024-04-25T13:42:26.694 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:42:26.725 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:26.732 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-25T13:42:26.733 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:42:26.733 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2024-04-25T13:42:26.733 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-25T13:42:26.733 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T13:42:26.733 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-25T13:42:26.733 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-25T13:42:26.733 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-25T13:42:26.734 DEBUG:teuthology.orchestra.run.smithi130:> ') 2024-04-25T13:42:26.781 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:42:26.904 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:26.910 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:42:26.911 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2024-04-25T13:42:26.911 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set brx.0 up 2024-04-25T13:42:26.911 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T13:42:26.911 DEBUG:teuthology.orchestra.run.smithi130:> ') 2024-04-25T13:42:27.001 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:42:27.032 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:27.039 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:42:27.039 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T13:42:27.048 INFO:teuthology.orchestra.run.smithi130.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T13:42:27.048 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:42:27.048 DEBUG:teuthology.orchestra.run.smithi130:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T13:42:27.099 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T13:42:27.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:27.099 DEBUG:teuthology.orchestra.run.smithi130:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T13:42:27.199 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T13:42:27.199 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T13:42:27.199 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2024-04-25T13:42:27.794 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T13:42:27.794 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T13:42:27.794 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2024-04-25T13:42:27.794 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.130:3300,172.21.15.130:3301" 2024-04-25T13:42:27.794 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T13:42:27.807 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T13:42:27.808 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T13:42:27.808 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2024-04-25T13:42:27.808 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.130:3300,172.21.15.130:3301" 2024-04-25T13:42:27.808 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T13:42:27.808 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.130:6789,172.21.15.130:6790" 2024-04-25T13:42:27.808 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.130:6789,172.21.15.130:6790:/ 2024-04-25T13:42:27.808 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=95274ccf-6ec8-480a-933e-b3986da91a7e" will pass to kernel 2024-04-25T13:42:27.812 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T13:42:27.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:27.812 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T13:42:27.831 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T13:42:27.919 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T13:42:27.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:27.966 INFO:teuthology.orchestra.run.smithi130.stdout:client4651 2024-04-25T13:42:27.966 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:42:27.966 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:42:27.977 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T13:42:28.070 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T13:42:28.072 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:28.079 INFO:teuthology.orchestra.run.smithi130.stdout:client4651 2024-04-25T13:42:28.079 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T13:42:28.125 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T13:42:28.128 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:28.134 INFO:teuthology.orchestra.run.smithi130.stdout:client4651 2024-04-25T13:42:28.135 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/95274ccf-6ec8-480a-933e-b3986da91a7e.client4651/status') 2024-04-25T13:42:28.181 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:42:28.193 INFO:teuthology.orchestra.run.smithi130.stdout:instance: client.4651 (3)192.168.0.1:0/2991980223 2024-04-25T13:42:28.193 INFO:teuthology.orchestra.run.smithi130.stdout:blocklisted: false 2024-04-25T13:42:28.193 INFO:teuthology.orchestra.run.smithi130.stderr:0+1 records in 2024-04-25T13:42:28.193 INFO:teuthology.orchestra.run.smithi130.stderr:0+1 records out 2024-04-25T13:42:28.193 INFO:teuthology.orchestra.run.smithi130.stderr:69 bytes copied, 4.8728e-05 s, 1.4 MB/s 2024-04-25T13:42:28.194 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:28.200 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-04-25T13:42:28.201 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T13:42:28.201 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-25T13:42:28.201 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T13:42:28.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.362+0000 7f67ac600640 1 Processor -- start 2024-04-25T13:42:28.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.362+0000 7f67ac600640 1 -- start start 2024-04-25T13:42:28.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.362+0000 7f67ac600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f67a40ce2e0 0x7f67a40ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:28.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.362+0000 7f67ac600640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f67a40cec30 0x7f67a40cf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:28.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.362+0000 7f67ac600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67a40b27b0 con 0x7f67a41623a0 2024-04-25T13:42:28.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.362+0000 7f67ac600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f67a40d16b0 con 0x7f67a40ce2e0 2024-04-25T13:42:28.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.362+0000 7f67ac600640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f67a40b7530 con 0x7f67a40cec30 2024-04-25T13:42:28.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.362+0000 7f67a9c00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f67a41623a0 0x7f67a41627b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:38494/0 (socket says 172.21.15.123:38494) 2024-04-25T13:42:28.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.362+0000 7f67a9c00640 1 -- 172.21.15.123:0/3298259873 learned_addr learned my addr 172.21.15.123:0/3298259873 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:28.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.362+0000 7f67a9200640 1 --2- 172.21.15.123:0/3298259873 >> v2:172.21.15.123:3300/0 conn(0x7f67a40ce2e0 0x7f67a40ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:28.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.362+0000 7f67aa600640 1 --2- 172.21.15.123:0/3298259873 >> v2:172.21.15.130:3300/0 conn(0x7f67a40cec30 0x7f67a40cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:28.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.362+0000 7f67a9200640 1 -- 172.21.15.123:0/3298259873 >> v2:172.21.15.130:3300/0 conn(0x7f67a40cec30 msgr2=0x7f67a40cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:28.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.362+0000 7f67a9200640 1 --2- 172.21.15.123:0/3298259873 >> v2:172.21.15.130:3300/0 conn(0x7f67a40cec30 0x7f67a40cf040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:28.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.362+0000 7f67a9200640 1 -- 172.21.15.123:0/3298259873 >> v1:172.21.15.123:6789/0 conn(0x7f67a41623a0 legacy=0x7f67a41627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:28.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.362+0000 7f67a3e00640 1 -- 172.21.15.123:0/3298259873 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3777888158 0 0) 0x7f67a40b27b0 con 0x7f67a41623a0 2024-04-25T13:42:28.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.362+0000 7f67a9200640 1 -- 172.21.15.123:0/3298259873 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a40b8e80 con 0x7f67a40ce2e0 2024-04-25T13:42:28.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.366+0000 7f67a9200640 1 --2- 172.21.15.123:0/3298259873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67a40ce2e0 0x7f67a40ce6f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f67a40745f0 tx=0x7f679001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c5dacfb82d272d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:28.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.366+0000 7f67a3e00640 1 -- 172.21.15.123:0/3298259873 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67900ab610 con 0x7f67a40ce2e0 2024-04-25T13:42:28.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.366+0000 7f67a3e00640 1 -- 172.21.15.123:0/3298259873 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67900b0070 con 0x7f67a40ce2e0 2024-04-25T13:42:28.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.366+0000 7f67a3e00640 1 -- 172.21.15.123:0/3298259873 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67900ab9d0 con 0x7f67a40ce2e0 2024-04-25T13:42:28.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.366+0000 7f67ac600640 1 -- 172.21.15.123:0/3298259873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67a40ce2e0 msgr2=0x7f67a40ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:28.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.366+0000 7f67ac600640 1 --2- 172.21.15.123:0/3298259873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67a40ce2e0 0x7f67a40ce6f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f67a40745f0 tx=0x7f679001c450 comp rx=0 tx=0).stop 2024-04-25T13:42:28.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.366+0000 7f67ac600640 1 -- 172.21.15.123:0/3298259873 shutdown_connections 2024-04-25T13:42:28.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.366+0000 7f67ac600640 1 --2- 172.21.15.123:0/3298259873 >> v2:172.21.15.130:3300/0 conn(0x7f67a40cec30 0x7f67a40cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:28.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.366+0000 7f67ac600640 1 --2- 172.21.15.123:0/3298259873 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67a40ce2e0 0x7f67a40ce6f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:28.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.366+0000 7f67ac600640 1 -- 172.21.15.123:0/3298259873 >> 172.21.15.123:0/3298259873 conn(0x7f67a40d0150 msgr2=0x7f67a40d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:28.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.366+0000 7f67ac600640 1 -- 172.21.15.123:0/3298259873 shutdown_connections 2024-04-25T13:42:28.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.366+0000 7f67ac600640 1 -- 172.21.15.123:0/3298259873 wait complete. 2024-04-25T13:42:28.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.370+0000 7f67ac600640 1 Processor -- start 2024-04-25T13:42:28.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.370+0000 7f67ac600640 1 -- start start 2024-04-25T13:42:28.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.370+0000 7f67ac600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67a40ce2e0 0x7f67a409e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:28.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.370+0000 7f67ac600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67a40cec30 0x7f67a415cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:28.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.370+0000 7f67ac600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67a41623a0 0x7f67a406ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:28.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.370+0000 7f67ac600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f67a40b2a20 con 0x7f67a41623a0 2024-04-25T13:42:28.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.370+0000 7f67ac600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f67a40b9160 con 0x7f67a40cec30 2024-04-25T13:42:28.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.370+0000 7f67ac600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f67a4162ec0 con 0x7f67a40ce2e0 2024-04-25T13:42:28.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.370+0000 7f67aa600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67a41623a0 0x7f67a406ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:28.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.370+0000 7f67aa600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67a41623a0 0x7f67a406ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33860/0 (socket says 172.21.15.123:33860) 2024-04-25T13:42:28.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.370+0000 7f67aa600640 1 -- 172.21.15.123:0/4244011374 learned_addr learned my addr 172.21.15.123:0/4244011374 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:28.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.370+0000 7f67a9200640 1 --2- 172.21.15.123:0/4244011374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67a40cec30 0x7f67a415cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:28.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.370+0000 7f67a9c00640 1 --2- 172.21.15.123:0/4244011374 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67a40ce2e0 0x7f67a409e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:28.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.370+0000 7f67aa600640 1 -- 172.21.15.123:0/4244011374 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67a40ce2e0 msgr2=0x7f67a409e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:28.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.370+0000 7f67aa600640 1 --2- 172.21.15.123:0/4244011374 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67a40ce2e0 0x7f67a409e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:28.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.370+0000 7f67aa600640 1 -- 172.21.15.123:0/4244011374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67a40cec30 msgr2=0x7f67a415cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:28.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.370+0000 7f67aa600640 1 --2- 172.21.15.123:0/4244011374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67a40cec30 0x7f67a415cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:28.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.370+0000 7f67aa600640 1 -- 172.21.15.123:0/4244011374 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a415ec00 con 0x7f67a41623a0 2024-04-25T13:42:28.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.374+0000 7f67aa600640 1 --2- 172.21.15.123:0/4244011374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67a41623a0 0x7f67a406ea30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f679c00e820 tx=0x7f679c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:28.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.374+0000 7f67a1600640 1 -- 172.21.15.123:0/4244011374 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679c017070 con 0x7f67a41623a0 2024-04-25T13:42:28.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.374+0000 7f67a1600640 1 -- 172.21.15.123:0/4244011374 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f679c00c940 con 0x7f67a41623a0 2024-04-25T13:42:28.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.374+0000 7f67a1600640 1 -- 172.21.15.123:0/4244011374 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679c00cd10 con 0x7f67a41623a0 2024-04-25T13:42:28.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.374+0000 7f67ac600640 1 -- 172.21.15.123:0/4244011374 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67a415f180 con 0x7f67a41623a0 2024-04-25T13:42:28.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.374+0000 7f67ac600640 1 -- 172.21.15.123:0/4244011374 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67a406e230 con 0x7f67a41623a0 2024-04-25T13:42:28.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.374+0000 7f67ac600640 1 -- 172.21.15.123:0/4244011374 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67a40507c0 con 0x7f67a41623a0 2024-04-25T13:42:28.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.374+0000 7f67a1600640 1 -- 172.21.15.123:0/4244011374 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f679c01a070 con 0x7f67a41623a0 2024-04-25T13:42:28.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.374+0000 7f67a1600640 1 --2- 172.21.15.123:0/4244011374 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f678406f430 0x7f6784071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:28.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.374+0000 7f67a1600640 1 -- 172.21.15.123:0/4244011374 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f679c08f110 con 0x7f67a41623a0 2024-04-25T13:42:28.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.378+0000 7f67a9c00640 1 --2- 172.21.15.123:0/4244011374 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f678406f430 0x7f6784071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:28.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.378+0000 7f67a9c00640 1 --2- 172.21.15.123:0/4244011374 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f678406f430 0x7f6784071940 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f67980012f0 tx=0x7f6798001690 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:28.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.382+0000 7f67a1600640 1 -- 172.21.15.123:0/4244011374 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f679c05b910 con 0x7f67a41623a0 2024-04-25T13:42:28.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.574+0000 7f67ac600640 1 -- 172.21.15.123:0/4244011374 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f67a415e1b0 con 0x7f67a41623a0 2024-04-25T13:42:28.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.574+0000 7f67a1600640 1 -- 172.21.15.123:0/4244011374 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f679c05fc10 con 0x7f67a41623a0 2024-04-25T13:42:28.573 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T13:42:28.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.574+0000 7f67ac600640 1 -- 172.21.15.123:0/4244011374 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f678406f430 msgr2=0x7f6784071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:28.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.574+0000 7f67ac600640 1 --2- 172.21.15.123:0/4244011374 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f678406f430 0x7f6784071940 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f67980012f0 tx=0x7f6798001690 comp rx=0 tx=0).stop 2024-04-25T13:42:28.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.574+0000 7f67ac600640 1 -- 172.21.15.123:0/4244011374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67a41623a0 msgr2=0x7f67a406ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:28.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.574+0000 7f67ac600640 1 --2- 172.21.15.123:0/4244011374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67a41623a0 0x7f67a406ea30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f679c00e820 tx=0x7f679c00ece0 comp rx=0 tx=0).stop 2024-04-25T13:42:28.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.574+0000 7f67ac600640 1 -- 172.21.15.123:0/4244011374 shutdown_connections 2024-04-25T13:42:28.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.574+0000 7f67ac600640 1 --2- 172.21.15.123:0/4244011374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67a40cec30 0x7f67a415cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:28.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.574+0000 7f67ac600640 1 --2- 172.21.15.123:0/4244011374 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f678406f430 0x7f6784071940 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:28.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.574+0000 7f67ac600640 1 --2- 172.21.15.123:0/4244011374 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f67a41623a0 0x7f67a406ea30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:28.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.574+0000 7f67ac600640 1 --2- 172.21.15.123:0/4244011374 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67a40ce2e0 0x7f67a409e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:28.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.574+0000 7f67ac600640 1 -- 172.21.15.123:0/4244011374 >> 172.21.15.123:0/4244011374 conn(0x7f67a40d0150 msgr2=0x7f67a41681a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:28.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.574+0000 7f67ac600640 1 -- 172.21.15.123:0/4244011374 shutdown_connections 2024-04-25T13:42:28.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:28.574+0000 7f67ac600640 1 -- 172.21.15.123:0/4244011374 wait complete. 2024-04-25T13:42:28.595 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T13:42:28.595 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T13:42:28.595 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi130.front.sepia.ceph.com 2024-04-25T13:42:28.595 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-25T13:42:28.595 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-25T13:42:28.595 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T13:42:28.595 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T13:42:28.595 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T13:42:28.595 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-25T13:42:28.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:28.596 DEBUG:teuthology.orchestra.run.smithi130:> ip addr 2024-04-25T13:42:28.606 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T13:42:28.606 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T13:42:28.606 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T13:42:28.606 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:28.606 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2024-04-25T13:42:28.606 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:28.606 INFO:teuthology.orchestra.run.smithi130.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T13:42:28.606 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:96 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:42:28.606 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f0 2024-04-25T13:42:28.606 INFO:teuthology.orchestra.run.smithi130.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T13:42:28.606 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:97 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:42:28.607 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f1 2024-04-25T13:42:28.607 INFO:teuthology.orchestra.run.smithi130.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T13:42:28.607 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:36 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:42:28.607 INFO:teuthology.orchestra.run.smithi130.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T13:42:28.607 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:37 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:42:28.607 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.21.15.130/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T13:42:28.607 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft 42470sec preferred_lft 42470sec 2024-04-25T13:42:28.607 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::ec4:7aff:fe88:7f37/64 scope link 2024-04-25T13:42:28.607 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:28.607 INFO:teuthology.orchestra.run.smithi130.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T13:42:28.607 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 02:42:a3:19:9f:9a brd ff:ff:ff:ff:ff:ff 2024-04-25T13:42:28.607 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T13:42:28.607 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:28.607 INFO:teuthology.orchestra.run.smithi130.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T13:42:28.608 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T13:42:28.608 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T13:42:28.608 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:28.608 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T13:42:28.608 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:28.608 INFO:teuthology.orchestra.run.smithi130.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T13:42:28.608 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T13:42:28.608 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-04-25T13:42:28.608 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:28.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:28.609 DEBUG:teuthology.orchestra.run.smithi130:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T13:42:28.665 INFO:teuthology.orchestra.run.smithi130.stdout:1 2024-04-25T13:42:28.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:28.667 DEBUG:teuthology.orchestra.run.smithi130:> route 2024-04-25T13:42:28.719 INFO:teuthology.orchestra.run.smithi130.stdout:Kernel IP routing table 2024-04-25T13:42:28.719 INFO:teuthology.orchestra.run.smithi130.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T13:42:28.719 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T13:42:28.719 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T13:42:28.719 INFO:teuthology.orchestra.run.smithi130.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T13:42:28.720 INFO:teuthology.orchestra.run.smithi130.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T13:42:28.720 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T13:42:28.720 INFO:teuthology.orchestra.run.smithi130.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T13:42:28.720 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T13:42:28.720 INFO:teuthology.orchestra.run.smithi130.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T13:42:28.720 INFO:teuthology.orchestra.run.smithi130.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T13:42:28.720 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:42:28.720 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2024-04-25T13:42:28.720 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T13:42:28.721 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T13:42:28.721 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T13:42:28.721 DEBUG:teuthology.orchestra.run.smithi130:> ') 2024-04-25T13:42:28.809 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:42:28.849 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:28.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:28.856 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2024-04-25T13:42:28.865 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T13:42:28.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:28.866 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list-id 2024-04-25T13:42:28.915 INFO:teuthology.orchestra.run.smithi130.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-25T13:42:28.916 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:42:28.916 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2024-04-25T13:42:28.916 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T13:42:28.916 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-25T13:42:28.916 DEBUG:teuthology.orchestra.run.smithi130:> ') 2024-04-25T13:42:29.005 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:42:29.035 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:29.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:29.042 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-25T13:42:29.062 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T13:42:29.062 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T13:42:29.062 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T13:42:29.062 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:29.062 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2024-04-25T13:42:29.062 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:29.062 INFO:teuthology.orchestra.run.smithi130.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T13:42:29.063 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 8e:e5:bd:bb:5a:89 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T13:42:29.063 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T13:42:29.063 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:29.063 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::8ce5:bdff:febb:5a89/64 scope link 2024-04-25T13:42:29.063 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:29.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:29.064 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-25T13:42:29.131 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T13:42:29.131 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T13:42:29.131 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T13:42:29.131 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:29.132 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2024-04-25T13:42:29.132 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:29.132 INFO:teuthology.orchestra.run.smithi130.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T13:42:29.132 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 8e:e5:bd:bb:5a:89 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T13:42:29.132 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T13:42:29.132 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:29.132 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::8ce5:bdff:febb:5a89/64 scope link 2024-04-25T13:42:29.132 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:42:29.133 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-25T13:42:29.134 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:42:29.134 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2024-04-25T13:42:29.134 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-25T13:42:29.134 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-25T13:42:29.134 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-25T13:42:29.134 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-25T13:42:29.134 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-25T13:42:29.134 DEBUG:teuthology.orchestra.run.smithi130:> ') 2024-04-25T13:42:29.221 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:42:29.306 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:29.312 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:42:29.313 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2024-04-25T13:42:29.313 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set brx.1 up 2024-04-25T13:42:29.313 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set dev brx.1 master ceph-brx 2024-04-25T13:42:29.313 DEBUG:teuthology.orchestra.run.smithi130:> ') 2024-04-25T13:42:29.358 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:42:29.388 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:29.394 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:42:29.394 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-25T13:42:29.444 INFO:teuthology.orchestra.run.smithi130.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-25T13:42:29.444 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:42:29.444 DEBUG:teuthology.orchestra.run.smithi130:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-25T13:42:29.495 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T13:42:29.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:29.495 DEBUG:teuthology.orchestra.run.smithi130:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T13:42:29.600 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T13:42:29.600 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T13:42:29.600 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2024-04-25T13:42:29.617 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T13:42:29.617 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T13:42:29.617 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2024-04-25T13:42:29.617 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.130:3300,172.21.15.130:3301" 2024-04-25T13:42:29.618 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T13:42:29.627 INFO:teuthology.orchestra.run.smithi130.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T13:42:29.627 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T13:42:29.628 INFO:teuthology.orchestra.run.smithi130.stdout:invalid new device string format 2024-04-25T13:42:29.628 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.130:3300,172.21.15.130:3301" 2024-04-25T13:42:29.628 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T13:42:29.628 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.130:6789,172.21.15.130:6790" 2024-04-25T13:42:29.628 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.130:6789,172.21.15.130:6790:/ 2024-04-25T13:42:29.628 INFO:teuthology.orchestra.run.smithi130.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=95274ccf-6ec8-480a-933e-b3986da91a7e" will pass to kernel 2024-04-25T13:42:29.631 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T13:42:29.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:29.632 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-25T13:42:29.651 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T13:42:29.738 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T13:42:29.741 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:29.747 INFO:teuthology.orchestra.run.smithi130.stdout:client4502 2024-04-25T13:42:29.747 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:42:29.747 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:42:29.800 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T13:42:29.890 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T13:42:29.892 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:29.899 INFO:teuthology.orchestra.run.smithi130.stdout:client4502 2024-04-25T13:42:29.899 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T13:42:29.945 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T13:42:29.948 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:29.954 INFO:teuthology.orchestra.run.smithi130.stdout:client4502 2024-04-25T13:42:29.955 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/95274ccf-6ec8-480a-933e-b3986da91a7e.client4502/status') 2024-04-25T13:42:30.041 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:42:30.053 INFO:teuthology.orchestra.run.smithi130.stdout:instance: client.4502 (3)192.168.0.2:0/1437373417 2024-04-25T13:42:30.053 INFO:teuthology.orchestra.run.smithi130.stdout:blocklisted: false 2024-04-25T13:42:30.054 INFO:teuthology.orchestra.run.smithi130.stderr:0+1 records in 2024-04-25T13:42:30.054 INFO:teuthology.orchestra.run.smithi130.stderr:0+1 records out 2024-04-25T13:42:30.054 INFO:teuthology.orchestra.run.smithi130.stderr:69 bytes copied, 4.7989e-05 s, 1.4 MB/s 2024-04-25T13:42:30.055 INFO:teuthology.orchestra.run.smithi130.stderr:2024-04-25T13:42:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:42:30.062 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-25T13:42:30.078 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:30.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.233+0000 7f6722600640 1 Processor -- start 2024-04-25T13:42:30.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.233+0000 7f6722600640 1 -- start start 2024-04-25T13:42:30.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.237+0000 7f6722600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f671c0747a0 0x7f671c15fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:30.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.237+0000 7f6722600640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f671c1602e0 0x7f671c072ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:30.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.237+0000 7f6722600640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f671c145d70 con 0x7f671c073010 2024-04-25T13:42:30.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.237+0000 7f6722600640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f671c074290 con 0x7f671c1602e0 2024-04-25T13:42:30.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.237+0000 7f6722600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f671c1606f0 con 0x7f671c0747a0 2024-04-25T13:42:30.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.237+0000 7f671b400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f671c0747a0 0x7f671c15fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:30.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.237+0000 7f671be00640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f671c073010 0x7f671c073420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.123:41002/0 (socket says 172.21.15.123:41002) 2024-04-25T13:42:30.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.237+0000 7f671be00640 1 -- 172.21.15.123:0/515681860 learned_addr learned my addr 172.21.15.123:0/515681860 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:30.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.237+0000 7f6712a00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f671c1602e0 0x7f671c072ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:30.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.237+0000 7f671b400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f671c0747a0 0x7f671c15fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:40538/0 (socket says 172.21.15.123:40538) 2024-04-25T13:42:30.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.237+0000 7f671aa00640 1 -- 172.21.15.123:0/515681860 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1130736984 0 0) 0x7f6714001120 con 0x7f671c073010 2024-04-25T13:42:30.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.237+0000 7f671aa00640 1 -- 172.21.15.123:0/515681860 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6700003530 con 0x7f671c073010 2024-04-25T13:42:30.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.237+0000 7f6712a00640 1 -- 172.21.15.123:0/515681860 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f671c0747a0 msgr2=0x7f671c15fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:30.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.237+0000 7f6712a00640 1 --2- 172.21.15.123:0/515681860 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f671c0747a0 0x7f671c15fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:30.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.237+0000 7f6712a00640 1 -- 172.21.15.123:0/515681860 >> v1:172.21.15.130:6789/0 conn(0x7f671c073010 legacy=0x7f671c073420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:30.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.237+0000 7f6712a00640 1 -- 172.21.15.123:0/515681860 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f671c073c80 con 0x7f671c1602e0 2024-04-25T13:42:30.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.237+0000 7f671b400640 1 --2- 172.21.15.123:0/515681860 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f671c0747a0 0x7f671c15fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:30.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.241+0000 7f6712a00640 1 --2- 172.21.15.123:0/515681860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f671c1602e0 0x7f671c072ad0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f670400aea0 tx=0x7f670401da70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9dbdd545bd39779 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:30.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.241+0000 7f671aa00640 1 -- 172.21.15.123:0/515681860 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67040a67a0 con 0x7f671c1602e0 2024-04-25T13:42:30.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.241+0000 7f671aa00640 1 -- 172.21.15.123:0/515681860 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67040a6940 con 0x7f671c1602e0 2024-04-25T13:42:30.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.241+0000 7f671aa00640 1 -- 172.21.15.123:0/515681860 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67040a6d10 con 0x7f671c1602e0 2024-04-25T13:42:30.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.241+0000 7f6722600640 1 -- 172.21.15.123:0/515681860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f671c1602e0 msgr2=0x7f671c072ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:30.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.241+0000 7f6722600640 1 --2- 172.21.15.123:0/515681860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f671c1602e0 0x7f671c072ad0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f670400aea0 tx=0x7f670401da70 comp rx=0 tx=0).stop 2024-04-25T13:42:30.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.241+0000 7f6722600640 1 -- 172.21.15.123:0/515681860 shutdown_connections 2024-04-25T13:42:30.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.241+0000 7f6722600640 1 --2- 172.21.15.123:0/515681860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f671c1602e0 0x7f671c072ad0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:30.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.241+0000 7f6722600640 1 --2- 172.21.15.123:0/515681860 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f671c0747a0 0x7f671c15fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:30.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.241+0000 7f6722600640 1 -- 172.21.15.123:0/515681860 >> 172.21.15.123:0/515681860 conn(0x7f671c06d210 msgr2=0x7f671c06ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:30.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.241+0000 7f6722600640 1 -- 172.21.15.123:0/515681860 shutdown_connections 2024-04-25T13:42:30.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.241+0000 7f6722600640 1 -- 172.21.15.123:0/515681860 wait complete. 2024-04-25T13:42:30.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.241+0000 7f6722600640 1 Processor -- start 2024-04-25T13:42:30.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.245+0000 7f6722600640 1 -- start start 2024-04-25T13:42:30.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.245+0000 7f6722600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f671c073010 0x7f671c162f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:30.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.245+0000 7f6722600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f671c0747a0 0x7f671c13d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:30.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.245+0000 7f6722600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f671c1602e0 0x7f671c1433d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:30.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.245+0000 7f6722600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f671c0b6380 con 0x7f671c1602e0 2024-04-25T13:42:30.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.245+0000 7f6722600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f671c074bb0 con 0x7f671c0747a0 2024-04-25T13:42:30.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.245+0000 7f6722600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f671c0b6500 con 0x7f671c073010 2024-04-25T13:42:30.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.245+0000 7f671be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f671c1602e0 0x7f671c1433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:30.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.245+0000 7f671b400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f671c073010 0x7f671c162f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:30.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.245+0000 7f671be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f671c1602e0 0x7f671c1433d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48782/0 (socket says 172.21.15.123:48782) 2024-04-25T13:42:30.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.245+0000 7f671be00640 1 -- 172.21.15.123:0/327630484 learned_addr learned my addr 172.21.15.123:0/327630484 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:30.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.245+0000 7f6712a00640 1 --2- 172.21.15.123:0/327630484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f671c0747a0 0x7f671c13d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:30.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.245+0000 7f671b400640 1 -- 172.21.15.123:0/327630484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f671c0747a0 msgr2=0x7f671c13d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:30.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.245+0000 7f671b400640 1 --2- 172.21.15.123:0/327630484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f671c0747a0 0x7f671c13d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:30.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.245+0000 7f671b400640 1 -- 172.21.15.123:0/327630484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f671c1602e0 msgr2=0x7f671c1433d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:30.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.245+0000 7f671b400640 1 --2- 172.21.15.123:0/327630484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f671c1602e0 0x7f671c1433d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:30.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.245+0000 7f671b400640 1 -- 172.21.15.123:0/327630484 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f671c13d800 con 0x7f671c073010 2024-04-25T13:42:30.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.245+0000 7f671b400640 1 --2- 172.21.15.123:0/327630484 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f671c073010 0x7f671c162f70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f670c00e8e0 tx=0x7f670c00eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:30.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.245+0000 7f6713e00640 1 -- 172.21.15.123:0/327630484 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670c017070 con 0x7f671c073010 2024-04-25T13:42:30.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.245+0000 7f6713e00640 1 -- 172.21.15.123:0/327630484 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f670c00c8e0 con 0x7f671c073010 2024-04-25T13:42:30.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.245+0000 7f6722600640 1 -- 172.21.15.123:0/327630484 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f671c1615d0 con 0x7f671c073010 2024-04-25T13:42:30.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.245+0000 7f6713e00640 1 -- 172.21.15.123:0/327630484 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670c00ccd0 con 0x7f671c073010 2024-04-25T13:42:30.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.245+0000 7f6722600640 1 -- 172.21.15.123:0/327630484 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f671c161b90 con 0x7f671c073010 2024-04-25T13:42:30.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.245+0000 7f6722600640 1 -- 172.21.15.123:0/327630484 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f671c0507c0 con 0x7f671c073010 2024-04-25T13:42:30.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.249+0000 7f6713e00640 1 -- 172.21.15.123:0/327630484 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f670c01a070 con 0x7f671c073010 2024-04-25T13:42:30.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.249+0000 7f6713e00640 1 --2- 172.21.15.123:0/327630484 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f66f806f400 0x7f66f8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:30.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.249+0000 7f6713e00640 1 -- 172.21.15.123:0/327630484 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f670c08f450 con 0x7f671c073010 2024-04-25T13:42:30.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.249+0000 7f6712a00640 1 --2- 172.21.15.123:0/327630484 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f66f806f400 0x7f66f8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:30.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.249+0000 7f6712a00640 1 --2- 172.21.15.123:0/327630484 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f66f806f400 0x7f66f8071910 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f67040af000 tx=0x7f67040a8070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:30.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.253+0000 7f6713e00640 1 -- 172.21.15.123:0/327630484 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f670c05bc50 con 0x7f671c073010 2024-04-25T13:42:30.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.413+0000 7f6722600640 1 -- 172.21.15.123:0/327630484 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f671c0b6780 con 0x7f671c073010 2024-04-25T13:42:30.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.417+0000 7f6713e00640 1 -- 172.21.15.123:0/327630484 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16629 (secure 0 0 0) 0x7f670c05ff50 con 0x7f671c073010 2024-04-25T13:42:30.417 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:30.417 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:42:07.405529+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:03.949161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:04.755682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:30.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.417+0000 7f6722600640 1 -- 172.21.15.123:0/327630484 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f66f806f400 msgr2=0x7f66f8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:30.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.417+0000 7f6722600640 1 --2- 172.21.15.123:0/327630484 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f66f806f400 0x7f66f8071910 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f67040af000 tx=0x7f67040a8070 comp rx=0 tx=0).stop 2024-04-25T13:42:30.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.417+0000 7f6722600640 1 -- 172.21.15.123:0/327630484 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f671c073010 msgr2=0x7f671c162f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:30.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.417+0000 7f6722600640 1 --2- 172.21.15.123:0/327630484 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f671c073010 0x7f671c162f70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f670c00e8e0 tx=0x7f670c00eda0 comp rx=0 tx=0).stop 2024-04-25T13:42:30.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.417+0000 7f6722600640 1 -- 172.21.15.123:0/327630484 shutdown_connections 2024-04-25T13:42:30.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.417+0000 7f6722600640 1 --2- 172.21.15.123:0/327630484 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f671c0747a0 0x7f671c13d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:30.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.417+0000 7f6722600640 1 --2- 172.21.15.123:0/327630484 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f66f806f400 0x7f66f8071910 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:30.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.417+0000 7f6722600640 1 --2- 172.21.15.123:0/327630484 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f671c1602e0 0x7f671c1433d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:30.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.417+0000 7f6722600640 1 --2- 172.21.15.123:0/327630484 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f671c073010 0x7f671c162f70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:30.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.417+0000 7f6722600640 1 -- 172.21.15.123:0/327630484 >> 172.21.15.123:0/327630484 conn(0x7f671c06d210 msgr2=0x7f671c06ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:30.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.417+0000 7f6722600640 1 -- 172.21.15.123:0/327630484 shutdown_connections 2024-04-25T13:42:30.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.417+0000 7f6722600640 1 -- 172.21.15.123:0/327630484 wait complete. 2024-04-25T13:42:30.441 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:41:53.602480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:42:03.949161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:42:04.755682+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:42:30.441 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:42:30.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.589+0000 7f6a7b400640 1 Processor -- start 2024-04-25T13:42:30.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.589+0000 7f6a7b400640 1 -- start start 2024-04-25T13:42:30.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.593+0000 7f6a7b400640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6a740cdeb0 0x7f6a740ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:30.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.593+0000 7f6a7b400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a740ce800 con 0x7f6a741534e0 2024-04-25T13:42:30.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.593+0000 7f6a7b400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a741538f0 con 0x7f6a740b4770 2024-04-25T13:42:30.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.593+0000 7f6a7b400640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f6a74074a50 con 0x7f6a740cdeb0 2024-04-25T13:42:30.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.593+0000 7f6a78a00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6a741534e0 0x7f6a74074240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60722/0 (socket says 172.21.15.123:60722) 2024-04-25T13:42:30.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.593+0000 7f6a78a00640 1 -- 172.21.15.123:0/1805165297 learned_addr learned my addr 172.21.15.123:0/1805165297 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:30.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.593+0000 7f6a6be00640 1 --2- 172.21.15.123:0/1805165297 >> v2:172.21.15.130:3300/0 conn(0x7f6a740cdeb0 0x7f6a740ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:30.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.593+0000 7f6a73e00640 1 -- 172.21.15.123:0/1805165297 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 491721416 0 0) 0x7f6a64001120 con 0x7f6a741534e0 2024-04-25T13:42:30.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.593+0000 7f6a73e00640 1 -- 172.21.15.123:0/1805165297 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a58003530 con 0x7f6a741534e0 2024-04-25T13:42:30.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.593+0000 7f6a73e00640 1 -- 172.21.15.123:0/1805165297 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3905024020 0 0) 0x7f6a741538f0 con 0x7f6a740b4770 2024-04-25T13:42:30.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.593+0000 7f6a73e00640 1 -- 172.21.15.123:0/1805165297 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a64001120 con 0x7f6a740b4770 2024-04-25T13:42:30.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.593+0000 7f6a6be00640 1 -- 172.21.15.123:0/1805165297 >> v1:172.21.15.130:6789/0 conn(0x7f6a740b4770 legacy=0x7f6a740b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:30.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.593+0000 7f6a73e00640 1 -- 172.21.15.123:0/1805165297 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 31891993 0 0) 0x7f6a58003530 con 0x7f6a741534e0 2024-04-25T13:42:30.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.593+0000 7f6a6be00640 1 -- 172.21.15.123:0/1805165297 >> v1:172.21.15.123:6789/0 conn(0x7f6a741534e0 legacy=0x7f6a74074240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:30.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.593+0000 7f6a6be00640 1 -- 172.21.15.123:0/1805165297 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a7415cde0 con 0x7f6a740cdeb0 2024-04-25T13:42:30.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.597+0000 7f6a6be00640 1 --2- 172.21.15.123:0/1805165297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a740cdeb0 0x7f6a740ce2c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c00a960 tx=0x7f6a5c01c600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c9bed9eefac6224 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:30.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.597+0000 7f6a73e00640 1 -- 172.21.15.123:0/1805165297 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a64001850 con 0x7f6a740cdeb0 2024-04-25T13:42:30.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.597+0000 7f6a73e00640 1 -- 172.21.15.123:0/1805165297 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a5c0af070 con 0x7f6a740cdeb0 2024-04-25T13:42:30.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.597+0000 7f6a73e00640 1 -- 172.21.15.123:0/1805165297 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c00b040 con 0x7f6a740cdeb0 2024-04-25T13:42:30.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.597+0000 7f6a7b400640 1 -- 172.21.15.123:0/1805165297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a740cdeb0 msgr2=0x7f6a740ce2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:30.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.597+0000 7f6a7b400640 1 --2- 172.21.15.123:0/1805165297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a740cdeb0 0x7f6a740ce2c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c00a960 tx=0x7f6a5c01c600 comp rx=0 tx=0).stop 2024-04-25T13:42:30.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.597+0000 7f6a7b400640 1 -- 172.21.15.123:0/1805165297 shutdown_connections 2024-04-25T13:42:30.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.597+0000 7f6a7b400640 1 --2- 172.21.15.123:0/1805165297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a740cdeb0 0x7f6a740ce2c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:30.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.597+0000 7f6a7b400640 1 -- 172.21.15.123:0/1805165297 >> 172.21.15.123:0/1805165297 conn(0x7f6a7406ca70 msgr2=0x7f6a7406ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:30.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.597+0000 7f6a7b400640 1 -- 172.21.15.123:0/1805165297 shutdown_connections 2024-04-25T13:42:30.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.597+0000 7f6a7b400640 1 -- 172.21.15.123:0/1805165297 wait complete. 2024-04-25T13:42:30.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.601+0000 7f6a7b400640 1 Processor -- start 2024-04-25T13:42:30.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.601+0000 7f6a7b400640 1 -- start start 2024-04-25T13:42:30.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.601+0000 7f6a7b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a740b4770 0x7f6a74154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:30.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.601+0000 7f6a7b400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6a740cdeb0 0x7f6a740c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:30.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.601+0000 7f6a7b400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a741534e0 0x7f6a740c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:30.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.601+0000 7f6a7b400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7415da40 con 0x7f6a741534e0 2024-04-25T13:42:30.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.601+0000 7f6a7b400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6a7415d8c0 con 0x7f6a740b4770 2024-04-25T13:42:30.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.601+0000 7f6a7b400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f6a7415ca40 con 0x7f6a740cdeb0 2024-04-25T13:42:30.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.601+0000 7f6a79400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a741534e0 0x7f6a740c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:30.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.601+0000 7f6a79400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a741534e0 0x7f6a740c7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48792/0 (socket says 172.21.15.123:48792) 2024-04-25T13:42:30.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.601+0000 7f6a79400640 1 -- 172.21.15.123:0/2837568747 learned_addr learned my addr 172.21.15.123:0/2837568747 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:30.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.601+0000 7f6a78a00640 1 --2- 172.21.15.123:0/2837568747 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a740b4770 0x7f6a74154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:30.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.601+0000 7f6a6be00640 1 --2- 172.21.15.123:0/2837568747 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6a740cdeb0 0x7f6a740c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:30.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.601+0000 7f6a79400640 1 -- 172.21.15.123:0/2837568747 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6a740cdeb0 msgr2=0x7f6a740c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:30.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.601+0000 7f6a79400640 1 --2- 172.21.15.123:0/2837568747 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6a740cdeb0 0x7f6a740c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:30.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.601+0000 7f6a79400640 1 -- 172.21.15.123:0/2837568747 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a740b4770 msgr2=0x7f6a74154300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:30.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.601+0000 7f6a79400640 1 --2- 172.21.15.123:0/2837568747 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a740b4770 0x7f6a74154300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:30.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.601+0000 7f6a79400640 1 -- 172.21.15.123:0/2837568747 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a74154840 con 0x7f6a741534e0 2024-04-25T13:42:30.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.601+0000 7f6a6be00640 1 --2- 172.21.15.123:0/2837568747 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6a740cdeb0 0x7f6a740c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:30.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.601+0000 7f6a78a00640 1 --2- 172.21.15.123:0/2837568747 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a740b4770 0x7f6a74154300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:30.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.601+0000 7f6a79400640 1 --2- 172.21.15.123:0/2837568747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a741534e0 0x7f6a740c7c50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00c6c0 tx=0x7f6a6c00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:30.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.601+0000 7f6a71600640 1 -- 172.21.15.123:0/2837568747 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c003b80 con 0x7f6a741534e0 2024-04-25T13:42:30.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.601+0000 7f6a71600640 1 -- 172.21.15.123:0/2837568747 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a6c003d20 con 0x7f6a741534e0 2024-04-25T13:42:30.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.601+0000 7f6a7b400640 1 -- 172.21.15.123:0/2837568747 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a74154cc0 con 0x7f6a741534e0 2024-04-25T13:42:30.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.601+0000 7f6a71600640 1 -- 172.21.15.123:0/2837568747 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a6c0052f0 con 0x7f6a741534e0 2024-04-25T13:42:30.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.601+0000 7f6a7b400640 1 -- 172.21.15.123:0/2837568747 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a74155280 con 0x7f6a741534e0 2024-04-25T13:42:30.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.605+0000 7f6a7b400640 1 -- 172.21.15.123:0/2837568747 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a74154a10 con 0x7f6a741534e0 2024-04-25T13:42:30.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.605+0000 7f6a71600640 1 -- 172.21.15.123:0/2837568747 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6a6c005490 con 0x7f6a741534e0 2024-04-25T13:42:30.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.605+0000 7f6a71600640 1 --2- 172.21.15.123:0/2837568747 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f6a5006f400 0x7f6a50071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:30.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.605+0000 7f6a71600640 1 -- 172.21.15.123:0/2837568747 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6a6c08f2b0 con 0x7f6a741534e0 2024-04-25T13:42:30.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.605+0000 7f6a78a00640 1 --2- 172.21.15.123:0/2837568747 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f6a5006f400 0x7f6a50071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:30.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.605+0000 7f6a78a00640 1 --2- 172.21.15.123:0/2837568747 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f6a5006f400 0x7f6a50071910 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6a64001ec0 tx=0x7f6a64009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:30.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.609+0000 7f6a71600640 1 -- 172.21.15.123:0/2837568747 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6a6c05c100 con 0x7f6a741534e0 2024-04-25T13:42:30.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.769+0000 7f6a7b400640 1 -- 172.21.15.123:0/2837568747 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6a74050750 con 0x7f6a741534e0 2024-04-25T13:42:30.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.769+0000 7f6a71600640 1 -- 172.21.15.123:0/2837568747 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f6a6c064180 con 0x7f6a741534e0 2024-04-25T13:42:30.770 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-04-25T13:42:30.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.773+0000 7f6a7b400640 1 -- 172.21.15.123:0/2837568747 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f6a5006f400 msgr2=0x7f6a50071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:30.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.773+0000 7f6a7b400640 1 --2- 172.21.15.123:0/2837568747 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f6a5006f400 0x7f6a50071910 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6a64001ec0 tx=0x7f6a64009040 comp rx=0 tx=0).stop 2024-04-25T13:42:30.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.773+0000 7f6a7b400640 1 -- 172.21.15.123:0/2837568747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a741534e0 msgr2=0x7f6a740c7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:30.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.773+0000 7f6a7b400640 1 --2- 172.21.15.123:0/2837568747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a741534e0 0x7f6a740c7c50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c00c6c0 tx=0x7f6a6c00cb80 comp rx=0 tx=0).stop 2024-04-25T13:42:30.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.773+0000 7f6a7b400640 1 -- 172.21.15.123:0/2837568747 shutdown_connections 2024-04-25T13:42:30.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.773+0000 7f6a7b400640 1 --2- 172.21.15.123:0/2837568747 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f6a5006f400 0x7f6a50071910 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:30.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.773+0000 7f6a7b400640 1 --2- 172.21.15.123:0/2837568747 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6a741534e0 0x7f6a740c7c50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:30.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.773+0000 7f6a7b400640 1 --2- 172.21.15.123:0/2837568747 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6a740cdeb0 0x7f6a740c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:30.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.773+0000 7f6a7b400640 1 --2- 172.21.15.123:0/2837568747 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6a740b4770 0x7f6a74154300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:30.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.773+0000 7f6a7b400640 1 -- 172.21.15.123:0/2837568747 >> 172.21.15.123:0/2837568747 conn(0x7f6a7406ca70 msgr2=0x7f6a7415b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:30.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.773+0000 7f6a7b400640 1 -- 172.21.15.123:0/2837568747 shutdown_connections 2024-04-25T13:42:30.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.773+0000 7f6a7b400640 1 -- 172.21.15.123:0/2837568747 wait complete. 2024-04-25T13:42:30.792 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:42:30.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.941+0000 7f7ba0a00640 1 Processor -- start 2024-04-25T13:42:30.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.941+0000 7f7ba0a00640 1 -- start start 2024-04-25T13:42:30.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.941+0000 7f7ba0a00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7b9c0ce740 0x7f7b9c0ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:30.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.941+0000 7f7ba0a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b9c0d0c80 con 0x7f7b9c0d1d70 2024-04-25T13:42:30.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.941+0000 7f7ba0a00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b9c0b8cd0 con 0x7f7b9c06e5a0 2024-04-25T13:42:30.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.941+0000 7f7ba0a00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f7b9c09cf90 con 0x7f7b9c0ce740 2024-04-25T13:42:30.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.941+0000 7f7b9a800640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7b9c0d1d70 0x7f7b9c0d2180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60726/0 (socket says 172.21.15.123:60726) 2024-04-25T13:42:30.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.941+0000 7f7b9a800640 1 -- 172.21.15.123:0/3761446156 learned_addr learned my addr 172.21.15.123:0/3761446156 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:30.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.941+0000 7f7b91400640 1 --2- 172.21.15.123:0/3761446156 >> v2:172.21.15.130:3300/0 conn(0x7f7b9c0ce740 0x7f7b9c0ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:30.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.941+0000 7f7b99400640 1 -- 172.21.15.123:0/3761446156 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1634905024 0 0) 0x7f7b9c0d0c80 con 0x7f7b9c0d1d70 2024-04-25T13:42:30.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.941+0000 7f7b99400640 1 -- 172.21.15.123:0/3761446156 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b80003530 con 0x7f7b9c0d1d70 2024-04-25T13:42:30.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.941+0000 7f7b99400640 1 -- 172.21.15.123:0/3761446156 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1466283971 0 0) 0x7f7b9c0b8cd0 con 0x7f7b9c06e5a0 2024-04-25T13:42:30.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.941+0000 7f7b99400640 1 -- 172.21.15.123:0/3761446156 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b9c0d0c80 con 0x7f7b9c06e5a0 2024-04-25T13:42:30.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.941+0000 7f7b99400640 1 -- 172.21.15.123:0/3761446156 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2621983490 0 0) 0x7f7b80003530 con 0x7f7b9c0d1d70 2024-04-25T13:42:30.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.945+0000 7f7b99400640 1 -- 172.21.15.123:0/3761446156 >> v2:172.21.15.130:3300/0 conn(0x7f7b9c0ce740 msgr2=0x7f7b9c0ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:30.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.945+0000 7f7b99400640 1 --2- 172.21.15.123:0/3761446156 >> v2:172.21.15.130:3300/0 conn(0x7f7b9c0ce740 0x7f7b9c0ceb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:30.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.945+0000 7f7b99400640 1 -- 172.21.15.123:0/3761446156 >> v1:172.21.15.130:6789/0 conn(0x7f7b9c06e5a0 legacy=0x7f7b9c06e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:30.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.945+0000 7f7b99400640 1 -- 172.21.15.123:0/3761446156 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b9c06de80 con 0x7f7b9c0d1d70 2024-04-25T13:42:30.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.945+0000 7f7b99400640 1 -- 172.21.15.123:0/3761446156 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7f7b94001a00 con 0x7f7b9c0d1d70 2024-04-25T13:42:30.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.945+0000 7f7b99400640 1 -- 172.21.15.123:0/3761446156 >> v1:172.21.15.123:6789/0 conn(0x7f7b9c0d1d70 legacy=0x7f7b9c0d2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:30.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.945+0000 7f7b99400640 1 --2- 172.21.15.123:0/3761446156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b80003c30 0x7f7b80004080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:30.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.945+0000 7f7b99400640 1 --2- 172.21.15.123:0/3761446156 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7b80004810 0x7f7b80004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:30.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.945+0000 7f7b99400640 1 --2- 172.21.15.123:0/3761446156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b80005290 0x7f7b8000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:30.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.945+0000 7f7b99400640 1 -- 172.21.15.123:0/3761446156 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8000c210 con 0x7f7b80005290 2024-04-25T13:42:30.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.945+0000 7f7b99400640 1 -- 172.21.15.123:0/3761446156 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8000c3c0 con 0x7f7b80003c30 2024-04-25T13:42:30.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.945+0000 7f7b99400640 1 -- 172.21.15.123:0/3761446156 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7b8000c5c0 con 0x7f7b80004810 2024-04-25T13:42:30.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.945+0000 7f7b9a800640 1 --2- 172.21.15.123:0/3761446156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b80005290 0x7f7b8000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:30.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.945+0000 7f7b99e00640 1 --2- 172.21.15.123:0/3761446156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b80003c30 0x7f7b80004080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:30.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.945+0000 7f7b91400640 1 --2- 172.21.15.123:0/3761446156 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7b80004810 0x7f7b80004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:30.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.945+0000 7f7b9a800640 1 -- 172.21.15.123:0/3761446156 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7b80004810 msgr2=0x7f7b80004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:30.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.945+0000 7f7b9a800640 1 --2- 172.21.15.123:0/3761446156 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7b80004810 0x7f7b80004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:30.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.945+0000 7f7b9a800640 1 -- 172.21.15.123:0/3761446156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b80003c30 msgr2=0x7f7b80004080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:30.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.945+0000 7f7b9a800640 1 --2- 172.21.15.123:0/3761446156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b80003c30 0x7f7b80004080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:30.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.945+0000 7f7b9a800640 1 -- 172.21.15.123:0/3761446156 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b80003530 con 0x7f7b80005290 2024-04-25T13:42:30.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.945+0000 7f7b9a800640 1 -- 172.21.15.123:0/3761446156 reap_dead start 2024-04-25T13:42:30.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.945+0000 7f7b9a800640 1 --2- 172.21.15.123:0/3761446156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b80005290 0x7f7b8000b9d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c074d90 tx=0x7f7b9401fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4635b7cec8971bce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:30.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.949+0000 7f7b99400640 1 -- 172.21.15.123:0/3761446156 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9400a450 con 0x7f7b80005290 2024-04-25T13:42:30.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.949+0000 7f7b99400640 1 -- 172.21.15.123:0/3761446156 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b940aa6b0 con 0x7f7b80005290 2024-04-25T13:42:30.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.949+0000 7f7b99400640 1 -- 172.21.15.123:0/3761446156 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b940aaaa0 con 0x7f7b80005290 2024-04-25T13:42:30.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.949+0000 7f7ba0a00640 1 -- 172.21.15.123:0/3761446156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b80005290 msgr2=0x7f7b8000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:30.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.949+0000 7f7ba0a00640 1 --2- 172.21.15.123:0/3761446156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b80005290 0x7f7b8000b9d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c074d90 tx=0x7f7b9401fa60 comp rx=0 tx=0).stop 2024-04-25T13:42:30.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.949+0000 7f7ba0a00640 1 -- 172.21.15.123:0/3761446156 shutdown_connections 2024-04-25T13:42:30.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.949+0000 7f7ba0a00640 1 --2- 172.21.15.123:0/3761446156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b80005290 0x7f7b8000b9d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:30.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.949+0000 7f7ba0a00640 1 -- 172.21.15.123:0/3761446156 >> 172.21.15.123:0/3761446156 conn(0x7f7b9c0d0160 msgr2=0x7f7b9c0d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:30.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.949+0000 7f7ba0a00640 1 -- 172.21.15.123:0/3761446156 shutdown_connections 2024-04-25T13:42:30.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.949+0000 7f7ba0a00640 1 -- 172.21.15.123:0/3761446156 wait complete. 2024-04-25T13:42:30.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.949+0000 7f7ba0a00640 1 Processor -- start 2024-04-25T13:42:30.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.949+0000 7f7ba0a00640 1 -- start start 2024-04-25T13:42:30.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.953+0000 7f7ba0a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7b80005290 0x7f7b9c14fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:30.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.953+0000 7f7ba0a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b9c159a40 0x7f7b9c159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:30.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.953+0000 7f7ba0a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b9c15af60 0x7f7b9c15b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:30.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.953+0000 7f7ba0a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7b9c09ccb0 con 0x7f7b9c15af60 2024-04-25T13:42:30.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.953+0000 7f7ba0a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7b9c06e050 con 0x7f7b9c159a40 2024-04-25T13:42:30.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.953+0000 7f7ba0a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7b9c0d3330 con 0x7f7b80005290 2024-04-25T13:42:30.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.953+0000 7f7b9a800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b9c15af60 0x7f7b9c15b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:30.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.953+0000 7f7b9a800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b9c15af60 0x7f7b9c15b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48796/0 (socket says 172.21.15.123:48796) 2024-04-25T13:42:30.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.953+0000 7f7b9a800640 1 -- 172.21.15.123:0/766293567 learned_addr learned my addr 172.21.15.123:0/766293567 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:30.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.953+0000 7f7b99e00640 1 --2- 172.21.15.123:0/766293567 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7b80005290 0x7f7b9c14fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:30.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.953+0000 7f7b91400640 1 --2- 172.21.15.123:0/766293567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b9c159a40 0x7f7b9c159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:30.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.953+0000 7f7b9a800640 1 -- 172.21.15.123:0/766293567 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7b80005290 msgr2=0x7f7b9c14fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:30.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.953+0000 7f7b9a800640 1 --2- 172.21.15.123:0/766293567 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7b80005290 0x7f7b9c14fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:30.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.953+0000 7f7b9a800640 1 -- 172.21.15.123:0/766293567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b9c159a40 msgr2=0x7f7b9c159e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:30.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.953+0000 7f7b9a800640 1 --2- 172.21.15.123:0/766293567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b9c159a40 0x7f7b9c159e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:30.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.953+0000 7f7b9a800640 1 -- 172.21.15.123:0/766293567 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b9c15b8b0 con 0x7f7b9c15af60 2024-04-25T13:42:30.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.953+0000 7f7b9a800640 1 --2- 172.21.15.123:0/766293567 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b9c15af60 0x7f7b9c15b370 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7b9400a030 tx=0x7f7b80005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:30.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.953+0000 7f7b92a00640 1 -- 172.21.15.123:0/766293567 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b940bb070 con 0x7f7b9c15af60 2024-04-25T13:42:30.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.953+0000 7f7b92a00640 1 -- 172.21.15.123:0/766293567 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b940aa860 con 0x7f7b9c15af60 2024-04-25T13:42:30.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.953+0000 7f7b92a00640 1 -- 172.21.15.123:0/766293567 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b94001f80 con 0x7f7b9c15af60 2024-04-25T13:42:30.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.953+0000 7f7ba0a00640 1 -- 172.21.15.123:0/766293567 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b9c14ff50 con 0x7f7b9c15af60 2024-04-25T13:42:30.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.953+0000 7f7ba0a00640 1 -- 172.21.15.123:0/766293567 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b9c15cdf0 con 0x7f7b9c15af60 2024-04-25T13:42:30.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.953+0000 7f7ba0a00640 1 -- 172.21.15.123:0/766293567 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b9c050750 con 0x7f7b9c15af60 2024-04-25T13:42:30.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.957+0000 7f7b92a00640 1 -- 172.21.15.123:0/766293567 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7b940be070 con 0x7f7b9c15af60 2024-04-25T13:42:30.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.957+0000 7f7b92a00640 1 --2- 172.21.15.123:0/766293567 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f7b7806f430 0x7f7b78071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:30.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.957+0000 7f7b92a00640 1 -- 172.21.15.123:0/766293567 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7b9412c1b0 con 0x7f7b9c15af60 2024-04-25T13:42:30.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.957+0000 7f7b99e00640 1 --2- 172.21.15.123:0/766293567 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f7b7806f430 0x7f7b78071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:30.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.957+0000 7f7b99e00640 1 --2- 172.21.15.123:0/766293567 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f7b7806f430 0x7f7b78071940 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c000fc0 tx=0x7f7b8c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:30.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:30.961+0000 7f7b92a00640 1 -- 172.21.15.123:0/766293567 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7b9c15b8b0 con 0x7f7b9c15af60 2024-04-25T13:42:31.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.117+0000 7f7ba0a00640 1 -- 172.21.15.123:0/766293567 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7b9c0cd510 con 0x7f7b9c15af60 2024-04-25T13:42:31.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.117+0000 7f7b92a00640 1 -- 172.21.15.123:0/766293567 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f7b94019770 con 0x7f7b9c15af60 2024-04-25T13:42:31.119 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-04-25T13:42:31.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.121+0000 7f7ba0a00640 1 -- 172.21.15.123:0/766293567 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f7b7806f430 msgr2=0x7f7b78071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.121+0000 7f7ba0a00640 1 --2- 172.21.15.123:0/766293567 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f7b7806f430 0x7f7b78071940 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7b8c000fc0 tx=0x7f7b8c009040 comp rx=0 tx=0).stop 2024-04-25T13:42:31.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.121+0000 7f7ba0a00640 1 -- 172.21.15.123:0/766293567 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b9c15af60 msgr2=0x7f7b9c15b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.121+0000 7f7ba0a00640 1 --2- 172.21.15.123:0/766293567 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b9c15af60 0x7f7b9c15b370 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7b9400a030 tx=0x7f7b80005840 comp rx=0 tx=0).stop 2024-04-25T13:42:31.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.121+0000 7f7ba0a00640 1 -- 172.21.15.123:0/766293567 shutdown_connections 2024-04-25T13:42:31.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.121+0000 7f7ba0a00640 1 --2- 172.21.15.123:0/766293567 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7b9c159a40 0x7f7b9c159e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.121+0000 7f7ba0a00640 1 --2- 172.21.15.123:0/766293567 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f7b7806f430 0x7f7b78071940 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.121+0000 7f7ba0a00640 1 --2- 172.21.15.123:0/766293567 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b9c15af60 0x7f7b9c15b370 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.121+0000 7f7ba0a00640 1 --2- 172.21.15.123:0/766293567 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7b80005290 0x7f7b9c14fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.121+0000 7f7ba0a00640 1 -- 172.21.15.123:0/766293567 >> 172.21.15.123:0/766293567 conn(0x7f7b9c0d0160 msgr2=0x7f7b9c0725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:31.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.121+0000 7f7ba0a00640 1 -- 172.21.15.123:0/766293567 shutdown_connections 2024-04-25T13:42:31.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.121+0000 7f7ba0a00640 1 -- 172.21.15.123:0/766293567 wait complete. 2024-04-25T13:42:31.141 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:42:31.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.289+0000 7f4cc6400640 1 Processor -- start 2024-04-25T13:42:31.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.289+0000 7f4cc6400640 1 -- start start 2024-04-25T13:42:31.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cc6400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cc0165840 0x7f4cc0167c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:31.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cc6400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cc00cdee0 con 0x7f4cc01571b0 2024-04-25T13:42:31.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cc6400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cc015d570 con 0x7f4cc00b3870 2024-04-25T13:42:31.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cc6400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4cc015d850 con 0x7f4cc0165840 2024-04-25T13:42:31.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cbf400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4cc01571b0 0x7f4cc00cd6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60734/0 (socket says 172.21.15.123:60734) 2024-04-25T13:42:31.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cbf400640 1 -- 172.21.15.123:0/4148190348 learned_addr learned my addr 172.21.15.123:0/4148190348 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:31.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cbfe00640 1 --2- 172.21.15.123:0/4148190348 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cc0165840 0x7f4cc0167c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:31.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cbea00640 1 -- 172.21.15.123:0/4148190348 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2400233143 0 0) 0x7f4cc00cdee0 con 0x7f4cc01571b0 2024-04-25T13:42:31.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cbea00640 1 -- 172.21.15.123:0/4148190348 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ca4003530 con 0x7f4cc01571b0 2024-04-25T13:42:31.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cbea00640 1 -- 172.21.15.123:0/4148190348 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1247066454 0 0) 0x7f4cc015d570 con 0x7f4cc00b3870 2024-04-25T13:42:31.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cbea00640 1 -- 172.21.15.123:0/4148190348 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cc00cdee0 con 0x7f4cc00b3870 2024-04-25T13:42:31.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cbea00640 1 -- 172.21.15.123:0/4148190348 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2270093965 0 0) 0x7f4ca4003530 con 0x7f4cc01571b0 2024-04-25T13:42:31.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cbea00640 1 -- 172.21.15.123:0/4148190348 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cc0165840 msgr2=0x7f4cc0167c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:31.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cbea00640 1 --2- 172.21.15.123:0/4148190348 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cc0165840 0x7f4cc0167c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cbea00640 1 -- 172.21.15.123:0/4148190348 >> v1:172.21.15.130:6789/0 conn(0x7f4cc00b3870 legacy=0x7f4cc00b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cbea00640 1 -- 172.21.15.123:0/4148190348 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc015db30 con 0x7f4cc01571b0 2024-04-25T13:42:31.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cbea00640 1 -- 172.21.15.123:0/4148190348 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7f4cb00016a0 con 0x7f4cc01571b0 2024-04-25T13:42:31.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cbea00640 1 -- 172.21.15.123:0/4148190348 >> v1:172.21.15.123:6789/0 conn(0x7f4cc01571b0 legacy=0x7f4cc00cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cbea00640 1 --2- 172.21.15.123:0/4148190348 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ca4003c60 0x7f4ca40040b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:31.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cbea00640 1 --2- 172.21.15.123:0/4148190348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ca4004810 0x7f4ca4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:31.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cbea00640 1 --2- 172.21.15.123:0/4148190348 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cc0165840 0x7f4ca400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:31.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cbea00640 1 -- 172.21.15.123:0/4148190348 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc015d850 con 0x7f4ca4004810 2024-04-25T13:42:31.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cbea00640 1 -- 172.21.15.123:0/4148190348 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca40055b0 con 0x7f4ca4003c60 2024-04-25T13:42:31.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cbea00640 1 -- 172.21.15.123:0/4148190348 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4ca400bf10 con 0x7f4cc0165840 2024-04-25T13:42:31.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cb6a00640 1 --2- 172.21.15.123:0/4148190348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ca4004810 0x7f4ca4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:31.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cbf400640 1 --2- 172.21.15.123:0/4148190348 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ca4003c60 0x7f4ca40040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:31.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cbfe00640 1 --2- 172.21.15.123:0/4148190348 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cc0165840 0x7f4ca400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:31.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cb6a00640 1 -- 172.21.15.123:0/4148190348 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cc0165840 msgr2=0x7f4ca400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:31.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cb6a00640 1 --2- 172.21.15.123:0/4148190348 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4cc0165840 0x7f4ca400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cb6a00640 1 -- 172.21.15.123:0/4148190348 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ca4003c60 msgr2=0x7f4ca40040b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:31.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cb6a00640 1 --2- 172.21.15.123:0/4148190348 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ca4003c60 0x7f4ca40040b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.293+0000 7f4cb6a00640 1 -- 172.21.15.123:0/4148190348 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca4003530 con 0x7f4ca4004810 2024-04-25T13:42:31.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.297+0000 7f4cb6a00640 1 --2- 172.21.15.123:0/4148190348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ca4004810 0x7f4ca4004c40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4cc00cde10 tx=0x7f4ca801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4243dcd3e1d1df0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:31.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.297+0000 7f4cbea00640 1 -- 172.21.15.123:0/4148190348 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8001520 con 0x7f4ca4004810 2024-04-25T13:42:31.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.297+0000 7f4cbea00640 1 -- 172.21.15.123:0/4148190348 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca80052f0 con 0x7f4ca4004810 2024-04-25T13:42:31.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.297+0000 7f4cbea00640 1 -- 172.21.15.123:0/4148190348 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8003840 con 0x7f4ca4004810 2024-04-25T13:42:31.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.297+0000 7f4cc6400640 1 -- 172.21.15.123:0/4148190348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ca4004810 msgr2=0x7f4ca4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.297+0000 7f4cc6400640 1 --2- 172.21.15.123:0/4148190348 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ca4004810 0x7f4ca4004c40 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4cc00cde10 tx=0x7f4ca801c560 comp rx=0 tx=0).stop 2024-04-25T13:42:31.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.297+0000 7f4cbfe00640 1 -- 172.21.15.123:0/4148190348 reap_dead start 2024-04-25T13:42:31.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.297+0000 7f4cc6400640 1 -- 172.21.15.123:0/4148190348 shutdown_connections 2024-04-25T13:42:31.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.297+0000 7f4cc6400640 1 -- 172.21.15.123:0/4148190348 >> 172.21.15.123:0/4148190348 conn(0x7f4cc006ca70 msgr2=0x7f4cc006ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:31.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.297+0000 7f4cc6400640 1 -- 172.21.15.123:0/4148190348 shutdown_connections 2024-04-25T13:42:31.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.297+0000 7f4cc6400640 1 -- 172.21.15.123:0/4148190348 wait complete. 2024-04-25T13:42:31.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.301+0000 7f4cc6400640 1 Processor -- start 2024-04-25T13:42:31.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.301+0000 7f4cc6400640 1 -- start start 2024-04-25T13:42:31.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.301+0000 7f4cc6400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ca4004810 0x7f4cc00b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:31.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.301+0000 7f4cc6400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cc0148fc0 0x7f4cc013cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:31.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.301+0000 7f4cc6400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cc014de00 0x7f4cc0151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:31.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.301+0000 7f4cc6400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc00ce340 con 0x7f4cc0148fc0 2024-04-25T13:42:31.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.301+0000 7f4cc6400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc00ce1c0 con 0x7f4cc014de00 2024-04-25T13:42:31.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.301+0000 7f4cc6400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4cc00ce4c0 con 0x7f4ca4004810 2024-04-25T13:42:31.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.301+0000 7f4cb6a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cc0148fc0 0x7f4cc013cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:31.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.301+0000 7f4cb6a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cc0148fc0 0x7f4cc013cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48816/0 (socket says 172.21.15.123:48816) 2024-04-25T13:42:31.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.301+0000 7f4cb6a00640 1 -- 172.21.15.123:0/3654259025 learned_addr learned my addr 172.21.15.123:0/3654259025 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:31.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.301+0000 7f4cbf400640 1 --2- 172.21.15.123:0/3654259025 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ca4004810 0x7f4cc00b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:31.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.305+0000 7f4cb6a00640 1 -- 172.21.15.123:0/3654259025 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ca4004810 msgr2=0x7f4cc00b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.305+0000 7f4cb6a00640 1 --2- 172.21.15.123:0/3654259025 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ca4004810 0x7f4cc00b5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.305+0000 7f4cb6a00640 1 -- 172.21.15.123:0/3654259025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cc014de00 msgr2=0x7f4cc0151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.305+0000 7f4cb6a00640 1 --2- 172.21.15.123:0/3654259025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cc014de00 0x7f4cc0151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.305+0000 7f4cb6a00640 1 -- 172.21.15.123:0/3654259025 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc00b5fc0 con 0x7f4cc0148fc0 2024-04-25T13:42:31.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.305+0000 7f4cb6a00640 1 --2- 172.21.15.123:0/3654259025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cc0148fc0 0x7f4cc013cec0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80ad040 tx=0x7f4ca4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:31.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.305+0000 7f4cb7e00640 1 -- 172.21.15.123:0/3654259025 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca80054a0 con 0x7f4cc0148fc0 2024-04-25T13:42:31.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.305+0000 7f4cb7e00640 1 -- 172.21.15.123:0/3654259025 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca8001500 con 0x7f4cc0148fc0 2024-04-25T13:42:31.305 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.305+0000 7f4cb7e00640 1 -- 172.21.15.123:0/3654259025 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca80067e0 con 0x7f4cc0148fc0 2024-04-25T13:42:31.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.305+0000 7f4cc6400640 1 -- 172.21.15.123:0/3654259025 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc00b44e0 con 0x7f4cc0148fc0 2024-04-25T13:42:31.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.305+0000 7f4cc6400640 1 -- 172.21.15.123:0/3654259025 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc00b4cc0 con 0x7f4cc0148fc0 2024-04-25T13:42:31.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.305+0000 7f4cc6400640 1 -- 172.21.15.123:0/3654259025 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc0050750 con 0x7f4cc0148fc0 2024-04-25T13:42:31.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.305+0000 7f4cb7e00640 1 -- 172.21.15.123:0/3654259025 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4ca80c1060 con 0x7f4cc0148fc0 2024-04-25T13:42:31.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.305+0000 7f4cb7e00640 1 --2- 172.21.15.123:0/3654259025 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4c9c06f430 0x7f4c9c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:31.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.309+0000 7f4cb7e00640 1 -- 172.21.15.123:0/3654259025 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4ca8128a10 con 0x7f4cc0148fc0 2024-04-25T13:42:31.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.309+0000 7f4cbf400640 1 --2- 172.21.15.123:0/3654259025 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4c9c06f430 0x7f4c9c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:31.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.309+0000 7f4cbf400640 1 --2- 172.21.15.123:0/3654259025 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4c9c06f430 0x7f4c9c071940 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0001230 tx=0x7f4cb0001da0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:31.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.313+0000 7f4cb7e00640 1 -- 172.21.15.123:0/3654259025 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4ca8016270 con 0x7f4cc0148fc0 2024-04-25T13:42:31.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.465+0000 7f4cc6400640 1 -- 172.21.15.123:0/3654259025 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4cc0074cc0 con 0x7f4cc0148fc0 2024-04-25T13:42:31.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.469+0000 7f4cb7e00640 1 -- 172.21.15.123:0/3654259025 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f4ca80f5860 con 0x7f4cc0148fc0 2024-04-25T13:42:31.468 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-04-25T13:42:31.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.469+0000 7f4cc6400640 1 -- 172.21.15.123:0/3654259025 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4c9c06f430 msgr2=0x7f4c9c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.469+0000 7f4cc6400640 1 --2- 172.21.15.123:0/3654259025 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4c9c06f430 0x7f4c9c071940 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0001230 tx=0x7f4cb0001da0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.469+0000 7f4cc6400640 1 -- 172.21.15.123:0/3654259025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cc0148fc0 msgr2=0x7f4cc013cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.469+0000 7f4cc6400640 1 --2- 172.21.15.123:0/3654259025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cc0148fc0 0x7f4cc013cec0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4ca80ad040 tx=0x7f4ca4005840 comp rx=0 tx=0).stop 2024-04-25T13:42:31.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.469+0000 7f4cc6400640 1 -- 172.21.15.123:0/3654259025 shutdown_connections 2024-04-25T13:42:31.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.469+0000 7f4cc6400640 1 --2- 172.21.15.123:0/3654259025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cc014de00 0x7f4cc0151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.469+0000 7f4cc6400640 1 --2- 172.21.15.123:0/3654259025 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4c9c06f430 0x7f4c9c071940 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.469+0000 7f4cc6400640 1 --2- 172.21.15.123:0/3654259025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4cc0148fc0 0x7f4cc013cec0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.469+0000 7f4cc6400640 1 --2- 172.21.15.123:0/3654259025 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ca4004810 0x7f4cc00b5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.469+0000 7f4cc6400640 1 -- 172.21.15.123:0/3654259025 >> 172.21.15.123:0/3654259025 conn(0x7f4cc006ca70 msgr2=0x7f4cc00b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:31.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.469+0000 7f4cc6400640 1 -- 172.21.15.123:0/3654259025 shutdown_connections 2024-04-25T13:42:31.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.469+0000 7f4cc6400640 1 -- 172.21.15.123:0/3654259025 wait complete. 2024-04-25T13:42:31.489 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:31.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.637+0000 7f639ce00640 1 Processor -- start 2024-04-25T13:42:31.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.637+0000 7f639ce00640 1 -- start start 2024-04-25T13:42:31.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.637+0000 7f639ce00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f639806e9a0 0x7f6398164490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:31.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.637+0000 7f639ce00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f639809cc20 con 0x7f6398164de0 2024-04-25T13:42:31.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.637+0000 7f639ce00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63980d2d20 con 0x7f63981649d0 2024-04-25T13:42:31.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.637+0000 7f639ce00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f639809cf50 con 0x7f639806e9a0 2024-04-25T13:42:31.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.641+0000 7f6396800640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f6398164de0 0x7f63980b4190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60742/0 (socket says 172.21.15.123:60742) 2024-04-25T13:42:31.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.641+0000 7f6396800640 1 -- 172.21.15.123:0/1954183599 learned_addr learned my addr 172.21.15.123:0/1954183599 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:31.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.641+0000 7f6395e00640 1 --2- 172.21.15.123:0/1954183599 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f639806e9a0 0x7f6398164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:31.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.641+0000 7f6394a00640 1 -- 172.21.15.123:0/1954183599 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1732970015 0 0) 0x7f639809cc20 con 0x7f6398164de0 2024-04-25T13:42:31.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.641+0000 7f6394a00640 1 -- 172.21.15.123:0/1954183599 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f637c003530 con 0x7f6398164de0 2024-04-25T13:42:31.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.641+0000 7f6394a00640 1 -- 172.21.15.123:0/1954183599 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2818843057 0 0) 0x7f63980d2d20 con 0x7f63981649d0 2024-04-25T13:42:31.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.641+0000 7f6394a00640 1 -- 172.21.15.123:0/1954183599 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f639809cc20 con 0x7f63981649d0 2024-04-25T13:42:31.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.641+0000 7f6395e00640 1 -- 172.21.15.123:0/1954183599 >> v1:172.21.15.130:6789/0 conn(0x7f63981649d0 legacy=0x7f63980b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.641+0000 7f6395e00640 1 -- 172.21.15.123:0/1954183599 >> v1:172.21.15.123:6789/0 conn(0x7f6398164de0 legacy=0x7f63980b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.641+0000 7f6395e00640 1 -- 172.21.15.123:0/1954183599 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f639806d940 con 0x7f639806e9a0 2024-04-25T13:42:31.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.641+0000 7f6395e00640 1 --2- 172.21.15.123:0/1954183599 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f639806e9a0 0x7f6398164490 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f63980d2ef0 tx=0x7f638801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=988be78e2ff142b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:31.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.645+0000 7f6394a00640 1 -- 172.21.15.123:0/1954183599 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63880b1070 con 0x7f639806e9a0 2024-04-25T13:42:31.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.645+0000 7f6394a00640 1 -- 172.21.15.123:0/1954183599 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63880ac410 con 0x7f639806e9a0 2024-04-25T13:42:31.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.645+0000 7f6394a00640 1 -- 172.21.15.123:0/1954183599 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63880ac7c0 con 0x7f639806e9a0 2024-04-25T13:42:31.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.645+0000 7f639ce00640 1 -- 172.21.15.123:0/1954183599 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f639806e9a0 msgr2=0x7f6398164490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.645+0000 7f639ce00640 1 --2- 172.21.15.123:0/1954183599 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f639806e9a0 0x7f6398164490 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f63980d2ef0 tx=0x7f638801c4a0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.645+0000 7f639ce00640 1 -- 172.21.15.123:0/1954183599 shutdown_connections 2024-04-25T13:42:31.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.645+0000 7f639ce00640 1 --2- 172.21.15.123:0/1954183599 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f639806e9a0 0x7f6398164490 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.645+0000 7f639ce00640 1 -- 172.21.15.123:0/1954183599 >> 172.21.15.123:0/1954183599 conn(0x7f63980d01e0 msgr2=0x7f63980d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:31.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.645+0000 7f639ce00640 1 -- 172.21.15.123:0/1954183599 shutdown_connections 2024-04-25T13:42:31.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.645+0000 7f639ce00640 1 -- 172.21.15.123:0/1954183599 wait complete. 2024-04-25T13:42:31.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.645+0000 7f639ce00640 1 Processor -- start 2024-04-25T13:42:31.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.645+0000 7f639ce00640 1 -- start start 2024-04-25T13:42:31.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.649+0000 7f639ce00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f639806e9a0 0x7f63981626e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:31.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.649+0000 7f639ce00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63981649d0 0x7f6398164410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:31.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.649+0000 7f639ce00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6398164de0 0x7f639815b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:31.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.649+0000 7f639ce00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f63980d0fe0 con 0x7f63981649d0 2024-04-25T13:42:31.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.649+0000 7f639ce00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f63981651f0 con 0x7f639806e9a0 2024-04-25T13:42:31.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.649+0000 7f639ce00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f63980d1160 con 0x7f6398164de0 2024-04-25T13:42:31.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.649+0000 7f6395400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63981649d0 0x7f6398164410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:31.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.649+0000 7f6395400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63981649d0 0x7f6398164410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48830/0 (socket says 172.21.15.123:48830) 2024-04-25T13:42:31.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.649+0000 7f6395400640 1 -- 172.21.15.123:0/1324062795 learned_addr learned my addr 172.21.15.123:0/1324062795 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:31.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.649+0000 7f6396800640 1 --2- 172.21.15.123:0/1324062795 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6398164de0 0x7f639815b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:31.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.649+0000 7f6395e00640 1 --2- 172.21.15.123:0/1324062795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f639806e9a0 0x7f63981626e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:31.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.649+0000 7f6395400640 1 -- 172.21.15.123:0/1324062795 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6398164de0 msgr2=0x7f639815b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.649+0000 7f6395400640 1 --2- 172.21.15.123:0/1324062795 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6398164de0 0x7f639815b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.649+0000 7f6395400640 1 -- 172.21.15.123:0/1324062795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f639806e9a0 msgr2=0x7f63981626e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.649+0000 7f6395400640 1 --2- 172.21.15.123:0/1324062795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f639806e9a0 0x7f63981626e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.649+0000 7f6395400640 1 -- 172.21.15.123:0/1324062795 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6398162f30 con 0x7f63981649d0 2024-04-25T13:42:31.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.649+0000 7f6396800640 1 --2- 172.21.15.123:0/1324062795 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6398164de0 0x7f639815b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:31.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.649+0000 7f6395e00640 1 --2- 172.21.15.123:0/1324062795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f639806e9a0 0x7f63981626e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:31.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.649+0000 7f6395400640 1 --2- 172.21.15.123:0/1324062795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63981649d0 0x7f6398164410 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f638400c390 tx=0x7f638400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:31.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.649+0000 7f638e000640 1 -- 172.21.15.123:0/1324062795 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6384017070 con 0x7f63981649d0 2024-04-25T13:42:31.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.649+0000 7f638e000640 1 -- 172.21.15.123:0/1324062795 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63840052f0 con 0x7f63981649d0 2024-04-25T13:42:31.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.649+0000 7f638e000640 1 -- 172.21.15.123:0/1324062795 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6384003840 con 0x7f63981649d0 2024-04-25T13:42:31.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.649+0000 7f639ce00640 1 -- 172.21.15.123:0/1324062795 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6398163210 con 0x7f63981649d0 2024-04-25T13:42:31.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.649+0000 7f639ce00640 1 -- 172.21.15.123:0/1324062795 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63981637d0 con 0x7f63981649d0 2024-04-25T13:42:31.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.649+0000 7f639ce00640 1 -- 172.21.15.123:0/1324062795 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63980507c0 con 0x7f63981649d0 2024-04-25T13:42:31.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.653+0000 7f638e000640 1 -- 172.21.15.123:0/1324062795 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f638401a070 con 0x7f63981649d0 2024-04-25T13:42:31.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.653+0000 7f638e000640 1 --2- 172.21.15.123:0/1324062795 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f637806f430 0x7f6378071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:31.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.653+0000 7f638e000640 1 -- 172.21.15.123:0/1324062795 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f638408e690 con 0x7f63981649d0 2024-04-25T13:42:31.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.653+0000 7f6395e00640 1 --2- 172.21.15.123:0/1324062795 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f637806f430 0x7f6378071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:31.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.653+0000 7f6395e00640 1 --2- 172.21.15.123:0/1324062795 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f637806f430 0x7f6378071940 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f63880ae000 tx=0x7f63880a6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:31.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.657+0000 7f638e000640 1 -- 172.21.15.123:0/1324062795 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f638405b570 con 0x7f63981649d0 2024-04-25T13:42:31.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.813+0000 7f639ce00640 1 -- 172.21.15.123:0/1324062795 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6398162cc0 con 0x7f63981649d0 2024-04-25T13:42:31.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.813+0000 7f638e000640 1 -- 172.21.15.123:0/1324062795 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16629 (secure 0 0 0) 0x7f638405ae70 con 0x7f63981649d0 2024-04-25T13:42:31.816 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:31.816 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:42:07.405529+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:03.949161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:04.755682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:31.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.817+0000 7f639ce00640 1 -- 172.21.15.123:0/1324062795 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f637806f430 msgr2=0x7f6378071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.817+0000 7f639ce00640 1 --2- 172.21.15.123:0/1324062795 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f637806f430 0x7f6378071940 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f63880ae000 tx=0x7f63880a6040 comp rx=0 tx=0).stop 2024-04-25T13:42:31.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.817+0000 7f639ce00640 1 -- 172.21.15.123:0/1324062795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63981649d0 msgr2=0x7f6398164410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.817+0000 7f639ce00640 1 --2- 172.21.15.123:0/1324062795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63981649d0 0x7f6398164410 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f638400c390 tx=0x7f638400c850 comp rx=0 tx=0).stop 2024-04-25T13:42:31.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.817+0000 7f639ce00640 1 -- 172.21.15.123:0/1324062795 shutdown_connections 2024-04-25T13:42:31.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.817+0000 7f639ce00640 1 --2- 172.21.15.123:0/1324062795 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f637806f430 0x7f6378071940 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.817+0000 7f639ce00640 1 --2- 172.21.15.123:0/1324062795 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6398164de0 0x7f639815b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.817+0000 7f639ce00640 1 --2- 172.21.15.123:0/1324062795 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63981649d0 0x7f6398164410 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.817+0000 7f639ce00640 1 --2- 172.21.15.123:0/1324062795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f639806e9a0 0x7f63981626e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.817+0000 7f639ce00640 1 -- 172.21.15.123:0/1324062795 >> 172.21.15.123:0/1324062795 conn(0x7f63980d01e0 msgr2=0x7f6398160bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:31.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.817+0000 7f639ce00640 1 -- 172.21.15.123:0/1324062795 shutdown_connections 2024-04-25T13:42:31.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.817+0000 7f639ce00640 1 -- 172.21.15.123:0/1324062795 wait complete. 2024-04-25T13:42:31.838 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:41:53.602480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:42:03.949161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:42:04.755682+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:42:31.839 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:42:31.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.989+0000 7fe764600640 1 Processor -- start 2024-04-25T13:42:31.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.989+0000 7fe764600640 1 -- start start 2024-04-25T13:42:31.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.989+0000 7fe764600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe75c1571b0 0x7fe75c0cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:31.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.989+0000 7fe764600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe75c072af0 0x7fe75c072f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:31.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.989+0000 7fe764600640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe75c0cdee0 con 0x7fe75c0b3870 2024-04-25T13:42:31.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.989+0000 7fe764600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe75c15d570 con 0x7fe75c1571b0 2024-04-25T13:42:31.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.989+0000 7fe764600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe75c15d850 con 0x7fe75c072af0 2024-04-25T13:42:31.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.989+0000 7fe761c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe75c1571b0 0x7fe75c0cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:31.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.989+0000 7fe761c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe75c1571b0 0x7fe75c0cd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48832/0 (socket says 172.21.15.123:48832) 2024-04-25T13:42:31.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.989+0000 7fe761c00640 1 -- 172.21.15.123:0/708466897 learned_addr learned my addr 172.21.15.123:0/708466897 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:31.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.989+0000 7fe762600640 1 --2- 172.21.15.123:0/708466897 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe75c072af0 0x7fe75c072f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:31.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.989+0000 7fe761c00640 1 -- 172.21.15.123:0/708466897 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe75c072af0 msgr2=0x7fe75c072f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:31.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.989+0000 7fe761c00640 1 --2- 172.21.15.123:0/708466897 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe75c072af0 0x7fe75c072f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.989+0000 7fe761c00640 1 -- 172.21.15.123:0/708466897 >> v1:172.21.15.130:6789/0 conn(0x7fe75c0b3870 legacy=0x7fe75c0b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.989+0000 7fe761c00640 1 -- 172.21.15.123:0/708466897 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe75c15db30 con 0x7fe75c1571b0 2024-04-25T13:42:31.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.989+0000 7fe75be00640 1 -- 172.21.15.123:0/708466897 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3403031440 0 0) 0x7fe75c0cdee0 con 0x7fe75c0b3870 2024-04-25T13:42:31.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.993+0000 7fe761c00640 1 --2- 172.21.15.123:0/708466897 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe75c1571b0 0x7fe75c0cd6b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe750009e50 tx=0x7fe75001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228e62c3d9b33dc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:31.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.993+0000 7fe75be00640 1 -- 172.21.15.123:0/708466897 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7500a5880 con 0x7fe75c1571b0 2024-04-25T13:42:31.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.993+0000 7fe75be00640 1 -- 172.21.15.123:0/708466897 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7500a5a20 con 0x7fe75c1571b0 2024-04-25T13:42:31.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.993+0000 7fe75be00640 1 -- 172.21.15.123:0/708466897 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7500a5df0 con 0x7fe75c1571b0 2024-04-25T13:42:31.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.993+0000 7fe764600640 1 -- 172.21.15.123:0/708466897 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe75c1571b0 msgr2=0x7fe75c0cd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:31.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.993+0000 7fe764600640 1 --2- 172.21.15.123:0/708466897 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe75c1571b0 0x7fe75c0cd6b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe750009e50 tx=0x7fe75001c960 comp rx=0 tx=0).stop 2024-04-25T13:42:31.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.993+0000 7fe764600640 1 -- 172.21.15.123:0/708466897 shutdown_connections 2024-04-25T13:42:31.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.993+0000 7fe764600640 1 --2- 172.21.15.123:0/708466897 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe75c072af0 0x7fe75c072f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.993+0000 7fe764600640 1 --2- 172.21.15.123:0/708466897 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe75c1571b0 0x7fe75c0cd6b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:31.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.993+0000 7fe764600640 1 -- 172.21.15.123:0/708466897 >> 172.21.15.123:0/708466897 conn(0x7fe75c06ca70 msgr2=0x7fe75c06ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:31.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.993+0000 7fe764600640 1 -- 172.21.15.123:0/708466897 shutdown_connections 2024-04-25T13:42:31.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.993+0000 7fe764600640 1 -- 172.21.15.123:0/708466897 wait complete. 2024-04-25T13:42:31.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.997+0000 7fe764600640 1 Processor -- start 2024-04-25T13:42:31.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.997+0000 7fe764600640 1 -- start start 2024-04-25T13:42:32.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.997+0000 7fe764600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe75c072af0 0x7fe75c14f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:32.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.997+0000 7fe764600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe75c0b3870 0x7fe75c0b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:32.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.997+0000 7fe764600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe75c1571b0 0x7fe75c150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:32.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.997+0000 7fe764600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe75c157740 con 0x7fe75c0b3870 2024-04-25T13:42:32.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.997+0000 7fe764600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe75c1575c0 con 0x7fe75c1571b0 2024-04-25T13:42:32.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.997+0000 7fe764600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe75c073850 con 0x7fe75c072af0 2024-04-25T13:42:32.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.997+0000 7fe761200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe75c0b3870 0x7fe75c0b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:32.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.997+0000 7fe761200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe75c0b3870 0x7fe75c0b5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48836/0 (socket says 172.21.15.123:48836) 2024-04-25T13:42:32.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.997+0000 7fe761200640 1 -- 172.21.15.123:0/1963573432 learned_addr learned my addr 172.21.15.123:0/1963573432 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:32.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.997+0000 7fe761c00640 1 --2- 172.21.15.123:0/1963573432 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe75c072af0 0x7fe75c14f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:32.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.997+0000 7fe762600640 1 --2- 172.21.15.123:0/1963573432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe75c1571b0 0x7fe75c150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:32.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.997+0000 7fe761200640 1 -- 172.21.15.123:0/1963573432 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe75c072af0 msgr2=0x7fe75c14f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:32.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.997+0000 7fe761200640 1 --2- 172.21.15.123:0/1963573432 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe75c072af0 0x7fe75c14f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:32.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.997+0000 7fe761200640 1 -- 172.21.15.123:0/1963573432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe75c1571b0 msgr2=0x7fe75c150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:32.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.997+0000 7fe761200640 1 --2- 172.21.15.123:0/1963573432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe75c1571b0 0x7fe75c150430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:32.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:31.997+0000 7fe761200640 1 -- 172.21.15.123:0/1963573432 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe75c0b4560 con 0x7fe75c0b3870 2024-04-25T13:42:32.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.001+0000 7fe761200640 1 --2- 172.21.15.123:0/1963573432 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe75c0b3870 0x7fe75c0b5d10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe74800c3f0 tx=0x7fe74800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:32.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.001+0000 7fe759600640 1 -- 172.21.15.123:0/1963573432 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe748017070 con 0x7fe75c0b3870 2024-04-25T13:42:32.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.001+0000 7fe759600640 1 -- 172.21.15.123:0/1963573432 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe748003600 con 0x7fe75c0b3870 2024-04-25T13:42:32.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.001+0000 7fe759600640 1 -- 172.21.15.123:0/1963573432 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7480039f0 con 0x7fe75c0b3870 2024-04-25T13:42:32.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.001+0000 7fe764600640 1 -- 172.21.15.123:0/1963573432 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe75c150110 con 0x7fe75c0b3870 2024-04-25T13:42:32.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.001+0000 7fe764600640 1 -- 172.21.15.123:0/1963573432 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe75c0b4b00 con 0x7fe75c0b3870 2024-04-25T13:42:32.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.001+0000 7fe764600640 1 -- 172.21.15.123:0/1963573432 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe75c050750 con 0x7fe75c0b3870 2024-04-25T13:42:32.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.001+0000 7fe759600640 1 -- 172.21.15.123:0/1963573432 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe74801a070 con 0x7fe75c0b3870 2024-04-25T13:42:32.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.001+0000 7fe759600640 1 --2- 172.21.15.123:0/1963573432 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe73c06f400 0x7fe73c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:32.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.001+0000 7fe759600640 1 -- 172.21.15.123:0/1963573432 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe74808e6c0 con 0x7fe75c0b3870 2024-04-25T13:42:32.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.001+0000 7fe761c00640 1 --2- 172.21.15.123:0/1963573432 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe73c06f400 0x7fe73c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:32.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.005+0000 7fe761c00640 1 --2- 172.21.15.123:0/1963573432 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe73c06f400 0x7fe73c071910 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe7500ae000 tx=0x7fe7500a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:32.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.005+0000 7fe759600640 1 -- 172.21.15.123:0/1963573432 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe74805b5a0 con 0x7fe75c0b3870 2024-04-25T13:42:32.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.165+0000 7fe764600640 1 -- 172.21.15.123:0/1963573432 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe75c073110 con 0x7fe75c0b3870 2024-04-25T13:42:32.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.165+0000 7fe759600640 1 -- 172.21.15.123:0/1963573432 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fe74805aea0 con 0x7fe75c0b3870 2024-04-25T13:42:32.166 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-04-25T13:42:32.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.165+0000 7fe764600640 1 -- 172.21.15.123:0/1963573432 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe73c06f400 msgr2=0x7fe73c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:32.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.165+0000 7fe764600640 1 --2- 172.21.15.123:0/1963573432 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe73c06f400 0x7fe73c071910 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe7500ae000 tx=0x7fe7500a7070 comp rx=0 tx=0).stop 2024-04-25T13:42:32.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.165+0000 7fe764600640 1 -- 172.21.15.123:0/1963573432 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe75c0b3870 msgr2=0x7fe75c0b5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:32.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.165+0000 7fe764600640 1 --2- 172.21.15.123:0/1963573432 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe75c0b3870 0x7fe75c0b5d10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe74800c3f0 tx=0x7fe74800c8b0 comp rx=0 tx=0).stop 2024-04-25T13:42:32.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.165+0000 7fe764600640 1 -- 172.21.15.123:0/1963573432 shutdown_connections 2024-04-25T13:42:32.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.165+0000 7fe764600640 1 --2- 172.21.15.123:0/1963573432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe75c1571b0 0x7fe75c150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:32.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.165+0000 7fe764600640 1 --2- 172.21.15.123:0/1963573432 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe73c06f400 0x7fe73c071910 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:32.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.165+0000 7fe764600640 1 --2- 172.21.15.123:0/1963573432 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe75c0b3870 0x7fe75c0b5d10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:32.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.165+0000 7fe764600640 1 --2- 172.21.15.123:0/1963573432 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe75c072af0 0x7fe75c14f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:32.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.169+0000 7fe764600640 1 -- 172.21.15.123:0/1963573432 >> 172.21.15.123:0/1963573432 conn(0x7fe75c06ca70 msgr2=0x7fe75c0b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:32.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.169+0000 7fe764600640 1 -- 172.21.15.123:0/1963573432 shutdown_connections 2024-04-25T13:42:32.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.169+0000 7fe764600640 1 -- 172.21.15.123:0/1963573432 wait complete. 2024-04-25T13:42:32.187 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:42:32.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.333+0000 7f50e3e00640 1 Processor -- start 2024-04-25T13:42:32.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.333+0000 7f50e3e00640 1 -- start start 2024-04-25T13:42:32.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.337+0000 7f50e3e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f50e40ce750 0x7f50e40b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:32.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.337+0000 7f50e3e00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f50e40b5910 0x7f50e40cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:32.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.337+0000 7f50e3e00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e40b3db0 con 0x7f50e40b5d20 2024-04-25T13:42:32.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.337+0000 7f50e3e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f50e40b7f90 con 0x7f50e40ce750 2024-04-25T13:42:32.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.337+0000 7f50e3e00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f50e40cfe30 con 0x7f50e40b5910 2024-04-25T13:42:32.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.337+0000 7f50e2a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f50e40ce750 0x7f50e40b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:32.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.337+0000 7f50e3400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f50e40b5d20 0x7f50e40cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60748/0 (socket says 172.21.15.123:60748) 2024-04-25T13:42:32.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.337+0000 7f50e3400640 1 -- 172.21.15.123:0/1725003676 learned_addr learned my addr 172.21.15.123:0/1725003676 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:32.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.337+0000 7f50da000640 1 --2- 172.21.15.123:0/1725003676 >> v2:172.21.15.130:3300/0 conn(0x7f50e40b5910 0x7f50e40cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:32.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.337+0000 7f50e2a00640 1 -- 172.21.15.123:0/1725003676 >> v2:172.21.15.130:3300/0 conn(0x7f50e40b5910 msgr2=0x7f50e40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:32.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.337+0000 7f50e2a00640 1 --2- 172.21.15.123:0/1725003676 >> v2:172.21.15.130:3300/0 conn(0x7f50e40b5910 0x7f50e40cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:32.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.337+0000 7f50e2a00640 1 -- 172.21.15.123:0/1725003676 >> v1:172.21.15.123:6789/0 conn(0x7f50e40b5d20 legacy=0x7f50e40cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:32.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.337+0000 7f50e2a00640 1 -- 172.21.15.123:0/1725003676 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e40b3ad0 con 0x7f50e40ce750 2024-04-25T13:42:32.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.337+0000 7f50da000640 1 --2- 172.21.15.123:0/1725003676 >> v2:172.21.15.130:3300/0 conn(0x7f50e40b5910 0x7f50e40cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:32.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.337+0000 7f50e2000640 1 -- 172.21.15.123:0/1725003676 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2867345115 0 0) 0x7f50e40b3db0 con 0x7f50e40b5d20 2024-04-25T13:42:32.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.341+0000 7f50e2a00640 1 --2- 172.21.15.123:0/1725003676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e40ce750 0x7f50e40b53d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f50e406e820 tx=0x7f50d401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4998df97009c38bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:32.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.341+0000 7f50e2000640 1 -- 172.21.15.123:0/1725003676 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d40b0070 con 0x7f50e40ce750 2024-04-25T13:42:32.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.341+0000 7f50e2000640 1 -- 172.21.15.123:0/1725003676 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50d4004230 con 0x7f50e40ce750 2024-04-25T13:42:32.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.341+0000 7f50e2000640 1 -- 172.21.15.123:0/1725003676 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d4003620 con 0x7f50e40ce750 2024-04-25T13:42:32.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.341+0000 7f50e3e00640 1 -- 172.21.15.123:0/1725003676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e40ce750 msgr2=0x7f50e40b53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:32.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.341+0000 7f50e3e00640 1 --2- 172.21.15.123:0/1725003676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e40ce750 0x7f50e40b53d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f50e406e820 tx=0x7f50d401c460 comp rx=0 tx=0).stop 2024-04-25T13:42:32.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.341+0000 7f50e3e00640 1 -- 172.21.15.123:0/1725003676 shutdown_connections 2024-04-25T13:42:32.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.341+0000 7f50e3e00640 1 --2- 172.21.15.123:0/1725003676 >> v2:172.21.15.130:3300/0 conn(0x7f50e40b5910 0x7f50e40cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:32.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.341+0000 7f50e3e00640 1 --2- 172.21.15.123:0/1725003676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e40ce750 0x7f50e40b53d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:32.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.341+0000 7f50e3e00640 1 -- 172.21.15.123:0/1725003676 >> 172.21.15.123:0/1725003676 conn(0x7f50e40d2580 msgr2=0x7f50e40d2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:32.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.341+0000 7f50e3e00640 1 -- 172.21.15.123:0/1725003676 shutdown_connections 2024-04-25T13:42:32.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.341+0000 7f50e3e00640 1 -- 172.21.15.123:0/1725003676 wait complete. 2024-04-25T13:42:32.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.345+0000 7f50e3e00640 1 Processor -- start 2024-04-25T13:42:32.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.345+0000 7f50e3e00640 1 -- start start 2024-04-25T13:42:32.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.345+0000 7f50e3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50e40b5910 0x7f50e4156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:32.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.345+0000 7f50e3e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50e40b5d20 0x7f50e40af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:32.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.345+0000 7f50e3e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e40ce750 0x7f50e40b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:32.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.345+0000 7f50e3e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f50e41617b0 con 0x7f50e40ce750 2024-04-25T13:42:32.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.345+0000 7f50e3e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f50e40ceb60 con 0x7f50e40b5910 2024-04-25T13:42:32.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.345+0000 7f50e3e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f50e4161930 con 0x7f50e40b5d20 2024-04-25T13:42:32.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.345+0000 7f50e3400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e40ce750 0x7f50e40b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:32.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.345+0000 7f50e3400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e40ce750 0x7f50e40b18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48854/0 (socket says 172.21.15.123:48854) 2024-04-25T13:42:32.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.345+0000 7f50e3400640 1 -- 172.21.15.123:0/3416966043 learned_addr learned my addr 172.21.15.123:0/3416966043 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:32.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.345+0000 7f50e2a00640 1 --2- 172.21.15.123:0/3416966043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50e40b5910 0x7f50e4156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:32.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.345+0000 7f50da000640 1 --2- 172.21.15.123:0/3416966043 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50e40b5d20 0x7f50e40af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:32.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.345+0000 7f50e3400640 1 -- 172.21.15.123:0/3416966043 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50e40b5d20 msgr2=0x7f50e40af260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:32.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.345+0000 7f50e3400640 1 --2- 172.21.15.123:0/3416966043 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50e40b5d20 0x7f50e40af260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:32.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.345+0000 7f50e3400640 1 -- 172.21.15.123:0/3416966043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50e40b5910 msgr2=0x7f50e4156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:32.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.345+0000 7f50e3400640 1 --2- 172.21.15.123:0/3416966043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50e40b5910 0x7f50e4156600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:32.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.345+0000 7f50e3400640 1 -- 172.21.15.123:0/3416966043 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e40affd0 con 0x7f50e40ce750 2024-04-25T13:42:32.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.345+0000 7f50e3400640 1 --2- 172.21.15.123:0/3416966043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e40ce750 0x7f50e40b18f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00c700 tx=0x7f50dc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:32.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.345+0000 7f50dbe00640 1 -- 172.21.15.123:0/3416966043 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc018070 con 0x7f50e40ce750 2024-04-25T13:42:32.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.345+0000 7f50dbe00640 1 -- 172.21.15.123:0/3416966043 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50dc00ce10 con 0x7f50e40ce750 2024-04-25T13:42:32.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.345+0000 7f50e3e00640 1 -- 172.21.15.123:0/3416966043 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e40b02b0 con 0x7f50e40ce750 2024-04-25T13:42:32.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.345+0000 7f50dbe00640 1 -- 172.21.15.123:0/3416966043 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc00a800 con 0x7f50e40ce750 2024-04-25T13:42:32.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.345+0000 7f50e3e00640 1 -- 172.21.15.123:0/3416966043 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e40b0870 con 0x7f50e40ce750 2024-04-25T13:42:32.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.349+0000 7f50e3e00640 1 -- 172.21.15.123:0/3416966043 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50e4050750 con 0x7f50e40ce750 2024-04-25T13:42:32.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.349+0000 7f50dbe00640 1 -- 172.21.15.123:0/3416966043 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f50dc01b070 con 0x7f50e40ce750 2024-04-25T13:42:32.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.349+0000 7f50dbe00640 1 --2- 172.21.15.123:0/3416966043 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f50c006f430 0x7f50c0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:32.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.349+0000 7f50dbe00640 1 -- 172.21.15.123:0/3416966043 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f50dc08e880 con 0x7f50e40ce750 2024-04-25T13:42:32.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.349+0000 7f50e2a00640 1 --2- 172.21.15.123:0/3416966043 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f50c006f430 0x7f50c0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:32.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.349+0000 7f50e2a00640 1 --2- 172.21.15.123:0/3416966043 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f50c006f430 0x7f50c0071940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f50d40ad000 tx=0x7f50d40a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:32.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.353+0000 7f50dbe00640 1 -- 172.21.15.123:0/3416966043 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f50dc05b6d0 con 0x7f50e40ce750 2024-04-25T13:42:32.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.509+0000 7f50e3e00640 1 -- 172.21.15.123:0/3416966043 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f50e4160290 con 0x7f50e40ce750 2024-04-25T13:42:32.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.509+0000 7f50dbe00640 1 -- 172.21.15.123:0/3416966043 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f50dc05afd0 con 0x7f50e40ce750 2024-04-25T13:42:32.509 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-04-25T13:42:32.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.509+0000 7f50e3e00640 1 -- 172.21.15.123:0/3416966043 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f50c006f430 msgr2=0x7f50c0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:32.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.509+0000 7f50e3e00640 1 --2- 172.21.15.123:0/3416966043 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f50c006f430 0x7f50c0071940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f50d40ad000 tx=0x7f50d40a6000 comp rx=0 tx=0).stop 2024-04-25T13:42:32.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.509+0000 7f50e3e00640 1 -- 172.21.15.123:0/3416966043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e40ce750 msgr2=0x7f50e40b18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:32.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.509+0000 7f50e3e00640 1 --2- 172.21.15.123:0/3416966043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e40ce750 0x7f50e40b18f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00c700 tx=0x7f50dc00cbc0 comp rx=0 tx=0).stop 2024-04-25T13:42:32.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.509+0000 7f50e3e00640 1 -- 172.21.15.123:0/3416966043 shutdown_connections 2024-04-25T13:42:32.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.509+0000 7f50e3e00640 1 --2- 172.21.15.123:0/3416966043 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f50c006f430 0x7f50c0071940 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:32.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.509+0000 7f50e3e00640 1 --2- 172.21.15.123:0/3416966043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50e40ce750 0x7f50e40b18f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:32.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.509+0000 7f50e3e00640 1 --2- 172.21.15.123:0/3416966043 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50e40b5d20 0x7f50e40af260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:32.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.509+0000 7f50e3e00640 1 --2- 172.21.15.123:0/3416966043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50e40b5910 0x7f50e4156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:32.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.509+0000 7f50e3e00640 1 -- 172.21.15.123:0/3416966043 >> 172.21.15.123:0/3416966043 conn(0x7f50e40d2580 msgr2=0x7f50e40b6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:32.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.509+0000 7f50e3e00640 1 -- 172.21.15.123:0/3416966043 shutdown_connections 2024-04-25T13:42:32.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.509+0000 7f50e3e00640 1 -- 172.21.15.123:0/3416966043 wait complete. 2024-04-25T13:42:32.532 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:42:32.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.681+0000 7f11a6600640 1 Processor -- start 2024-04-25T13:42:32.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.681+0000 7f11a6600640 1 -- start start 2024-04-25T13:42:32.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.681+0000 7f11a6600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11a01534e0 0x7f11a0074240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:32.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.681+0000 7f11a6600640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f11a00b4770 0x7f11a00b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:32.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.681+0000 7f11a6600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11a01538f0 con 0x7f11a00cdeb0 2024-04-25T13:42:32.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.681+0000 7f11a6600640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f11a0074780 con 0x7f11a00b4770 2024-04-25T13:42:32.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.681+0000 7f11a6600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f11a0074a50 con 0x7f11a01534e0 2024-04-25T13:42:32.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.681+0000 7f1196a00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f11a00cdeb0 0x7f11a00ce2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60754/0 (socket says 172.21.15.123:60754) 2024-04-25T13:42:32.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.681+0000 7f1196a00640 1 -- 172.21.15.123:0/3181924105 learned_addr learned my addr 172.21.15.123:0/3181924105 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:32.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.685+0000 7f119f400640 1 --2- 172.21.15.123:0/3181924105 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11a01534e0 0x7f11a0074240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:32.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.685+0000 7f119fe00640 1 --2- 172.21.15.123:0/3181924105 >> v2:172.21.15.130:3300/0 conn(0x7f11a00b4770 0x7f11a00b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:32.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.685+0000 7f119ea00640 1 -- 172.21.15.123:0/3181924105 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 504659140 0 0) 0x7f11a01538f0 con 0x7f11a00cdeb0 2024-04-25T13:42:32.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.685+0000 7f119ea00640 1 -- 172.21.15.123:0/3181924105 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1184003530 con 0x7f11a00cdeb0 2024-04-25T13:42:32.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.685+0000 7f119f400640 1 -- 172.21.15.123:0/3181924105 >> v2:172.21.15.130:3300/0 conn(0x7f11a00b4770 msgr2=0x7f11a00b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:32.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.685+0000 7f119f400640 1 --2- 172.21.15.123:0/3181924105 >> v2:172.21.15.130:3300/0 conn(0x7f11a00b4770 0x7f11a00b4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:32.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.685+0000 7f119f400640 1 -- 172.21.15.123:0/3181924105 >> v1:172.21.15.123:6789/0 conn(0x7f11a00cdeb0 legacy=0x7f11a00ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:32.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.685+0000 7f119f400640 1 -- 172.21.15.123:0/3181924105 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11a015cde0 con 0x7f11a01534e0 2024-04-25T13:42:32.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.685+0000 7f119f400640 1 --2- 172.21.15.123:0/3181924105 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11a01534e0 0x7f11a0074240 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f11900097c0 tx=0x7f119001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3acfdb595d57c63 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:32.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.685+0000 7f119ea00640 1 -- 172.21.15.123:0/3181924105 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11900b0070 con 0x7f11a01534e0 2024-04-25T13:42:32.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.685+0000 7f119ea00640 1 -- 172.21.15.123:0/3181924105 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11900ab400 con 0x7f11a01534e0 2024-04-25T13:42:32.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.685+0000 7f119ea00640 1 -- 172.21.15.123:0/3181924105 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11900ab7d0 con 0x7f11a01534e0 2024-04-25T13:42:32.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.689+0000 7f11a6600640 1 -- 172.21.15.123:0/3181924105 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11a01534e0 msgr2=0x7f11a0074240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:32.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.689+0000 7f11a6600640 1 --2- 172.21.15.123:0/3181924105 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11a01534e0 0x7f11a0074240 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f11900097c0 tx=0x7f119001c410 comp rx=0 tx=0).stop 2024-04-25T13:42:32.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.689+0000 7f11a6600640 1 -- 172.21.15.123:0/3181924105 shutdown_connections 2024-04-25T13:42:32.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.689+0000 7f11a6600640 1 --2- 172.21.15.123:0/3181924105 >> v2:172.21.15.130:3300/0 conn(0x7f11a00b4770 0x7f11a00b4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:32.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.689+0000 7f11a6600640 1 --2- 172.21.15.123:0/3181924105 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11a01534e0 0x7f11a0074240 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:32.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.689+0000 7f11a6600640 1 -- 172.21.15.123:0/3181924105 >> 172.21.15.123:0/3181924105 conn(0x7f11a006ca70 msgr2=0x7f11a006ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:32.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.689+0000 7f11a6600640 1 -- 172.21.15.123:0/3181924105 shutdown_connections 2024-04-25T13:42:32.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.689+0000 7f11a6600640 1 -- 172.21.15.123:0/3181924105 wait complete. 2024-04-25T13:42:32.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.689+0000 7f11a6600640 1 Processor -- start 2024-04-25T13:42:32.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.689+0000 7f11a6600640 1 -- start start 2024-04-25T13:42:32.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.693+0000 7f11a6600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11a00b4770 0x7f11a0154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:32.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.693+0000 7f11a6600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11a00cdeb0 0x7f11a014c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:32.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.693+0000 7f11a6600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11a01534e0 0x7f11a016a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:32.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.693+0000 7f11a6600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f11a015cbc0 con 0x7f11a00b4770 2024-04-25T13:42:32.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.693+0000 7f11a6600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f11a015ca40 con 0x7f11a01534e0 2024-04-25T13:42:32.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.693+0000 7f11a6600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f11a00b50c0 con 0x7f11a00cdeb0 2024-04-25T13:42:32.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.693+0000 7f119f400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11a00b4770 0x7f11a0154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:32.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.693+0000 7f119f400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11a00b4770 0x7f11a0154a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48856/0 (socket says 172.21.15.123:48856) 2024-04-25T13:42:32.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.693+0000 7f119f400640 1 -- 172.21.15.123:0/1007132431 learned_addr learned my addr 172.21.15.123:0/1007132431 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:32.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.693+0000 7f119fe00640 1 --2- 172.21.15.123:0/1007132431 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11a01534e0 0x7f11a016a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:32.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.693+0000 7f1196a00640 1 --2- 172.21.15.123:0/1007132431 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11a00cdeb0 0x7f11a014c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:32.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.693+0000 7f119f400640 1 -- 172.21.15.123:0/1007132431 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11a00cdeb0 msgr2=0x7f11a014c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:32.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.693+0000 7f119f400640 1 --2- 172.21.15.123:0/1007132431 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11a00cdeb0 0x7f11a014c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:32.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.693+0000 7f119f400640 1 -- 172.21.15.123:0/1007132431 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11a01534e0 msgr2=0x7f11a016a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:32.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.693+0000 7f119f400640 1 --2- 172.21.15.123:0/1007132431 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11a01534e0 0x7f11a016a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:32.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.693+0000 7f119f400640 1 -- 172.21.15.123:0/1007132431 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11a0156990 con 0x7f11a00b4770 2024-04-25T13:42:32.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.693+0000 7f119fe00640 1 --2- 172.21.15.123:0/1007132431 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11a01534e0 0x7f11a016a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:32.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.693+0000 7f119f400640 1 --2- 172.21.15.123:0/1007132431 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11a00b4770 0x7f11a0154a70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f11900097c0 tx=0x7f119001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:32.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.693+0000 7f1197e00640 1 -- 172.21.15.123:0/1007132431 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11900b0050 con 0x7f11a00b4770 2024-04-25T13:42:32.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.693+0000 7f1197e00640 1 -- 172.21.15.123:0/1007132431 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11900bc070 con 0x7f11a00b4770 2024-04-25T13:42:32.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.693+0000 7f11a6600640 1 -- 172.21.15.123:0/1007132431 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11a01560f0 con 0x7f11a00b4770 2024-04-25T13:42:32.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.693+0000 7f1197e00640 1 -- 172.21.15.123:0/1007132431 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11900b7690 con 0x7f11a00b4770 2024-04-25T13:42:32.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.693+0000 7f11a6600640 1 -- 172.21.15.123:0/1007132431 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11a01566b0 con 0x7f11a00b4770 2024-04-25T13:42:32.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.693+0000 7f11a6600640 1 -- 172.21.15.123:0/1007132431 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11a0050750 con 0x7f11a00b4770 2024-04-25T13:42:32.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.697+0000 7f1197e00640 1 -- 172.21.15.123:0/1007132431 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f11900b7830 con 0x7f11a00b4770 2024-04-25T13:42:32.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.697+0000 7f1197e00640 1 --2- 172.21.15.123:0/1007132431 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f117c06f430 0x7f117c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:32.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.697+0000 7f1197e00640 1 -- 172.21.15.123:0/1007132431 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1190129600 con 0x7f11a00b4770 2024-04-25T13:42:32.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.697+0000 7f1196a00640 1 --2- 172.21.15.123:0/1007132431 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f117c06f430 0x7f117c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:32.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.697+0000 7f1196a00640 1 --2- 172.21.15.123:0/1007132431 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f117c06f430 0x7f117c071940 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f11a0156d30 tx=0x7f1188009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:32.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.701+0000 7f1197e00640 1 -- 172.21.15.123:0/1007132431 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f11900c6020 con 0x7f11a00b4770 2024-04-25T13:42:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.861+0000 7f11a6600640 1 -- 172.21.15.123:0/1007132431 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f11a00cd8b0 con 0x7f11a00b4770 2024-04-25T13:42:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.861+0000 7f1197e00640 1 -- 172.21.15.123:0/1007132431 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f1190016090 con 0x7f11a00b4770 2024-04-25T13:42:32.861 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-04-25T13:42:32.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.861+0000 7f11a6600640 1 -- 172.21.15.123:0/1007132431 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f117c06f430 msgr2=0x7f117c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:32.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.861+0000 7f11a6600640 1 --2- 172.21.15.123:0/1007132431 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f117c06f430 0x7f117c071940 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f11a0156d30 tx=0x7f1188009040 comp rx=0 tx=0).stop 2024-04-25T13:42:32.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.861+0000 7f11a6600640 1 -- 172.21.15.123:0/1007132431 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11a00b4770 msgr2=0x7f11a0154a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:32.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.861+0000 7f11a6600640 1 --2- 172.21.15.123:0/1007132431 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11a00b4770 0x7f11a0154a70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f11900097c0 tx=0x7f119001ac50 comp rx=0 tx=0).stop 2024-04-25T13:42:32.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.861+0000 7f11a6600640 1 -- 172.21.15.123:0/1007132431 shutdown_connections 2024-04-25T13:42:32.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.861+0000 7f11a6600640 1 --2- 172.21.15.123:0/1007132431 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11a01534e0 0x7f11a016a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:32.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.861+0000 7f11a6600640 1 --2- 172.21.15.123:0/1007132431 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f117c06f430 0x7f117c071940 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:32.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.861+0000 7f11a6600640 1 --2- 172.21.15.123:0/1007132431 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11a00cdeb0 0x7f11a014c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:32.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.861+0000 7f11a6600640 1 --2- 172.21.15.123:0/1007132431 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11a00b4770 0x7f11a0154a70 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:32.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.861+0000 7f11a6600640 1 -- 172.21.15.123:0/1007132431 >> 172.21.15.123:0/1007132431 conn(0x7f11a006ca70 msgr2=0x7f11a0073370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:32.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.861+0000 7f11a6600640 1 -- 172.21.15.123:0/1007132431 shutdown_connections 2024-04-25T13:42:32.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:32.861+0000 7f11a6600640 1 -- 172.21.15.123:0/1007132431 wait complete. 2024-04-25T13:42:32.882 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:33.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.029+0000 7fa833800640 1 Processor -- start 2024-04-25T13:42:33.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.029+0000 7fa833800640 1 -- start start 2024-04-25T13:42:33.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.029+0000 7fa833800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa82c1623a0 0x7fa82c1627b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:33.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.029+0000 7fa833800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa82c0b6c30 0x7fa82c0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:33.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.029+0000 7fa833800640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa82c0b27b0 con 0x7fa82c162cf0 2024-04-25T13:42:33.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.029+0000 7fa833800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa82c0d16b0 con 0x7fa82c0b6c30 2024-04-25T13:42:33.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.029+0000 7fa833800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa82c0b8e80 con 0x7fa82c1623a0 2024-04-25T13:42:33.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.029+0000 7fa831800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa82c0b6c30 0x7fa82c0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:33.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.029+0000 7fa831800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa82c0b6c30 0x7fa82c0b7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48860/0 (socket says 172.21.15.123:48860) 2024-04-25T13:42:33.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.029+0000 7fa831800640 1 -- 172.21.15.123:0/3597349798 learned_addr learned my addr 172.21.15.123:0/3597349798 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:33.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.029+0000 7fa830e00640 1 --2- 172.21.15.123:0/3597349798 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa82c1623a0 0x7fa82c1627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:33.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.029+0000 7fa831800640 1 -- 172.21.15.123:0/3597349798 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa82c1623a0 msgr2=0x7fa82c1627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:33.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.029+0000 7fa831800640 1 --2- 172.21.15.123:0/3597349798 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa82c1623a0 0x7fa82c1627b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.029+0000 7fa831800640 1 -- 172.21.15.123:0/3597349798 >> v1:172.21.15.130:6789/0 conn(0x7fa82c162cf0 legacy=0x7fa82c0b6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:33.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.029+0000 7fa831800640 1 -- 172.21.15.123:0/3597349798 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82c0d1340 con 0x7fa82c0b6c30 2024-04-25T13:42:33.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.029+0000 7fa830e00640 1 --2- 172.21.15.123:0/3597349798 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa82c1623a0 0x7fa82c1627b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:33.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.033+0000 7fa831800640 1 --2- 172.21.15.123:0/3597349798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa82c0b6c30 0x7fa82c0b7040 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa824009e50 tx=0x7fa82401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4dfbc6e461bca2a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:33.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.033+0000 7fa82be00640 1 -- 172.21.15.123:0/3597349798 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8240a5700 con 0x7fa82c0b6c30 2024-04-25T13:42:33.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.033+0000 7fa82be00640 1 -- 172.21.15.123:0/3597349798 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8240a58a0 con 0x7fa82c0b6c30 2024-04-25T13:42:33.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.033+0000 7fa82be00640 1 -- 172.21.15.123:0/3597349798 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8240a5c70 con 0x7fa82c0b6c30 2024-04-25T13:42:33.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.033+0000 7fa833800640 1 -- 172.21.15.123:0/3597349798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa82c0b6c30 msgr2=0x7fa82c0b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:33.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.033+0000 7fa833800640 1 --2- 172.21.15.123:0/3597349798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa82c0b6c30 0x7fa82c0b7040 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa824009e50 tx=0x7fa82401c9f0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.033+0000 7fa833800640 1 -- 172.21.15.123:0/3597349798 shutdown_connections 2024-04-25T13:42:33.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.033+0000 7fa833800640 1 --2- 172.21.15.123:0/3597349798 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa82c0b6c30 0x7fa82c0b7040 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.033+0000 7fa833800640 1 --2- 172.21.15.123:0/3597349798 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa82c1623a0 0x7fa82c1627b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.033+0000 7fa833800640 1 -- 172.21.15.123:0/3597349798 >> 172.21.15.123:0/3597349798 conn(0x7fa82c0d0150 msgr2=0x7fa82c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:33.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.033+0000 7fa833800640 1 -- 172.21.15.123:0/3597349798 shutdown_connections 2024-04-25T13:42:33.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.033+0000 7fa833800640 1 -- 172.21.15.123:0/3597349798 wait complete. 2024-04-25T13:42:33.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.037+0000 7fa833800640 1 Processor -- start 2024-04-25T13:42:33.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.037+0000 7fa833800640 1 -- start start 2024-04-25T13:42:33.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.037+0000 7fa833800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa82c0b6c30 0x7fa82c0b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:33.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.037+0000 7fa833800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa82c1623a0 0x7fa82c0b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:33.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.037+0000 7fa833800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa82c162cf0 0x7fa82c14e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:33.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.037+0000 7fa833800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c0b88d0 con 0x7fa82c0b6c30 2024-04-25T13:42:33.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.037+0000 7fa833800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c0b2a20 con 0x7fa82c1623a0 2024-04-25T13:42:33.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.037+0000 7fa833800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa82c0b8a50 con 0x7fa82c162cf0 2024-04-25T13:42:33.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.037+0000 7fa830e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa82c0b6c30 0x7fa82c0b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:33.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.037+0000 7fa830e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa82c0b6c30 0x7fa82c0b4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48870/0 (socket says 172.21.15.123:48870) 2024-04-25T13:42:33.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.037+0000 7fa830e00640 1 -- 172.21.15.123:0/776120334 learned_addr learned my addr 172.21.15.123:0/776120334 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:33.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.037+0000 7fa823e00640 1 --2- 172.21.15.123:0/776120334 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa82c1623a0 0x7fa82c0b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:33.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.037+0000 7fa831800640 1 --2- 172.21.15.123:0/776120334 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa82c162cf0 0x7fa82c14e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:33.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.037+0000 7fa830e00640 1 -- 172.21.15.123:0/776120334 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa82c162cf0 msgr2=0x7fa82c14e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:33.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.037+0000 7fa830e00640 1 --2- 172.21.15.123:0/776120334 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa82c162cf0 0x7fa82c14e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.037+0000 7fa830e00640 1 -- 172.21.15.123:0/776120334 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa82c1623a0 msgr2=0x7fa82c0b11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:33.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.037+0000 7fa830e00640 1 --2- 172.21.15.123:0/776120334 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa82c1623a0 0x7fa82c0b11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.041+0000 7fa830e00640 1 -- 172.21.15.123:0/776120334 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82c14b2a0 con 0x7fa82c0b6c30 2024-04-25T13:42:33.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.041+0000 7fa831800640 1 --2- 172.21.15.123:0/776120334 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa82c162cf0 0x7fa82c14e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:33.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.041+0000 7fa830e00640 1 --2- 172.21.15.123:0/776120334 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa82c0b6c30 0x7fa82c0b4b30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00c7f0 tx=0x7fa81c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:33.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.041+0000 7fa829600640 1 -- 172.21.15.123:0/776120334 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81c015070 con 0x7fa82c0b6c30 2024-04-25T13:42:33.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.041+0000 7fa829600640 1 -- 172.21.15.123:0/776120334 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa81c007820 con 0x7fa82c0b6c30 2024-04-25T13:42:33.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.041+0000 7fa833800640 1 -- 172.21.15.123:0/776120334 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa82c14b580 con 0x7fa82c0b6c30 2024-04-25T13:42:33.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.041+0000 7fa829600640 1 -- 172.21.15.123:0/776120334 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81c007c10 con 0x7fa82c0b6c30 2024-04-25T13:42:33.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.041+0000 7fa833800640 1 -- 172.21.15.123:0/776120334 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa82c14bb40 con 0x7fa82c0b6c30 2024-04-25T13:42:33.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.041+0000 7fa833800640 1 -- 172.21.15.123:0/776120334 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa82c0507c0 con 0x7fa82c0b6c30 2024-04-25T13:42:33.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.041+0000 7fa829600640 1 -- 172.21.15.123:0/776120334 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa81c018070 con 0x7fa82c0b6c30 2024-04-25T13:42:33.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.045+0000 7fa829600640 1 --2- 172.21.15.123:0/776120334 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa80806f430 0x7fa808071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:33.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.045+0000 7fa829600640 1 -- 172.21.15.123:0/776120334 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa81c08f110 con 0x7fa82c0b6c30 2024-04-25T13:42:33.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.045+0000 7fa823e00640 1 --2- 172.21.15.123:0/776120334 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa80806f430 0x7fa808071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:33.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.045+0000 7fa823e00640 1 --2- 172.21.15.123:0/776120334 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa80806f430 0x7fa808071940 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0b1dd0 tx=0x7fa814009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:33.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.049+0000 7fa829600640 1 -- 172.21.15.123:0/776120334 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa81c05b910 con 0x7fa82c0b6c30 2024-04-25T13:42:33.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.205+0000 7fa833800640 1 -- 172.21.15.123:0/776120334 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa82c162ad0 con 0x7fa82c0b6c30 2024-04-25T13:42:33.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.205+0000 7fa829600640 1 -- 172.21.15.123:0/776120334 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16629 (secure 0 0 0) 0x7fa81c05fc10 con 0x7fa82c0b6c30 2024-04-25T13:42:33.207 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:33.207 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:42:07.405529+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:03.949161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:04.755682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:33.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.209+0000 7fa833800640 1 -- 172.21.15.123:0/776120334 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa80806f430 msgr2=0x7fa808071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:33.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.209+0000 7fa833800640 1 --2- 172.21.15.123:0/776120334 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa80806f430 0x7fa808071940 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0b1dd0 tx=0x7fa814009060 comp rx=0 tx=0).stop 2024-04-25T13:42:33.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.209+0000 7fa833800640 1 -- 172.21.15.123:0/776120334 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa82c0b6c30 msgr2=0x7fa82c0b4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:33.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.209+0000 7fa833800640 1 --2- 172.21.15.123:0/776120334 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa82c0b6c30 0x7fa82c0b4b30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00c7f0 tx=0x7fa81c00ccb0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.209+0000 7fa833800640 1 -- 172.21.15.123:0/776120334 shutdown_connections 2024-04-25T13:42:33.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.209+0000 7fa833800640 1 --2- 172.21.15.123:0/776120334 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa82c1623a0 0x7fa82c0b11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.209+0000 7fa833800640 1 --2- 172.21.15.123:0/776120334 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa80806f430 0x7fa808071940 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.209+0000 7fa833800640 1 --2- 172.21.15.123:0/776120334 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa82c162cf0 0x7fa82c14e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.209+0000 7fa833800640 1 --2- 172.21.15.123:0/776120334 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa82c0b6c30 0x7fa82c0b4b30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.209+0000 7fa833800640 1 -- 172.21.15.123:0/776120334 >> 172.21.15.123:0/776120334 conn(0x7fa82c0d0150 msgr2=0x7fa82c168990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:33.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.209+0000 7fa833800640 1 -- 172.21.15.123:0/776120334 shutdown_connections 2024-04-25T13:42:33.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.209+0000 7fa833800640 1 -- 172.21.15.123:0/776120334 wait complete. 2024-04-25T13:42:33.229 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:41:53.602480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:42:03.949161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:42:04.755682+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:42:33.229 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:42:33.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.377+0000 7fa5b5a00640 1 Processor -- start 2024-04-25T13:42:33.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.377+0000 7fa5b5a00640 1 -- start start 2024-04-25T13:42:33.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.381+0000 7fa5b5a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa5b00ceac0 0x7fa5b00c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:33.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.381+0000 7fa5b5a00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa5b00b3870 0x7fa5b00b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:33.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.381+0000 7fa5b5a00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5b00b41c0 con 0x7fa5b00b5980 2024-04-25T13:42:33.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.381+0000 7fa5b5a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa5b00c7140 con 0x7fa5b00ceac0 2024-04-25T13:42:33.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.381+0000 7fa5b5a00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fa5b00cf060 con 0x7fa5b00b3870 2024-04-25T13:42:33.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.381+0000 7fa5aea00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa5b00ceac0 0x7fa5b00c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:33.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.381+0000 7fa5aea00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa5b00ceac0 0x7fa5b00c75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48876/0 (socket says 172.21.15.123:48876) 2024-04-25T13:42:33.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.381+0000 7fa5aea00640 1 -- 172.21.15.123:0/1391084818 learned_addr learned my addr 172.21.15.123:0/1391084818 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:33.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.381+0000 7fa5ae000640 1 --2- 172.21.15.123:0/1391084818 >> v2:172.21.15.130:3300/0 conn(0x7fa5b00b3870 0x7fa5b00b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:33.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.381+0000 7fa5aea00640 1 -- 172.21.15.123:0/1391084818 >> v2:172.21.15.130:3300/0 conn(0x7fa5b00b3870 msgr2=0x7fa5b00b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:33.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.381+0000 7fa5aea00640 1 --2- 172.21.15.123:0/1391084818 >> v2:172.21.15.130:3300/0 conn(0x7fa5b00b3870 0x7fa5b00b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.381+0000 7fa5aea00640 1 -- 172.21.15.123:0/1391084818 >> v1:172.21.15.130:6789/0 conn(0x7fa5b00b5980 legacy=0x7fa5b00b5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:33.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.381+0000 7fa5aea00640 1 -- 172.21.15.123:0/1391084818 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5b00c7b10 con 0x7fa5b00ceac0 2024-04-25T13:42:33.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.381+0000 7fa5ae000640 1 --2- 172.21.15.123:0/1391084818 >> v2:172.21.15.130:3300/0 conn(0x7fa5b00b3870 0x7fa5b00b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:33.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.385+0000 7fa5aea00640 1 --2- 172.21.15.123:0/1391084818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5b00ceac0 0x7fa5b00c75d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0161870 tx=0x7fa5a001c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6133676f67071f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:33.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.385+0000 7fa5ad600640 1 -- 172.21.15.123:0/1391084818 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a00a55d0 con 0x7fa5b00ceac0 2024-04-25T13:42:33.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.385+0000 7fa5ad600640 1 -- 172.21.15.123:0/1391084818 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5a00a5770 con 0x7fa5b00ceac0 2024-04-25T13:42:33.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.385+0000 7fa5ad600640 1 -- 172.21.15.123:0/1391084818 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a00a5b40 con 0x7fa5b00ceac0 2024-04-25T13:42:33.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.385+0000 7fa5b5a00640 1 -- 172.21.15.123:0/1391084818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5b00ceac0 msgr2=0x7fa5b00c75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:33.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.385+0000 7fa5b5a00640 1 --2- 172.21.15.123:0/1391084818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5b00ceac0 0x7fa5b00c75d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0161870 tx=0x7fa5a001c710 comp rx=0 tx=0).stop 2024-04-25T13:42:33.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.385+0000 7fa5b5a00640 1 -- 172.21.15.123:0/1391084818 shutdown_connections 2024-04-25T13:42:33.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.385+0000 7fa5b5a00640 1 --2- 172.21.15.123:0/1391084818 >> v2:172.21.15.130:3300/0 conn(0x7fa5b00b3870 0x7fa5b00b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.385+0000 7fa5b5a00640 1 --2- 172.21.15.123:0/1391084818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5b00ceac0 0x7fa5b00c75d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.385+0000 7fa5b5a00640 1 -- 172.21.15.123:0/1391084818 >> 172.21.15.123:0/1391084818 conn(0x7fa5b006ca70 msgr2=0x7fa5b006ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:33.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.385+0000 7fa5b5a00640 1 -- 172.21.15.123:0/1391084818 shutdown_connections 2024-04-25T13:42:33.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.385+0000 7fa5b5a00640 1 -- 172.21.15.123:0/1391084818 wait complete. 2024-04-25T13:42:33.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.389+0000 7fa5b5a00640 1 Processor -- start 2024-04-25T13:42:33.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.389+0000 7fa5b5a00640 1 -- start start 2024-04-25T13:42:33.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.389+0000 7fa5b5a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5b00b3870 0x7fa5b014d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:33.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.389+0000 7fa5b5a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5b00b5980 0x7fa5b01550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:33.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.389+0000 7fa5b5a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5b00ceac0 0x7fa5b01555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:33.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.389+0000 7fa5b5a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b015ee90 con 0x7fa5b00ceac0 2024-04-25T13:42:33.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.389+0000 7fa5b5a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b00b5110 con 0x7fa5b00b5980 2024-04-25T13:42:33.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.389+0000 7fa5b5a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa5b014eab0 con 0x7fa5b00b3870 2024-04-25T13:42:33.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.389+0000 7fa5af400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5b00ceac0 0x7fa5b01555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:33.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.389+0000 7fa5af400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5b00ceac0 0x7fa5b01555e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48888/0 (socket says 172.21.15.123:48888) 2024-04-25T13:42:33.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.389+0000 7fa5af400640 1 -- 172.21.15.123:0/655114065 learned_addr learned my addr 172.21.15.123:0/655114065 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:33.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.389+0000 7fa5ae000640 1 --2- 172.21.15.123:0/655114065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5b00b5980 0x7fa5b01550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:33.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.389+0000 7fa5aea00640 1 --2- 172.21.15.123:0/655114065 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5b00b3870 0x7fa5b014d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:33.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.389+0000 7fa5af400640 1 -- 172.21.15.123:0/655114065 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5b00b3870 msgr2=0x7fa5b014d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:33.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.389+0000 7fa5af400640 1 --2- 172.21.15.123:0/655114065 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5b00b3870 0x7fa5b014d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.389+0000 7fa5af400640 1 -- 172.21.15.123:0/655114065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5b00b5980 msgr2=0x7fa5b01550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:33.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.389+0000 7fa5af400640 1 --2- 172.21.15.123:0/655114065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5b00b5980 0x7fa5b01550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.389+0000 7fa5af400640 1 -- 172.21.15.123:0/655114065 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5b00d1040 con 0x7fa5b00ceac0 2024-04-25T13:42:33.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.389+0000 7fa5aea00640 1 --2- 172.21.15.123:0/655114065 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5b00b3870 0x7fa5b014d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:33.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.389+0000 7fa5ae000640 1 --2- 172.21.15.123:0/655114065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5b00b5980 0x7fa5b01550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:33.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.389+0000 7fa5af400640 1 --2- 172.21.15.123:0/655114065 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5b00ceac0 0x7fa5b01555e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800b440 tx=0x7fa5a800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:33.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.389+0000 7fa5a6a00640 1 -- 172.21.15.123:0/655114065 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a8015020 con 0x7fa5b00ceac0 2024-04-25T13:42:33.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.389+0000 7fa5a6a00640 1 -- 172.21.15.123:0/655114065 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5a8011870 con 0x7fa5b00ceac0 2024-04-25T13:42:33.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.389+0000 7fa5b5a00640 1 -- 172.21.15.123:0/655114065 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5b015c360 con 0x7fa5b00ceac0 2024-04-25T13:42:33.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.389+0000 7fa5a6a00640 1 -- 172.21.15.123:0/655114065 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a8011c60 con 0x7fa5b00ceac0 2024-04-25T13:42:33.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.389+0000 7fa5b5a00640 1 -- 172.21.15.123:0/655114065 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5b00d0d60 con 0x7fa5b00ceac0 2024-04-25T13:42:33.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.393+0000 7fa5b5a00640 1 -- 172.21.15.123:0/655114065 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5b006d600 con 0x7fa5b00ceac0 2024-04-25T13:42:33.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.393+0000 7fa5a6a00640 1 -- 172.21.15.123:0/655114065 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa5a8018020 con 0x7fa5b00ceac0 2024-04-25T13:42:33.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.393+0000 7fa5a6a00640 1 --2- 172.21.15.123:0/655114065 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa59006f430 0x7fa590071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:33.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.393+0000 7fa5a6a00640 1 -- 172.21.15.123:0/655114065 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa5a808ef20 con 0x7fa5b00ceac0 2024-04-25T13:42:33.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.393+0000 7fa5aea00640 1 --2- 172.21.15.123:0/655114065 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa59006f430 0x7fa590071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:33.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.393+0000 7fa5aea00640 1 --2- 172.21.15.123:0/655114065 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa59006f430 0x7fa590071940 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa5a00ae000 tx=0x7fa5a00a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:33.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.397+0000 7fa5a6a00640 1 -- 172.21.15.123:0/655114065 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa5a801f030 con 0x7fa5b00ceac0 2024-04-25T13:42:33.535 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:42:33.538 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:42:33.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.557+0000 7fa5b5a00640 1 -- 172.21.15.123:0/655114065 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa5b0050750 con 0x7fa5b00ceac0 2024-04-25T13:42:33.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.557+0000 7fa5a6a00640 1 -- 172.21.15.123:0/655114065 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fa5a805bd70 con 0x7fa5b00ceac0 2024-04-25T13:42:33.558 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-04-25T13:42:33.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.557+0000 7fa5b5a00640 1 -- 172.21.15.123:0/655114065 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa59006f430 msgr2=0x7fa590071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:33.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.557+0000 7fa5b5a00640 1 --2- 172.21.15.123:0/655114065 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa59006f430 0x7fa590071940 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa5a00ae000 tx=0x7fa5a00a7070 comp rx=0 tx=0).stop 2024-04-25T13:42:33.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.557+0000 7fa5b5a00640 1 -- 172.21.15.123:0/655114065 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5b00ceac0 msgr2=0x7fa5b01555e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:33.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.557+0000 7fa5b5a00640 1 --2- 172.21.15.123:0/655114065 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5b00ceac0 0x7fa5b01555e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800b440 tx=0x7fa5a800b900 comp rx=0 tx=0).stop 2024-04-25T13:42:33.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.557+0000 7fa5b5a00640 1 -- 172.21.15.123:0/655114065 shutdown_connections 2024-04-25T13:42:33.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.557+0000 7fa5b5a00640 1 --2- 172.21.15.123:0/655114065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5b00b5980 0x7fa5b01550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.557+0000 7fa5b5a00640 1 --2- 172.21.15.123:0/655114065 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa59006f430 0x7fa590071940 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.557+0000 7fa5b5a00640 1 --2- 172.21.15.123:0/655114065 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5b00ceac0 0x7fa5b01555e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.557+0000 7fa5b5a00640 1 --2- 172.21.15.123:0/655114065 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5b00b3870 0x7fa5b014d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.557+0000 7fa5b5a00640 1 -- 172.21.15.123:0/655114065 >> 172.21.15.123:0/655114065 conn(0x7fa5b006ca70 msgr2=0x7fa5b01564a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:33.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.557+0000 7fa5b5a00640 1 -- 172.21.15.123:0/655114065 shutdown_connections 2024-04-25T13:42:33.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.557+0000 7fa5b5a00640 1 -- 172.21.15.123:0/655114065 wait complete. 2024-04-25T13:42:33.579 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:42:33.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.813+0000 7fe95ce00640 1 Processor -- start 2024-04-25T13:42:33.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe95ce00640 1 -- start start 2024-04-25T13:42:33.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe95ce00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe9581534e0 0x7fe958074240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:33.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe95ce00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9581538f0 con 0x7fe9580cdeb0 2024-04-25T13:42:33.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe95ce00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe958074780 con 0x7fe9580b4770 2024-04-25T13:42:33.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe95ce00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fe958074a50 con 0x7fe9581534e0 2024-04-25T13:42:33.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe955400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe9580cdeb0 0x7fe9580ce2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60768/0 (socket says 172.21.15.123:60768) 2024-04-25T13:42:33.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe955400640 1 -- 172.21.15.123:0/3425983749 learned_addr learned my addr 172.21.15.123:0/3425983749 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:33.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe955e00640 1 --2- 172.21.15.123:0/3425983749 >> v2:172.21.15.130:3300/0 conn(0x7fe9581534e0 0x7fe958074240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:33.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe954a00640 1 -- 172.21.15.123:0/3425983749 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3027983932 0 0) 0x7fe9581538f0 con 0x7fe9580cdeb0 2024-04-25T13:42:33.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe954a00640 1 -- 172.21.15.123:0/3425983749 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe93c003450 con 0x7fe9580cdeb0 2024-04-25T13:42:33.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe954a00640 1 -- 172.21.15.123:0/3425983749 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3547405113 0 0) 0x7fe958074780 con 0x7fe9580b4770 2024-04-25T13:42:33.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe954a00640 1 -- 172.21.15.123:0/3425983749 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9581538f0 con 0x7fe9580b4770 2024-04-25T13:42:33.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe954a00640 1 -- 172.21.15.123:0/3425983749 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2281460712 0 0) 0x7fe93c003450 con 0x7fe9580cdeb0 2024-04-25T13:42:33.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe954a00640 1 -- 172.21.15.123:0/3425983749 >> v2:172.21.15.130:3300/0 conn(0x7fe9581534e0 msgr2=0x7fe958074240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:33.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe954a00640 1 --2- 172.21.15.123:0/3425983749 >> v2:172.21.15.130:3300/0 conn(0x7fe9581534e0 0x7fe958074240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe954a00640 1 -- 172.21.15.123:0/3425983749 >> v1:172.21.15.130:6789/0 conn(0x7fe9580b4770 legacy=0x7fe9580b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:33.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe954a00640 1 -- 172.21.15.123:0/3425983749 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95815cde0 con 0x7fe9580cdeb0 2024-04-25T13:42:33.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe954a00640 1 -- 172.21.15.123:0/3425983749 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7fe944001680 con 0x7fe9580cdeb0 2024-04-25T13:42:33.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe954a00640 1 -- 172.21.15.123:0/3425983749 >> v1:172.21.15.123:6789/0 conn(0x7fe9580cdeb0 legacy=0x7fe9580ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:33.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe954a00640 1 --2- 172.21.15.123:0/3425983749 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe93c003d20 0x7fe93c008860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:33.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe954a00640 1 --2- 172.21.15.123:0/3425983749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe93c008da0 0x7fe93c00b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:33.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe954a00640 1 --2- 172.21.15.123:0/3425983749 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe93c00b700 0x7fe93c00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:33.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe954a00640 1 -- 172.21.15.123:0/3425983749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe958074a50 con 0x7fe93c008da0 2024-04-25T13:42:33.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe954a00640 1 -- 172.21.15.123:0/3425983749 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe93c00e4c0 con 0x7fe93c003d20 2024-04-25T13:42:33.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe954a00640 1 -- 172.21.15.123:0/3425983749 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe93c00e6c0 con 0x7fe93c00b700 2024-04-25T13:42:33.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe955400640 1 --2- 172.21.15.123:0/3425983749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe93c008da0 0x7fe93c00b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:33.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe955e00640 1 --2- 172.21.15.123:0/3425983749 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe93c003d20 0x7fe93c008860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:33.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe956800640 1 --2- 172.21.15.123:0/3425983749 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe93c00b700 0x7fe93c00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:33.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe955400640 1 -- 172.21.15.123:0/3425983749 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe93c00b700 msgr2=0x7fe93c00dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:33.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe955400640 1 --2- 172.21.15.123:0/3425983749 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe93c00b700 0x7fe93c00dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe955400640 1 -- 172.21.15.123:0/3425983749 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe93c003d20 msgr2=0x7fe93c008860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:33.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.817+0000 7fe955400640 1 --2- 172.21.15.123:0/3425983749 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe93c003d20 0x7fe93c008860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.821+0000 7fe955400640 1 -- 172.21.15.123:0/3425983749 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe93c003450 con 0x7fe93c008da0 2024-04-25T13:42:33.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.821+0000 7fe956800640 1 --2- 172.21.15.123:0/3425983749 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe93c00b700 0x7fe93c00dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:33.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.821+0000 7fe956800640 1 -- 172.21.15.123:0/3425983749 reap_dead start 2024-04-25T13:42:33.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.821+0000 7fe955400640 1 --2- 172.21.15.123:0/3425983749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe93c008da0 0x7fe93c00b1c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe94400c190 tx=0x7fe94401cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed628523889f6c65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:33.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.821+0000 7fe954a00640 1 -- 172.21.15.123:0/3425983749 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe944007cf0 con 0x7fe93c008da0 2024-04-25T13:42:33.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.821+0000 7fe954a00640 1 -- 172.21.15.123:0/3425983749 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9440a9020 con 0x7fe93c008da0 2024-04-25T13:42:33.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.821+0000 7fe954a00640 1 -- 172.21.15.123:0/3425983749 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe944005ae0 con 0x7fe93c008da0 2024-04-25T13:42:33.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.821+0000 7fe95ce00640 1 -- 172.21.15.123:0/3425983749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe93c008da0 msgr2=0x7fe93c00b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:33.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.821+0000 7fe95ce00640 1 --2- 172.21.15.123:0/3425983749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe93c008da0 0x7fe93c00b1c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe94400c190 tx=0x7fe94401cbe0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.821+0000 7fe95ce00640 1 -- 172.21.15.123:0/3425983749 shutdown_connections 2024-04-25T13:42:33.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.821+0000 7fe95ce00640 1 --2- 172.21.15.123:0/3425983749 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe93c008da0 0x7fe93c00b1c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.821+0000 7fe95ce00640 1 -- 172.21.15.123:0/3425983749 >> 172.21.15.123:0/3425983749 conn(0x7fe95806ca70 msgr2=0x7fe95806ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:33.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.821+0000 7fe95ce00640 1 -- 172.21.15.123:0/3425983749 shutdown_connections 2024-04-25T13:42:33.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.821+0000 7fe95ce00640 1 -- 172.21.15.123:0/3425983749 wait complete. 2024-04-25T13:42:33.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.825+0000 7fe95ce00640 1 Processor -- start 2024-04-25T13:42:33.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.825+0000 7fe95ce00640 1 -- start start 2024-04-25T13:42:33.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.825+0000 7fe95ce00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe93c008da0 0x7fe9581e9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:33.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.825+0000 7fe95ce00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe95813ebc0 0x7fe9581e81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:33.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.825+0000 7fe95ce00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9581e86e0 0x7fe95813c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:33.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.825+0000 7fe95ce00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe95815cbc0 con 0x7fe9581e86e0 2024-04-25T13:42:33.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.825+0000 7fe95ce00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe95815ca40 con 0x7fe95813ebc0 2024-04-25T13:42:33.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.825+0000 7fe95ce00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe9580ce6d0 con 0x7fe93c008da0 2024-04-25T13:42:33.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.829+0000 7fe956800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9581e86e0 0x7fe95813c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:33.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.829+0000 7fe956800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9581e86e0 0x7fe95813c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48902/0 (socket says 172.21.15.123:48902) 2024-04-25T13:42:33.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.829+0000 7fe956800640 1 -- 172.21.15.123:0/2547848266 learned_addr learned my addr 172.21.15.123:0/2547848266 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:33.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.829+0000 7fe955e00640 1 --2- 172.21.15.123:0/2547848266 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe93c008da0 0x7fe9581e9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:33.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.829+0000 7fe955400640 1 --2- 172.21.15.123:0/2547848266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe95813ebc0 0x7fe9581e81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:33.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.829+0000 7fe956800640 1 -- 172.21.15.123:0/2547848266 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe93c008da0 msgr2=0x7fe9581e9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:33.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.829+0000 7fe956800640 1 --2- 172.21.15.123:0/2547848266 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe93c008da0 0x7fe9581e9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.829+0000 7fe956800640 1 -- 172.21.15.123:0/2547848266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe95813ebc0 msgr2=0x7fe9581e81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:33.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.829+0000 7fe956800640 1 --2- 172.21.15.123:0/2547848266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe95813ebc0 0x7fe9581e81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.829+0000 7fe956800640 1 -- 172.21.15.123:0/2547848266 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9581e8f10 con 0x7fe9581e86e0 2024-04-25T13:42:33.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.829+0000 7fe956800640 1 --2- 172.21.15.123:0/2547848266 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9581e86e0 0x7fe95813c770 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe958072aa0 tx=0x7fe95000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:33.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.829+0000 7fe94e000640 1 -- 172.21.15.123:0/2547848266 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe950006b60 con 0x7fe9581e86e0 2024-04-25T13:42:33.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.829+0000 7fe94e000640 1 -- 172.21.15.123:0/2547848266 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe950006d20 con 0x7fe9581e86e0 2024-04-25T13:42:33.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.829+0000 7fe94e000640 1 -- 172.21.15.123:0/2547848266 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe950003980 con 0x7fe9581e86e0 2024-04-25T13:42:33.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.829+0000 7fe95ce00640 1 -- 172.21.15.123:0/2547848266 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9581e91f0 con 0x7fe9581e86e0 2024-04-25T13:42:33.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.829+0000 7fe95ce00640 1 -- 172.21.15.123:0/2547848266 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9581e97b0 con 0x7fe9581e86e0 2024-04-25T13:42:33.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.829+0000 7fe95ce00640 1 -- 172.21.15.123:0/2547848266 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9581e8c80 con 0x7fe9581e86e0 2024-04-25T13:42:33.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.829+0000 7fe94e000640 1 -- 172.21.15.123:0/2547848266 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe95001a020 con 0x7fe9581e86e0 2024-04-25T13:42:33.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.833+0000 7fe94e000640 1 --2- 172.21.15.123:0/2547848266 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe93806f400 0x7fe938071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:33.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.833+0000 7fe94e000640 1 -- 172.21.15.123:0/2547848266 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe95008e9c0 con 0x7fe9581e86e0 2024-04-25T13:42:33.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.833+0000 7fe955e00640 1 --2- 172.21.15.123:0/2547848266 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe93806f400 0x7fe938071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:33.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.833+0000 7fe955e00640 1 --2- 172.21.15.123:0/2547848266 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe93806f400 0x7fe938071910 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe958070e80 tx=0x7fe948009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:33.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.837+0000 7fe94e000640 1 -- 172.21.15.123:0/2547848266 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe95005b810 con 0x7fe9581e86e0 2024-04-25T13:42:33.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.993+0000 7fe95ce00640 1 -- 172.21.15.123:0/2547848266 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe958050750 con 0x7fe9581e86e0 2024-04-25T13:42:33.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.993+0000 7fe94e000640 1 -- 172.21.15.123:0/2547848266 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fe95005b110 con 0x7fe9581e86e0 2024-04-25T13:42:33.992 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-04-25T13:42:33.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.993+0000 7fe95ce00640 1 -- 172.21.15.123:0/2547848266 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe93806f400 msgr2=0x7fe938071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:33.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.993+0000 7fe95ce00640 1 --2- 172.21.15.123:0/2547848266 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe93806f400 0x7fe938071910 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe958070e80 tx=0x7fe948009190 comp rx=0 tx=0).stop 2024-04-25T13:42:33.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.993+0000 7fe95ce00640 1 -- 172.21.15.123:0/2547848266 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9581e86e0 msgr2=0x7fe95813c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:33.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.993+0000 7fe95ce00640 1 --2- 172.21.15.123:0/2547848266 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9581e86e0 0x7fe95813c770 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe958072aa0 tx=0x7fe95000ec10 comp rx=0 tx=0).stop 2024-04-25T13:42:33.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.993+0000 7fe95ce00640 1 -- 172.21.15.123:0/2547848266 shutdown_connections 2024-04-25T13:42:33.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.993+0000 7fe95ce00640 1 --2- 172.21.15.123:0/2547848266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe95813ebc0 0x7fe9581e81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.993+0000 7fe95ce00640 1 --2- 172.21.15.123:0/2547848266 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe93806f400 0x7fe938071910 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.993+0000 7fe95ce00640 1 --2- 172.21.15.123:0/2547848266 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9581e86e0 0x7fe95813c770 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.993+0000 7fe95ce00640 1 --2- 172.21.15.123:0/2547848266 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe93c008da0 0x7fe9581e9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:33.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.993+0000 7fe95ce00640 1 -- 172.21.15.123:0/2547848266 >> 172.21.15.123:0/2547848266 conn(0x7fe95806ca70 msgr2=0x7fe958160010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:33.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.993+0000 7fe95ce00640 1 -- 172.21.15.123:0/2547848266 shutdown_connections 2024-04-25T13:42:33.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:33.993+0000 7fe95ce00640 1 -- 172.21.15.123:0/2547848266 wait complete. 2024-04-25T13:42:34.014 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:42:34.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.161+0000 7f1497200640 1 Processor -- start 2024-04-25T13:42:34.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.161+0000 7f1497200640 1 -- start start 2024-04-25T13:42:34.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.165+0000 7f1497200640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f149006c670 0x7f14900b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:34.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.165+0000 7f1497200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f14900b6c00 0x7f1490161930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:34.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.165+0000 7f1497200640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14900af9a0 con 0x7f1490161e70 2024-04-25T13:42:34.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.165+0000 7f1497200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f14900af750 con 0x7f14900b6c00 2024-04-25T13:42:34.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.165+0000 7f1497200640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f14900afc80 con 0x7f149006c670 2024-04-25T13:42:34.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.165+0000 7f1487400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f14900b6c00 0x7f1490161930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:34.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.165+0000 7f1487400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f14900b6c00 0x7f1490161930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48910/0 (socket says 172.21.15.123:48910) 2024-04-25T13:42:34.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.165+0000 7f1487400640 1 -- 172.21.15.123:0/2414445640 learned_addr learned my addr 172.21.15.123:0/2414445640 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:34.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.165+0000 7f148fe00640 1 --2- 172.21.15.123:0/2414445640 >> v2:172.21.15.130:3300/0 conn(0x7f149006c670 0x7f14900b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:34.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.165+0000 7f1487400640 1 -- 172.21.15.123:0/2414445640 >> v2:172.21.15.130:3300/0 conn(0x7f149006c670 msgr2=0x7f14900b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:34.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.165+0000 7f1487400640 1 --2- 172.21.15.123:0/2414445640 >> v2:172.21.15.130:3300/0 conn(0x7f149006c670 0x7f14900b66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.165+0000 7f1487400640 1 -- 172.21.15.123:0/2414445640 >> v1:172.21.15.130:6789/0 conn(0x7f1490161e70 legacy=0x7f149015dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:34.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.165+0000 7f1487400640 1 -- 172.21.15.123:0/2414445640 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14900b5ec0 con 0x7f14900b6c00 2024-04-25T13:42:34.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.169+0000 7f1487400640 1 --2- 172.21.15.123:0/2414445640 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14900b6c00 0x7f1490161930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1490074740 tx=0x7f147801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5985a61f44e1462 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:34.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.169+0000 7f148f400640 1 -- 172.21.15.123:0/2414445640 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14780b0070 con 0x7f14900b6c00 2024-04-25T13:42:34.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.169+0000 7f148f400640 1 -- 172.21.15.123:0/2414445640 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14780ab600 con 0x7f14900b6c00 2024-04-25T13:42:34.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.169+0000 7f148f400640 1 -- 172.21.15.123:0/2414445640 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14780ab9d0 con 0x7f14900b6c00 2024-04-25T13:42:34.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.169+0000 7f1497200640 1 -- 172.21.15.123:0/2414445640 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14900b6c00 msgr2=0x7f1490161930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:34.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.169+0000 7f1497200640 1 --2- 172.21.15.123:0/2414445640 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14900b6c00 0x7f1490161930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1490074740 tx=0x7f147801c490 comp rx=0 tx=0).stop 2024-04-25T13:42:34.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.169+0000 7f1497200640 1 -- 172.21.15.123:0/2414445640 shutdown_connections 2024-04-25T13:42:34.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.169+0000 7f1497200640 1 --2- 172.21.15.123:0/2414445640 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14900b6c00 0x7f1490161930 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.169+0000 7f1497200640 1 --2- 172.21.15.123:0/2414445640 >> v2:172.21.15.130:3300/0 conn(0x7f149006c670 0x7f14900b66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.169+0000 7f1497200640 1 -- 172.21.15.123:0/2414445640 >> 172.21.15.123:0/2414445640 conn(0x7f14900d2180 msgr2=0x7f14900d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:34.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.169+0000 7f1497200640 1 -- 172.21.15.123:0/2414445640 shutdown_connections 2024-04-25T13:42:34.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.169+0000 7f1497200640 1 -- 172.21.15.123:0/2414445640 wait complete. 2024-04-25T13:42:34.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.173+0000 7f1497200640 1 Processor -- start 2024-04-25T13:42:34.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.173+0000 7f1497200640 1 -- start start 2024-04-25T13:42:34.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.173+0000 7f1497200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f149006c670 0x7f1490140290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:34.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.173+0000 7f1497200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14900b6c00 0x7f14901582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:34.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.173+0000 7f1497200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1490161e70 0x7f1490158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:34.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.173+0000 7f1497200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f14900b7190 con 0x7f14900b6c00 2024-04-25T13:42:34.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.173+0000 7f1497200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f14900b7010 con 0x7f149006c670 2024-04-25T13:42:34.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.173+0000 7f1497200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f149016b4e0 con 0x7f1490161e70 2024-04-25T13:42:34.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.173+0000 7f1487400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14900b6c00 0x7f14901582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:34.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.173+0000 7f1487400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14900b6c00 0x7f14901582f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48920/0 (socket says 172.21.15.123:48920) 2024-04-25T13:42:34.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.173+0000 7f1487400640 1 -- 172.21.15.123:0/2627194053 learned_addr learned my addr 172.21.15.123:0/2627194053 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:34.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.173+0000 7f1495200640 1 --2- 172.21.15.123:0/2627194053 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1490161e70 0x7f1490158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:34.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.173+0000 7f148fe00640 1 --2- 172.21.15.123:0/2627194053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f149006c670 0x7f1490140290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:34.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.173+0000 7f1487400640 1 -- 172.21.15.123:0/2627194053 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1490161e70 msgr2=0x7f1490158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:34.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.173+0000 7f1487400640 1 --2- 172.21.15.123:0/2627194053 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1490161e70 0x7f1490158830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.173+0000 7f1487400640 1 -- 172.21.15.123:0/2627194053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f149006c670 msgr2=0x7f1490140290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:34.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.173+0000 7f1487400640 1 --2- 172.21.15.123:0/2627194053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f149006c670 0x7f1490140290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.173+0000 7f1487400640 1 -- 172.21.15.123:0/2627194053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1490158d70 con 0x7f14900b6c00 2024-04-25T13:42:34.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.173+0000 7f148fe00640 1 --2- 172.21.15.123:0/2627194053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f149006c670 0x7f1490140290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:34.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.173+0000 7f1487400640 1 --2- 172.21.15.123:0/2627194053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14900b6c00 0x7f14901582f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f14780ae040 tx=0x7f1478019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:34.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.173+0000 7f148cc00640 1 -- 172.21.15.123:0/2627194053 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14780abe60 con 0x7f14900b6c00 2024-04-25T13:42:34.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.173+0000 7f148cc00640 1 -- 172.21.15.123:0/2627194053 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14780b4620 con 0x7f14900b6c00 2024-04-25T13:42:34.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.173+0000 7f1497200640 1 -- 172.21.15.123:0/2627194053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f149009bc50 con 0x7f14900b6c00 2024-04-25T13:42:34.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.173+0000 7f148cc00640 1 -- 172.21.15.123:0/2627194053 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14780b0040 con 0x7f14900b6c00 2024-04-25T13:42:34.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.173+0000 7f1497200640 1 -- 172.21.15.123:0/2627194053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14900cf0b0 con 0x7f14900b6c00 2024-04-25T13:42:34.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.173+0000 7f1497200640 1 -- 172.21.15.123:0/2627194053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1490050750 con 0x7f14900b6c00 2024-04-25T13:42:34.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.177+0000 7f148cc00640 1 -- 172.21.15.123:0/2627194053 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f14780ab4c0 con 0x7f14900b6c00 2024-04-25T13:42:34.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.177+0000 7f148cc00640 1 --2- 172.21.15.123:0/2627194053 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f146c06f430 0x7f146c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:34.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.177+0000 7f148cc00640 1 -- 172.21.15.123:0/2627194053 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1478129700 con 0x7f14900b6c00 2024-04-25T13:42:34.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.177+0000 7f148fe00640 1 --2- 172.21.15.123:0/2627194053 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f146c06f430 0x7f146c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:34.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.177+0000 7f148fe00640 1 --2- 172.21.15.123:0/2627194053 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f146c06f430 0x7f146c071940 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1480009b10 tx=0x7f1480008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:34.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.181+0000 7f148cc00640 1 -- 172.21.15.123:0/2627194053 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1478016110 con 0x7f14900b6c00 2024-04-25T13:42:34.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.337+0000 7f1497200640 1 -- 172.21.15.123:0/2627194053 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f14900b56b0 con 0x7f14900b6c00 2024-04-25T13:42:34.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.337+0000 7f148cc00640 1 -- 172.21.15.123:0/2627194053 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f14780f6660 con 0x7f14900b6c00 2024-04-25T13:42:34.338 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-04-25T13:42:34.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.341+0000 7f1497200640 1 -- 172.21.15.123:0/2627194053 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f146c06f430 msgr2=0x7f146c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:34.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.341+0000 7f1497200640 1 --2- 172.21.15.123:0/2627194053 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f146c06f430 0x7f146c071940 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1480009b10 tx=0x7f1480008040 comp rx=0 tx=0).stop 2024-04-25T13:42:34.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.341+0000 7f1497200640 1 -- 172.21.15.123:0/2627194053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14900b6c00 msgr2=0x7f14901582f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:34.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.341+0000 7f1497200640 1 --2- 172.21.15.123:0/2627194053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14900b6c00 0x7f14901582f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f14780ae040 tx=0x7f1478019230 comp rx=0 tx=0).stop 2024-04-25T13:42:34.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.341+0000 7f1497200640 1 -- 172.21.15.123:0/2627194053 shutdown_connections 2024-04-25T13:42:34.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.341+0000 7f1497200640 1 --2- 172.21.15.123:0/2627194053 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f146c06f430 0x7f146c071940 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.341+0000 7f1497200640 1 --2- 172.21.15.123:0/2627194053 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1490161e70 0x7f1490158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.341+0000 7f1497200640 1 --2- 172.21.15.123:0/2627194053 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14900b6c00 0x7f14901582f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.341+0000 7f1497200640 1 --2- 172.21.15.123:0/2627194053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f149006c670 0x7f1490140290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.341+0000 7f1497200640 1 -- 172.21.15.123:0/2627194053 >> 172.21.15.123:0/2627194053 conn(0x7f14900d2180 msgr2=0x7f1490160860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:34.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.341+0000 7f1497200640 1 -- 172.21.15.123:0/2627194053 shutdown_connections 2024-04-25T13:42:34.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.341+0000 7f1497200640 1 -- 172.21.15.123:0/2627194053 wait complete. 2024-04-25T13:42:34.360 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:34.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.505+0000 7f740a600640 1 Processor -- start 2024-04-25T13:42:34.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.505+0000 7f740a600640 1 -- start start 2024-04-25T13:42:34.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.509+0000 7f740a600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74040b6970 0x7f74040b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:34.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.509+0000 7f740a600640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f74040cd8e0 0x7f74040cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:34.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.509+0000 7f740a600640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74040b72c0 con 0x7f74041474f0 2024-04-25T13:42:34.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.509+0000 7f740a600640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f74040d0d10 con 0x7f74040cd8e0 2024-04-25T13:42:34.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.509+0000 7f740a600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7404073400 con 0x7f74040b6970 2024-04-25T13:42:34.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.509+0000 7f7402a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74040b6970 0x7f74040b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:34.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.509+0000 7f7403400640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f74041474f0 0x7f740415eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.123:41074/0 (socket says 172.21.15.123:41074) 2024-04-25T13:42:34.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.509+0000 7f7402a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74040b6970 0x7f74040b6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:40714/0 (socket says 172.21.15.123:40714) 2024-04-25T13:42:34.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.509+0000 7f7403400640 1 -- 172.21.15.123:0/3343935306 learned_addr learned my addr 172.21.15.123:0/3343935306 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:34.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.509+0000 7f7403e00640 1 --2- 172.21.15.123:0/3343935306 >> v2:172.21.15.130:3300/0 conn(0x7f74040cd8e0 0x7f74040cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:34.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.509+0000 7f7402a00640 1 -- 172.21.15.123:0/3343935306 >> v2:172.21.15.130:3300/0 conn(0x7f74040cd8e0 msgr2=0x7f74040cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:34.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.509+0000 7f7402a00640 1 --2- 172.21.15.123:0/3343935306 >> v2:172.21.15.130:3300/0 conn(0x7f74040cd8e0 0x7f74040cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.509+0000 7f7402a00640 1 -- 172.21.15.123:0/3343935306 >> v1:172.21.15.130:6789/0 conn(0x7f74041474f0 legacy=0x7f740415eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:34.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.509+0000 7f7402a00640 1 -- 172.21.15.123:0/3343935306 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74040736e0 con 0x7f74040b6970 2024-04-25T13:42:34.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.509+0000 7f7402000640 1 -- 172.21.15.123:0/3343935306 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4242905729 0 0) 0x7f73f40014a0 con 0x7f74041474f0 2024-04-25T13:42:34.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.513+0000 7f7402a00640 1 --2- 172.21.15.123:0/3343935306 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74040b6970 0x7f74040b6d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f73f00097c0 tx=0x7f73f001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdfc6ca8b69505fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:34.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.513+0000 7f7402000640 1 -- 172.21.15.123:0/3343935306 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f00ab610 con 0x7f74040b6970 2024-04-25T13:42:34.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.513+0000 7f7402000640 1 -- 172.21.15.123:0/3343935306 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f00b0070 con 0x7f74040b6970 2024-04-25T13:42:34.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.513+0000 7f7402000640 1 -- 172.21.15.123:0/3343935306 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f00ab9d0 con 0x7f74040b6970 2024-04-25T13:42:34.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.513+0000 7f740a600640 1 -- 172.21.15.123:0/3343935306 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74040b6970 msgr2=0x7f74040b6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:34.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.513+0000 7f740a600640 1 --2- 172.21.15.123:0/3343935306 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74040b6970 0x7f74040b6d80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f73f00097c0 tx=0x7f73f001c410 comp rx=0 tx=0).stop 2024-04-25T13:42:34.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.513+0000 7f740a600640 1 -- 172.21.15.123:0/3343935306 shutdown_connections 2024-04-25T13:42:34.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.513+0000 7f740a600640 1 --2- 172.21.15.123:0/3343935306 >> v2:172.21.15.130:3300/0 conn(0x7f74040cd8e0 0x7f74040cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.513+0000 7f740a600640 1 --2- 172.21.15.123:0/3343935306 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74040b6970 0x7f74040b6d80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.513+0000 7f740a600640 1 -- 172.21.15.123:0/3343935306 >> 172.21.15.123:0/3343935306 conn(0x7f740406d210 msgr2=0x7f740406ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:34.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.513+0000 7f740a600640 1 -- 172.21.15.123:0/3343935306 shutdown_connections 2024-04-25T13:42:34.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.513+0000 7f740a600640 1 -- 172.21.15.123:0/3343935306 wait complete. 2024-04-25T13:42:34.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.513+0000 7f740a600640 1 Processor -- start 2024-04-25T13:42:34.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.513+0000 7f740a600640 1 -- start start 2024-04-25T13:42:34.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.517+0000 7f740a600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74040b6970 0x7f740413a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:34.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.517+0000 7f740a600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74040cd8e0 0x7f740413bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:34.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.517+0000 7f740a600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74041474f0 0x7f740413c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:34.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.517+0000 7f740a600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f74040b4760 con 0x7f74040cd8e0 2024-04-25T13:42:34.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.517+0000 7f740a600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f74040744a0 con 0x7f74040b6970 2024-04-25T13:42:34.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.517+0000 7f740a600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f74040b48e0 con 0x7f74041474f0 2024-04-25T13:42:34.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.517+0000 7f7402a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74040cd8e0 0x7f740413bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:34.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.517+0000 7f7402a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74040cd8e0 0x7f740413bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48924/0 (socket says 172.21.15.123:48924) 2024-04-25T13:42:34.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.517+0000 7f7402a00640 1 -- 172.21.15.123:0/2720981479 learned_addr learned my addr 172.21.15.123:0/2720981479 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:34.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.517+0000 7f7403400640 1 --2- 172.21.15.123:0/2720981479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74040b6970 0x7f740413a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:34.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.517+0000 7f7403e00640 1 --2- 172.21.15.123:0/2720981479 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74041474f0 0x7f740413c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:34.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.517+0000 7f7402a00640 1 -- 172.21.15.123:0/2720981479 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74041474f0 msgr2=0x7f740413c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:34.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.517+0000 7f7402a00640 1 --2- 172.21.15.123:0/2720981479 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74041474f0 0x7f740413c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.517+0000 7f7402a00640 1 -- 172.21.15.123:0/2720981479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74040b6970 msgr2=0x7f740413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:34.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.517+0000 7f7402a00640 1 --2- 172.21.15.123:0/2720981479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74040b6970 0x7f740413a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.517+0000 7f7402a00640 1 -- 172.21.15.123:0/2720981479 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7404159d10 con 0x7f74040cd8e0 2024-04-25T13:42:34.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.517+0000 7f7402a00640 1 --2- 172.21.15.123:0/2720981479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74040cd8e0 0x7f740413bc70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f73f00ad040 tx=0x7f73f001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:34.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.517+0000 7f73fb400640 1 -- 172.21.15.123:0/2720981479 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f00bf610 con 0x7f74040cd8e0 2024-04-25T13:42:34.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.517+0000 7f73fb400640 1 -- 172.21.15.123:0/2720981479 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f00bf7d0 con 0x7f74040cd8e0 2024-04-25T13:42:34.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.517+0000 7f740a600640 1 -- 172.21.15.123:0/2720981479 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7404158a20 con 0x7f74040cd8e0 2024-04-25T13:42:34.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.517+0000 7f73fb400640 1 -- 172.21.15.123:0/2720981479 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f00bfbc0 con 0x7f74040cd8e0 2024-04-25T13:42:34.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.517+0000 7f740a600640 1 -- 172.21.15.123:0/2720981479 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7404158fe0 con 0x7f74040cd8e0 2024-04-25T13:42:34.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.517+0000 7f740a600640 1 -- 172.21.15.123:0/2720981479 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74041591e0 con 0x7f74040cd8e0 2024-04-25T13:42:34.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.521+0000 7f73fb400640 1 -- 172.21.15.123:0/2720981479 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f73f00bd020 con 0x7f74040cd8e0 2024-04-25T13:42:34.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.521+0000 7f73fb400640 1 --2- 172.21.15.123:0/2720981479 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f73e406f430 0x7f73e4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:34.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.521+0000 7f73fb400640 1 -- 172.21.15.123:0/2720981479 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f73f01298a0 con 0x7f74040cd8e0 2024-04-25T13:42:34.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.521+0000 7f7403400640 1 --2- 172.21.15.123:0/2720981479 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f73e406f430 0x7f73e4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:34.522 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.521+0000 7f7403400640 1 --2- 172.21.15.123:0/2720981479 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f73e406f430 0x7f73e4071940 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f73f40012f0 tx=0x7f73f4001690 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:34.527 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.525+0000 7f73fb400640 1 -- 172.21.15.123:0/2720981479 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f74041591e0 con 0x7f74040cd8e0 2024-04-25T13:42:34.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.685+0000 7f740a600640 1 -- 172.21.15.123:0/2720981479 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f74040b1420 con 0x7f74040cd8e0 2024-04-25T13:42:34.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.685+0000 7f73fb400640 1 -- 172.21.15.123:0/2720981479 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16629 (secure 0 0 0) 0x7f73f00a8050 con 0x7f74040cd8e0 2024-04-25T13:42:34.686 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:34.686 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:42:07.405529+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:03.949161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:04.755682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:34.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.689+0000 7f740a600640 1 -- 172.21.15.123:0/2720981479 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f73e406f430 msgr2=0x7f73e4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:34.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.689+0000 7f740a600640 1 --2- 172.21.15.123:0/2720981479 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f73e406f430 0x7f73e4071940 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f73f40012f0 tx=0x7f73f4001690 comp rx=0 tx=0).stop 2024-04-25T13:42:34.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.689+0000 7f740a600640 1 -- 172.21.15.123:0/2720981479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74040cd8e0 msgr2=0x7f740413bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:34.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.689+0000 7f740a600640 1 --2- 172.21.15.123:0/2720981479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74040cd8e0 0x7f740413bc70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f73f00ad040 tx=0x7f73f001acb0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.689+0000 7f740a600640 1 -- 172.21.15.123:0/2720981479 shutdown_connections 2024-04-25T13:42:34.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.689+0000 7f740a600640 1 --2- 172.21.15.123:0/2720981479 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f73e406f430 0x7f73e4071940 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.689+0000 7f740a600640 1 --2- 172.21.15.123:0/2720981479 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74041474f0 0x7f740413c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.689+0000 7f740a600640 1 --2- 172.21.15.123:0/2720981479 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f74040cd8e0 0x7f740413bc70 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.689+0000 7f740a600640 1 --2- 172.21.15.123:0/2720981479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74040b6970 0x7f740413a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.689+0000 7f740a600640 1 -- 172.21.15.123:0/2720981479 >> 172.21.15.123:0/2720981479 conn(0x7f740406d210 msgr2=0x7f740406ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:34.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.689+0000 7f740a600640 1 -- 172.21.15.123:0/2720981479 shutdown_connections 2024-04-25T13:42:34.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.689+0000 7f740a600640 1 -- 172.21.15.123:0/2720981479 wait complete. 2024-04-25T13:42:34.709 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:41:53.602480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:42:03.949161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:42:04.755682+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:42:34.710 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:42:34.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.857+0000 7fae60200640 1 Processor -- start 2024-04-25T13:42:34.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.861+0000 7fae60200640 1 -- start start 2024-04-25T13:42:34.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.861+0000 7fae60200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fae580b3870 0x7fae580b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:34.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.861+0000 7fae60200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae580b41c0 con 0x7fae580ceac0 2024-04-25T13:42:34.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.861+0000 7fae60200640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae580c6810 con 0x7fae5815de80 2024-04-25T13:42:34.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.861+0000 7fae60200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fae580c7140 con 0x7fae580b3870 2024-04-25T13:42:34.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.861+0000 7fae5d800640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fae580ceac0 0x7fae580c75d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60784/0 (socket says 172.21.15.123:60784) 2024-04-25T13:42:34.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.861+0000 7fae5ce00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fae580b3870 0x7fae580b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:34.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.861+0000 7fae5d800640 1 -- 172.21.15.123:0/282631339 learned_addr learned my addr 172.21.15.123:0/282631339 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:34.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.861+0000 7fae5ce00640 1 -- 172.21.15.123:0/282631339 >> v1:172.21.15.130:6789/0 conn(0x7fae5815de80 legacy=0x7fae5815e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:34.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.861+0000 7fae5ce00640 1 -- 172.21.15.123:0/282631339 >> v1:172.21.15.123:6789/0 conn(0x7fae580ceac0 legacy=0x7fae580c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:34.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.861+0000 7fae5ce00640 1 -- 172.21.15.123:0/282631339 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae580c6af0 con 0x7fae580b3870 2024-04-25T13:42:34.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.861+0000 7fae57e00640 1 -- 172.21.15.123:0/282631339 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 825631466 0 0) 0x7fae500014a0 con 0x7fae580ceac0 2024-04-25T13:42:34.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.865+0000 7fae5ce00640 1 --2- 172.21.15.123:0/282631339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae580b3870 0x7fae580b3c80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fae580c72c0 tx=0x7fae4c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ac4f898684ade1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:34.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.865+0000 7fae57e00640 1 -- 172.21.15.123:0/282631339 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4c0b0070 con 0x7fae580b3870 2024-04-25T13:42:34.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.865+0000 7fae57e00640 1 -- 172.21.15.123:0/282631339 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae4c0ab600 con 0x7fae580b3870 2024-04-25T13:42:34.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.865+0000 7fae57e00640 1 -- 172.21.15.123:0/282631339 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4c0ab9d0 con 0x7fae580b3870 2024-04-25T13:42:34.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.865+0000 7fae60200640 1 -- 172.21.15.123:0/282631339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae580b3870 msgr2=0x7fae580b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:34.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.865+0000 7fae60200640 1 --2- 172.21.15.123:0/282631339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae580b3870 0x7fae580b3c80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fae580c72c0 tx=0x7fae4c01c410 comp rx=0 tx=0).stop 2024-04-25T13:42:34.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.865+0000 7fae60200640 1 -- 172.21.15.123:0/282631339 shutdown_connections 2024-04-25T13:42:34.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.865+0000 7fae60200640 1 --2- 172.21.15.123:0/282631339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae580b3870 0x7fae580b3c80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.865+0000 7fae60200640 1 -- 172.21.15.123:0/282631339 >> 172.21.15.123:0/282631339 conn(0x7fae5806ca70 msgr2=0x7fae5806ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:34.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.865+0000 7fae60200640 1 -- 172.21.15.123:0/282631339 shutdown_connections 2024-04-25T13:42:34.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.865+0000 7fae60200640 1 -- 172.21.15.123:0/282631339 wait complete. 2024-04-25T13:42:34.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.869+0000 7fae60200640 1 Processor -- start 2024-04-25T13:42:34.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.869+0000 7fae60200640 1 -- start start 2024-04-25T13:42:34.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.869+0000 7fae60200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fae580b3870 0x7fae58147010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:34.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.869+0000 7fae60200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae580ceac0 0x7fae581f9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:34.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.869+0000 7fae60200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae5815de80 0x7fae5814b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:34.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.869+0000 7fae60200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fae5816c710 con 0x7fae580ceac0 2024-04-25T13:42:34.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.869+0000 7fae60200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fae5816c590 con 0x7fae5815de80 2024-04-25T13:42:34.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.869+0000 7fae60200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fae5816c890 con 0x7fae580b3870 2024-04-25T13:42:34.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.869+0000 7fae5ce00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae580ceac0 0x7fae581f9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:34.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.869+0000 7fae5ce00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae580ceac0 0x7fae581f9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48954/0 (socket says 172.21.15.123:48954) 2024-04-25T13:42:34.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.869+0000 7fae5ce00640 1 -- 172.21.15.123:0/931743183 learned_addr learned my addr 172.21.15.123:0/931743183 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:34.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.869+0000 7fae5d800640 1 --2- 172.21.15.123:0/931743183 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fae580b3870 0x7fae58147010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:34.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.869+0000 7fae5e200640 1 --2- 172.21.15.123:0/931743183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae5815de80 0x7fae5814b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:34.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.869+0000 7fae5ce00640 1 -- 172.21.15.123:0/931743183 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fae580b3870 msgr2=0x7fae58147010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:34.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.869+0000 7fae5ce00640 1 --2- 172.21.15.123:0/931743183 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fae580b3870 0x7fae58147010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.869+0000 7fae5ce00640 1 -- 172.21.15.123:0/931743183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae5815de80 msgr2=0x7fae5814b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:34.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.869+0000 7fae5ce00640 1 --2- 172.21.15.123:0/931743183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae5815de80 0x7fae5814b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:34.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.869+0000 7fae5ce00640 1 -- 172.21.15.123:0/931743183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae58149be0 con 0x7fae580ceac0 2024-04-25T13:42:34.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.869+0000 7fae5e200640 1 --2- 172.21.15.123:0/931743183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae5815de80 0x7fae5814b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:34.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.869+0000 7fae5ce00640 1 --2- 172.21.15.123:0/931743183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae580ceac0 0x7fae581f9cd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fae4c01aac0 tx=0x7fae4c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:34.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.869+0000 7fae55600640 1 -- 172.21.15.123:0/931743183 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4c0b0040 con 0x7fae580ceac0 2024-04-25T13:42:34.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.869+0000 7fae55600640 1 -- 172.21.15.123:0/931743183 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae4c004030 con 0x7fae580ceac0 2024-04-25T13:42:34.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.869+0000 7fae55600640 1 -- 172.21.15.123:0/931743183 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4c0043e0 con 0x7fae580ceac0 2024-04-25T13:42:34.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.869+0000 7fae60200640 1 -- 172.21.15.123:0/931743183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae58150a30 con 0x7fae580ceac0 2024-04-25T13:42:34.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.869+0000 7fae60200640 1 -- 172.21.15.123:0/931743183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae58150ff0 con 0x7fae580ceac0 2024-04-25T13:42:34.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.873+0000 7fae60200640 1 -- 172.21.15.123:0/931743183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae58149950 con 0x7fae580ceac0 2024-04-25T13:42:34.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.873+0000 7fae55600640 1 -- 172.21.15.123:0/931743183 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fae4c003620 con 0x7fae580ceac0 2024-04-25T13:42:34.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.873+0000 7fae55600640 1 --2- 172.21.15.123:0/931743183 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fae3806f400 0x7fae38071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:34.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.873+0000 7fae55600640 1 -- 172.21.15.123:0/931743183 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fae4c129a80 con 0x7fae580ceac0 2024-04-25T13:42:34.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.873+0000 7fae5d800640 1 --2- 172.21.15.123:0/931743183 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fae3806f400 0x7fae38071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:34.875 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.873+0000 7fae5d800640 1 --2- 172.21.15.123:0/931743183 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fae3806f400 0x7fae38071910 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fae50005fd0 tx=0x7fae50005c20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:34.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:34.877+0000 7fae55600640 1 -- 172.21.15.123:0/931743183 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fae4c12be20 con 0x7fae580ceac0 2024-04-25T13:42:35.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.037+0000 7fae60200640 1 -- 172.21.15.123:0/931743183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fae5806d600 con 0x7fae580ceac0 2024-04-25T13:42:35.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.037+0000 7fae55600640 1 -- 172.21.15.123:0/931743183 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fae4c016090 con 0x7fae580ceac0 2024-04-25T13:42:35.037 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-04-25T13:42:35.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.037+0000 7fae60200640 1 -- 172.21.15.123:0/931743183 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fae3806f400 msgr2=0x7fae38071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:35.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.037+0000 7fae60200640 1 --2- 172.21.15.123:0/931743183 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fae3806f400 0x7fae38071910 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fae50005fd0 tx=0x7fae50005c20 comp rx=0 tx=0).stop 2024-04-25T13:42:35.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.037+0000 7fae60200640 1 -- 172.21.15.123:0/931743183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae580ceac0 msgr2=0x7fae581f9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:35.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.037+0000 7fae60200640 1 --2- 172.21.15.123:0/931743183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae580ceac0 0x7fae581f9cd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fae4c01aac0 tx=0x7fae4c01ac50 comp rx=0 tx=0).stop 2024-04-25T13:42:35.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.037+0000 7fae60200640 1 -- 172.21.15.123:0/931743183 shutdown_connections 2024-04-25T13:42:35.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.037+0000 7fae60200640 1 --2- 172.21.15.123:0/931743183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae5815de80 0x7fae5814b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.037+0000 7fae60200640 1 --2- 172.21.15.123:0/931743183 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fae3806f400 0x7fae38071910 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.037+0000 7fae60200640 1 --2- 172.21.15.123:0/931743183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fae580ceac0 0x7fae581f9cd0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.037+0000 7fae60200640 1 --2- 172.21.15.123:0/931743183 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fae580b3870 0x7fae58147010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.037+0000 7fae60200640 1 -- 172.21.15.123:0/931743183 >> 172.21.15.123:0/931743183 conn(0x7fae5806ca70 msgr2=0x7fae580b5980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:35.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.037+0000 7fae60200640 1 -- 172.21.15.123:0/931743183 shutdown_connections 2024-04-25T13:42:35.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.037+0000 7fae60200640 1 -- 172.21.15.123:0/931743183 wait complete. 2024-04-25T13:42:35.059 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:42:35.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.209+0000 7f1b58000640 1 Processor -- start 2024-04-25T13:42:35.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.209+0000 7f1b58000640 1 -- start start 2024-04-25T13:42:35.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.209+0000 7f1b58000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1b501571b0 0x7f1b500cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:35.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.209+0000 7f1b58000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b500cdee0 con 0x7f1b500b3870 2024-04-25T13:42:35.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.209+0000 7f1b58000640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b5015d570 con 0x7f1b50072af0 2024-04-25T13:42:35.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.209+0000 7f1b58000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f1b5015d850 con 0x7f1b501571b0 2024-04-25T13:42:35.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.209+0000 7f1b55600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1b501571b0 0x7f1b500cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:35.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.209+0000 7f1b54c00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1b500b3870 0x7f1b500b3c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60792/0 (socket says 172.21.15.123:60792) 2024-04-25T13:42:35.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.209+0000 7f1b54c00640 1 -- 172.21.15.123:0/685350897 learned_addr learned my addr 172.21.15.123:0/685350897 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:35.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.209+0000 7f1b4fe00640 1 -- 172.21.15.123:0/685350897 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3486843878 0 0) 0x7f1b500cdee0 con 0x7f1b500b3870 2024-04-25T13:42:35.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.209+0000 7f1b4fe00640 1 -- 172.21.15.123:0/685350897 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b38005740 con 0x7f1b500b3870 2024-04-25T13:42:35.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.209+0000 7f1b55600640 1 -- 172.21.15.123:0/685350897 >> v1:172.21.15.130:6789/0 conn(0x7f1b50072af0 legacy=0x7f1b50072f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:35.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.209+0000 7f1b55600640 1 -- 172.21.15.123:0/685350897 >> v1:172.21.15.123:6789/0 conn(0x7f1b500b3870 legacy=0x7f1b500b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:35.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.209+0000 7f1b55600640 1 -- 172.21.15.123:0/685350897 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b5015db30 con 0x7f1b501571b0 2024-04-25T13:42:35.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.213+0000 7f1b55600640 1 --2- 172.21.15.123:0/685350897 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b501571b0 0x7f1b500cd6b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1b440097c0 tx=0x7f1b4401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec07ee58497e5e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:35.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.213+0000 7f1b4fe00640 1 -- 172.21.15.123:0/685350897 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b440b0070 con 0x7f1b501571b0 2024-04-25T13:42:35.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.213+0000 7f1b4fe00640 1 -- 172.21.15.123:0/685350897 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b440ab600 con 0x7f1b501571b0 2024-04-25T13:42:35.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.213+0000 7f1b4fe00640 1 -- 172.21.15.123:0/685350897 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b440ab9d0 con 0x7f1b501571b0 2024-04-25T13:42:35.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.213+0000 7f1b58000640 1 -- 172.21.15.123:0/685350897 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b501571b0 msgr2=0x7f1b500cd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:35.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.213+0000 7f1b58000640 1 --2- 172.21.15.123:0/685350897 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b501571b0 0x7f1b500cd6b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1b440097c0 tx=0x7f1b4401c3d0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.213+0000 7f1b58000640 1 -- 172.21.15.123:0/685350897 shutdown_connections 2024-04-25T13:42:35.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.213+0000 7f1b58000640 1 --2- 172.21.15.123:0/685350897 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b501571b0 0x7f1b500cd6b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.213+0000 7f1b58000640 1 -- 172.21.15.123:0/685350897 >> 172.21.15.123:0/685350897 conn(0x7f1b5006ca70 msgr2=0x7f1b5006ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:35.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.213+0000 7f1b58000640 1 -- 172.21.15.123:0/685350897 shutdown_connections 2024-04-25T13:42:35.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.213+0000 7f1b58000640 1 -- 172.21.15.123:0/685350897 wait complete. 2024-04-25T13:42:35.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.217+0000 7f1b58000640 1 Processor -- start 2024-04-25T13:42:35.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.217+0000 7f1b58000640 1 -- start start 2024-04-25T13:42:35.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.217+0000 7f1b58000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b50072af0 0x7f1b50144150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:35.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.217+0000 7f1b58000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b500b3870 0x7f1b500b4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:35.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.217+0000 7f1b58000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b501571b0 0x7f1b500b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:35.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.217+0000 7f1b58000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5015e050 con 0x7f1b501571b0 2024-04-25T13:42:35.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.217+0000 7f1b58000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1b501575c0 con 0x7f1b50072af0 2024-04-25T13:42:35.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.217+0000 7f1b58000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f1b500b5480 con 0x7f1b500b3870 2024-04-25T13:42:35.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.217+0000 7f1b56000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b501571b0 0x7f1b500b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:35.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.217+0000 7f1b56000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b501571b0 0x7f1b500b4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48968/0 (socket says 172.21.15.123:48968) 2024-04-25T13:42:35.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.217+0000 7f1b56000640 1 -- 172.21.15.123:0/3888466033 learned_addr learned my addr 172.21.15.123:0/3888466033 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:35.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.217+0000 7f1b54c00640 1 --2- 172.21.15.123:0/3888466033 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b500b3870 0x7f1b500b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:35.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.217+0000 7f1b55600640 1 --2- 172.21.15.123:0/3888466033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b50072af0 0x7f1b50144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:35.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.217+0000 7f1b56000640 1 -- 172.21.15.123:0/3888466033 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b500b3870 msgr2=0x7f1b500b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:35.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.217+0000 7f1b56000640 1 --2- 172.21.15.123:0/3888466033 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b500b3870 0x7f1b500b4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.217+0000 7f1b56000640 1 -- 172.21.15.123:0/3888466033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b50072af0 msgr2=0x7f1b50144150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:35.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.217+0000 7f1b56000640 1 --2- 172.21.15.123:0/3888466033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b50072af0 0x7f1b50144150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.217+0000 7f1b56000640 1 -- 172.21.15.123:0/3888466033 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b50149e40 con 0x7f1b501571b0 2024-04-25T13:42:35.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.217+0000 7f1b54c00640 1 --2- 172.21.15.123:0/3888466033 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b500b3870 0x7f1b500b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:35.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.217+0000 7f1b56000640 1 --2- 172.21.15.123:0/3888466033 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b501571b0 0x7f1b500b4aa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800c760 tx=0x7f1b4800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:35.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.217+0000 7f1b4d600640 1 -- 172.21.15.123:0/3888466033 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b48003b80 con 0x7f1b501571b0 2024-04-25T13:42:35.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.221+0000 7f1b4d600640 1 -- 172.21.15.123:0/3888466033 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b48003d20 con 0x7f1b501571b0 2024-04-25T13:42:35.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.221+0000 7f1b58000640 1 -- 172.21.15.123:0/3888466033 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b50147260 con 0x7f1b501571b0 2024-04-25T13:42:35.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.221+0000 7f1b4d600640 1 -- 172.21.15.123:0/3888466033 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4800aa90 con 0x7f1b501571b0 2024-04-25T13:42:35.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.221+0000 7f1b58000640 1 -- 172.21.15.123:0/3888466033 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b500b51c0 con 0x7f1b501571b0 2024-04-25T13:42:35.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.221+0000 7f1b58000640 1 -- 172.21.15.123:0/3888466033 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b50144690 con 0x7f1b501571b0 2024-04-25T13:42:35.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.221+0000 7f1b4d600640 1 -- 172.21.15.123:0/3888466033 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1b4800ac30 con 0x7f1b501571b0 2024-04-25T13:42:35.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.221+0000 7f1b4d600640 1 --2- 172.21.15.123:0/3888466033 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1b3006f430 0x7f1b30071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:35.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.221+0000 7f1b4d600640 1 -- 172.21.15.123:0/3888466033 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1b4808efe0 con 0x7f1b501571b0 2024-04-25T13:42:35.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.221+0000 7f1b55600640 1 --2- 172.21.15.123:0/3888466033 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1b3006f430 0x7f1b30071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:35.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.225+0000 7f1b55600640 1 --2- 172.21.15.123:0/3888466033 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1b3006f430 0x7f1b30071940 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1b440ad000 tx=0x7f1b440a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:35.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.225+0000 7f1b4d600640 1 -- 172.21.15.123:0/3888466033 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1b4805bf70 con 0x7f1b501571b0 2024-04-25T13:42:35.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.381+0000 7f1b58000640 1 -- 172.21.15.123:0/3888466033 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1b500b4fe0 con 0x7f1b501571b0 2024-04-25T13:42:35.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.381+0000 7f1b4d600640 1 -- 172.21.15.123:0/3888466033 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f1b500b4fe0 con 0x7f1b501571b0 2024-04-25T13:42:35.383 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-04-25T13:42:35.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.385+0000 7f1b58000640 1 -- 172.21.15.123:0/3888466033 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1b3006f430 msgr2=0x7f1b30071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:35.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.385+0000 7f1b58000640 1 --2- 172.21.15.123:0/3888466033 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1b3006f430 0x7f1b30071940 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1b440ad000 tx=0x7f1b440a6000 comp rx=0 tx=0).stop 2024-04-25T13:42:35.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.385+0000 7f1b58000640 1 -- 172.21.15.123:0/3888466033 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b501571b0 msgr2=0x7f1b500b4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:35.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.385+0000 7f1b58000640 1 --2- 172.21.15.123:0/3888466033 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b501571b0 0x7f1b500b4aa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800c760 tx=0x7f1b4800cc20 comp rx=0 tx=0).stop 2024-04-25T13:42:35.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.385+0000 7f1b58000640 1 -- 172.21.15.123:0/3888466033 shutdown_connections 2024-04-25T13:42:35.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.385+0000 7f1b58000640 1 --2- 172.21.15.123:0/3888466033 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1b3006f430 0x7f1b30071940 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.385+0000 7f1b58000640 1 --2- 172.21.15.123:0/3888466033 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b501571b0 0x7f1b500b4aa0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.385+0000 7f1b58000640 1 --2- 172.21.15.123:0/3888466033 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b500b3870 0x7f1b500b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.385+0000 7f1b58000640 1 --2- 172.21.15.123:0/3888466033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b50072af0 0x7f1b50144150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.385+0000 7f1b58000640 1 -- 172.21.15.123:0/3888466033 >> 172.21.15.123:0/3888466033 conn(0x7f1b5006ca70 msgr2=0x7f1b5014e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:35.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.385+0000 7f1b58000640 1 -- 172.21.15.123:0/3888466033 shutdown_connections 2024-04-25T13:42:35.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.385+0000 7f1b58000640 1 -- 172.21.15.123:0/3888466033 wait complete. 2024-04-25T13:42:35.404 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:42:35.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.553+0000 7f2ca7400640 1 Processor -- start 2024-04-25T13:42:35.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.553+0000 7f2ca7400640 1 -- start start 2024-04-25T13:42:35.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.557+0000 7f2ca7400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2ca01534e0 0x7f2ca0074240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:35.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.557+0000 7f2ca7400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ca00cdeb0 0x7f2ca00ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:35.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.557+0000 7f2ca7400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ca00ce800 con 0x7f2ca0072af0 2024-04-25T13:42:35.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.557+0000 7f2ca7400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f2ca00b5780 con 0x7f2ca01534e0 2024-04-25T13:42:35.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.557+0000 7f2ca7400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2ca01538f0 con 0x7f2ca00cdeb0 2024-04-25T13:42:35.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.557+0000 7f2ca4a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2ca01534e0 0x7f2ca0074240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:35.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.557+0000 7f2ca5400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2ca0072af0 0x7f2ca0072f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60798/0 (socket says 172.21.15.123:60798) 2024-04-25T13:42:35.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.557+0000 7f2ca5400640 1 -- 172.21.15.123:0/2078538816 learned_addr learned my addr 172.21.15.123:0/2078538816 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:35.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.557+0000 7f2c97e00640 1 --2- 172.21.15.123:0/2078538816 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ca00cdeb0 0x7f2ca00ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:35.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.557+0000 7f2ca4a00640 1 -- 172.21.15.123:0/2078538816 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ca00cdeb0 msgr2=0x7f2ca00ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:35.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.557+0000 7f2ca4a00640 1 --2- 172.21.15.123:0/2078538816 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ca00cdeb0 0x7f2ca00ce2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.557+0000 7f2ca4a00640 1 -- 172.21.15.123:0/2078538816 >> v1:172.21.15.123:6789/0 conn(0x7f2ca0072af0 legacy=0x7f2ca0072f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:35.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.557+0000 7f2ca4a00640 1 -- 172.21.15.123:0/2078538816 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca0074780 con 0x7f2ca01534e0 2024-04-25T13:42:35.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.557+0000 7f2c9fe00640 1 -- 172.21.15.123:0/2078538816 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1136069708 0 0) 0x7f2c980014a0 con 0x7f2ca0072af0 2024-04-25T13:42:35.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.561+0000 7f2ca4a00640 1 --2- 172.21.15.123:0/2078538816 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ca01534e0 0x7f2ca0074240 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2c900097c0 tx=0x7f2c9001d640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aedc33b53a2f382 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:35.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.561+0000 7f2c9fe00640 1 -- 172.21.15.123:0/2078538816 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c900aa670 con 0x7f2ca01534e0 2024-04-25T13:42:35.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.561+0000 7f2c9fe00640 1 -- 172.21.15.123:0/2078538816 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c900aa810 con 0x7f2ca01534e0 2024-04-25T13:42:35.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.561+0000 7f2c9fe00640 1 -- 172.21.15.123:0/2078538816 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c900aabe0 con 0x7f2ca01534e0 2024-04-25T13:42:35.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.561+0000 7f2ca7400640 1 -- 172.21.15.123:0/2078538816 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ca01534e0 msgr2=0x7f2ca0074240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:35.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.561+0000 7f2ca7400640 1 --2- 172.21.15.123:0/2078538816 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ca01534e0 0x7f2ca0074240 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2c900097c0 tx=0x7f2c9001d640 comp rx=0 tx=0).stop 2024-04-25T13:42:35.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.561+0000 7f2ca7400640 1 -- 172.21.15.123:0/2078538816 shutdown_connections 2024-04-25T13:42:35.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.561+0000 7f2ca7400640 1 --2- 172.21.15.123:0/2078538816 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ca00cdeb0 0x7f2ca00ce2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.561+0000 7f2ca7400640 1 --2- 172.21.15.123:0/2078538816 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ca01534e0 0x7f2ca0074240 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.561+0000 7f2ca7400640 1 -- 172.21.15.123:0/2078538816 >> 172.21.15.123:0/2078538816 conn(0x7f2ca006ca70 msgr2=0x7f2ca006ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:35.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.561+0000 7f2ca7400640 1 -- 172.21.15.123:0/2078538816 shutdown_connections 2024-04-25T13:42:35.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.561+0000 7f2ca7400640 1 -- 172.21.15.123:0/2078538816 wait complete. 2024-04-25T13:42:35.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.561+0000 7f2ca7400640 1 Processor -- start 2024-04-25T13:42:35.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.565+0000 7f2ca7400640 1 -- start start 2024-04-25T13:42:35.566 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.565+0000 7f2ca7400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ca0072af0 0x7f2ca0139f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:35.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.565+0000 7f2ca7400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ca00cdeb0 0x7f2ca014a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:35.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.565+0000 7f2ca7400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca01534e0 0x7f2ca0147f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:35.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.565+0000 7f2ca7400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca015d8c0 con 0x7f2ca00cdeb0 2024-04-25T13:42:35.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.565+0000 7f2ca7400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca015d3a0 con 0x7f2ca01534e0 2024-04-25T13:42:35.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.565+0000 7f2ca7400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2ca015da40 con 0x7f2ca0072af0 2024-04-25T13:42:35.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.565+0000 7f2c97e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ca00cdeb0 0x7f2ca014a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:35.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.565+0000 7f2c97e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ca00cdeb0 0x7f2ca014a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:48988/0 (socket says 172.21.15.123:48988) 2024-04-25T13:42:35.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.565+0000 7f2c97e00640 1 -- 172.21.15.123:0/959719770 learned_addr learned my addr 172.21.15.123:0/959719770 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:35.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.565+0000 7f2ca4a00640 1 --2- 172.21.15.123:0/959719770 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ca0072af0 0x7f2ca0139f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:35.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.565+0000 7f2ca5400640 1 --2- 172.21.15.123:0/959719770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca01534e0 0x7f2ca0147f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:35.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.565+0000 7f2c97e00640 1 -- 172.21.15.123:0/959719770 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ca0072af0 msgr2=0x7f2ca0139f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:35.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.565+0000 7f2c97e00640 1 --2- 172.21.15.123:0/959719770 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ca0072af0 0x7f2ca0139f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.565+0000 7f2c97e00640 1 -- 172.21.15.123:0/959719770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca01534e0 msgr2=0x7f2ca0147f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:35.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.565+0000 7f2c97e00640 1 --2- 172.21.15.123:0/959719770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca01534e0 0x7f2ca0147f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.565+0000 7f2c97e00640 1 -- 172.21.15.123:0/959719770 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca014adb0 con 0x7f2ca00cdeb0 2024-04-25T13:42:35.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.565+0000 7f2ca4a00640 1 --2- 172.21.15.123:0/959719770 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ca0072af0 0x7f2ca0139f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:35.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.565+0000 7f2ca5400640 1 --2- 172.21.15.123:0/959719770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca01534e0 0x7f2ca0147f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:35.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.565+0000 7f2c97e00640 1 --2- 172.21.15.123:0/959719770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ca00cdeb0 0x7f2ca014a870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800e870 tx=0x7f2c8800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:35.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.565+0000 7f2c9d600640 1 -- 172.21.15.123:0/959719770 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c88017070 con 0x7f2ca00cdeb0 2024-04-25T13:42:35.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.565+0000 7f2c9d600640 1 -- 172.21.15.123:0/959719770 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c8800c8e0 con 0x7f2ca00cdeb0 2024-04-25T13:42:35.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.565+0000 7f2ca7400640 1 -- 172.21.15.123:0/959719770 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ca014bda0 con 0x7f2ca00cdeb0 2024-04-25T13:42:35.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.565+0000 7f2c9d600640 1 -- 172.21.15.123:0/959719770 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8800ccd0 con 0x7f2ca00cdeb0 2024-04-25T13:42:35.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.565+0000 7f2ca7400640 1 -- 172.21.15.123:0/959719770 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ca014c360 con 0x7f2ca00cdeb0 2024-04-25T13:42:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.565+0000 7f2ca7400640 1 -- 172.21.15.123:0/959719770 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ca0050750 con 0x7f2ca00cdeb0 2024-04-25T13:42:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.569+0000 7f2c9d600640 1 -- 172.21.15.123:0/959719770 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2c8801a070 con 0x7f2ca00cdeb0 2024-04-25T13:42:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.569+0000 7f2c9d600640 1 --2- 172.21.15.123:0/959719770 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f2c7c06f430 0x7f2c7c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:35.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.569+0000 7f2c9d600640 1 -- 172.21.15.123:0/959719770 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2c8808f0b0 con 0x7f2ca00cdeb0 2024-04-25T13:42:35.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.569+0000 7f2ca4a00640 1 --2- 172.21.15.123:0/959719770 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f2c7c06f430 0x7f2c7c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:35.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.569+0000 7f2ca4a00640 1 --2- 172.21.15.123:0/959719770 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f2c7c06f430 0x7f2c7c071940 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2c900af000 tx=0x7f2c900a8000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:35.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.573+0000 7f2c9d600640 1 -- 172.21.15.123:0/959719770 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2c8805bf90 con 0x7f2ca00cdeb0 2024-04-25T13:42:35.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.733+0000 7f2ca7400640 1 -- 172.21.15.123:0/959719770 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2ca014bb30 con 0x7f2ca00cdeb0 2024-04-25T13:42:35.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.733+0000 7f2c9d600640 1 -- 172.21.15.123:0/959719770 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f2c8805b890 con 0x7f2ca00cdeb0 2024-04-25T13:42:35.735 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-04-25T13:42:35.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.737+0000 7f2ca7400640 1 -- 172.21.15.123:0/959719770 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f2c7c06f430 msgr2=0x7f2c7c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:35.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.737+0000 7f2ca7400640 1 --2- 172.21.15.123:0/959719770 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f2c7c06f430 0x7f2c7c071940 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2c900af000 tx=0x7f2c900a8000 comp rx=0 tx=0).stop 2024-04-25T13:42:35.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.737+0000 7f2ca7400640 1 -- 172.21.15.123:0/959719770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ca00cdeb0 msgr2=0x7f2ca014a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:35.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.737+0000 7f2ca7400640 1 --2- 172.21.15.123:0/959719770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ca00cdeb0 0x7f2ca014a870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2c8800e870 tx=0x7f2c8800ec70 comp rx=0 tx=0).stop 2024-04-25T13:42:35.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.737+0000 7f2ca7400640 1 -- 172.21.15.123:0/959719770 shutdown_connections 2024-04-25T13:42:35.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.737+0000 7f2ca7400640 1 --2- 172.21.15.123:0/959719770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca01534e0 0x7f2ca0147f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.737+0000 7f2ca7400640 1 --2- 172.21.15.123:0/959719770 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f2c7c06f430 0x7f2c7c071940 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.737+0000 7f2ca7400640 1 --2- 172.21.15.123:0/959719770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ca00cdeb0 0x7f2ca014a870 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.737+0000 7f2ca7400640 1 --2- 172.21.15.123:0/959719770 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ca0072af0 0x7f2ca0139f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.737+0000 7f2ca7400640 1 -- 172.21.15.123:0/959719770 >> 172.21.15.123:0/959719770 conn(0x7f2ca006ca70 msgr2=0x7f2ca00b5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:35.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.737+0000 7f2ca7400640 1 -- 172.21.15.123:0/959719770 shutdown_connections 2024-04-25T13:42:35.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.737+0000 7f2ca7400640 1 -- 172.21.15.123:0/959719770 wait complete. 2024-04-25T13:42:35.775 INFO:tasks.cephfs_test_runner:Starting test: test_flush (tasks.cephfs.test_flush.TestFlush) 2024-04-25T13:42:35.776 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:35.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.921+0000 7ff359e00640 1 Processor -- start 2024-04-25T13:42:35.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.921+0000 7ff359e00640 1 -- start start 2024-04-25T13:42:35.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.925+0000 7ff359e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff3540b32f0 0x7ff3540b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:35.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.925+0000 7ff359e00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff3540b5010 0x7ff3540b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:35.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.925+0000 7ff359e00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3540b3c40 con 0x7ff3540d0f80 2024-04-25T13:42:35.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.925+0000 7ff359e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff35415cfe0 con 0x7ff3540b32f0 2024-04-25T13:42:35.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.925+0000 7ff359e00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7ff35415d240 con 0x7ff3540b5010 2024-04-25T13:42:35.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.925+0000 7ff352000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff3540b32f0 0x7ff3540b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:35.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.925+0000 7ff352000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff3540b32f0 0x7ff3540b3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49002/0 (socket says 172.21.15.123:49002) 2024-04-25T13:42:35.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.925+0000 7ff352000640 1 -- 172.21.15.123:0/1969864305 learned_addr learned my addr 172.21.15.123:0/1969864305 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:35.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.925+0000 7ff352000640 1 -- 172.21.15.123:0/1969864305 >> v2:172.21.15.130:3300/0 conn(0x7ff3540b5010 msgr2=0x7ff3540b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:35.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.925+0000 7ff352000640 1 --2- 172.21.15.123:0/1969864305 >> v2:172.21.15.130:3300/0 conn(0x7ff3540b5010 0x7ff3540b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.925+0000 7ff352000640 1 -- 172.21.15.123:0/1969864305 >> v1:172.21.15.130:6789/0 conn(0x7ff3540d0f80 legacy=0x7ff354160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:35.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.925+0000 7ff352000640 1 -- 172.21.15.123:0/1969864305 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff35415d520 con 0x7ff3540b32f0 2024-04-25T13:42:35.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.925+0000 7ff352000640 1 --2- 172.21.15.123:0/1969864305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3540b32f0 0x7ff3540b3700 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff3540b40b0 tx=0x7ff34001c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5c1b266e84bb286 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:35.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.925+0000 7ff351600640 1 -- 172.21.15.123:0/1969864305 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3400b0070 con 0x7ff3540b32f0 2024-04-25T13:42:35.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.925+0000 7ff351600640 1 -- 172.21.15.123:0/1969864305 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3400ab600 con 0x7ff3540b32f0 2024-04-25T13:42:35.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.925+0000 7ff351600640 1 -- 172.21.15.123:0/1969864305 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3400ab9d0 con 0x7ff3540b32f0 2024-04-25T13:42:35.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.929+0000 7ff359e00640 1 -- 172.21.15.123:0/1969864305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3540b32f0 msgr2=0x7ff3540b3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:35.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.929+0000 7ff359e00640 1 --2- 172.21.15.123:0/1969864305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3540b32f0 0x7ff3540b3700 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff3540b40b0 tx=0x7ff34001c240 comp rx=0 tx=0).stop 2024-04-25T13:42:35.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.929+0000 7ff359e00640 1 -- 172.21.15.123:0/1969864305 shutdown_connections 2024-04-25T13:42:35.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.929+0000 7ff359e00640 1 --2- 172.21.15.123:0/1969864305 >> v2:172.21.15.130:3300/0 conn(0x7ff3540b5010 0x7ff3540b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.929+0000 7ff359e00640 1 --2- 172.21.15.123:0/1969864305 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3540b32f0 0x7ff3540b3700 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.929+0000 7ff359e00640 1 -- 172.21.15.123:0/1969864305 >> 172.21.15.123:0/1969864305 conn(0x7ff35406d210 msgr2=0x7ff35406ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:35.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.929+0000 7ff359e00640 1 -- 172.21.15.123:0/1969864305 shutdown_connections 2024-04-25T13:42:35.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.929+0000 7ff359e00640 1 -- 172.21.15.123:0/1969864305 wait complete. 2024-04-25T13:42:35.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.929+0000 7ff359e00640 1 Processor -- start 2024-04-25T13:42:35.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.929+0000 7ff359e00640 1 -- start start 2024-04-25T13:42:35.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.933+0000 7ff359e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3540b32f0 0x7ff35414d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:35.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.933+0000 7ff359e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3540b5010 0x7ff354153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:35.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.933+0000 7ff359e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3540d0f80 0x7ff3541536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:35.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.933+0000 7ff359e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff3541697b0 con 0x7ff3540d0f80 2024-04-25T13:42:35.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.933+0000 7ff359e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff3540b6470 con 0x7ff3540b5010 2024-04-25T13:42:35.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.933+0000 7ff359e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff354169930 con 0x7ff3540b32f0 2024-04-25T13:42:35.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.933+0000 7ff353400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3540d0f80 0x7ff3541536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:35.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.933+0000 7ff353400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3540d0f80 0x7ff3541536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49004/0 (socket says 172.21.15.123:49004) 2024-04-25T13:42:35.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.933+0000 7ff353400640 1 -- 172.21.15.123:0/3554277204 learned_addr learned my addr 172.21.15.123:0/3554277204 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:35.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.933+0000 7ff352a00640 1 --2- 172.21.15.123:0/3554277204 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3540b32f0 0x7ff35414d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:35.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.933+0000 7ff352000640 1 --2- 172.21.15.123:0/3554277204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3540b5010 0x7ff354153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:35.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.933+0000 7ff353400640 1 -- 172.21.15.123:0/3554277204 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3540b32f0 msgr2=0x7ff35414d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:35.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.933+0000 7ff353400640 1 --2- 172.21.15.123:0/3554277204 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3540b32f0 0x7ff35414d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.933+0000 7ff353400640 1 -- 172.21.15.123:0/3554277204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3540b5010 msgr2=0x7ff354153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:35.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.933+0000 7ff353400640 1 --2- 172.21.15.123:0/3554277204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3540b5010 0x7ff354153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:35.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.933+0000 7ff353400640 1 -- 172.21.15.123:0/3554277204 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3541fa1d0 con 0x7ff3540d0f80 2024-04-25T13:42:35.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.933+0000 7ff353400640 1 --2- 172.21.15.123:0/3554277204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3540d0f80 0x7ff3541536a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff34c00b390 tx=0x7ff34c00b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:35.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.933+0000 7ff34b400640 1 -- 172.21.15.123:0/3554277204 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34c015020 con 0x7ff3540d0f80 2024-04-25T13:42:35.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.933+0000 7ff34b400640 1 -- 172.21.15.123:0/3554277204 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff34c011830 con 0x7ff3540d0f80 2024-04-25T13:42:35.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.933+0000 7ff359e00640 1 -- 172.21.15.123:0/3554277204 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3541f9410 con 0x7ff3540d0f80 2024-04-25T13:42:35.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.933+0000 7ff34b400640 1 -- 172.21.15.123:0/3554277204 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34c011c20 con 0x7ff3540d0f80 2024-04-25T13:42:35.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.933+0000 7ff359e00640 1 -- 172.21.15.123:0/3554277204 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3541f99d0 con 0x7ff3540d0f80 2024-04-25T13:42:35.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.933+0000 7ff359e00640 1 -- 172.21.15.123:0/3554277204 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3540507c0 con 0x7ff3540d0f80 2024-04-25T13:42:35.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.937+0000 7ff34b400640 1 -- 172.21.15.123:0/3554277204 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff34c018020 con 0x7ff3540d0f80 2024-04-25T13:42:35.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.937+0000 7ff34b400640 1 --2- 172.21.15.123:0/3554277204 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff33406f400 0x7ff334071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:35.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.937+0000 7ff34b400640 1 -- 172.21.15.123:0/3554277204 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff34c08f0c0 con 0x7ff3540d0f80 2024-04-25T13:42:35.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.937+0000 7ff352a00640 1 --2- 172.21.15.123:0/3554277204 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff33406f400 0x7ff334071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:35.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.937+0000 7ff352a00640 1 --2- 172.21.15.123:0/3554277204 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff33406f400 0x7ff334071910 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff354070fa0 tx=0x7ff34400d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:35.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:35.941+0000 7ff34b400640 1 -- 172.21.15.123:0/3554277204 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff34c01f020 con 0x7ff3540d0f80 2024-04-25T13:42:36.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.097+0000 7ff359e00640 1 -- 172.21.15.123:0/3554277204 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff35415ff90 con 0x7ff3540d0f80 2024-04-25T13:42:36.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.097+0000 7ff34b400640 1 -- 172.21.15.123:0/3554277204 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16629 (secure 0 0 0) 0x7ff34c05b950 con 0x7ff3540d0f80 2024-04-25T13:42:36.100 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:36.100 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:42:07.405529+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:03.949161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:04.755682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:36.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.101+0000 7ff359e00640 1 -- 172.21.15.123:0/3554277204 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff33406f400 msgr2=0x7ff334071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.101+0000 7ff359e00640 1 --2- 172.21.15.123:0/3554277204 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff33406f400 0x7ff334071910 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff354070fa0 tx=0x7ff34400d040 comp rx=0 tx=0).stop 2024-04-25T13:42:36.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.101+0000 7ff359e00640 1 -- 172.21.15.123:0/3554277204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3540d0f80 msgr2=0x7ff3541536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.101+0000 7ff359e00640 1 --2- 172.21.15.123:0/3554277204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3540d0f80 0x7ff3541536a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff34c00b390 tx=0x7ff34c00b850 comp rx=0 tx=0).stop 2024-04-25T13:42:36.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.101+0000 7ff359e00640 1 -- 172.21.15.123:0/3554277204 shutdown_connections 2024-04-25T13:42:36.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.101+0000 7ff359e00640 1 --2- 172.21.15.123:0/3554277204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3540b5010 0x7ff354153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.101+0000 7ff359e00640 1 --2- 172.21.15.123:0/3554277204 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff33406f400 0x7ff334071910 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.101+0000 7ff359e00640 1 --2- 172.21.15.123:0/3554277204 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff3540d0f80 0x7ff3541536a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.101+0000 7ff359e00640 1 --2- 172.21.15.123:0/3554277204 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3540b32f0 0x7ff35414d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.101+0000 7ff359e00640 1 -- 172.21.15.123:0/3554277204 >> 172.21.15.123:0/3554277204 conn(0x7ff35406d210 msgr2=0x7ff354154460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:36.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.101+0000 7ff359e00640 1 -- 172.21.15.123:0/3554277204 shutdown_connections 2024-04-25T13:42:36.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.101+0000 7ff359e00640 1 -- 172.21.15.123:0/3554277204 wait complete. 2024-04-25T13:42:36.121 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:41:53.602480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:42:03.949161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:42:04.755682+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:42:36.122 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:42:36.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.269+0000 7fdfe6c00640 1 Processor -- start 2024-04-25T13:42:36.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.269+0000 7fdfe6c00640 1 -- start start 2024-04-25T13:42:36.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.273+0000 7fdfe6c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdfe00b5550 0x7fdfe00b5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:36.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.273+0000 7fdfe6c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfe006c950 0x7fdfe006cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:36.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.273+0000 7fdfe6c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfe00b5ea0 con 0x7fdfe0149b00 2024-04-25T13:42:36.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.273+0000 7fdfe6c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fdfe00701d0 con 0x7fdfe00b5550 2024-04-25T13:42:36.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.273+0000 7fdfe6c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fdfe0070410 con 0x7fdfe006c950 2024-04-25T13:42:36.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.273+0000 7fdfd7400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdfe00b5550 0x7fdfe00b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:36.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.273+0000 7fdfd7400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdfe00b5550 0x7fdfe00b5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49006/0 (socket says 172.21.15.123:49006) 2024-04-25T13:42:36.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.273+0000 7fdfd7400640 1 -- 172.21.15.123:0/2017450126 learned_addr learned my addr 172.21.15.123:0/2017450126 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:36.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.273+0000 7fdfdfe00640 1 --1- 172.21.15.123:0/2017450126 >> v1:172.21.15.123:6789/0 conn(0x7fdfe0149b00 0x7fdfe006fac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60814/0 (socket says 172.21.15.123:60814) 2024-04-25T13:42:36.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.273+0000 7fdfe4c00640 1 --2- 172.21.15.123:0/2017450126 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfe006c950 0x7fdfe006cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:36.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.273+0000 7fdfd7400640 1 -- 172.21.15.123:0/2017450126 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfe006c950 msgr2=0x7fdfe006cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:36.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.273+0000 7fdfd7400640 1 --2- 172.21.15.123:0/2017450126 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfe006c950 0x7fdfe006cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.273+0000 7fdfd7400640 1 -- 172.21.15.123:0/2017450126 >> v1:172.21.15.123:6789/0 conn(0x7fdfe0149b00 legacy=0x7fdfe006fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.273+0000 7fdfd7400640 1 -- 172.21.15.123:0/2017450126 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe00706f0 con 0x7fdfe00b5550 2024-04-25T13:42:36.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.273+0000 7fdfd7400640 1 --2- 172.21.15.123:0/2017450126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfe00b5550 0x7fdfe00b5960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8009870 tx=0x7fdfc801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef81cc9aa757ae0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:36.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.273+0000 7fdfdf400640 1 -- 172.21.15.123:0/2017450126 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc80a95f0 con 0x7fdfe00b5550 2024-04-25T13:42:36.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.277+0000 7fdfdf400640 1 -- 172.21.15.123:0/2017450126 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfc80a9790 con 0x7fdfe00b5550 2024-04-25T13:42:36.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.277+0000 7fdfdf400640 1 -- 172.21.15.123:0/2017450126 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc80a9b60 con 0x7fdfe00b5550 2024-04-25T13:42:36.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.277+0000 7fdfe6c00640 1 -- 172.21.15.123:0/2017450126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfe00b5550 msgr2=0x7fdfe00b5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.277+0000 7fdfe6c00640 1 --2- 172.21.15.123:0/2017450126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfe00b5550 0x7fdfe00b5960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8009870 tx=0x7fdfc801c530 comp rx=0 tx=0).stop 2024-04-25T13:42:36.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.277+0000 7fdfe6c00640 1 -- 172.21.15.123:0/2017450126 shutdown_connections 2024-04-25T13:42:36.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.277+0000 7fdfe6c00640 1 --2- 172.21.15.123:0/2017450126 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfe006c950 0x7fdfe006cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.277+0000 7fdfe6c00640 1 --2- 172.21.15.123:0/2017450126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfe00b5550 0x7fdfe00b5960 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.277+0000 7fdfe6c00640 1 -- 172.21.15.123:0/2017450126 >> 172.21.15.123:0/2017450126 conn(0x7fdfe00d2180 msgr2=0x7fdfe00d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:36.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.277+0000 7fdfe6c00640 1 -- 172.21.15.123:0/2017450126 shutdown_connections 2024-04-25T13:42:36.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.277+0000 7fdfe6c00640 1 -- 172.21.15.123:0/2017450126 wait complete. 2024-04-25T13:42:36.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.277+0000 7fdfe6c00640 1 Processor -- start 2024-04-25T13:42:36.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.277+0000 7fdfe6c00640 1 -- start start 2024-04-25T13:42:36.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.281+0000 7fdfe6c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfe006c950 0x7fdfe013b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:36.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.281+0000 7fdfe6c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfe00b5550 0x7fdfe0143df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:36.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.281+0000 7fdfe6c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfe0149b00 0x7fdfe0144330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:36.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.281+0000 7fdfe6c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe016cf40 con 0x7fdfe00b5550 2024-04-25T13:42:36.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.281+0000 7fdfe6c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe016cdc0 con 0x7fdfe006c950 2024-04-25T13:42:36.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.281+0000 7fdfe6c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fdfe016d0c0 con 0x7fdfe0149b00 2024-04-25T13:42:36.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.281+0000 7fdfd7400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfe00b5550 0x7fdfe0143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:36.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.281+0000 7fdfd7400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfe00b5550 0x7fdfe0143df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49014/0 (socket says 172.21.15.123:49014) 2024-04-25T13:42:36.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.281+0000 7fdfd7400640 1 -- 172.21.15.123:0/1911616652 learned_addr learned my addr 172.21.15.123:0/1911616652 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:36.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.281+0000 7fdfdfe00640 1 --2- 172.21.15.123:0/1911616652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfe006c950 0x7fdfe013b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:36.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.281+0000 7fdfe4c00640 1 --2- 172.21.15.123:0/1911616652 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfe0149b00 0x7fdfe0144330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:36.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.281+0000 7fdfd7400640 1 -- 172.21.15.123:0/1911616652 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfe0149b00 msgr2=0x7fdfe0144330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.281+0000 7fdfd7400640 1 --2- 172.21.15.123:0/1911616652 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfe0149b00 0x7fdfe0144330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.281+0000 7fdfd7400640 1 -- 172.21.15.123:0/1911616652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfe006c950 msgr2=0x7fdfe013b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.281+0000 7fdfd7400640 1 --2- 172.21.15.123:0/1911616652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfe006c950 0x7fdfe013b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.281+0000 7fdfd7400640 1 -- 172.21.15.123:0/1911616652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe0144df0 con 0x7fdfe00b5550 2024-04-25T13:42:36.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.281+0000 7fdfd7400640 1 --2- 172.21.15.123:0/1911616652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfe00b5550 0x7fdfe0143df0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdfc801ca10 tx=0x7fdfc80192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:36.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.281+0000 7fdfdcc00640 1 -- 172.21.15.123:0/1911616652 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc80b1800 con 0x7fdfe00b5550 2024-04-25T13:42:36.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.281+0000 7fdfdcc00640 1 -- 172.21.15.123:0/1911616652 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfc80b19a0 con 0x7fdfe00b5550 2024-04-25T13:42:36.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.281+0000 7fdfe6c00640 1 -- 172.21.15.123:0/1911616652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfe013bd00 con 0x7fdfe00b5550 2024-04-25T13:42:36.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.281+0000 7fdfdcc00640 1 -- 172.21.15.123:0/1911616652 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfc80b1d70 con 0x7fdfe00b5550 2024-04-25T13:42:36.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.281+0000 7fdfe6c00640 1 -- 172.21.15.123:0/1911616652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfe00af550 con 0x7fdfe00b5550 2024-04-25T13:42:36.283 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.281+0000 7fdfe6c00640 1 -- 172.21.15.123:0/1911616652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfe013ba70 con 0x7fdfe00b5550 2024-04-25T13:42:36.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.285+0000 7fdfdcc00640 1 -- 172.21.15.123:0/1911616652 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fdfc80ba480 con 0x7fdfe00b5550 2024-04-25T13:42:36.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.285+0000 7fdfdcc00640 1 --2- 172.21.15.123:0/1911616652 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdfbc06f430 0x7fdfbc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:36.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.285+0000 7fdfdcc00640 1 -- 172.21.15.123:0/1911616652 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdfc8129b20 con 0x7fdfe00b5550 2024-04-25T13:42:36.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.285+0000 7fdfdfe00640 1 --2- 172.21.15.123:0/1911616652 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdfbc06f430 0x7fdfbc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:36.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.285+0000 7fdfdfe00640 1 --2- 172.21.15.123:0/1911616652 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdfbc06f430 0x7fdfbc071940 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0007fd0 tx=0x7fdfd0005b80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:36.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.289+0000 7fdfdcc00640 1 -- 172.21.15.123:0/1911616652 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdfc80ad020 con 0x7fdfe00b5550 2024-04-25T13:42:36.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.445+0000 7fdfe6c00640 1 -- 172.21.15.123:0/1911616652 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdfe0050750 con 0x7fdfe00b5550 2024-04-25T13:42:36.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.445+0000 7fdfdcc00640 1 -- 172.21.15.123:0/1911616652 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fdfc8016150 con 0x7fdfe00b5550 2024-04-25T13:42:36.445 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-04-25T13:42:36.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.445+0000 7fdfe6c00640 1 -- 172.21.15.123:0/1911616652 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdfbc06f430 msgr2=0x7fdfbc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.445+0000 7fdfe6c00640 1 --2- 172.21.15.123:0/1911616652 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdfbc06f430 0x7fdfbc071940 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0007fd0 tx=0x7fdfd0005b80 comp rx=0 tx=0).stop 2024-04-25T13:42:36.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.445+0000 7fdfe6c00640 1 -- 172.21.15.123:0/1911616652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfe00b5550 msgr2=0x7fdfe0143df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.445+0000 7fdfe6c00640 1 --2- 172.21.15.123:0/1911616652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfe00b5550 0x7fdfe0143df0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdfc801ca10 tx=0x7fdfc80192d0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.445+0000 7fdfe6c00640 1 -- 172.21.15.123:0/1911616652 shutdown_connections 2024-04-25T13:42:36.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.445+0000 7fdfe6c00640 1 --2- 172.21.15.123:0/1911616652 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdfbc06f430 0x7fdfbc071940 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.445+0000 7fdfe6c00640 1 --2- 172.21.15.123:0/1911616652 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfe0149b00 0x7fdfe0144330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.445+0000 7fdfe6c00640 1 --2- 172.21.15.123:0/1911616652 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdfe00b5550 0x7fdfe0143df0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.445+0000 7fdfe6c00640 1 --2- 172.21.15.123:0/1911616652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfe006c950 0x7fdfe013b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.445+0000 7fdfe6c00640 1 -- 172.21.15.123:0/1911616652 >> 172.21.15.123:0/1911616652 conn(0x7fdfe00d2180 msgr2=0x7fdfe0146320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:36.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.445+0000 7fdfe6c00640 1 -- 172.21.15.123:0/1911616652 shutdown_connections 2024-04-25T13:42:36.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.445+0000 7fdfe6c00640 1 -- 172.21.15.123:0/1911616652 wait complete. 2024-04-25T13:42:36.467 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:42:36.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.617+0000 7f2535a00640 1 Processor -- start 2024-04-25T13:42:36.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.617+0000 7f2535a00640 1 -- start start 2024-04-25T13:42:36.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.621+0000 7f2535a00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f253006e5a0 0x7f253006e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:36.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.621+0000 7f2535a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f25300ce740 0x7f25300ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:36.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.621+0000 7f2535a00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25300d0c80 con 0x7f2530164480 2024-04-25T13:42:36.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.621+0000 7f2535a00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f253009cf90 con 0x7f253006e5a0 2024-04-25T13:42:36.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.621+0000 7f2535a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f253009ccb0 con 0x7f25300ce740 2024-04-25T13:42:36.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.621+0000 7f252e000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f25300ce740 0x7f25300ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:36.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.621+0000 7f252f400640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f2530164480 0x7f2530164890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.123:41112/0 (socket says 172.21.15.123:41112) 2024-04-25T13:42:36.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.621+0000 7f252f400640 1 -- 172.21.15.123:0/1085217653 learned_addr learned my addr 172.21.15.123:0/1085217653 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:36.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.621+0000 7f252ea00640 1 --2- 172.21.15.123:0/1085217653 >> v2:172.21.15.130:3300/0 conn(0x7f253006e5a0 0x7f253006e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:36.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.621+0000 7f252e000640 1 -- 172.21.15.123:0/1085217653 >> v2:172.21.15.130:3300/0 conn(0x7f253006e5a0 msgr2=0x7f253006e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:36.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.621+0000 7f252e000640 1 --2- 172.21.15.123:0/1085217653 >> v2:172.21.15.130:3300/0 conn(0x7f253006e5a0 0x7f253006e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.621+0000 7f252d600640 1 -- 172.21.15.123:0/1085217653 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2891973569 0 0) 0x7f25300d0c80 con 0x7f2530164480 2024-04-25T13:42:36.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.621+0000 7f252e000640 1 -- 172.21.15.123:0/1085217653 >> v1:172.21.15.130:6789/0 conn(0x7f2530164480 legacy=0x7f2530164890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.621+0000 7f252e000640 1 -- 172.21.15.123:0/1085217653 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25300b8cd0 con 0x7f25300ce740 2024-04-25T13:42:36.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.625+0000 7f252e000640 1 --2- 172.21.15.123:0/1085217653 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f25300ce740 0x7f25300ceb50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f251c0097c0 tx=0x7f251c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfbb12dac6bce9e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:36.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.625+0000 7f252d600640 1 -- 172.21.15.123:0/1085217653 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251c0b0070 con 0x7f25300ce740 2024-04-25T13:42:36.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.625+0000 7f252d600640 1 -- 172.21.15.123:0/1085217653 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f251c0ab600 con 0x7f25300ce740 2024-04-25T13:42:36.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.625+0000 7f252d600640 1 -- 172.21.15.123:0/1085217653 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251c0ab9d0 con 0x7f25300ce740 2024-04-25T13:42:36.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.625+0000 7f2535a00640 1 -- 172.21.15.123:0/1085217653 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f25300ce740 msgr2=0x7f25300ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.625+0000 7f2535a00640 1 --2- 172.21.15.123:0/1085217653 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f25300ce740 0x7f25300ceb50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f251c0097c0 tx=0x7f251c01c4a0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.625+0000 7f2535a00640 1 -- 172.21.15.123:0/1085217653 shutdown_connections 2024-04-25T13:42:36.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.625+0000 7f2535a00640 1 --2- 172.21.15.123:0/1085217653 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f25300ce740 0x7f25300ceb50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.625+0000 7f2535a00640 1 --2- 172.21.15.123:0/1085217653 >> v2:172.21.15.130:3300/0 conn(0x7f253006e5a0 0x7f253006e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.625+0000 7f2535a00640 1 -- 172.21.15.123:0/1085217653 >> 172.21.15.123:0/1085217653 conn(0x7f25300d0160 msgr2=0x7f25300d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:36.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.625+0000 7f2535a00640 1 -- 172.21.15.123:0/1085217653 shutdown_connections 2024-04-25T13:42:36.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.625+0000 7f2535a00640 1 -- 172.21.15.123:0/1085217653 wait complete. 2024-04-25T13:42:36.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.629+0000 7f2535a00640 1 Processor -- start 2024-04-25T13:42:36.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.629+0000 7f2535a00640 1 -- start start 2024-04-25T13:42:36.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.629+0000 7f2535a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f253006e5a0 0x7f2530144d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:36.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.629+0000 7f2535a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25300ce740 0x7f25301570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:36.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.629+0000 7f2535a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2530164480 0x7f25301636d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:36.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.629+0000 7f2535a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f253006f070 con 0x7f2530164480 2024-04-25T13:42:36.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.629+0000 7f2535a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f253006eef0 con 0x7f25300ce740 2024-04-25T13:42:36.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.629+0000 7f2535a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f253006d930 con 0x7f253006e5a0 2024-04-25T13:42:36.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.629+0000 7f252f400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2530164480 0x7f25301636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:36.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.629+0000 7f252ea00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f253006e5a0 0x7f2530144d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:36.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.629+0000 7f252e000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25300ce740 0x7f25301570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:36.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.629+0000 7f252f400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2530164480 0x7f25301636d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49018/0 (socket says 172.21.15.123:49018) 2024-04-25T13:42:36.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.629+0000 7f252f400640 1 -- 172.21.15.123:0/3845605380 learned_addr learned my addr 172.21.15.123:0/3845605380 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:36.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.629+0000 7f252ea00640 1 -- 172.21.15.123:0/3845605380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25300ce740 msgr2=0x7f25301570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.629+0000 7f252ea00640 1 --2- 172.21.15.123:0/3845605380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25300ce740 0x7f25301570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.629+0000 7f252ea00640 1 -- 172.21.15.123:0/3845605380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2530164480 msgr2=0x7f25301636d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.629+0000 7f252ea00640 1 --2- 172.21.15.123:0/3845605380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2530164480 0x7f25301636d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.629+0000 7f252ea00640 1 -- 172.21.15.123:0/3845605380 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2530145260 con 0x7f253006e5a0 2024-04-25T13:42:36.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.629+0000 7f252f400640 1 --2- 172.21.15.123:0/3845605380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2530164480 0x7f25301636d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:36.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.629+0000 7f252ea00640 1 --2- 172.21.15.123:0/3845605380 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f253006e5a0 0x7f2530144d20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f252000e840 tx=0x7f252000ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:36.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.629+0000 7f2526a00640 1 -- 172.21.15.123:0/3845605380 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2520017070 con 0x7f253006e5a0 2024-04-25T13:42:36.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.629+0000 7f2526a00640 1 -- 172.21.15.123:0/3845605380 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f252000ee90 con 0x7f253006e5a0 2024-04-25T13:42:36.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.629+0000 7f2526a00640 1 -- 172.21.15.123:0/3845605380 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252000cb40 con 0x7f253006e5a0 2024-04-25T13:42:36.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.629+0000 7f2535a00640 1 -- 172.21.15.123:0/3845605380 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25300c9210 con 0x7f253006e5a0 2024-04-25T13:42:36.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.629+0000 7f2535a00640 1 -- 172.21.15.123:0/3845605380 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f25300c97d0 con 0x7f253006e5a0 2024-04-25T13:42:36.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.633+0000 7f2535a00640 1 -- 172.21.15.123:0/3845605380 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2530050750 con 0x7f253006e5a0 2024-04-25T13:42:36.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.633+0000 7f2526a00640 1 -- 172.21.15.123:0/3845605380 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f252001a070 con 0x7f253006e5a0 2024-04-25T13:42:36.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.633+0000 7f2526a00640 1 --2- 172.21.15.123:0/3845605380 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f251006f400 0x7f2510071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:36.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.633+0000 7f2526a00640 1 -- 172.21.15.123:0/3845605380 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f252008f570 con 0x7f253006e5a0 2024-04-25T13:42:36.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.633+0000 7f252e000640 1 --2- 172.21.15.123:0/3845605380 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f251006f400 0x7f2510071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:36.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.633+0000 7f252e000640 1 --2- 172.21.15.123:0/3845605380 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f251006f400 0x7f2510071910 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f251c0ad000 tx=0x7f251c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:36.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.637+0000 7f2526a00640 1 -- 172.21.15.123:0/3845605380 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2530145260 con 0x7f253006e5a0 2024-04-25T13:42:36.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.797+0000 7f2535a00640 1 -- 172.21.15.123:0/3845605380 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f25300b4840 con 0x7f253006e5a0 2024-04-25T13:42:36.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.797+0000 7f2526a00640 1 -- 172.21.15.123:0/3845605380 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f252008de20 con 0x7f253006e5a0 2024-04-25T13:42:36.798 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-04-25T13:42:36.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.801+0000 7f2535a00640 1 -- 172.21.15.123:0/3845605380 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f251006f400 msgr2=0x7f2510071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.801+0000 7f2535a00640 1 --2- 172.21.15.123:0/3845605380 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f251006f400 0x7f2510071910 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f251c0ad000 tx=0x7f251c008040 comp rx=0 tx=0).stop 2024-04-25T13:42:36.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.801+0000 7f2535a00640 1 -- 172.21.15.123:0/3845605380 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f253006e5a0 msgr2=0x7f2530144d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.801+0000 7f2535a00640 1 --2- 172.21.15.123:0/3845605380 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f253006e5a0 0x7f2530144d20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f252000e840 tx=0x7f252000ec40 comp rx=0 tx=0).stop 2024-04-25T13:42:36.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.801+0000 7f2535a00640 1 -- 172.21.15.123:0/3845605380 shutdown_connections 2024-04-25T13:42:36.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.801+0000 7f2535a00640 1 --2- 172.21.15.123:0/3845605380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25300ce740 0x7f25301570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.801+0000 7f2535a00640 1 --2- 172.21.15.123:0/3845605380 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f251006f400 0x7f2510071910 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.801+0000 7f2535a00640 1 --2- 172.21.15.123:0/3845605380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2530164480 0x7f25301636d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.801+0000 7f2535a00640 1 --2- 172.21.15.123:0/3845605380 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f253006e5a0 0x7f2530144d20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.801+0000 7f2535a00640 1 -- 172.21.15.123:0/3845605380 >> 172.21.15.123:0/3845605380 conn(0x7f25300d0160 msgr2=0x7f25300b7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:36.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.801+0000 7f2535a00640 1 -- 172.21.15.123:0/3845605380 shutdown_connections 2024-04-25T13:42:36.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.801+0000 7f2535a00640 1 -- 172.21.15.123:0/3845605380 wait complete. 2024-04-25T13:42:36.820 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:42:36.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.969+0000 7f290fa00640 1 Processor -- start 2024-04-25T13:42:36.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.969+0000 7f290fa00640 1 -- start start 2024-04-25T13:42:36.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.969+0000 7f290fa00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f29080b8ea0 0x7f29080b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:36.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.969+0000 7f290fa00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f29080cf3e0 0x7f29080d0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:36.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.969+0000 7f290fa00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29080ce660 con 0x7f29080cf7f0 2024-04-25T13:42:36.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.969+0000 7f290fa00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f29080b92b0 con 0x7f29080cf3e0 2024-04-25T13:42:36.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.969+0000 7f290fa00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f29080ce430 con 0x7f29080b8ea0 2024-04-25T13:42:36.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.969+0000 7f28ffe00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f29080cf3e0 0x7f29080d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:36.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.969+0000 7f290d000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f29080b8ea0 0x7f29080b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:36.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.969+0000 7f290da00640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f29080cf7f0 0x7f29080b3040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.123:41124/0 (socket says 172.21.15.123:41124) 2024-04-25T13:42:36.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.969+0000 7f290da00640 1 -- 172.21.15.123:0/1423739954 learned_addr learned my addr 172.21.15.123:0/1423739954 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:36.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.973+0000 7f290d000640 1 -- 172.21.15.123:0/1423739954 >> v2:172.21.15.130:3300/0 conn(0x7f29080cf3e0 msgr2=0x7f29080d0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:36.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.973+0000 7f290d000640 1 --2- 172.21.15.123:0/1423739954 >> v2:172.21.15.130:3300/0 conn(0x7f29080cf3e0 0x7f29080d0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.973+0000 7f290d000640 1 -- 172.21.15.123:0/1423739954 >> v1:172.21.15.130:6789/0 conn(0x7f29080cf7f0 legacy=0x7f29080b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.973+0000 7f2907e00640 1 -- 172.21.15.123:0/1423739954 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1216961412 0 0) 0x7f29080ce660 con 0x7f29080cf7f0 2024-04-25T13:42:36.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.973+0000 7f290d000640 1 -- 172.21.15.123:0/1423739954 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29080b2df0 con 0x7f29080b8ea0 2024-04-25T13:42:36.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.973+0000 7f290d000640 1 --2- 172.21.15.123:0/1423739954 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f29080b8ea0 0x7f29080b28b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f28f80097a0 tx=0x7f28f801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=931c376f7688772c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:36.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.973+0000 7f2907e00640 1 -- 172.21.15.123:0/1423739954 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f80b1070 con 0x7f29080b8ea0 2024-04-25T13:42:36.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.973+0000 7f2907e00640 1 -- 172.21.15.123:0/1423739954 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f80ac620 con 0x7f29080b8ea0 2024-04-25T13:42:36.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.973+0000 7f2907e00640 1 -- 172.21.15.123:0/1423739954 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f80ac9f0 con 0x7f29080b8ea0 2024-04-25T13:42:36.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.973+0000 7f290fa00640 1 -- 172.21.15.123:0/1423739954 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f29080b8ea0 msgr2=0x7f29080b28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.973+0000 7f290fa00640 1 --2- 172.21.15.123:0/1423739954 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f29080b8ea0 0x7f29080b28b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f28f80097a0 tx=0x7f28f801c3c0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.973+0000 7f290fa00640 1 -- 172.21.15.123:0/1423739954 shutdown_connections 2024-04-25T13:42:36.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.973+0000 7f290fa00640 1 --2- 172.21.15.123:0/1423739954 >> v2:172.21.15.130:3300/0 conn(0x7f29080cf3e0 0x7f29080d0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.973+0000 7f290fa00640 1 --2- 172.21.15.123:0/1423739954 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f29080b8ea0 0x7f29080b28b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.973+0000 7f290fa00640 1 -- 172.21.15.123:0/1423739954 >> 172.21.15.123:0/1423739954 conn(0x7f29080d36e0 msgr2=0x7f29080d3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:36.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.977+0000 7f290fa00640 1 -- 172.21.15.123:0/1423739954 shutdown_connections 2024-04-25T13:42:36.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.977+0000 7f290fa00640 1 -- 172.21.15.123:0/1423739954 wait complete. 2024-04-25T13:42:36.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.977+0000 7f290fa00640 1 Processor -- start 2024-04-25T13:42:36.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.977+0000 7f290fa00640 1 -- start start 2024-04-25T13:42:36.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.977+0000 7f290fa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29080b8ea0 0x7f29080b4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:36.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.977+0000 7f290fa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29080cf3e0 0x7f2908152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:36.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.977+0000 7f290fa00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f29080cf7f0 0x7f2908160da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:36.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.977+0000 7f290fa00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f29080b8c00 con 0x7f29080cf3e0 2024-04-25T13:42:36.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.977+0000 7f290fa00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f29080d09a0 con 0x7f29080b8ea0 2024-04-25T13:42:36.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.977+0000 7f290fa00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f29080d2800 con 0x7f29080cf7f0 2024-04-25T13:42:36.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.981+0000 7f28ffe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29080cf3e0 0x7f2908152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:36.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.981+0000 7f28ffe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29080cf3e0 0x7f2908152010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49020/0 (socket says 172.21.15.123:49020) 2024-04-25T13:42:36.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.981+0000 7f28ffe00640 1 -- 172.21.15.123:0/2631675236 learned_addr learned my addr 172.21.15.123:0/2631675236 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:36.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.981+0000 7f290d000640 1 --2- 172.21.15.123:0/2631675236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29080b8ea0 0x7f29080b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:36.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.981+0000 7f290da00640 1 --2- 172.21.15.123:0/2631675236 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f29080cf7f0 0x7f2908160da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:36.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.981+0000 7f28ffe00640 1 -- 172.21.15.123:0/2631675236 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f29080cf7f0 msgr2=0x7f2908160da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.981+0000 7f28ffe00640 1 --2- 172.21.15.123:0/2631675236 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f29080cf7f0 0x7f2908160da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.981+0000 7f28ffe00640 1 -- 172.21.15.123:0/2631675236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29080b8ea0 msgr2=0x7f29080b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:36.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.981+0000 7f28ffe00640 1 --2- 172.21.15.123:0/2631675236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29080b8ea0 0x7f29080b4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:36.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.981+0000 7f28ffe00640 1 -- 172.21.15.123:0/2631675236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29080b4ab0 con 0x7f29080cf3e0 2024-04-25T13:42:36.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.981+0000 7f290da00640 1 --2- 172.21.15.123:0/2631675236 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f29080cf7f0 0x7f2908160da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:36.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.981+0000 7f28ffe00640 1 --2- 172.21.15.123:0/2631675236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29080cf3e0 0x7f2908152010 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f28f000e840 tx=0x7f28f000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:36.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.981+0000 7f2905600640 1 -- 172.21.15.123:0/2631675236 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f0017070 con 0x7f29080cf3e0 2024-04-25T13:42:36.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.981+0000 7f2905600640 1 -- 172.21.15.123:0/2631675236 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f000c730 con 0x7f29080cf3e0 2024-04-25T13:42:36.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.981+0000 7f2905600640 1 -- 172.21.15.123:0/2631675236 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f000cb20 con 0x7f29080cf3e0 2024-04-25T13:42:36.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.981+0000 7f290fa00640 1 -- 172.21.15.123:0/2631675236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2908158c30 con 0x7f29080cf3e0 2024-04-25T13:42:36.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.981+0000 7f290fa00640 1 -- 172.21.15.123:0/2631675236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29081591f0 con 0x7f29080cf3e0 2024-04-25T13:42:36.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.981+0000 7f290fa00640 1 -- 172.21.15.123:0/2631675236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29081589a0 con 0x7f29080cf3e0 2024-04-25T13:42:36.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.981+0000 7f2905600640 1 -- 172.21.15.123:0/2631675236 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f28f001a070 con 0x7f29080cf3e0 2024-04-25T13:42:36.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.985+0000 7f2905600640 1 --2- 172.21.15.123:0/2631675236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f28e406f400 0x7f28e4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:36.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.985+0000 7f2905600640 1 -- 172.21.15.123:0/2631675236 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f28f008f0b0 con 0x7f29080cf3e0 2024-04-25T13:42:36.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.985+0000 7f290d000640 1 --2- 172.21.15.123:0/2631675236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f28e406f400 0x7f28e4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:36.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.985+0000 7f290d000640 1 --2- 172.21.15.123:0/2631675236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f28e406f400 0x7f28e4071910 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f28f80ae000 tx=0x7f28f80a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:36.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:36.989+0000 7f2905600640 1 -- 172.21.15.123:0/2631675236 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f28f005b940 con 0x7f29080cf3e0 2024-04-25T13:42:37.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.145+0000 7f290fa00640 1 -- 172.21.15.123:0/2631675236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2908050750 con 0x7f29080cf3e0 2024-04-25T13:42:37.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.145+0000 7f2905600640 1 -- 172.21.15.123:0/2631675236 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f28f005fc40 con 0x7f29080cf3e0 2024-04-25T13:42:37.145 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-04-25T13:42:37.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.145+0000 7f290fa00640 1 -- 172.21.15.123:0/2631675236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f28e406f400 msgr2=0x7f28e4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:37.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.145+0000 7f290fa00640 1 --2- 172.21.15.123:0/2631675236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f28e406f400 0x7f28e4071910 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f28f80ae000 tx=0x7f28f80a7000 comp rx=0 tx=0).stop 2024-04-25T13:42:37.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.145+0000 7f290fa00640 1 -- 172.21.15.123:0/2631675236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29080cf3e0 msgr2=0x7f2908152010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:37.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.145+0000 7f290fa00640 1 --2- 172.21.15.123:0/2631675236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29080cf3e0 0x7f2908152010 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f28f000e840 tx=0x7f28f000ed00 comp rx=0 tx=0).stop 2024-04-25T13:42:37.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.145+0000 7f290fa00640 1 -- 172.21.15.123:0/2631675236 shutdown_connections 2024-04-25T13:42:37.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.145+0000 7f290fa00640 1 --2- 172.21.15.123:0/2631675236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f28e406f400 0x7f28e4071910 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.145+0000 7f290fa00640 1 --2- 172.21.15.123:0/2631675236 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f29080cf7f0 0x7f2908160da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.145+0000 7f290fa00640 1 --2- 172.21.15.123:0/2631675236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29080cf3e0 0x7f2908152010 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.145+0000 7f290fa00640 1 --2- 172.21.15.123:0/2631675236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f29080b8ea0 0x7f29080b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.145+0000 7f290fa00640 1 -- 172.21.15.123:0/2631675236 >> 172.21.15.123:0/2631675236 conn(0x7f29080d36e0 msgr2=0x7f29080722d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:37.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.145+0000 7f290fa00640 1 -- 172.21.15.123:0/2631675236 shutdown_connections 2024-04-25T13:42:37.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.145+0000 7f290fa00640 1 -- 172.21.15.123:0/2631675236 wait complete. 2024-04-25T13:42:37.167 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_flush.TestFlush.test_flush' 2024-04-25T13:42:37.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.313+0000 7fba19c00640 1 Processor -- start 2024-04-25T13:42:37.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.313+0000 7fba19c00640 1 -- start start 2024-04-25T13:42:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.313+0000 7fba19c00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fba141623a0 0x7fba141627b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.313+0000 7fba19c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fba140b6c30 0x7fba140b7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.313+0000 7fba19c00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba140b27b0 con 0x7fba14162cf0 2024-04-25T13:42:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.313+0000 7fba19c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fba140d16b0 con 0x7fba140b6c30 2024-04-25T13:42:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.313+0000 7fba19c00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fba140b8e80 con 0x7fba141623a0 2024-04-25T13:42:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.313+0000 7fba13400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fba140b6c30 0x7fba140b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.313+0000 7fba13400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fba140b6c30 0x7fba140b7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49034/0 (socket says 172.21.15.123:49034) 2024-04-25T13:42:37.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.313+0000 7fba13400640 1 -- 172.21.15.123:0/2402197104 learned_addr learned my addr 172.21.15.123:0/2402197104 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.313+0000 7fba12a00640 1 --2- 172.21.15.123:0/2402197104 >> v2:172.21.15.130:3300/0 conn(0x7fba141623a0 0x7fba141627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.313+0000 7fba13400640 1 -- 172.21.15.123:0/2402197104 >> v2:172.21.15.130:3300/0 conn(0x7fba141623a0 msgr2=0x7fba141627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.313+0000 7fba13400640 1 --2- 172.21.15.123:0/2402197104 >> v2:172.21.15.130:3300/0 conn(0x7fba141623a0 0x7fba141627b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.313+0000 7fba13400640 1 -- 172.21.15.123:0/2402197104 >> v1:172.21.15.130:6789/0 conn(0x7fba14162cf0 legacy=0x7fba140b6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:37.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.313+0000 7fba13400640 1 -- 172.21.15.123:0/2402197104 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba140d1340 con 0x7fba140b6c30 2024-04-25T13:42:37.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.317+0000 7fba13400640 1 --2- 172.21.15.123:0/2402197104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba140b6c30 0x7fba140b7040 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fba14073b50 tx=0x7fba0c01c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff8564a71f3d2ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:37.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.317+0000 7fba12000640 1 -- 172.21.15.123:0/2402197104 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c0a5700 con 0x7fba140b6c30 2024-04-25T13:42:37.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.317+0000 7fba12000640 1 -- 172.21.15.123:0/2402197104 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba0c0a58a0 con 0x7fba140b6c30 2024-04-25T13:42:37.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.317+0000 7fba12000640 1 -- 172.21.15.123:0/2402197104 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c0a5c70 con 0x7fba140b6c30 2024-04-25T13:42:37.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.317+0000 7fba19c00640 1 -- 172.21.15.123:0/2402197104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba140b6c30 msgr2=0x7fba140b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:37.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.317+0000 7fba19c00640 1 --2- 172.21.15.123:0/2402197104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba140b6c30 0x7fba140b7040 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fba14073b50 tx=0x7fba0c01c9b0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.317+0000 7fba19c00640 1 -- 172.21.15.123:0/2402197104 shutdown_connections 2024-04-25T13:42:37.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.317+0000 7fba19c00640 1 --2- 172.21.15.123:0/2402197104 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba140b6c30 0x7fba140b7040 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.317+0000 7fba19c00640 1 --2- 172.21.15.123:0/2402197104 >> v2:172.21.15.130:3300/0 conn(0x7fba141623a0 0x7fba141627b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.317+0000 7fba19c00640 1 -- 172.21.15.123:0/2402197104 >> 172.21.15.123:0/2402197104 conn(0x7fba140d0150 msgr2=0x7fba140d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:37.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.317+0000 7fba19c00640 1 -- 172.21.15.123:0/2402197104 shutdown_connections 2024-04-25T13:42:37.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.317+0000 7fba19c00640 1 -- 172.21.15.123:0/2402197104 wait complete. 2024-04-25T13:42:37.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.321+0000 7fba19c00640 1 Processor -- start 2024-04-25T13:42:37.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.321+0000 7fba19c00640 1 -- start start 2024-04-25T13:42:37.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.321+0000 7fba19c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fba140b6c30 0x7fba14167f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:37.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.321+0000 7fba19c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba141623a0 0x7fba1415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:37.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.321+0000 7fba19c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba14162cf0 0x7fba1415c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:37.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.321+0000 7fba19c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fba140b88d0 con 0x7fba14162cf0 2024-04-25T13:42:37.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.321+0000 7fba19c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fba140b2a20 con 0x7fba141623a0 2024-04-25T13:42:37.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.321+0000 7fba19c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fba140b8a50 con 0x7fba140b6c30 2024-04-25T13:42:37.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.321+0000 7fba13400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba14162cf0 0x7fba1415c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:37.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.321+0000 7fba13400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba14162cf0 0x7fba1415c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49040/0 (socket says 172.21.15.123:49040) 2024-04-25T13:42:37.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.321+0000 7fba13400640 1 -- 172.21.15.123:0/3123855323 learned_addr learned my addr 172.21.15.123:0/3123855323 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:37.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.325+0000 7fba12a00640 1 --2- 172.21.15.123:0/3123855323 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fba140b6c30 0x7fba14167f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:37.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.325+0000 7fba0a000640 1 --2- 172.21.15.123:0/3123855323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba141623a0 0x7fba1415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:37.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.325+0000 7fba13400640 1 -- 172.21.15.123:0/3123855323 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fba140b6c30 msgr2=0x7fba14167f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:37.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.325+0000 7fba13400640 1 --2- 172.21.15.123:0/3123855323 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fba140b6c30 0x7fba14167f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.325+0000 7fba13400640 1 -- 172.21.15.123:0/3123855323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba141623a0 msgr2=0x7fba1415bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:37.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.325+0000 7fba13400640 1 --2- 172.21.15.123:0/3123855323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba141623a0 0x7fba1415bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:37.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.325+0000 7fba13400640 1 -- 172.21.15.123:0/3123855323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba140b3550 con 0x7fba14162cf0 2024-04-25T13:42:37.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.325+0000 7fba13400640 1 --2- 172.21.15.123:0/3123855323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba14162cf0 0x7fba1415c190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fba0c01a5e0 tx=0x7fba0c019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:37.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.325+0000 7fba0b400640 1 -- 172.21.15.123:0/3123855323 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c009510 con 0x7fba14162cf0 2024-04-25T13:42:37.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.325+0000 7fba0b400640 1 -- 172.21.15.123:0/3123855323 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba0c0be070 con 0x7fba14162cf0 2024-04-25T13:42:37.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.325+0000 7fba19c00640 1 -- 172.21.15.123:0/3123855323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba140b3830 con 0x7fba14162cf0 2024-04-25T13:42:37.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.325+0000 7fba0b400640 1 -- 172.21.15.123:0/3123855323 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c0b88b0 con 0x7fba14162cf0 2024-04-25T13:42:37.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.325+0000 7fba19c00640 1 -- 172.21.15.123:0/3123855323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba1406f250 con 0x7fba14162cf0 2024-04-25T13:42:37.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.325+0000 7fba19c00640 1 -- 172.21.15.123:0/3123855323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba140507c0 con 0x7fba14162cf0 2024-04-25T13:42:37.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.325+0000 7fba0b400640 1 -- 172.21.15.123:0/3123855323 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fba0c0b8a50 con 0x7fba14162cf0 2024-04-25T13:42:37.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.329+0000 7fba0b400640 1 --2- 172.21.15.123:0/3123855323 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb9f006f430 0x7fb9f0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:37.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.329+0000 7fba0b400640 1 -- 172.21.15.123:0/3123855323 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fba0c129e90 con 0x7fba14162cf0 2024-04-25T13:42:37.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.329+0000 7fba12a00640 1 --2- 172.21.15.123:0/3123855323 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb9f006f430 0x7fb9f0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:37.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.329+0000 7fba12a00640 1 --2- 172.21.15.123:0/3123855323 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb9f006f430 0x7fb9f0071940 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fba140cde90 tx=0x7fba04008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:37.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.333+0000 7fba0b400640 1 -- 172.21.15.123:0/3123855323 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fba0c0165a0 con 0x7fba14162cf0 2024-04-25T13:42:37.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:37.549+0000 7fba19c00640 1 -- 172.21.15.123:0/3123855323 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_flush.TestFlush.test_flush"]} v 0) -- 0x7fba140a1370 con 0x7fba14162cf0 2024-04-25T13:42:38.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.545+0000 7fba0b400640 1 -- 172.21.15.123:0/3123855323 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_flush.TestFlush.test_flush"]}]=0 v55) ==== 126+0+0 (secure 0 0 0) 0x7fba0c0f6720 con 0x7fba14162cf0 2024-04-25T13:42:38.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.549+0000 7fba19c00640 1 -- 172.21.15.123:0/3123855323 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb9f006f430 msgr2=0x7fb9f0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:38.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.549+0000 7fba19c00640 1 --2- 172.21.15.123:0/3123855323 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb9f006f430 0x7fb9f0071940 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fba140cde90 tx=0x7fba04008040 comp rx=0 tx=0).stop 2024-04-25T13:42:38.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.549+0000 7fba19c00640 1 -- 172.21.15.123:0/3123855323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba14162cf0 msgr2=0x7fba1415c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:38.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.549+0000 7fba19c00640 1 --2- 172.21.15.123:0/3123855323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba14162cf0 0x7fba1415c190 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fba0c01a5e0 tx=0x7fba0c019750 comp rx=0 tx=0).stop 2024-04-25T13:42:38.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.549+0000 7fba19c00640 1 -- 172.21.15.123:0/3123855323 shutdown_connections 2024-04-25T13:42:38.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.549+0000 7fba19c00640 1 --2- 172.21.15.123:0/3123855323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba141623a0 0x7fba1415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.549+0000 7fba19c00640 1 --2- 172.21.15.123:0/3123855323 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb9f006f430 0x7fb9f0071940 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.549+0000 7fba19c00640 1 --2- 172.21.15.123:0/3123855323 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba14162cf0 0x7fba1415c190 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.549+0000 7fba19c00640 1 --2- 172.21.15.123:0/3123855323 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fba140b6c30 0x7fba14167f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.549+0000 7fba19c00640 1 -- 172.21.15.123:0/3123855323 >> 172.21.15.123:0/3123855323 conn(0x7fba140d0150 msgr2=0x7fba140b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:38.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.549+0000 7fba19c00640 1 -- 172.21.15.123:0/3123855323 shutdown_connections 2024-04-25T13:42:38.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.549+0000 7fba19c00640 1 -- 172.21.15.123:0/3123855323 wait complete. 2024-04-25T13:42:38.572 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T13:42:38.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.725+0000 7f8bd3400640 1 Processor -- start 2024-04-25T13:42:38.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.725+0000 7f8bd3400640 1 -- start start 2024-04-25T13:42:38.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.729+0000 7f8bd3400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bcc0b3870 0x7f8bcc0b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:38.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.729+0000 7f8bd3400640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8bcc15de80 0x7f8bcc15e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:38.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.729+0000 7f8bd3400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bcc0b41c0 con 0x7f8bcc0ceac0 2024-04-25T13:42:38.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.729+0000 7f8bd3400640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f8bcc0c7140 con 0x7f8bcc15de80 2024-04-25T13:42:38.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.729+0000 7f8bd3400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8bcc0cf060 con 0x7f8bcc0b3870 2024-04-25T13:42:38.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.729+0000 7f8bd0a00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8bcc0ceac0 0x7f8bcc0c75d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60830/0 (socket says 172.21.15.123:60830) 2024-04-25T13:42:38.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.729+0000 7f8bd0a00640 1 -- 172.21.15.123:0/518324094 learned_addr learned my addr 172.21.15.123:0/518324094 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:38.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.729+0000 7f8bcbe00640 1 --2- 172.21.15.123:0/518324094 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bcc0b3870 0x7f8bcc0b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:38.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.729+0000 7f8bd1400640 1 --2- 172.21.15.123:0/518324094 >> v2:172.21.15.130:3300/0 conn(0x7f8bcc15de80 0x7f8bcc15e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:38.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.729+0000 7f8bcb400640 1 -- 172.21.15.123:0/518324094 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4171953812 0 0) 0x7f8bbc0014a0 con 0x7f8bcc0ceac0 2024-04-25T13:42:38.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.729+0000 7f8bcb400640 1 -- 172.21.15.123:0/518324094 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bb0003530 con 0x7f8bcc0ceac0 2024-04-25T13:42:38.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.729+0000 7f8bd1400640 1 -- 172.21.15.123:0/518324094 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bcc0b3870 msgr2=0x7f8bcc0b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:38.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.729+0000 7f8bd1400640 1 --2- 172.21.15.123:0/518324094 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bcc0b3870 0x7f8bcc0b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.729+0000 7f8bd1400640 1 -- 172.21.15.123:0/518324094 >> v1:172.21.15.123:6789/0 conn(0x7f8bcc0ceac0 legacy=0x7f8bcc0c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:38.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.729+0000 7f8bd1400640 1 -- 172.21.15.123:0/518324094 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bcc0c6810 con 0x7f8bcc15de80 2024-04-25T13:42:38.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.729+0000 7f8bcbe00640 1 --2- 172.21.15.123:0/518324094 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bcc0b3870 0x7f8bcc0b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:38.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.733+0000 7f8bd1400640 1 --2- 172.21.15.123:0/518324094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8bcc15de80 0x7f8bcc15e290 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8bc40097c0 tx=0x7f8bc401c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15654fd307226397 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:38.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.733+0000 7f8bcb400640 1 -- 172.21.15.123:0/518324094 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc40b1070 con 0x7f8bcc15de80 2024-04-25T13:42:38.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.733+0000 7f8bcb400640 1 -- 172.21.15.123:0/518324094 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bc40a8050 con 0x7f8bcc15de80 2024-04-25T13:42:38.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.733+0000 7f8bcb400640 1 -- 172.21.15.123:0/518324094 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc40ac860 con 0x7f8bcc15de80 2024-04-25T13:42:38.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.733+0000 7f8bd3400640 1 -- 172.21.15.123:0/518324094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8bcc15de80 msgr2=0x7f8bcc15e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:38.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.733+0000 7f8bd3400640 1 --2- 172.21.15.123:0/518324094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8bcc15de80 0x7f8bcc15e290 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8bc40097c0 tx=0x7f8bc401c3e0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.733+0000 7f8bd3400640 1 -- 172.21.15.123:0/518324094 shutdown_connections 2024-04-25T13:42:38.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.733+0000 7f8bd3400640 1 --2- 172.21.15.123:0/518324094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8bcc15de80 0x7f8bcc15e290 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.733+0000 7f8bd3400640 1 --2- 172.21.15.123:0/518324094 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bcc0b3870 0x7f8bcc0b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.733+0000 7f8bd3400640 1 -- 172.21.15.123:0/518324094 >> 172.21.15.123:0/518324094 conn(0x7f8bcc06ca70 msgr2=0x7f8bcc06ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:38.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.733+0000 7f8bd3400640 1 -- 172.21.15.123:0/518324094 shutdown_connections 2024-04-25T13:42:38.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.733+0000 7f8bd3400640 1 -- 172.21.15.123:0/518324094 wait complete. 2024-04-25T13:42:38.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.737+0000 7f8bd3400640 1 Processor -- start 2024-04-25T13:42:38.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.737+0000 7f8bd3400640 1 -- start start 2024-04-25T13:42:38.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.737+0000 7f8bd3400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bcc0b3870 0x7f8bcc163030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:38.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.737+0000 7f8bd3400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8bcc0ceac0 0x7f8bcc1fd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:38.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.737+0000 7f8bd3400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bcc15de80 0x7f8bcc0cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:38.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.737+0000 7f8bd3400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc16aae0 con 0x7f8bcc0b3870 2024-04-25T13:42:38.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.737+0000 7f8bd3400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc16a960 con 0x7f8bcc0ceac0 2024-04-25T13:42:38.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.737+0000 7f8bd3400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8bcc16ac60 con 0x7f8bcc15de80 2024-04-25T13:42:38.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.737+0000 7f8bd0a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bcc0b3870 0x7f8bcc163030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:38.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.737+0000 7f8bd0a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bcc0b3870 0x7f8bcc163030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49050/0 (socket says 172.21.15.123:49050) 2024-04-25T13:42:38.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.737+0000 7f8bd0a00640 1 -- 172.21.15.123:0/1057132050 learned_addr learned my addr 172.21.15.123:0/1057132050 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.737+0000 7f8bd1400640 1 --2- 172.21.15.123:0/1057132050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bcc15de80 0x7f8bcc0cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.737+0000 7f8bcbe00640 1 --2- 172.21.15.123:0/1057132050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8bcc0ceac0 0x7f8bcc1fd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.737+0000 7f8bd0a00640 1 -- 172.21.15.123:0/1057132050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bcc15de80 msgr2=0x7f8bcc0cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.737+0000 7f8bd0a00640 1 --2- 172.21.15.123:0/1057132050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bcc15de80 0x7f8bcc0cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.737+0000 7f8bd0a00640 1 -- 172.21.15.123:0/1057132050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8bcc0ceac0 msgr2=0x7f8bcc1fd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.737+0000 7f8bd0a00640 1 --2- 172.21.15.123:0/1057132050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8bcc0ceac0 0x7f8bcc1fd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.737+0000 7f8bd0a00640 1 -- 172.21.15.123:0/1057132050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bcc1f9620 con 0x7f8bcc0b3870 2024-04-25T13:42:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.737+0000 7f8bd1400640 1 --2- 172.21.15.123:0/1057132050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bcc15de80 0x7f8bcc0cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.737+0000 7f8bcbe00640 1 --2- 172.21.15.123:0/1057132050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8bcc0ceac0 0x7f8bcc1fd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.737+0000 7f8bd0a00640 1 --2- 172.21.15.123:0/1057132050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bcc0b3870 0x7f8bcc163030 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00cb10 tx=0x7f8bbc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.737+0000 7f8bc8c00640 1 -- 172.21.15.123:0/1057132050 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc017070 con 0x7f8bcc0b3870 2024-04-25T13:42:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.737+0000 7f8bc8c00640 1 -- 172.21.15.123:0/1057132050 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bbc00ac10 con 0x7f8bcc0b3870 2024-04-25T13:42:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.737+0000 7f8bd3400640 1 -- 172.21.15.123:0/1057132050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bcc1f9900 con 0x7f8bcc0b3870 2024-04-25T13:42:38.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.737+0000 7f8bc8c00640 1 -- 172.21.15.123:0/1057132050 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc012400 con 0x7f8bcc0b3870 2024-04-25T13:42:38.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.737+0000 7f8bd3400640 1 -- 172.21.15.123:0/1057132050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bcc1f9ec0 con 0x7f8bcc0b3870 2024-04-25T13:42:38.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.737+0000 7f8bd3400640 1 -- 172.21.15.123:0/1057132050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bcc06d600 con 0x7f8bcc0b3870 2024-04-25T13:42:38.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.741+0000 7f8bc8c00640 1 -- 172.21.15.123:0/1057132050 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8bbc01a070 con 0x7f8bcc0b3870 2024-04-25T13:42:38.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.741+0000 7f8bc8c00640 1 --2- 172.21.15.123:0/1057132050 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8bac06f400 0x7f8bac071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:38.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.741+0000 7f8bc8c00640 1 -- 172.21.15.123:0/1057132050 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8bbc08f180 con 0x7f8bcc0b3870 2024-04-25T13:42:38.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.741+0000 7f8bcbe00640 1 --2- 172.21.15.123:0/1057132050 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8bac06f400 0x7f8bac071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:38.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.741+0000 7f8bcbe00640 1 --2- 172.21.15.123:0/1057132050 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8bac06f400 0x7f8bac071910 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc168510 tx=0x7f8bb8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:38.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.745+0000 7f8bc8c00640 1 -- 172.21.15.123:0/1057132050 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8bcc0b41c0 con 0x7f8bcc0b3870 2024-04-25T13:42:38.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.901+0000 7f8bd3400640 1 -- 172.21.15.123:0/1057132050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f8bcc050750 con 0x7f8bcc0b3870 2024-04-25T13:42:38.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.905+0000 7f8bc8c00640 1 -- 172.21.15.123:0/1057132050 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f8bbc05bf50 con 0x7f8bcc0b3870 2024-04-25T13:42:38.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.909+0000 7f8bd3400640 1 -- 172.21.15.123:0/1057132050 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8bac06f400 msgr2=0x7f8bac071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:38.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.909+0000 7f8bd3400640 1 --2- 172.21.15.123:0/1057132050 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8bac06f400 0x7f8bac071910 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc168510 tx=0x7f8bb8008040 comp rx=0 tx=0).stop 2024-04-25T13:42:38.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.909+0000 7f8bd3400640 1 -- 172.21.15.123:0/1057132050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bcc0b3870 msgr2=0x7f8bcc163030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:38.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.909+0000 7f8bd3400640 1 --2- 172.21.15.123:0/1057132050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bcc0b3870 0x7f8bcc163030 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc00cb10 tx=0x7f8bbc00a060 comp rx=0 tx=0).stop 2024-04-25T13:42:38.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.909+0000 7f8bd3400640 1 -- 172.21.15.123:0/1057132050 shutdown_connections 2024-04-25T13:42:38.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.909+0000 7f8bd3400640 1 --2- 172.21.15.123:0/1057132050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8bcc0ceac0 0x7f8bcc1fd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.909+0000 7f8bd3400640 1 --2- 172.21.15.123:0/1057132050 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8bac06f400 0x7f8bac071910 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.909+0000 7f8bd3400640 1 --2- 172.21.15.123:0/1057132050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bcc15de80 0x7f8bcc0cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.909+0000 7f8bd3400640 1 --2- 172.21.15.123:0/1057132050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bcc0b3870 0x7f8bcc163030 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:38.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.909+0000 7f8bd3400640 1 -- 172.21.15.123:0/1057132050 >> 172.21.15.123:0/1057132050 conn(0x7f8bcc06ca70 msgr2=0x7f8bcc15ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:38.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.909+0000 7f8bd3400640 1 -- 172.21.15.123:0/1057132050 shutdown_connections 2024-04-25T13:42:38.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:38.909+0000 7f8bd3400640 1 -- 172.21.15.123:0/1057132050 wait complete. 2024-04-25T13:42:38.928 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T13:42:38.928 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T13:42:39.030 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T13:42:39.091 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T13:42:39.092 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:42:39.092 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:42:39.100 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:42:39.100 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:42:39.153 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:42:39.153 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:42:39.203 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:39.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.393+0000 7ff93a000640 1 Processor -- start 2024-04-25T13:42:39.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.393+0000 7ff93a000640 1 -- start start 2024-04-25T13:42:39.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.393+0000 7ff93a000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9341623a0 0x7ff9341627b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:39.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.393+0000 7ff93a000640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff9340b6c30 0x7ff9340b7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:39.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.393+0000 7ff93a000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9340b27b0 con 0x7ff934162cf0 2024-04-25T13:42:39.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.393+0000 7ff93a000640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7ff9340d16b0 con 0x7ff9340b6c30 2024-04-25T13:42:39.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.393+0000 7ff93a000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff9340b8e80 con 0x7ff9341623a0 2024-04-25T13:42:39.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.393+0000 7ff932a00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff934162cf0 0x7ff9340b6520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:60836/0 (socket says 172.21.15.123:60836) 2024-04-25T13:42:39.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.393+0000 7ff932a00640 1 -- 172.21.15.123:0/706268130 learned_addr learned my addr 172.21.15.123:0/706268130 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:39.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.393+0000 7ff933e00640 1 --2- 172.21.15.123:0/706268130 >> v2:172.21.15.130:3300/0 conn(0x7ff9340b6c30 0x7ff9340b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:39.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.393+0000 7ff933400640 1 --2- 172.21.15.123:0/706268130 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9341623a0 0x7ff9341627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:39.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.397+0000 7ff932000640 1 -- 172.21.15.123:0/706268130 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 958413099 0 0) 0x7ff9340b27b0 con 0x7ff934162cf0 2024-04-25T13:42:39.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.397+0000 7ff932000640 1 -- 172.21.15.123:0/706268130 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff918003530 con 0x7ff934162cf0 2024-04-25T13:42:39.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.397+0000 7ff932000640 1 -- 172.21.15.123:0/706268130 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1686199525 0 0) 0x7ff918003530 con 0x7ff934162cf0 2024-04-25T13:42:39.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.397+0000 7ff932000640 1 -- 172.21.15.123:0/706268130 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9341623a0 msgr2=0x7ff9341627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:39.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.397+0000 7ff932000640 1 --2- 172.21.15.123:0/706268130 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9341623a0 0x7ff9341627b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.397+0000 7ff932000640 1 -- 172.21.15.123:0/706268130 >> v2:172.21.15.130:3300/0 conn(0x7ff9340b6c30 msgr2=0x7ff9340b7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:39.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.397+0000 7ff932000640 1 --2- 172.21.15.123:0/706268130 >> v2:172.21.15.130:3300/0 conn(0x7ff9340b6c30 0x7ff9340b7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.397+0000 7ff932000640 1 -- 172.21.15.123:0/706268130 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9340d1340 con 0x7ff934162cf0 2024-04-25T13:42:39.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.397+0000 7ff932000640 1 -- 172.21.15.123:0/706268130 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7ff91c001680 con 0x7ff934162cf0 2024-04-25T13:42:39.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.397+0000 7ff932000640 1 -- 172.21.15.123:0/706268130 >> v1:172.21.15.123:6789/0 conn(0x7ff934162cf0 legacy=0x7ff9340b6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:39.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.397+0000 7ff932000640 1 --2- 172.21.15.123:0/706268130 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9341623a0 0x7ff918003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:39.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.397+0000 7ff932000640 1 --2- 172.21.15.123:0/706268130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff918003fb0 0x7ff918004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:39.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.397+0000 7ff932000640 1 --2- 172.21.15.123:0/706268130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff918004d50 0x7ff918005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:39.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.397+0000 7ff932000640 1 -- 172.21.15.123:0/706268130 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff9340d16b0 con 0x7ff918004d50 2024-04-25T13:42:39.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.397+0000 7ff932000640 1 -- 172.21.15.123:0/706268130 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff9340b8e80 con 0x7ff918003fb0 2024-04-25T13:42:39.398 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.397+0000 7ff932000640 1 -- 172.21.15.123:0/706268130 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff91800bab0 con 0x7ff9341623a0 2024-04-25T13:42:39.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.397+0000 7ff933e00640 1 --2- 172.21.15.123:0/706268130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff918004d50 0x7ff918005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:39.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.397+0000 7ff932a00640 1 --2- 172.21.15.123:0/706268130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff918003fb0 0x7ff918004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:39.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.397+0000 7ff933400640 1 --2- 172.21.15.123:0/706268130 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9341623a0 0x7ff918003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:39.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.397+0000 7ff933e00640 1 -- 172.21.15.123:0/706268130 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9341623a0 msgr2=0x7ff918003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:39.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.397+0000 7ff933e00640 1 --2- 172.21.15.123:0/706268130 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9341623a0 0x7ff918003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.397+0000 7ff933e00640 1 -- 172.21.15.123:0/706268130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff918003fb0 msgr2=0x7ff918004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:39.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.397+0000 7ff933e00640 1 --2- 172.21.15.123:0/706268130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff918003fb0 0x7ff918004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.397+0000 7ff933e00640 1 -- 172.21.15.123:0/706268130 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff918003530 con 0x7ff918004d50 2024-04-25T13:42:39.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.401+0000 7ff933e00640 1 --2- 172.21.15.123:0/706268130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff918004d50 0x7ff918005160 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff92c009f90 tx=0x7ff92c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceef36e6ba4136e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:39.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.401+0000 7ff932000640 1 -- 172.21.15.123:0/706268130 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92c0b2070 con 0x7ff918004d50 2024-04-25T13:42:39.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.401+0000 7ff932000640 1 -- 172.21.15.123:0/706268130 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff92c0a5c90 con 0x7ff918004d50 2024-04-25T13:42:39.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.401+0000 7ff932000640 1 -- 172.21.15.123:0/706268130 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92c009c10 con 0x7ff918004d50 2024-04-25T13:42:39.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.401+0000 7ff93a000640 1 -- 172.21.15.123:0/706268130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff918004d50 msgr2=0x7ff918005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:39.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.401+0000 7ff93a000640 1 --2- 172.21.15.123:0/706268130 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff918004d50 0x7ff918005160 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff92c009f90 tx=0x7ff92c01cc80 comp rx=0 tx=0).stop 2024-04-25T13:42:39.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.401+0000 7ff933e00640 1 -- 172.21.15.123:0/706268130 reap_dead start 2024-04-25T13:42:39.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.401+0000 7ff93a000640 1 -- 172.21.15.123:0/706268130 shutdown_connections 2024-04-25T13:42:39.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.401+0000 7ff93a000640 1 -- 172.21.15.123:0/706268130 >> 172.21.15.123:0/706268130 conn(0x7ff9340d0150 msgr2=0x7ff9340d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:39.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.401+0000 7ff93a000640 1 -- 172.21.15.123:0/706268130 shutdown_connections 2024-04-25T13:42:39.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.401+0000 7ff93a000640 1 -- 172.21.15.123:0/706268130 wait complete. 2024-04-25T13:42:39.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.401+0000 7ff93a000640 1 Processor -- start 2024-04-25T13:42:39.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.401+0000 7ff93a000640 1 -- start start 2024-04-25T13:42:39.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.405+0000 7ff93a000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff918004d50 0x7ff9341615b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:39.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.405+0000 7ff93a000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff93409e5c0 0x7ff93406e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:39.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.405+0000 7ff93a000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9340a0780 0x7ff9340a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:39.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.405+0000 7ff93a000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff9340b9160 con 0x7ff9340a0780 2024-04-25T13:42:39.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.405+0000 7ff93a000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff9340d1b40 con 0x7ff93409e5c0 2024-04-25T13:42:39.406 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.405+0000 7ff93a000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff9340b2a20 con 0x7ff918004d50 2024-04-25T13:42:39.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.405+0000 7ff933e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9340a0780 0x7ff9340a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:39.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.405+0000 7ff933e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9340a0780 0x7ff9340a0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:49072/0 (socket says 172.21.15.123:49072) 2024-04-25T13:42:39.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.405+0000 7ff933e00640 1 -- 172.21.15.123:0/791735119 learned_addr learned my addr 172.21.15.123:0/791735119 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:39.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.405+0000 7ff932a00640 1 --2- 172.21.15.123:0/791735119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff93409e5c0 0x7ff93406e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:39.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.405+0000 7ff933400640 1 --2- 172.21.15.123:0/791735119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff918004d50 0x7ff9341615b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:39.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.405+0000 7ff933e00640 1 -- 172.21.15.123:0/791735119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff918004d50 msgr2=0x7ff9341615b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:39.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.405+0000 7ff933e00640 1 --2- 172.21.15.123:0/791735119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff918004d50 0x7ff9341615b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.405+0000 7ff933e00640 1 -- 172.21.15.123:0/791735119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff93409e5c0 msgr2=0x7ff93406e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:39.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.405+0000 7ff933e00640 1 --2- 172.21.15.123:0/791735119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff93409e5c0 0x7ff93406e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.405+0000 7ff933e00640 1 -- 172.21.15.123:0/791735119 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9340a10d0 con 0x7ff9340a0780 2024-04-25T13:42:39.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.405+0000 7ff933e00640 1 --2- 172.21.15.123:0/791735119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9340a0780 0x7ff9340a0b90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff92c0b0040 tx=0x7ff92c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:39.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.405+0000 7ff92b400640 1 -- 172.21.15.123:0/791735119 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92c0bb070 con 0x7ff9340a0780 2024-04-25T13:42:39.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.405+0000 7ff92b400640 1 -- 172.21.15.123:0/791735119 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff92c0adb70 con 0x7ff9340a0780 2024-04-25T13:42:39.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.405+0000 7ff92b400640 1 -- 172.21.15.123:0/791735119 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92c0b2040 con 0x7ff9340a0780 2024-04-25T13:42:39.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.405+0000 7ff93a000640 1 -- 172.21.15.123:0/791735119 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff93406eb00 con 0x7ff9340a0780 2024-04-25T13:42:39.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.405+0000 7ff93a000640 1 -- 172.21.15.123:0/791735119 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff93406f0c0 con 0x7ff9340a0780 2024-04-25T13:42:39.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.405+0000 7ff93a000640 1 -- 172.21.15.123:0/791735119 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff93406e870 con 0x7ff9340a0780 2024-04-25T13:42:39.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.409+0000 7ff92b400640 1 -- 172.21.15.123:0/791735119 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff92c0be070 con 0x7ff9340a0780 2024-04-25T13:42:39.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.409+0000 7ff92b400640 1 --2- 172.21.15.123:0/791735119 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff91006f400 0x7ff910071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:39.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.409+0000 7ff92b400640 1 -- 172.21.15.123:0/791735119 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff92c129500 con 0x7ff9340a0780 2024-04-25T13:42:39.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.409+0000 7ff933400640 1 --2- 172.21.15.123:0/791735119 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff91006f400 0x7ff910071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:39.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.409+0000 7ff933400640 1 --2- 172.21.15.123:0/791735119 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff91006f400 0x7ff910071910 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff9340cde90 tx=0x7ff924008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:39.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.413+0000 7ff92b400640 1 -- 172.21.15.123:0/791735119 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff9340a10d0 con 0x7ff9340a0780 2024-04-25T13:42:39.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.573+0000 7ff93a000640 1 -- 172.21.15.123:0/791735119 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9340507c0 con 0x7ff9340a0780 2024-04-25T13:42:39.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.573+0000 7ff92b400640 1 -- 172.21.15.123:0/791735119 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16629 (secure 0 0 0) 0x7ff92c016990 con 0x7ff9340a0780 2024-04-25T13:42:39.575 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:39.575 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:42:07.405529+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:03.949161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:04.755682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:39.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.577+0000 7ff93a000640 1 -- 172.21.15.123:0/791735119 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff91006f400 msgr2=0x7ff910071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:39.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.577+0000 7ff93a000640 1 --2- 172.21.15.123:0/791735119 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff91006f400 0x7ff910071910 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff9340cde90 tx=0x7ff924008040 comp rx=0 tx=0).stop 2024-04-25T13:42:39.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.577+0000 7ff93a000640 1 -- 172.21.15.123:0/791735119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9340a0780 msgr2=0x7ff9340a0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:39.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.577+0000 7ff93a000640 1 --2- 172.21.15.123:0/791735119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9340a0780 0x7ff9340a0b90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff92c0b0040 tx=0x7ff92c009750 comp rx=0 tx=0).stop 2024-04-25T13:42:39.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.577+0000 7ff93a000640 1 -- 172.21.15.123:0/791735119 shutdown_connections 2024-04-25T13:42:39.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.577+0000 7ff93a000640 1 --2- 172.21.15.123:0/791735119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff93409e5c0 0x7ff93406e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.577+0000 7ff93a000640 1 --2- 172.21.15.123:0/791735119 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff91006f400 0x7ff910071910 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.577+0000 7ff93a000640 1 --2- 172.21.15.123:0/791735119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9340a0780 0x7ff9340a0b90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.577+0000 7ff93a000640 1 --2- 172.21.15.123:0/791735119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff918004d50 0x7ff9341615b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.577+0000 7ff93a000640 1 -- 172.21.15.123:0/791735119 >> 172.21.15.123:0/791735119 conn(0x7ff9340d0150 msgr2=0x7ff9340d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:39.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.577+0000 7ff93a000640 1 -- 172.21.15.123:0/791735119 shutdown_connections 2024-04-25T13:42:39.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.577+0000 7ff93a000640 1 -- 172.21.15.123:0/791735119 wait complete. 2024-04-25T13:42:39.598 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:41:53.602480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:42:03.949161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:42:04.755682+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:42:39.599 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:42:39.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.749+0000 7f93a2e00640 1 Processor -- start 2024-04-25T13:42:39.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.749+0000 7f93a2e00640 1 -- start start 2024-04-25T13:42:39.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.749+0000 7f93a2e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f939c1571b0 0x7f939c0cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:39.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.749+0000 7f93a2e00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f939c0cdee0 con 0x7f939c0b3870 2024-04-25T13:42:39.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.749+0000 7f93a2e00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f939c15d570 con 0x7f939c072af0 2024-04-25T13:42:39.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.749+0000 7f93a2e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f939c15d850 con 0x7f939c1571b0 2024-04-25T13:42:39.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.753+0000 7f9393400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f939c0b3870 0x7f939c0b3c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54314/0 (socket says 172.21.15.123:54314) 2024-04-25T13:42:39.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.753+0000 7f9393400640 1 -- 172.21.15.123:0/906983459 learned_addr learned my addr 172.21.15.123:0/906983459 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:39.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.753+0000 7f939be00640 1 --2- 172.21.15.123:0/906983459 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f939c1571b0 0x7f939c0cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:39.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.753+0000 7f939b400640 1 -- 172.21.15.123:0/906983459 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3650313926 0 0) 0x7f939c0cdee0 con 0x7f939c0b3870 2024-04-25T13:42:39.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.753+0000 7f939b400640 1 -- 172.21.15.123:0/906983459 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9380003530 con 0x7f939c0b3870 2024-04-25T13:42:39.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.753+0000 7f939b400640 1 -- 172.21.15.123:0/906983459 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1700106054 0 0) 0x7f9380003530 con 0x7f939c0b3870 2024-04-25T13:42:39.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.753+0000 7f939b400640 1 -- 172.21.15.123:0/906983459 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f939c1571b0 msgr2=0x7f939c0cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:39.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.753+0000 7f939b400640 1 --2- 172.21.15.123:0/906983459 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f939c1571b0 0x7f939c0cd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.753+0000 7f939b400640 1 -- 172.21.15.123:0/906983459 >> v1:172.21.15.130:6789/0 conn(0x7f939c072af0 legacy=0x7f939c072f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:39.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.753+0000 7f939b400640 1 -- 172.21.15.123:0/906983459 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f939c15db30 con 0x7f939c0b3870 2024-04-25T13:42:39.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.753+0000 7f939b400640 1 -- 172.21.15.123:0/906983459 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7f9384001680 con 0x7f939c0b3870 2024-04-25T13:42:39.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.753+0000 7f939b400640 1 -- 172.21.15.123:0/906983459 >> v1:172.21.15.123:6789/0 conn(0x7f939c0b3870 legacy=0x7f939c0b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:39.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.753+0000 7f939b400640 1 --2- 172.21.15.123:0/906983459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9380003ad0 0x7f9380003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:39.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.753+0000 7f939b400640 1 --2- 172.21.15.123:0/906983459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9380004810 0x7f9380004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:39.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.753+0000 7f939b400640 1 --2- 172.21.15.123:0/906983459 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f939c1571b0 0x7f938000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:39.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.753+0000 7f939b400640 1 -- 172.21.15.123:0/906983459 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f939c15d850 con 0x7f9380004810 2024-04-25T13:42:39.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.753+0000 7f939b400640 1 -- 172.21.15.123:0/906983459 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f93800054f0 con 0x7f9380003ad0 2024-04-25T13:42:39.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.753+0000 7f939b400640 1 -- 172.21.15.123:0/906983459 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f938000bf10 con 0x7f939c1571b0 2024-04-25T13:42:39.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.753+0000 7f9393400640 1 --2- 172.21.15.123:0/906983459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9380004810 0x7f9380004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:39.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.753+0000 7f939be00640 1 --2- 172.21.15.123:0/906983459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9380003ad0 0x7f9380003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:39.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.753+0000 7f93a0e00640 1 --2- 172.21.15.123:0/906983459 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f939c1571b0 0x7f938000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:39.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.753+0000 7f9393400640 1 -- 172.21.15.123:0/906983459 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f939c1571b0 msgr2=0x7f938000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:39.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.753+0000 7f9393400640 1 --2- 172.21.15.123:0/906983459 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f939c1571b0 0x7f938000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.753+0000 7f9393400640 1 -- 172.21.15.123:0/906983459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9380003ad0 msgr2=0x7f9380003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:39.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.753+0000 7f9393400640 1 --2- 172.21.15.123:0/906983459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9380003ad0 0x7f9380003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.753+0000 7f9393400640 1 -- 172.21.15.123:0/906983459 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9380003530 con 0x7f9380004810 2024-04-25T13:42:39.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.757+0000 7f9393400640 1 --2- 172.21.15.123:0/906983459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9380004810 0x7f9380004c20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f938400c210 tx=0x7f938401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7363e27177ea4fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:39.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.757+0000 7f939b400640 1 -- 172.21.15.123:0/906983459 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9384007d20 con 0x7f9380004810 2024-04-25T13:42:39.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.757+0000 7f939b400640 1 -- 172.21.15.123:0/906983459 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93840a9020 con 0x7f9380004810 2024-04-25T13:42:39.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.757+0000 7f939b400640 1 -- 172.21.15.123:0/906983459 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93840a5b40 con 0x7f9380004810 2024-04-25T13:42:39.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.757+0000 7f93a2e00640 1 -- 172.21.15.123:0/906983459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9380004810 msgr2=0x7f9380004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:39.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.757+0000 7f93a2e00640 1 --2- 172.21.15.123:0/906983459 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9380004810 0x7f9380004c20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f938400c210 tx=0x7f938401cc40 comp rx=0 tx=0).stop 2024-04-25T13:42:39.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.757+0000 7f93a0e00640 1 -- 172.21.15.123:0/906983459 reap_dead start 2024-04-25T13:42:39.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.757+0000 7f93a2e00640 1 -- 172.21.15.123:0/906983459 shutdown_connections 2024-04-25T13:42:39.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.757+0000 7f93a2e00640 1 -- 172.21.15.123:0/906983459 >> 172.21.15.123:0/906983459 conn(0x7f939c06ca70 msgr2=0x7f939c06ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:39.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.757+0000 7f93a2e00640 1 -- 172.21.15.123:0/906983459 shutdown_connections 2024-04-25T13:42:39.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.757+0000 7f93a2e00640 1 -- 172.21.15.123:0/906983459 wait complete. 2024-04-25T13:42:39.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.757+0000 7f93a2e00640 1 Processor -- start 2024-04-25T13:42:39.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.761+0000 7f93a2e00640 1 -- start start 2024-04-25T13:42:39.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.761+0000 7f93a2e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9380004810 0x7f939c1448c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:39.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.761+0000 7f93a2e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f939c0cba80 0x7f939c1578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:39.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.761+0000 7f93a2e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f939c15bf60 0x7f939c15c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:39.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.761+0000 7f93a2e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f939c15e050 con 0x7f9380004810 2024-04-25T13:42:39.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.761+0000 7f93a2e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f939c1575c0 con 0x7f939c15bf60 2024-04-25T13:42:39.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.761+0000 7f93a2e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f939c145e70 con 0x7f939c0cba80 2024-04-25T13:42:39.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.761+0000 7f939be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9380004810 0x7f939c1448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:39.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.761+0000 7f939be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9380004810 0x7f939c1448c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35036/0 (socket says 172.21.15.123:35036) 2024-04-25T13:42:39.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.761+0000 7f939be00640 1 -- 172.21.15.123:0/969808279 learned_addr learned my addr 172.21.15.123:0/969808279 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:39.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.761+0000 7f9393400640 1 --2- 172.21.15.123:0/969808279 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f939c0cba80 0x7f939c1578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:39.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.761+0000 7f93a0e00640 1 --2- 172.21.15.123:0/969808279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f939c15bf60 0x7f939c15c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:39.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.761+0000 7f939be00640 1 -- 172.21.15.123:0/969808279 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f939c0cba80 msgr2=0x7f939c1578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:39.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.761+0000 7f939be00640 1 --2- 172.21.15.123:0/969808279 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f939c0cba80 0x7f939c1578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.761+0000 7f939be00640 1 -- 172.21.15.123:0/969808279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f939c15bf60 msgr2=0x7f939c15c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:39.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.761+0000 7f939be00640 1 --2- 172.21.15.123:0/969808279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f939c15bf60 0x7f939c15c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.761+0000 7f939be00640 1 -- 172.21.15.123:0/969808279 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f939c15c8b0 con 0x7f9380004810 2024-04-25T13:42:39.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.761+0000 7f93a0e00640 1 --2- 172.21.15.123:0/969808279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f939c15bf60 0x7f939c15c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:39.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.761+0000 7f939be00640 1 --2- 172.21.15.123:0/969808279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9380004810 0x7f939c1448c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f938c009f90 tx=0x7f938c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:39.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.761+0000 7f9398c00640 1 -- 172.21.15.123:0/969808279 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c00fea0 con 0x7f9380004810 2024-04-25T13:42:39.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.761+0000 7f9398c00640 1 -- 172.21.15.123:0/969808279 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f938c015630 con 0x7f9380004810 2024-04-25T13:42:39.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.761+0000 7f93a2e00640 1 -- 172.21.15.123:0/969808279 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f939c157e30 con 0x7f9380004810 2024-04-25T13:42:39.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.761+0000 7f9398c00640 1 -- 172.21.15.123:0/969808279 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c015a00 con 0x7f9380004810 2024-04-25T13:42:39.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.761+0000 7f93a2e00640 1 -- 172.21.15.123:0/969808279 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f939c0cacc0 con 0x7f9380004810 2024-04-25T13:42:39.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.761+0000 7f93a2e00640 1 -- 172.21.15.123:0/969808279 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f939c050750 con 0x7f9380004810 2024-04-25T13:42:39.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.765+0000 7f9398c00640 1 -- 172.21.15.123:0/969808279 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f938c015ba0 con 0x7f9380004810 2024-04-25T13:42:39.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.765+0000 7f9398c00640 1 --2- 172.21.15.123:0/969808279 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f937806f400 0x7f9378071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:39.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.765+0000 7f9398c00640 1 -- 172.21.15.123:0/969808279 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f938c090440 con 0x7f9380004810 2024-04-25T13:42:39.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.765+0000 7f9393400640 1 --2- 172.21.15.123:0/969808279 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f937806f400 0x7f9378071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:39.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.765+0000 7f9393400640 1 --2- 172.21.15.123:0/969808279 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f937806f400 0x7f9378071910 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f93840aa000 tx=0x7f939c0ce0b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:39.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.769+0000 7f9398c00640 1 -- 172.21.15.123:0/969808279 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f939c15c8b0 con 0x7f9380004810 2024-04-25T13:42:39.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.929+0000 7f93a2e00640 1 -- 172.21.15.123:0/969808279 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f939c074cc0 con 0x7f9380004810 2024-04-25T13:42:39.928 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.929+0000 7f9398c00640 1 -- 172.21.15.123:0/969808279 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f938c019030 con 0x7f9380004810 2024-04-25T13:42:39.929 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-04-25T13:42:39.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.929+0000 7f93a2e00640 1 -- 172.21.15.123:0/969808279 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f937806f400 msgr2=0x7f9378071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:39.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.929+0000 7f93a2e00640 1 --2- 172.21.15.123:0/969808279 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f937806f400 0x7f9378071910 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f93840aa000 tx=0x7f939c0ce0b0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.929+0000 7f93a2e00640 1 -- 172.21.15.123:0/969808279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9380004810 msgr2=0x7f939c1448c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:39.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.929+0000 7f93a2e00640 1 --2- 172.21.15.123:0/969808279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9380004810 0x7f939c1448c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f938c009f90 tx=0x7f938c00f580 comp rx=0 tx=0).stop 2024-04-25T13:42:39.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.929+0000 7f93a2e00640 1 -- 172.21.15.123:0/969808279 shutdown_connections 2024-04-25T13:42:39.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.929+0000 7f93a2e00640 1 --2- 172.21.15.123:0/969808279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f939c15bf60 0x7f939c15c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.929+0000 7f93a2e00640 1 --2- 172.21.15.123:0/969808279 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f937806f400 0x7f9378071910 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.929+0000 7f93a2e00640 1 --2- 172.21.15.123:0/969808279 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f939c0cba80 0x7f939c1578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.929+0000 7f93a2e00640 1 --2- 172.21.15.123:0/969808279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9380004810 0x7f939c1448c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:39.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.929+0000 7f93a2e00640 1 -- 172.21.15.123:0/969808279 >> 172.21.15.123:0/969808279 conn(0x7f939c06ca70 msgr2=0x7f939c0cf5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:39.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.929+0000 7f93a2e00640 1 -- 172.21.15.123:0/969808279 shutdown_connections 2024-04-25T13:42:39.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:39.929+0000 7f93a2e00640 1 -- 172.21.15.123:0/969808279 wait complete. 2024-04-25T13:42:39.950 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:42:40.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.097+0000 7f4dff400640 1 Processor -- start 2024-04-25T13:42:40.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.097+0000 7f4dff400640 1 -- start start 2024-04-25T13:42:40.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4dff400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4df80b3870 0x7f4df80b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:40.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4dff400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4df80b41c0 con 0x7f4df80ceac0 2024-04-25T13:42:40.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4dff400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4df80c6810 con 0x7f4df815de80 2024-04-25T13:42:40.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4dff400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4df80c7140 con 0x7f4df80b3870 2024-04-25T13:42:40.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4dfca00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4df80ceac0 0x7f4df80c75d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54324/0 (socket says 172.21.15.123:54324) 2024-04-25T13:42:40.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4dfca00640 1 -- 172.21.15.123:0/1389228609 learned_addr learned my addr 172.21.15.123:0/1389228609 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:40.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4df7400640 1 -- 172.21.15.123:0/1389228609 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 351348812 0 0) 0x7f4dec001120 con 0x7f4df80ceac0 2024-04-25T13:42:40.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4df7400640 1 -- 172.21.15.123:0/1389228609 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4de0003530 con 0x7f4df80ceac0 2024-04-25T13:42:40.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4df7e00640 1 --2- 172.21.15.123:0/1389228609 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4df80b3870 0x7f4df80b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:40.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4df7400640 1 -- 172.21.15.123:0/1389228609 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1937812077 0 0) 0x7f4de0003530 con 0x7f4df80ceac0 2024-04-25T13:42:40.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4df7400640 1 -- 172.21.15.123:0/1389228609 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4df80b3870 msgr2=0x7f4df80b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:40.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4df7400640 1 --2- 172.21.15.123:0/1389228609 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4df80b3870 0x7f4df80b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4df7400640 1 -- 172.21.15.123:0/1389228609 >> v1:172.21.15.130:6789/0 conn(0x7f4df815de80 legacy=0x7f4df815e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:40.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4df7400640 1 -- 172.21.15.123:0/1389228609 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df80c6af0 con 0x7f4df80ceac0 2024-04-25T13:42:40.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4df7400640 1 -- 172.21.15.123:0/1389228609 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7f4dec001850 con 0x7f4df80ceac0 2024-04-25T13:42:40.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4df7400640 1 -- 172.21.15.123:0/1389228609 >> v1:172.21.15.123:6789/0 conn(0x7f4df80ceac0 legacy=0x7f4df80c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:40.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4df7400640 1 --2- 172.21.15.123:0/1389228609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4de0003ad0 0x7f4de0003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:40.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4df7400640 1 --2- 172.21.15.123:0/1389228609 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4de0004810 0x7f4de0004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:40.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4df7400640 1 --2- 172.21.15.123:0/1389228609 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4df80b3870 0x7f4de000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:40.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4df7400640 1 -- 172.21.15.123:0/1389228609 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4df80c7140 con 0x7f4de0004810 2024-04-25T13:42:40.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4df7400640 1 -- 172.21.15.123:0/1389228609 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4de00055a0 con 0x7f4de0003ad0 2024-04-25T13:42:40.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4df7400640 1 -- 172.21.15.123:0/1389228609 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4de000bf10 con 0x7f4df80b3870 2024-04-25T13:42:40.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4df7e00640 1 --2- 172.21.15.123:0/1389228609 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4de0004810 0x7f4de0004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:40.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4dfca00640 1 --2- 172.21.15.123:0/1389228609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4de0003ad0 0x7f4de0003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:40.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4dfd400640 1 --2- 172.21.15.123:0/1389228609 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4df80b3870 0x7f4de000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:40.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4df7e00640 1 -- 172.21.15.123:0/1389228609 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4df80b3870 msgr2=0x7f4de000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:40.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4df7e00640 1 --2- 172.21.15.123:0/1389228609 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4df80b3870 0x7f4de000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4df7e00640 1 -- 172.21.15.123:0/1389228609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4de0003ad0 msgr2=0x7f4de0003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:40.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4df7e00640 1 --2- 172.21.15.123:0/1389228609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4de0003ad0 0x7f4de0003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.101+0000 7f4df7e00640 1 -- 172.21.15.123:0/1389228609 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de0003530 con 0x7f4de0004810 2024-04-25T13:42:40.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.105+0000 7f4df7e00640 1 --2- 172.21.15.123:0/1389228609 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4de0004810 0x7f4de0004c20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4de4009ae0 tx=0x7f4de401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb9f1bb6a7307c23 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:40.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.105+0000 7f4df7400640 1 -- 172.21.15.123:0/1389228609 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de40096b0 con 0x7f4de0004810 2024-04-25T13:42:40.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.105+0000 7f4df7400640 1 -- 172.21.15.123:0/1389228609 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de40a6470 con 0x7f4de0004810 2024-04-25T13:42:40.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.105+0000 7f4df7400640 1 -- 172.21.15.123:0/1389228609 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de40a6860 con 0x7f4de0004810 2024-04-25T13:42:40.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.105+0000 7f4dff400640 1 -- 172.21.15.123:0/1389228609 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4de0004810 msgr2=0x7f4de0004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:40.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.105+0000 7f4dff400640 1 --2- 172.21.15.123:0/1389228609 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4de0004810 0x7f4de0004c20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4de4009ae0 tx=0x7f4de401ca90 comp rx=0 tx=0).stop 2024-04-25T13:42:40.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.105+0000 7f4dfd400640 1 -- 172.21.15.123:0/1389228609 reap_dead start 2024-04-25T13:42:40.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.105+0000 7f4dff400640 1 -- 172.21.15.123:0/1389228609 shutdown_connections 2024-04-25T13:42:40.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.105+0000 7f4dff400640 1 -- 172.21.15.123:0/1389228609 >> 172.21.15.123:0/1389228609 conn(0x7f4df806ca70 msgr2=0x7f4df806ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:40.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.105+0000 7f4dff400640 1 -- 172.21.15.123:0/1389228609 shutdown_connections 2024-04-25T13:42:40.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.105+0000 7f4dff400640 1 -- 172.21.15.123:0/1389228609 wait complete. 2024-04-25T13:42:40.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.109+0000 7f4dff400640 1 Processor -- start 2024-04-25T13:42:40.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.109+0000 7f4dff400640 1 -- start start 2024-04-25T13:42:40.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.109+0000 7f4dff400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4de0004810 0x7f4df8155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:40.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.109+0000 7f4dff400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4df8167350 0x7f4df80cd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:40.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.109+0000 7f4dff400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4df8167760 0x7f4df80cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:40.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.109+0000 7f4dff400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4df816a170 con 0x7f4df8167760 2024-04-25T13:42:40.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.109+0000 7f4dff400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4df815efc0 con 0x7f4df8167350 2024-04-25T13:42:40.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.109+0000 7f4dff400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4df816a2f0 con 0x7f4de0004810 2024-04-25T13:42:40.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.109+0000 7f4dfd400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4df8167760 0x7f4df80cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:40.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.109+0000 7f4dfd400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4df8167760 0x7f4df80cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35048/0 (socket says 172.21.15.123:35048) 2024-04-25T13:42:40.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.109+0000 7f4dfd400640 1 -- 172.21.15.123:0/2565796705 learned_addr learned my addr 172.21.15.123:0/2565796705 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:40.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.109+0000 7f4dfca00640 1 --2- 172.21.15.123:0/2565796705 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4de0004810 0x7f4df8155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:40.112 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.109+0000 7f4df7e00640 1 --2- 172.21.15.123:0/2565796705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4df8167350 0x7f4df80cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:40.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.109+0000 7f4dfd400640 1 -- 172.21.15.123:0/2565796705 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4de0004810 msgr2=0x7f4df8155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:40.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.109+0000 7f4dfd400640 1 --2- 172.21.15.123:0/2565796705 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4de0004810 0x7f4df8155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.109+0000 7f4dfd400640 1 -- 172.21.15.123:0/2565796705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4df8167350 msgr2=0x7f4df80cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:40.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.109+0000 7f4dfd400640 1 --2- 172.21.15.123:0/2565796705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4df8167350 0x7f4df80cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.109+0000 7f4dfd400640 1 -- 172.21.15.123:0/2565796705 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df81557a0 con 0x7f4df8167760 2024-04-25T13:42:40.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.109+0000 7f4dfd400640 1 --2- 172.21.15.123:0/2565796705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4df8167760 0x7f4df80cd8c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4df80b4890 tx=0x7f4df000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:40.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.109+0000 7f4df4c00640 1 -- 172.21.15.123:0/2565796705 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df0003980 con 0x7f4df8167760 2024-04-25T13:42:40.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.109+0000 7f4df4c00640 1 -- 172.21.15.123:0/2565796705 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df0018070 con 0x7f4df8167760 2024-04-25T13:42:40.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.113+0000 7f4df4c00640 1 -- 172.21.15.123:0/2565796705 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df0003d60 con 0x7f4df8167760 2024-04-25T13:42:40.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.113+0000 7f4dff400640 1 -- 172.21.15.123:0/2565796705 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4df80736d0 con 0x7f4df8167760 2024-04-25T13:42:40.113 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.113+0000 7f4dff400640 1 -- 172.21.15.123:0/2565796705 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4df80d0f00 con 0x7f4df8167760 2024-04-25T13:42:40.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.113+0000 7f4dff400640 1 -- 172.21.15.123:0/2565796705 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4df806d600 con 0x7f4df8167760 2024-04-25T13:42:40.114 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.113+0000 7f4df4c00640 1 -- 172.21.15.123:0/2565796705 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4df00050d0 con 0x7f4df8167760 2024-04-25T13:42:40.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.113+0000 7f4df4c00640 1 --2- 172.21.15.123:0/2565796705 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4dd806f400 0x7f4dd8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:40.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.113+0000 7f4df4c00640 1 -- 172.21.15.123:0/2565796705 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4df008efd0 con 0x7f4df8167760 2024-04-25T13:42:40.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.113+0000 7f4dfca00640 1 --2- 172.21.15.123:0/2565796705 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4dd806f400 0x7f4dd8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:40.115 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.117+0000 7f4dfca00640 1 --2- 172.21.15.123:0/2565796705 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4dd806f400 0x7f4dd8071910 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4dec0012c0 tx=0x7f4dec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:40.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.117+0000 7f4df4c00640 1 -- 172.21.15.123:0/2565796705 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4df005beb0 con 0x7f4df8167760 2024-04-25T13:42:40.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.277+0000 7f4dff400640 1 -- 172.21.15.123:0/2565796705 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4df80d0cf0 con 0x7f4df8167760 2024-04-25T13:42:40.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.277+0000 7f4df4c00640 1 -- 172.21.15.123:0/2565796705 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f4df005b7b0 con 0x7f4df8167760 2024-04-25T13:42:40.278 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-04-25T13:42:40.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.277+0000 7f4dff400640 1 -- 172.21.15.123:0/2565796705 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4dd806f400 msgr2=0x7f4dd8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:40.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.277+0000 7f4dff400640 1 --2- 172.21.15.123:0/2565796705 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4dd806f400 0x7f4dd8071910 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4dec0012c0 tx=0x7f4dec009040 comp rx=0 tx=0).stop 2024-04-25T13:42:40.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.277+0000 7f4dff400640 1 -- 172.21.15.123:0/2565796705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4df8167760 msgr2=0x7f4df80cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:40.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.277+0000 7f4dff400640 1 --2- 172.21.15.123:0/2565796705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4df8167760 0x7f4df80cd8c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4df80b4890 tx=0x7f4df000ec10 comp rx=0 tx=0).stop 2024-04-25T13:42:40.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.277+0000 7f4dff400640 1 -- 172.21.15.123:0/2565796705 shutdown_connections 2024-04-25T13:42:40.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.277+0000 7f4dff400640 1 --2- 172.21.15.123:0/2565796705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4df8167350 0x7f4df80cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.277+0000 7f4dff400640 1 --2- 172.21.15.123:0/2565796705 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4dd806f400 0x7f4dd8071910 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.277+0000 7f4dff400640 1 --2- 172.21.15.123:0/2565796705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4df8167760 0x7f4df80cd8c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.277+0000 7f4dff400640 1 --2- 172.21.15.123:0/2565796705 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4de0004810 0x7f4df8155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.277+0000 7f4dff400640 1 -- 172.21.15.123:0/2565796705 >> 172.21.15.123:0/2565796705 conn(0x7f4df806ca70 msgr2=0x7f4df81604b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:40.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.281+0000 7f4dff400640 1 -- 172.21.15.123:0/2565796705 shutdown_connections 2024-04-25T13:42:40.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.281+0000 7f4dff400640 1 -- 172.21.15.123:0/2565796705 wait complete. 2024-04-25T13:42:40.299 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:42:40.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.449+0000 7fd074c00640 1 Processor -- start 2024-04-25T13:42:40.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.449+0000 7fd074c00640 1 -- start start 2024-04-25T13:42:40.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.449+0000 7fd074c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd0700ceac0 0x7fd0700c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:40.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.449+0000 7fd074c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0700b3870 0x7fd0700b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:40.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.449+0000 7fd074c00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd0700b5980 0x7fd0700b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:40.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.449+0000 7fd074c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd0700c7140 con 0x7fd0700ceac0 2024-04-25T13:42:40.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.449+0000 7fd074c00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fd0700cf060 con 0x7fd0700b5980 2024-04-25T13:42:40.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.449+0000 7fd074c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fd0700b41c0 con 0x7fd0700b3870 2024-04-25T13:42:40.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.449+0000 7fd06de00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd0700ceac0 0x7fd0700c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:40.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.449+0000 7fd06de00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd0700ceac0 0x7fd0700c75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35050/0 (socket says 172.21.15.123:35050) 2024-04-25T13:42:40.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.449+0000 7fd06de00640 1 -- 172.21.15.123:0/99606877 learned_addr learned my addr 172.21.15.123:0/99606877 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:40.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.449+0000 7fd06d400640 1 --2- 172.21.15.123:0/99606877 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0700b3870 0x7fd0700b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:40.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.449+0000 7fd06e800640 1 --2- 172.21.15.123:0/99606877 >> v2:172.21.15.130:3300/0 conn(0x7fd0700b5980 0x7fd0700b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:40.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.449+0000 7fd06de00640 1 -- 172.21.15.123:0/99606877 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0700b3870 msgr2=0x7fd0700b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:40.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.449+0000 7fd06de00640 1 --2- 172.21.15.123:0/99606877 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0700b3870 0x7fd0700b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.449+0000 7fd06de00640 1 -- 172.21.15.123:0/99606877 >> v2:172.21.15.130:3300/0 conn(0x7fd0700b5980 msgr2=0x7fd0700b5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:40.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.449+0000 7fd06de00640 1 --2- 172.21.15.123:0/99606877 >> v2:172.21.15.130:3300/0 conn(0x7fd0700b5980 0x7fd0700b5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.449+0000 7fd06de00640 1 -- 172.21.15.123:0/99606877 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0700c7b10 con 0x7fd0700ceac0 2024-04-25T13:42:40.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.449+0000 7fd06e800640 1 --2- 172.21.15.123:0/99606877 >> v2:172.21.15.130:3300/0 conn(0x7fd0700b5980 0x7fd0700b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:40.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.449+0000 7fd06d400640 1 --2- 172.21.15.123:0/99606877 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0700b3870 0x7fd0700b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:40.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.453+0000 7fd06de00640 1 --2- 172.21.15.123:0/99606877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0700ceac0 0x7fd0700c75d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd0700b4370 tx=0x7fd06001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad485a361d16748b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:40.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.453+0000 7fd06ca00640 1 -- 172.21.15.123:0/99606877 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0600ab620 con 0x7fd0700ceac0 2024-04-25T13:42:40.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.453+0000 7fd06ca00640 1 -- 172.21.15.123:0/99606877 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0600b0070 con 0x7fd0700ceac0 2024-04-25T13:42:40.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.453+0000 7fd06ca00640 1 -- 172.21.15.123:0/99606877 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0600ab9e0 con 0x7fd0700ceac0 2024-04-25T13:42:40.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.453+0000 7fd074c00640 1 -- 172.21.15.123:0/99606877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0700ceac0 msgr2=0x7fd0700c75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:40.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.453+0000 7fd074c00640 1 --2- 172.21.15.123:0/99606877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0700ceac0 0x7fd0700c75d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd0700b4370 tx=0x7fd06001c460 comp rx=0 tx=0).stop 2024-04-25T13:42:40.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.453+0000 7fd074c00640 1 -- 172.21.15.123:0/99606877 shutdown_connections 2024-04-25T13:42:40.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.453+0000 7fd074c00640 1 --2- 172.21.15.123:0/99606877 >> v2:172.21.15.130:3300/0 conn(0x7fd0700b5980 0x7fd0700b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.453+0000 7fd074c00640 1 --2- 172.21.15.123:0/99606877 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0700b3870 0x7fd0700b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.453+0000 7fd074c00640 1 --2- 172.21.15.123:0/99606877 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0700ceac0 0x7fd0700c75d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.453+0000 7fd074c00640 1 -- 172.21.15.123:0/99606877 >> 172.21.15.123:0/99606877 conn(0x7fd07006ca70 msgr2=0x7fd07006ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:40.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.453+0000 7fd074c00640 1 -- 172.21.15.123:0/99606877 shutdown_connections 2024-04-25T13:42:40.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.453+0000 7fd074c00640 1 -- 172.21.15.123:0/99606877 wait complete. 2024-04-25T13:42:40.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.457+0000 7fd074c00640 1 Processor -- start 2024-04-25T13:42:40.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.457+0000 7fd074c00640 1 -- start start 2024-04-25T13:42:40.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.457+0000 7fd074c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0700b3870 0x7fd07014e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:40.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.457+0000 7fd074c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0700b5980 0x7fd0701574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:40.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.457+0000 7fd074c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0700ceac0 0x7fd0700d0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:40.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.457+0000 7fd074c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd0700b5110 con 0x7fd0700b5980 2024-04-25T13:42:40.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.457+0000 7fd074c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd0700b66e0 con 0x7fd0700ceac0 2024-04-25T13:42:40.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.457+0000 7fd074c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fd0700b5290 con 0x7fd0700b3870 2024-04-25T13:42:40.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.457+0000 7fd06d400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0700b5980 0x7fd0701574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:40.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.457+0000 7fd06d400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0700b5980 0x7fd0701574c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35062/0 (socket says 172.21.15.123:35062) 2024-04-25T13:42:40.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.457+0000 7fd06d400640 1 -- 172.21.15.123:0/3983140030 learned_addr learned my addr 172.21.15.123:0/3983140030 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:40.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.457+0000 7fd06de00640 1 --2- 172.21.15.123:0/3983140030 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0700b3870 0x7fd07014e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:40.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.457+0000 7fd06e800640 1 --2- 172.21.15.123:0/3983140030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0700ceac0 0x7fd0700d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:40.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.457+0000 7fd06d400640 1 -- 172.21.15.123:0/3983140030 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0700b3870 msgr2=0x7fd07014e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:40.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.457+0000 7fd06d400640 1 --2- 172.21.15.123:0/3983140030 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0700b3870 0x7fd07014e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.457+0000 7fd06d400640 1 -- 172.21.15.123:0/3983140030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0700ceac0 msgr2=0x7fd0700d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:40.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.457+0000 7fd06d400640 1 --2- 172.21.15.123:0/3983140030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0700ceac0 0x7fd0700d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.457+0000 7fd06d400640 1 -- 172.21.15.123:0/3983140030 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0701523a0 con 0x7fd0700b5980 2024-04-25T13:42:40.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.457+0000 7fd06e800640 1 --2- 172.21.15.123:0/3983140030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0700ceac0 0x7fd0700d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:40.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.457+0000 7fd06d400640 1 --2- 172.21.15.123:0/3983140030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0700b5980 0x7fd0701574c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00c7f0 tx=0x7fd05c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:40.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.461+0000 7fd066000640 1 -- 172.21.15.123:0/3983140030 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05c015070 con 0x7fd0700b5980 2024-04-25T13:42:40.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.461+0000 7fd066000640 1 -- 172.21.15.123:0/3983140030 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd05c007820 con 0x7fd0700b5980 2024-04-25T13:42:40.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.461+0000 7fd066000640 1 -- 172.21.15.123:0/3983140030 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05c007c10 con 0x7fd0700b5980 2024-04-25T13:42:40.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.461+0000 7fd074c00640 1 -- 172.21.15.123:0/3983140030 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd070150280 con 0x7fd0700b5980 2024-04-25T13:42:40.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.461+0000 7fd074c00640 1 -- 172.21.15.123:0/3983140030 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd070150840 con 0x7fd0700b5980 2024-04-25T13:42:40.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.461+0000 7fd074c00640 1 -- 172.21.15.123:0/3983140030 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd07006d600 con 0x7fd0700b5980 2024-04-25T13:42:40.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.461+0000 7fd066000640 1 -- 172.21.15.123:0/3983140030 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd05c018070 con 0x7fd0700b5980 2024-04-25T13:42:40.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.461+0000 7fd066000640 1 --2- 172.21.15.123:0/3983140030 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd05006f400 0x7fd050071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:40.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.461+0000 7fd066000640 1 -- 172.21.15.123:0/3983140030 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd05c08f3e0 con 0x7fd0700b5980 2024-04-25T13:42:40.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.461+0000 7fd06de00640 1 --2- 172.21.15.123:0/3983140030 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd05006f400 0x7fd050071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:40.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.465+0000 7fd06de00640 1 --2- 172.21.15.123:0/3983140030 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd05006f400 0x7fd050071910 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd0600af000 tx=0x7fd0600a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:40.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.469+0000 7fd066000640 1 -- 172.21.15.123:0/3983140030 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd05c05bbe0 con 0x7fd0700b5980 2024-04-25T13:42:40.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.625+0000 7fd074c00640 1 -- 172.21.15.123:0/3983140030 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd070050750 con 0x7fd0700b5980 2024-04-25T13:42:40.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.625+0000 7fd066000640 1 -- 172.21.15.123:0/3983140030 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fd05c05fee0 con 0x7fd0700b5980 2024-04-25T13:42:40.627 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-04-25T13:42:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.629+0000 7fd074c00640 1 -- 172.21.15.123:0/3983140030 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd05006f400 msgr2=0x7fd050071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:40.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.629+0000 7fd074c00640 1 --2- 172.21.15.123:0/3983140030 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd05006f400 0x7fd050071910 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd0600af000 tx=0x7fd0600a7000 comp rx=0 tx=0).stop 2024-04-25T13:42:40.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.629+0000 7fd074c00640 1 -- 172.21.15.123:0/3983140030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0700b5980 msgr2=0x7fd0701574c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:40.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.629+0000 7fd074c00640 1 --2- 172.21.15.123:0/3983140030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0700b5980 0x7fd0701574c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00c7f0 tx=0x7fd05c00ccb0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.629+0000 7fd074c00640 1 -- 172.21.15.123:0/3983140030 shutdown_connections 2024-04-25T13:42:40.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.629+0000 7fd074c00640 1 --2- 172.21.15.123:0/3983140030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0700ceac0 0x7fd0700d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.629+0000 7fd074c00640 1 --2- 172.21.15.123:0/3983140030 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd05006f400 0x7fd050071910 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.629+0000 7fd074c00640 1 --2- 172.21.15.123:0/3983140030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd0700b5980 0x7fd0701574c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.629+0000 7fd074c00640 1 --2- 172.21.15.123:0/3983140030 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0700b3870 0x7fd07014e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.629+0000 7fd074c00640 1 -- 172.21.15.123:0/3983140030 >> 172.21.15.123:0/3983140030 conn(0x7fd07006ca70 msgr2=0x7fd070160ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:40.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.629+0000 7fd074c00640 1 -- 172.21.15.123:0/3983140030 shutdown_connections 2024-04-25T13:42:40.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.629+0000 7fd074c00640 1 -- 172.21.15.123:0/3983140030 wait complete. 2024-04-25T13:42:40.650 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:42:40.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.797+0000 7f02e9800640 1 Processor -- start 2024-04-25T13:42:40.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.797+0000 7f02e9800640 1 -- start start 2024-04-25T13:42:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.797+0000 7f02e9800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02e4149b00 0x7f02e406fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.797+0000 7f02e9800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f02e406c950 0x7f02e406cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.797+0000 7f02e9800640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e4070410 con 0x7f02e40b5550 2024-04-25T13:42:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.797+0000 7f02e9800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f02e40706f0 con 0x7f02e406c950 2024-04-25T13:42:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.797+0000 7f02e9800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f02e40709d0 con 0x7f02e4149b00 2024-04-25T13:42:40.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.797+0000 7f02e3400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f02e406c950 0x7f02e406cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:40.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.797+0000 7f02e3400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f02e406c950 0x7f02e406cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35074/0 (socket says 172.21.15.123:35074) 2024-04-25T13:42:40.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.797+0000 7f02e3400640 1 -- 172.21.15.123:0/2306930699 learned_addr learned my addr 172.21.15.123:0/2306930699 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:40.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.797+0000 7f02e3400640 1 -- 172.21.15.123:0/2306930699 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02e4149b00 msgr2=0x7f02e406fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:40.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.797+0000 7f02e3400640 1 --2- 172.21.15.123:0/2306930699 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02e4149b00 0x7f02e406fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.797+0000 7f02e3400640 1 -- 172.21.15.123:0/2306930699 >> v1:172.21.15.130:6789/0 conn(0x7f02e40b5550 legacy=0x7f02e40b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:40.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.797+0000 7f02e3400640 1 -- 172.21.15.123:0/2306930699 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e4070cb0 con 0x7f02e406c950 2024-04-25T13:42:40.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.801+0000 7f02e3400640 1 --2- 172.21.15.123:0/2306930699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02e406c950 0x7f02e406cd60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009e50 tx=0x7f02dc01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f7cfb0b6edc80 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:40.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.801+0000 7f02e2000640 1 -- 172.21.15.123:0/2306930699 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc0a5910 con 0x7f02e406c950 2024-04-25T13:42:40.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.801+0000 7f02e2000640 1 -- 172.21.15.123:0/2306930699 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02dc0a5ab0 con 0x7f02e406c950 2024-04-25T13:42:40.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.801+0000 7f02e2000640 1 -- 172.21.15.123:0/2306930699 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc0ad3f0 con 0x7f02e406c950 2024-04-25T13:42:40.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.801+0000 7f02e9800640 1 -- 172.21.15.123:0/2306930699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02e406c950 msgr2=0x7f02e406cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:40.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.801+0000 7f02e9800640 1 --2- 172.21.15.123:0/2306930699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02e406c950 0x7f02e406cd60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009e50 tx=0x7f02dc01ca20 comp rx=0 tx=0).stop 2024-04-25T13:42:40.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.801+0000 7f02e9800640 1 -- 172.21.15.123:0/2306930699 shutdown_connections 2024-04-25T13:42:40.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.801+0000 7f02e9800640 1 --2- 172.21.15.123:0/2306930699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02e406c950 0x7f02e406cd60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.801+0000 7f02e9800640 1 --2- 172.21.15.123:0/2306930699 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02e4149b00 0x7f02e406fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.801+0000 7f02e9800640 1 -- 172.21.15.123:0/2306930699 >> 172.21.15.123:0/2306930699 conn(0x7f02e40d2180 msgr2=0x7f02e40d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:40.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.801+0000 7f02e9800640 1 -- 172.21.15.123:0/2306930699 shutdown_connections 2024-04-25T13:42:40.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.801+0000 7f02e9800640 1 -- 172.21.15.123:0/2306930699 wait complete. 2024-04-25T13:42:40.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.805+0000 7f02e9800640 1 Processor -- start 2024-04-25T13:42:40.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.805+0000 7f02e9800640 1 -- start start 2024-04-25T13:42:40.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.805+0000 7f02e9800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02e406c950 0x7f02e40b0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:40.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.805+0000 7f02e9800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02e40b5550 0x7f02e4147ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:40.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.805+0000 7f02e9800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02e4149b00 0x7f02e413c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:40.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.805+0000 7f02e9800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f02e416d150 con 0x7f02e40b5550 2024-04-25T13:42:40.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.805+0000 7f02e9800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f02e416cfd0 con 0x7f02e4149b00 2024-04-25T13:42:40.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.805+0000 7f02e9800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f02e416d2d0 con 0x7f02e406c950 2024-04-25T13:42:40.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.805+0000 7f02dbe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02e40b5550 0x7f02e4147ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:40.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.805+0000 7f02dbe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02e40b5550 0x7f02e4147ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35078/0 (socket says 172.21.15.123:35078) 2024-04-25T13:42:40.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.805+0000 7f02dbe00640 1 -- 172.21.15.123:0/1118911365 learned_addr learned my addr 172.21.15.123:0/1118911365 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:40.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.805+0000 7f02e3400640 1 --2- 172.21.15.123:0/1118911365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02e4149b00 0x7f02e413c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:40.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.805+0000 7f02e2a00640 1 --2- 172.21.15.123:0/1118911365 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02e406c950 0x7f02e40b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:40.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.805+0000 7f02dbe00640 1 -- 172.21.15.123:0/1118911365 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02e406c950 msgr2=0x7f02e40b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:40.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.805+0000 7f02dbe00640 1 --2- 172.21.15.123:0/1118911365 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02e406c950 0x7f02e40b0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.805+0000 7f02dbe00640 1 -- 172.21.15.123:0/1118911365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02e4149b00 msgr2=0x7f02e413c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:40.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.805+0000 7f02dbe00640 1 --2- 172.21.15.123:0/1118911365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02e4149b00 0x7f02e413c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.805+0000 7f02dbe00640 1 -- 172.21.15.123:0/1118911365 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e40afab0 con 0x7f02e40b5550 2024-04-25T13:42:40.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.805+0000 7f02dbe00640 1 --2- 172.21.15.123:0/1118911365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02e40b5550 0x7f02e4147ad0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f02e40b1930 tx=0x7f02cc00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:40.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.809+0000 7f02daa00640 1 -- 172.21.15.123:0/1118911365 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02cc005220 con 0x7f02e40b5550 2024-04-25T13:42:40.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.809+0000 7f02daa00640 1 -- 172.21.15.123:0/1118911365 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02cc0053c0 con 0x7f02e40b5550 2024-04-25T13:42:40.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.809+0000 7f02e9800640 1 -- 172.21.15.123:0/1118911365 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02e4141470 con 0x7f02e40b5550 2024-04-25T13:42:40.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.809+0000 7f02daa00640 1 -- 172.21.15.123:0/1118911365 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02cc007270 con 0x7f02e40b5550 2024-04-25T13:42:40.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.809+0000 7f02e9800640 1 -- 172.21.15.123:0/1118911365 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02e40afd40 con 0x7f02e40b5550 2024-04-25T13:42:40.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.809+0000 7f02e9800640 1 -- 172.21.15.123:0/1118911365 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02e4050750 con 0x7f02e40b5550 2024-04-25T13:42:40.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.809+0000 7f02daa00640 1 -- 172.21.15.123:0/1118911365 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f02cc019020 con 0x7f02e40b5550 2024-04-25T13:42:40.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.809+0000 7f02daa00640 1 --2- 172.21.15.123:0/1118911365 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f02c006f400 0x7f02c0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:40.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.809+0000 7f02daa00640 1 -- 172.21.15.123:0/1118911365 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f02cc08e330 con 0x7f02e40b5550 2024-04-25T13:42:40.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.809+0000 7f02e2a00640 1 --2- 172.21.15.123:0/1118911365 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f02c006f400 0x7f02c0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:40.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.813+0000 7f02e2a00640 1 --2- 172.21.15.123:0/1118911365 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f02c006f400 0x7f02c0071910 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f02d40098f0 tx=0x7f02d4006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:40.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.813+0000 7f02daa00640 1 -- 172.21.15.123:0/1118911365 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f02cc05ab30 con 0x7f02e40b5550 2024-04-25T13:42:40.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.981+0000 7f02e9800640 1 -- 172.21.15.123:0/1118911365 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f02e4069b10 con 0x7f02e40b5550 2024-04-25T13:42:40.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.981+0000 7f02daa00640 1 -- 172.21.15.123:0/1118911365 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f02cc063020 con 0x7f02e40b5550 2024-04-25T13:42:40.983 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-04-25T13:42:40.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.985+0000 7f02e9800640 1 -- 172.21.15.123:0/1118911365 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f02c006f400 msgr2=0x7f02c0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:40.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.985+0000 7f02e9800640 1 --2- 172.21.15.123:0/1118911365 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f02c006f400 0x7f02c0071910 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f02d40098f0 tx=0x7f02d4006f90 comp rx=0 tx=0).stop 2024-04-25T13:42:40.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.985+0000 7f02e9800640 1 -- 172.21.15.123:0/1118911365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02e40b5550 msgr2=0x7f02e4147ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:40.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.985+0000 7f02e9800640 1 --2- 172.21.15.123:0/1118911365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02e40b5550 0x7f02e4147ad0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f02e40b1930 tx=0x7f02cc00c760 comp rx=0 tx=0).stop 2024-04-25T13:42:40.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.985+0000 7f02e9800640 1 -- 172.21.15.123:0/1118911365 shutdown_connections 2024-04-25T13:42:40.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.985+0000 7f02e9800640 1 --2- 172.21.15.123:0/1118911365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02e4149b00 0x7f02e413c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.985+0000 7f02e9800640 1 --2- 172.21.15.123:0/1118911365 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f02c006f400 0x7f02c0071910 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.985+0000 7f02e9800640 1 --2- 172.21.15.123:0/1118911365 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f02e40b5550 0x7f02e4147ad0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.985+0000 7f02e9800640 1 --2- 172.21.15.123:0/1118911365 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02e406c950 0x7f02e40b0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:40.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.985+0000 7f02e9800640 1 -- 172.21.15.123:0/1118911365 >> 172.21.15.123:0/1118911365 conn(0x7f02e40d2180 msgr2=0x7f02e40d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:40.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.985+0000 7f02e9800640 1 -- 172.21.15.123:0/1118911365 shutdown_connections 2024-04-25T13:42:40.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:40.985+0000 7f02e9800640 1 -- 172.21.15.123:0/1118911365 wait complete. 2024-04-25T13:42:41.005 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T13:42:41.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:41.005 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-25T13:42:41.035 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-04-25T13:42:41.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:41.035 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T13:42:41.094 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:42:41.094 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:42:41.104 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:42:41.104 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:42:41.160 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:42:41.160 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:42:41.212 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:41.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.357+0000 7fa0caa00640 1 Processor -- start 2024-04-25T13:42:41.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.357+0000 7fa0caa00640 1 -- start start 2024-04-25T13:42:41.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0caa00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0c40747a0 0x7fa0c415fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:41.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0caa00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa0c41602e0 0x7fa0c4072ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:41.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0caa00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0c4145d70 con 0x7fa0c4073010 2024-04-25T13:42:41.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0caa00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fa0c4074290 con 0x7fa0c41602e0 2024-04-25T13:42:41.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0caa00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa0c41606f0 con 0x7fa0c40747a0 2024-04-25T13:42:41.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c8a00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa0c4073010 0x7fa0c4073420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54328/0 (socket says 172.21.15.123:54328) 2024-04-25T13:42:41.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c8a00640 1 -- 172.21.15.123:0/4286722707 learned_addr learned my addr 172.21.15.123:0/4286722707 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:41.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c2a00640 1 -- 172.21.15.123:0/4286722707 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1455599273 0 0) 0x7fa0bc0014a0 con 0x7fa0c4073010 2024-04-25T13:42:41.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c3e00640 1 --2- 172.21.15.123:0/4286722707 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0c40747a0 0x7fa0c415fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:41.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c2a00640 1 -- 172.21.15.123:0/4286722707 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0a8003530 con 0x7fa0c4073010 2024-04-25T13:42:41.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c3400640 1 --2- 172.21.15.123:0/4286722707 >> v2:172.21.15.130:3300/0 conn(0x7fa0c41602e0 0x7fa0c4072ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:41.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c2a00640 1 -- 172.21.15.123:0/4286722707 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 696559645 0 0) 0x7fa0a8003530 con 0x7fa0c4073010 2024-04-25T13:42:41.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c2a00640 1 -- 172.21.15.123:0/4286722707 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0c40747a0 msgr2=0x7fa0c415fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:41.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c2a00640 1 --2- 172.21.15.123:0/4286722707 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0c40747a0 0x7fa0c415fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c2a00640 1 -- 172.21.15.123:0/4286722707 >> v2:172.21.15.130:3300/0 conn(0x7fa0c41602e0 msgr2=0x7fa0c4072ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:41.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c2a00640 1 --2- 172.21.15.123:0/4286722707 >> v2:172.21.15.130:3300/0 conn(0x7fa0c41602e0 0x7fa0c4072ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c2a00640 1 -- 172.21.15.123:0/4286722707 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c4073c80 con 0x7fa0c4073010 2024-04-25T13:42:41.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c2a00640 1 -- 172.21.15.123:0/4286722707 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7fa0bc001bd0 con 0x7fa0c4073010 2024-04-25T13:42:41.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c3e00640 1 --2- 172.21.15.123:0/4286722707 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0c40747a0 0x7fa0c415fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:41.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c2a00640 1 -- 172.21.15.123:0/4286722707 >> v1:172.21.15.123:6789/0 conn(0x7fa0c4073010 legacy=0x7fa0c4073420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:41.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c2a00640 1 --2- 172.21.15.123:0/4286722707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0a8003a30 0x7fa0a8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:41.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c2a00640 1 --2- 172.21.15.123:0/4286722707 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0a8004810 0x7fa0a8004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:41.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c2a00640 1 --2- 172.21.15.123:0/4286722707 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0c40747a0 0x7fa0a8005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:41.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c2a00640 1 -- 172.21.15.123:0/4286722707 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c4074290 con 0x7fa0a8004810 2024-04-25T13:42:41.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c2a00640 1 -- 172.21.15.123:0/4286722707 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c41606f0 con 0x7fa0a8003a30 2024-04-25T13:42:41.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c2a00640 1 -- 172.21.15.123:0/4286722707 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa0a800bab0 con 0x7fa0c40747a0 2024-04-25T13:42:41.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c3400640 1 --2- 172.21.15.123:0/4286722707 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0a8004810 0x7fa0a8004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:41.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c8a00640 1 --2- 172.21.15.123:0/4286722707 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0c40747a0 0x7fa0a8005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:41.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c3e00640 1 --2- 172.21.15.123:0/4286722707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0a8003a30 0x7fa0a8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:41.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c3400640 1 -- 172.21.15.123:0/4286722707 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0c40747a0 msgr2=0x7fa0a8005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:41.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c3400640 1 --2- 172.21.15.123:0/4286722707 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0c40747a0 0x7fa0a8005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c3400640 1 -- 172.21.15.123:0/4286722707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0a8003a30 msgr2=0x7fa0a8003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:41.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c3400640 1 --2- 172.21.15.123:0/4286722707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0a8003a30 0x7fa0a8003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.361+0000 7fa0c3400640 1 -- 172.21.15.123:0/4286722707 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a8003530 con 0x7fa0a8004810 2024-04-25T13:42:41.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.365+0000 7fa0c3400640 1 --2- 172.21.15.123:0/4286722707 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0a8004810 0x7fa0a8004c20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4071a00 tx=0x7fa0b001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18d9ebab32973d38 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:41.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.365+0000 7fa0c2a00640 1 -- 172.21.15.123:0/4286722707 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b00096b0 con 0x7fa0a8004810 2024-04-25T13:42:41.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.365+0000 7fa0c2a00640 1 -- 172.21.15.123:0/4286722707 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b00a64e0 con 0x7fa0a8004810 2024-04-25T13:42:41.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.365+0000 7fa0c2a00640 1 -- 172.21.15.123:0/4286722707 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b00a68d0 con 0x7fa0a8004810 2024-04-25T13:42:41.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.365+0000 7fa0caa00640 1 -- 172.21.15.123:0/4286722707 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0a8004810 msgr2=0x7fa0a8004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:41.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.365+0000 7fa0caa00640 1 --2- 172.21.15.123:0/4286722707 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0a8004810 0x7fa0a8004c20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4071a00 tx=0x7fa0b001c9f0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.365+0000 7fa0c8a00640 1 -- 172.21.15.123:0/4286722707 reap_dead start 2024-04-25T13:42:41.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.365+0000 7fa0caa00640 1 -- 172.21.15.123:0/4286722707 shutdown_connections 2024-04-25T13:42:41.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.365+0000 7fa0caa00640 1 -- 172.21.15.123:0/4286722707 >> 172.21.15.123:0/4286722707 conn(0x7fa0c406d210 msgr2=0x7fa0c406ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:41.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.365+0000 7fa0caa00640 1 -- 172.21.15.123:0/4286722707 shutdown_connections 2024-04-25T13:42:41.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.365+0000 7fa0caa00640 1 -- 172.21.15.123:0/4286722707 wait complete. 2024-04-25T13:42:41.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.369+0000 7fa0caa00640 1 Processor -- start 2024-04-25T13:42:41.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.369+0000 7fa0caa00640 1 -- start start 2024-04-25T13:42:41.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.369+0000 7fa0caa00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0a8004810 0x7fa0c413b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:41.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.369+0000 7fa0caa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0c41f7490 0x7fa0c41491f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:41.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.369+0000 7fa0caa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0c41471b0 0x7fa0c41475c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:41.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.369+0000 7fa0caa00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c4073f20 con 0x7fa0c41471b0 2024-04-25T13:42:41.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.369+0000 7fa0caa00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c40cdd50 con 0x7fa0c41f7490 2024-04-25T13:42:41.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.369+0000 7fa0caa00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa0c4074bb0 con 0x7fa0a8004810 2024-04-25T13:42:41.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.369+0000 7fa0c8a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0c41471b0 0x7fa0c41475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:41.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.369+0000 7fa0c8a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0c41471b0 0x7fa0c41475c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35094/0 (socket says 172.21.15.123:35094) 2024-04-25T13:42:41.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.369+0000 7fa0c8a00640 1 -- 172.21.15.123:0/2510187540 learned_addr learned my addr 172.21.15.123:0/2510187540 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:41.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.369+0000 7fa0c3e00640 1 --2- 172.21.15.123:0/2510187540 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0a8004810 0x7fa0c413b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:41.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.369+0000 7fa0c3400640 1 --2- 172.21.15.123:0/2510187540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0c41f7490 0x7fa0c41491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:41.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.369+0000 7fa0c8a00640 1 -- 172.21.15.123:0/2510187540 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0a8004810 msgr2=0x7fa0c413b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:41.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.369+0000 7fa0c8a00640 1 --2- 172.21.15.123:0/2510187540 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0a8004810 0x7fa0c413b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.369+0000 7fa0c8a00640 1 -- 172.21.15.123:0/2510187540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0c41f7490 msgr2=0x7fa0c41491f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:41.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.369+0000 7fa0c8a00640 1 --2- 172.21.15.123:0/2510187540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0c41f7490 0x7fa0c41491f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.369+0000 7fa0c8a00640 1 -- 172.21.15.123:0/2510187540 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c41f6a10 con 0x7fa0c41471b0 2024-04-25T13:42:41.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.369+0000 7fa0c3e00640 1 --2- 172.21.15.123:0/2510187540 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0a8004810 0x7fa0c413b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:41.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.369+0000 7fa0c8a00640 1 --2- 172.21.15.123:0/2510187540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0c41471b0 0x7fa0c41475c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc002240 tx=0x7fa0bc00f1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:41.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.369+0000 7fa0bbe00640 1 -- 172.21.15.123:0/2510187540 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc00fb60 con 0x7fa0c41471b0 2024-04-25T13:42:41.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.369+0000 7fa0bbe00640 1 -- 172.21.15.123:0/2510187540 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0bc01c070 con 0x7fa0c41471b0 2024-04-25T13:42:41.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.369+0000 7fa0bbe00640 1 -- 172.21.15.123:0/2510187540 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc015470 con 0x7fa0c41471b0 2024-04-25T13:42:41.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.369+0000 7fa0caa00640 1 -- 172.21.15.123:0/2510187540 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0c4149d00 con 0x7fa0c41471b0 2024-04-25T13:42:41.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.369+0000 7fa0caa00640 1 -- 172.21.15.123:0/2510187540 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0c41f6c90 con 0x7fa0c41471b0 2024-04-25T13:42:41.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.373+0000 7fa0caa00640 1 -- 172.21.15.123:0/2510187540 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0c40507c0 con 0x7fa0c41471b0 2024-04-25T13:42:41.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.373+0000 7fa0bbe00640 1 -- 172.21.15.123:0/2510187540 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa0bc013040 con 0x7fa0c41471b0 2024-04-25T13:42:41.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.373+0000 7fa0bbe00640 1 --2- 172.21.15.123:0/2510187540 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa0a406f400 0x7fa0a4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:41.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.373+0000 7fa0bbe00640 1 -- 172.21.15.123:0/2510187540 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa0bc0923b0 con 0x7fa0c41471b0 2024-04-25T13:42:41.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.373+0000 7fa0c3e00640 1 --2- 172.21.15.123:0/2510187540 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa0a406f400 0x7fa0a4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:41.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.373+0000 7fa0c3e00640 1 --2- 172.21.15.123:0/2510187540 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa0a406f400 0x7fa0a4071910 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4009910 tx=0x7fa0b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:41.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.377+0000 7fa0bbe00640 1 -- 172.21.15.123:0/2510187540 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa0c41f6a10 con 0x7fa0c41471b0 2024-04-25T13:42:41.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.537+0000 7fa0caa00640 1 -- 172.21.15.123:0/2510187540 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa0c4149a90 con 0x7fa0c41471b0 2024-04-25T13:42:41.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.537+0000 7fa0bbe00640 1 -- 172.21.15.123:0/2510187540 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16629 (secure 0 0 0) 0x7fa0c4145d70 con 0x7fa0c41471b0 2024-04-25T13:42:41.539 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:41.539 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:42:07.405529+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:03.949161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:04.755682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:41.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.541+0000 7fa0caa00640 1 -- 172.21.15.123:0/2510187540 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa0a406f400 msgr2=0x7fa0a4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:41.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.541+0000 7fa0caa00640 1 --2- 172.21.15.123:0/2510187540 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa0a406f400 0x7fa0a4071910 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4009910 tx=0x7fa0b4008040 comp rx=0 tx=0).stop 2024-04-25T13:42:41.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.541+0000 7fa0caa00640 1 -- 172.21.15.123:0/2510187540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0c41471b0 msgr2=0x7fa0c41475c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:41.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.541+0000 7fa0caa00640 1 --2- 172.21.15.123:0/2510187540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0c41471b0 0x7fa0c41475c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc002240 tx=0x7fa0bc00f1d0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.541+0000 7fa0caa00640 1 -- 172.21.15.123:0/2510187540 shutdown_connections 2024-04-25T13:42:41.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.541+0000 7fa0caa00640 1 --2- 172.21.15.123:0/2510187540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0c41f7490 0x7fa0c41491f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.541+0000 7fa0caa00640 1 --2- 172.21.15.123:0/2510187540 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa0a406f400 0x7fa0a4071910 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.541+0000 7fa0caa00640 1 --2- 172.21.15.123:0/2510187540 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0c41471b0 0x7fa0c41475c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.541+0000 7fa0caa00640 1 --2- 172.21.15.123:0/2510187540 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0a8004810 0x7fa0c413b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.541+0000 7fa0caa00640 1 -- 172.21.15.123:0/2510187540 >> 172.21.15.123:0/2510187540 conn(0x7fa0c406d210 msgr2=0x7fa0c4143e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:41.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.541+0000 7fa0caa00640 1 -- 172.21.15.123:0/2510187540 shutdown_connections 2024-04-25T13:42:41.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.541+0000 7fa0caa00640 1 -- 172.21.15.123:0/2510187540 wait complete. 2024-04-25T13:42:41.562 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:41:53.602480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:42:03.949161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:42:04.755682+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:42:41.563 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:42:41.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.713+0000 7f4a35c00640 1 Processor -- start 2024-04-25T13:42:41.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.713+0000 7f4a35c00640 1 -- start start 2024-04-25T13:42:41.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.713+0000 7f4a35c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4a300b5550 0x7f4a300b5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:41.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.713+0000 7f4a35c00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4a3006c950 0x7f4a3006cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:41.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.713+0000 7f4a35c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a300b5ea0 con 0x7f4a30149b00 2024-04-25T13:42:41.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.713+0000 7f4a35c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4a300701d0 con 0x7f4a300b5550 2024-04-25T13:42:41.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.713+0000 7f4a35c00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f4a30070410 con 0x7f4a3006c950 2024-04-25T13:42:41.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.713+0000 7f4a2ea00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4a30149b00 0x7f4a3006fac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54338/0 (socket says 172.21.15.123:54338) 2024-04-25T13:42:41.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.713+0000 7f4a26000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4a300b5550 0x7f4a300b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:41.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.713+0000 7f4a2ea00640 1 -- 172.21.15.123:0/434525813 learned_addr learned my addr 172.21.15.123:0/434525813 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:41.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.713+0000 7f4a2f400640 1 --2- 172.21.15.123:0/434525813 >> v2:172.21.15.130:3300/0 conn(0x7f4a3006c950 0x7f4a3006cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:41.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.713+0000 7f4a26000640 1 -- 172.21.15.123:0/434525813 >> v2:172.21.15.130:3300/0 conn(0x7f4a3006c950 msgr2=0x7f4a3006cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:41.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.713+0000 7f4a26000640 1 --2- 172.21.15.123:0/434525813 >> v2:172.21.15.130:3300/0 conn(0x7f4a3006c950 0x7f4a3006cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.713+0000 7f4a26000640 1 -- 172.21.15.123:0/434525813 >> v1:172.21.15.123:6789/0 conn(0x7f4a30149b00 legacy=0x7f4a3006fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:41.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.713+0000 7f4a26000640 1 -- 172.21.15.123:0/434525813 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a300706f0 con 0x7f4a300b5550 2024-04-25T13:42:41.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.713+0000 7f4a2f400640 1 --2- 172.21.15.123:0/434525813 >> v2:172.21.15.130:3300/0 conn(0x7f4a3006c950 0x7f4a3006cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:41.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.717+0000 7f4a26000640 1 --2- 172.21.15.123:0/434525813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a300b5550 0x7f4a300b5960 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4a300b39a0 tx=0x7f4a1801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d5e736b92916b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:41.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.717+0000 7f4a2e000640 1 -- 172.21.15.123:0/434525813 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a180ab650 con 0x7f4a300b5550 2024-04-25T13:42:41.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.717+0000 7f4a2e000640 1 -- 172.21.15.123:0/434525813 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a180b0070 con 0x7f4a300b5550 2024-04-25T13:42:41.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.717+0000 7f4a2e000640 1 -- 172.21.15.123:0/434525813 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a180aba10 con 0x7f4a300b5550 2024-04-25T13:42:41.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.717+0000 7f4a35c00640 1 -- 172.21.15.123:0/434525813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a300b5550 msgr2=0x7f4a300b5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:41.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.717+0000 7f4a35c00640 1 --2- 172.21.15.123:0/434525813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a300b5550 0x7f4a300b5960 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4a300b39a0 tx=0x7f4a1801c450 comp rx=0 tx=0).stop 2024-04-25T13:42:41.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.717+0000 7f4a35c00640 1 -- 172.21.15.123:0/434525813 shutdown_connections 2024-04-25T13:42:41.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.717+0000 7f4a35c00640 1 --2- 172.21.15.123:0/434525813 >> v2:172.21.15.130:3300/0 conn(0x7f4a3006c950 0x7f4a3006cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.717+0000 7f4a35c00640 1 --2- 172.21.15.123:0/434525813 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a300b5550 0x7f4a300b5960 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.717+0000 7f4a35c00640 1 -- 172.21.15.123:0/434525813 >> 172.21.15.123:0/434525813 conn(0x7f4a300d2180 msgr2=0x7f4a300d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:41.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.717+0000 7f4a35c00640 1 -- 172.21.15.123:0/434525813 shutdown_connections 2024-04-25T13:42:41.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.717+0000 7f4a35c00640 1 -- 172.21.15.123:0/434525813 wait complete. 2024-04-25T13:42:41.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.721+0000 7f4a35c00640 1 Processor -- start 2024-04-25T13:42:41.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.721+0000 7f4a35c00640 1 -- start start 2024-04-25T13:42:41.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.721+0000 7f4a35c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a3006c950 0x7f4a30161930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:41.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.721+0000 7f4a35c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a300b5550 0x7f4a30156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:41.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.721+0000 7f4a35c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a30149b00 0x7f4a30146010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:41.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.721+0000 7f4a35c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3016cf40 con 0x7f4a30149b00 2024-04-25T13:42:41.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.721+0000 7f4a35c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3016cdc0 con 0x7f4a300b5550 2024-04-25T13:42:41.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.721+0000 7f4a35c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4a3016d0c0 con 0x7f4a3006c950 2024-04-25T13:42:41.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.721+0000 7f4a2f400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a30149b00 0x7f4a30146010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:41.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.721+0000 7f4a2f400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a30149b00 0x7f4a30146010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35110/0 (socket says 172.21.15.123:35110) 2024-04-25T13:42:41.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.721+0000 7f4a2f400640 1 -- 172.21.15.123:0/1432603075 learned_addr learned my addr 172.21.15.123:0/1432603075 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:41.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.721+0000 7f4a26000640 1 --2- 172.21.15.123:0/1432603075 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a300b5550 0x7f4a30156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:41.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.721+0000 7f4a2ea00640 1 --2- 172.21.15.123:0/1432603075 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a3006c950 0x7f4a30161930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:41.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.725+0000 7f4a2f400640 1 -- 172.21.15.123:0/1432603075 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a3006c950 msgr2=0x7f4a30161930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:41.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.725+0000 7f4a2f400640 1 --2- 172.21.15.123:0/1432603075 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a3006c950 0x7f4a30161930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.725+0000 7f4a2f400640 1 -- 172.21.15.123:0/1432603075 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a300b5550 msgr2=0x7f4a30156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:41.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.725+0000 7f4a2f400640 1 --2- 172.21.15.123:0/1432603075 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a300b5550 0x7f4a30156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.725+0000 7f4a2f400640 1 -- 172.21.15.123:0/1432603075 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a30162230 con 0x7f4a30149b00 2024-04-25T13:42:41.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.725+0000 7f4a2f400640 1 --2- 172.21.15.123:0/1432603075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a30149b00 0x7f4a30146010 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4a28007df0 tx=0x7f4a2800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:41.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.725+0000 7f4a27400640 1 -- 172.21.15.123:0/1432603075 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2801a070 con 0x7f4a30149b00 2024-04-25T13:42:41.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.725+0000 7f4a27400640 1 -- 172.21.15.123:0/1432603075 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a280039a0 con 0x7f4a30149b00 2024-04-25T13:42:41.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.725+0000 7f4a27400640 1 -- 172.21.15.123:0/1432603075 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a28003d90 con 0x7f4a30149b00 2024-04-25T13:42:41.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.725+0000 7f4a35c00640 1 -- 172.21.15.123:0/1432603075 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a30166e60 con 0x7f4a30149b00 2024-04-25T13:42:41.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.725+0000 7f4a35c00640 1 -- 172.21.15.123:0/1432603075 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a30167420 con 0x7f4a30149b00 2024-04-25T13:42:41.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.725+0000 7f4a35c00640 1 -- 172.21.15.123:0/1432603075 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a30050750 con 0x7f4a30149b00 2024-04-25T13:42:41.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.725+0000 7f4a27400640 1 -- 172.21.15.123:0/1432603075 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4a2801d070 con 0x7f4a30149b00 2024-04-25T13:42:41.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.729+0000 7f4a27400640 1 --2- 172.21.15.123:0/1432603075 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4a0c06f400 0x7f4a0c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:41.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.729+0000 7f4a27400640 1 -- 172.21.15.123:0/1432603075 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4a2808f4c0 con 0x7f4a30149b00 2024-04-25T13:42:41.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.729+0000 7f4a2ea00640 1 --2- 172.21.15.123:0/1432603075 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4a0c06f400 0x7f4a0c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:41.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.729+0000 7f4a2ea00640 1 --2- 172.21.15.123:0/1432603075 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4a0c06f400 0x7f4a0c071910 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4a20000f70 tx=0x7f4a20007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:41.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.733+0000 7f4a27400640 1 -- 172.21.15.123:0/1432603075 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4a28010070 con 0x7f4a30149b00 2024-04-25T13:42:41.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.889+0000 7f4a35c00640 1 -- 172.21.15.123:0/1432603075 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4a300b61a0 con 0x7f4a30149b00 2024-04-25T13:42:41.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.889+0000 7f4a27400640 1 -- 172.21.15.123:0/1432603075 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f4a2805bd50 con 0x7f4a30149b00 2024-04-25T13:42:41.889 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-04-25T13:42:41.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.889+0000 7f4a35c00640 1 -- 172.21.15.123:0/1432603075 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4a0c06f400 msgr2=0x7f4a0c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:41.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.889+0000 7f4a35c00640 1 --2- 172.21.15.123:0/1432603075 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4a0c06f400 0x7f4a0c071910 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4a20000f70 tx=0x7f4a20007e90 comp rx=0 tx=0).stop 2024-04-25T13:42:41.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.889+0000 7f4a35c00640 1 -- 172.21.15.123:0/1432603075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a30149b00 msgr2=0x7f4a30146010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:41.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.889+0000 7f4a35c00640 1 --2- 172.21.15.123:0/1432603075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a30149b00 0x7f4a30146010 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4a28007df0 tx=0x7f4a2800d4a0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.889+0000 7f4a35c00640 1 -- 172.21.15.123:0/1432603075 shutdown_connections 2024-04-25T13:42:41.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.889+0000 7f4a35c00640 1 --2- 172.21.15.123:0/1432603075 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a300b5550 0x7f4a30156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.889+0000 7f4a35c00640 1 --2- 172.21.15.123:0/1432603075 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4a0c06f400 0x7f4a0c071910 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.889+0000 7f4a35c00640 1 --2- 172.21.15.123:0/1432603075 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4a30149b00 0x7f4a30146010 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.889+0000 7f4a35c00640 1 --2- 172.21.15.123:0/1432603075 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a3006c950 0x7f4a30161930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:41.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.889+0000 7f4a35c00640 1 -- 172.21.15.123:0/1432603075 >> 172.21.15.123:0/1432603075 conn(0x7f4a300d2180 msgr2=0x7f4a300d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:41.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.889+0000 7f4a35c00640 1 -- 172.21.15.123:0/1432603075 shutdown_connections 2024-04-25T13:42:41.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:41.889+0000 7f4a35c00640 1 -- 172.21.15.123:0/1432603075 wait complete. 2024-04-25T13:42:41.910 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:42:42.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.057+0000 7f9abd400640 1 Processor -- start 2024-04-25T13:42:42.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.057+0000 7f9abd400640 1 -- start start 2024-04-25T13:42:42.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9abd400640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9ab80b8d00 0x7f9ab80d4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:42.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9abd400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9ab80d0010 0x7f9ab80d0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:42.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9abd400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ab80d0960 con 0x7f9ab80d1490 2024-04-25T13:42:42.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9abd400640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f9ab8070e20 con 0x7f9ab80b8d00 2024-04-25T13:42:42.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9abd400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9ab80cec40 con 0x7f9ab80d0010 2024-04-25T13:42:42.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9abca00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9ab80d1490 0x7f9ab80d18a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54348/0 (socket says 172.21.15.123:54348) 2024-04-25T13:42:42.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9abca00640 1 -- 172.21.15.123:0/3036905055 learned_addr learned my addr 172.21.15.123:0/3036905055 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:42.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9ab7e00640 1 --2- 172.21.15.123:0/3036905055 >> v2:172.21.15.130:3300/0 conn(0x7f9ab80b8d00 0x7f9ab80d4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:42.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9aaf400640 1 --2- 172.21.15.123:0/3036905055 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9ab80d0010 0x7f9ab80d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:42.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9ab7400640 1 -- 172.21.15.123:0/3036905055 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3878256563 0 0) 0x7f9ab0001120 con 0x7f9ab80d1490 2024-04-25T13:42:42.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9ab7400640 1 -- 172.21.15.123:0/3036905055 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a9c003530 con 0x7f9ab80d1490 2024-04-25T13:42:42.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9ab7400640 1 -- 172.21.15.123:0/3036905055 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3642730481 0 0) 0x7f9a9c003530 con 0x7f9ab80d1490 2024-04-25T13:42:42.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9ab7400640 1 -- 172.21.15.123:0/3036905055 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9ab80d0010 msgr2=0x7f9ab80d0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:42.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9ab7400640 1 --2- 172.21.15.123:0/3036905055 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9ab80d0010 0x7f9ab80d0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9ab7400640 1 -- 172.21.15.123:0/3036905055 >> v2:172.21.15.130:3300/0 conn(0x7f9ab80b8d00 msgr2=0x7f9ab80d4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:42.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9ab7400640 1 --2- 172.21.15.123:0/3036905055 >> v2:172.21.15.130:3300/0 conn(0x7f9ab80b8d00 0x7f9ab80d4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9ab7400640 1 -- 172.21.15.123:0/3036905055 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab80cef20 con 0x7f9ab80d1490 2024-04-25T13:42:42.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9ab7400640 1 -- 172.21.15.123:0/3036905055 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7f9ab0001850 con 0x7f9ab80d1490 2024-04-25T13:42:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9ab7400640 1 -- 172.21.15.123:0/3036905055 >> v1:172.21.15.123:6789/0 conn(0x7f9ab80d1490 legacy=0x7f9ab80d18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9ab7400640 1 --2- 172.21.15.123:0/3036905055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a9c0039c0 0x7f9a9c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9ab7400640 1 --2- 172.21.15.123:0/3036905055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a9c004810 0x7f9a9c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9ab7400640 1 --2- 172.21.15.123:0/3036905055 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9ab80d0010 0x7f9a9c005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9ab7400640 1 -- 172.21.15.123:0/3036905055 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab8070e20 con 0x7f9a9c004810 2024-04-25T13:42:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9ab7400640 1 -- 172.21.15.123:0/3036905055 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab80cec40 con 0x7f9a9c0039c0 2024-04-25T13:42:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9ab7400640 1 -- 172.21.15.123:0/3036905055 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9a9c00ba20 con 0x7f9ab80d0010 2024-04-25T13:42:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9aaf400640 1 --2- 172.21.15.123:0/3036905055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a9c004810 0x7f9a9c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9ab7e00640 1 --2- 172.21.15.123:0/3036905055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a9c0039c0 0x7f9a9c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9abca00640 1 --2- 172.21.15.123:0/3036905055 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9ab80d0010 0x7f9a9c005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9aaf400640 1 -- 172.21.15.123:0/3036905055 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9ab80d0010 msgr2=0x7f9a9c005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9aaf400640 1 --2- 172.21.15.123:0/3036905055 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9ab80d0010 0x7f9a9c005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9aaf400640 1 -- 172.21.15.123:0/3036905055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a9c0039c0 msgr2=0x7f9a9c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:42.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9aaf400640 1 --2- 172.21.15.123:0/3036905055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a9c0039c0 0x7f9a9c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.061+0000 7f9aaf400640 1 -- 172.21.15.123:0/3036905055 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a9c003530 con 0x7f9a9c004810 2024-04-25T13:42:42.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.065+0000 7f9aaf400640 1 --2- 172.21.15.123:0/3036905055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a9c004810 0x7f9a9c004c20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009b10 tx=0x7f9aa001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=493839676fa1e01f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:42.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.065+0000 7f9ab7400640 1 -- 172.21.15.123:0/3036905055 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa00b2070 con 0x7f9a9c004810 2024-04-25T13:42:42.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.065+0000 7f9ab7400640 1 -- 172.21.15.123:0/3036905055 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aa00a5680 con 0x7f9a9c004810 2024-04-25T13:42:42.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.065+0000 7f9ab7400640 1 -- 172.21.15.123:0/3036905055 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa00096b0 con 0x7f9a9c004810 2024-04-25T13:42:42.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.065+0000 7f9abd400640 1 -- 172.21.15.123:0/3036905055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a9c004810 msgr2=0x7f9a9c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:42.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.065+0000 7f9abd400640 1 --2- 172.21.15.123:0/3036905055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a9c004810 0x7f9a9c004c20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009b10 tx=0x7f9aa001ca90 comp rx=0 tx=0).stop 2024-04-25T13:42:42.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.065+0000 7f9abca00640 1 -- 172.21.15.123:0/3036905055 reap_dead start 2024-04-25T13:42:42.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.065+0000 7f9abd400640 1 -- 172.21.15.123:0/3036905055 shutdown_connections 2024-04-25T13:42:42.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.065+0000 7f9abd400640 1 -- 172.21.15.123:0/3036905055 >> 172.21.15.123:0/3036905055 conn(0x7f9ab80d3620 msgr2=0x7f9ab80d3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:42.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.065+0000 7f9abd400640 1 -- 172.21.15.123:0/3036905055 shutdown_connections 2024-04-25T13:42:42.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.065+0000 7f9abd400640 1 -- 172.21.15.123:0/3036905055 wait complete. 2024-04-25T13:42:42.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.069+0000 7f9abd400640 1 Processor -- start 2024-04-25T13:42:42.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.069+0000 7f9abd400640 1 -- start start 2024-04-25T13:42:42.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.069+0000 7f9abd400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a9c004810 0x7f9ab809fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:42.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.069+0000 7f9abd400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ab81f67d0 0x7f9ab81f6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:42.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.069+0000 7f9abd400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9ab80b7490 0x7f9ab80b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:42.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.069+0000 7f9abd400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab80722c0 con 0x7f9a9c004810 2024-04-25T13:42:42.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.069+0000 7f9abd400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab80cf4e0 con 0x7f9ab81f67d0 2024-04-25T13:42:42.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.069+0000 7f9abd400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9ab8072440 con 0x7f9ab80b7490 2024-04-25T13:42:42.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.069+0000 7f9ab7e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a9c004810 0x7f9ab809fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:42.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.069+0000 7f9ab7e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a9c004810 0x7f9ab809fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35130/0 (socket says 172.21.15.123:35130) 2024-04-25T13:42:42.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.069+0000 7f9ab7e00640 1 -- 172.21.15.123:0/231347247 learned_addr learned my addr 172.21.15.123:0/231347247 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:42.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.069+0000 7f9abca00640 1 --2- 172.21.15.123:0/231347247 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9ab80b7490 0x7f9ab80b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:42.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.069+0000 7f9aaf400640 1 --2- 172.21.15.123:0/231347247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ab81f67d0 0x7f9ab81f6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:42.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.073+0000 7f9ab7e00640 1 -- 172.21.15.123:0/231347247 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9ab80b7490 msgr2=0x7f9ab80b78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:42.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.073+0000 7f9ab7e00640 1 --2- 172.21.15.123:0/231347247 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9ab80b7490 0x7f9ab80b78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.073+0000 7f9ab7e00640 1 -- 172.21.15.123:0/231347247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ab81f67d0 msgr2=0x7f9ab81f6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:42.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.073+0000 7f9ab7e00640 1 --2- 172.21.15.123:0/231347247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ab81f67d0 0x7f9ab81f6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.073+0000 7f9ab7e00640 1 -- 172.21.15.123:0/231347247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab80b7de0 con 0x7f9a9c004810 2024-04-25T13:42:42.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.073+0000 7f9ab7e00640 1 --2- 172.21.15.123:0/231347247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a9c004810 0x7f9ab809fc80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009f80 tx=0x7f9aa800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:42.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.073+0000 7f9ab4c00640 1 -- 172.21.15.123:0/231347247 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa800fea0 con 0x7f9a9c004810 2024-04-25T13:42:42.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.073+0000 7f9ab4c00640 1 -- 172.21.15.123:0/231347247 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9aa8015630 con 0x7f9a9c004810 2024-04-25T13:42:42.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.073+0000 7f9abd400640 1 -- 172.21.15.123:0/231347247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ab81f9600 con 0x7f9a9c004810 2024-04-25T13:42:42.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.073+0000 7f9ab4c00640 1 -- 172.21.15.123:0/231347247 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa80159e0 con 0x7f9a9c004810 2024-04-25T13:42:42.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.073+0000 7f9abd400640 1 -- 172.21.15.123:0/231347247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ab81f9bc0 con 0x7f9a9c004810 2024-04-25T13:42:42.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.073+0000 7f9abd400640 1 -- 172.21.15.123:0/231347247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ab8050750 con 0x7f9a9c004810 2024-04-25T13:42:42.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.073+0000 7f9ab4c00640 1 -- 172.21.15.123:0/231347247 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9aa8015b80 con 0x7f9a9c004810 2024-04-25T13:42:42.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.077+0000 7f9ab4c00640 1 --2- 172.21.15.123:0/231347247 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9a9406f400 0x7f9a94071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:42.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.077+0000 7f9ab4c00640 1 -- 172.21.15.123:0/231347247 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9aa80904e0 con 0x7f9a9c004810 2024-04-25T13:42:42.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.077+0000 7f9aaf400640 1 --2- 172.21.15.123:0/231347247 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9a9406f400 0x7f9a94071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:42.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.077+0000 7f9aaf400640 1 --2- 172.21.15.123:0/231347247 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9a9406f400 0x7f9a94071910 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9aa00af000 tx=0x7f9aa00046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:42.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.081+0000 7f9ab4c00640 1 -- 172.21.15.123:0/231347247 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9ab80b7de0 con 0x7f9a9c004810 2024-04-25T13:42:42.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.237+0000 7f9abd400640 1 -- 172.21.15.123:0/231347247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9ab80a01c0 con 0x7f9a9c004810 2024-04-25T13:42:42.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.237+0000 7f9ab4c00640 1 -- 172.21.15.123:0/231347247 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f9aa8019030 con 0x7f9a9c004810 2024-04-25T13:42:42.237 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-04-25T13:42:42.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.237+0000 7f9abd400640 1 -- 172.21.15.123:0/231347247 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9a9406f400 msgr2=0x7f9a94071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:42.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.237+0000 7f9abd400640 1 --2- 172.21.15.123:0/231347247 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9a9406f400 0x7f9a94071910 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9aa00af000 tx=0x7f9aa00046d0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.237+0000 7f9abd400640 1 -- 172.21.15.123:0/231347247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a9c004810 msgr2=0x7f9ab809fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:42.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.237+0000 7f9abd400640 1 --2- 172.21.15.123:0/231347247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a9c004810 0x7f9ab809fc80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009f80 tx=0x7f9aa800f580 comp rx=0 tx=0).stop 2024-04-25T13:42:42.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.237+0000 7f9abd400640 1 -- 172.21.15.123:0/231347247 shutdown_connections 2024-04-25T13:42:42.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.237+0000 7f9abd400640 1 --2- 172.21.15.123:0/231347247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ab81f67d0 0x7f9ab81f6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.237+0000 7f9abd400640 1 --2- 172.21.15.123:0/231347247 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9a9406f400 0x7f9a94071910 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.237+0000 7f9abd400640 1 --2- 172.21.15.123:0/231347247 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9ab80b7490 0x7f9ab80b78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.237+0000 7f9abd400640 1 --2- 172.21.15.123:0/231347247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a9c004810 0x7f9ab809fc80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.237+0000 7f9abd400640 1 -- 172.21.15.123:0/231347247 >> 172.21.15.123:0/231347247 conn(0x7f9ab80d3620 msgr2=0x7f9ab80b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:42.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.241+0000 7f9abd400640 1 -- 172.21.15.123:0/231347247 shutdown_connections 2024-04-25T13:42:42.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.241+0000 7f9abd400640 1 -- 172.21.15.123:0/231347247 wait complete. 2024-04-25T13:42:42.259 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:42:42.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.405+0000 7f43c5c00640 1 Processor -- start 2024-04-25T13:42:42.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.405+0000 7f43c5c00640 1 -- start start 2024-04-25T13:42:42.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.409+0000 7f43c5c00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f43c00d0d90 0x7f43c00ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:42.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.409+0000 7f43c5c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f43c00cf3e0 0x7f43c0072a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:42.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.409+0000 7f43c5c00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43c00b0eb0 con 0x7f43c00d0840 2024-04-25T13:42:42.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.409+0000 7f43c5c00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f43c006ff90 con 0x7f43c00d0d90 2024-04-25T13:42:42.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.409+0000 7f43c5c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f43c0070270 con 0x7f43c00cf3e0 2024-04-25T13:42:42.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.409+0000 7f43b7400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f43c00cf3e0 0x7f43c0072a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:42.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.409+0000 7f43b7400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f43c00cf3e0 0x7f43c0072a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:48426/0 (socket says 172.21.15.123:48426) 2024-04-25T13:42:42.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.409+0000 7f43b7400640 1 -- 172.21.15.123:0/495658884 learned_addr learned my addr 172.21.15.123:0/495658884 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:42.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.409+0000 7f43c5200640 1 --1- 172.21.15.123:0/495658884 >> v1:172.21.15.130:6789/0 conn(0x7f43c00d0840 0x7f43c006f050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.123:58096/0 (socket says 172.21.15.123:58096) 2024-04-25T13:42:42.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.409+0000 7f43bfe00640 1 --2- 172.21.15.123:0/495658884 >> v2:172.21.15.130:3300/0 conn(0x7f43c00d0d90 0x7f43c00ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:42.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.409+0000 7f43b7400640 1 -- 172.21.15.123:0/495658884 >> v2:172.21.15.130:3300/0 conn(0x7f43c00d0d90 msgr2=0x7f43c00ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:42.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.409+0000 7f43b7400640 1 --2- 172.21.15.123:0/495658884 >> v2:172.21.15.130:3300/0 conn(0x7f43c00d0d90 0x7f43c00ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.409+0000 7f43b7400640 1 -- 172.21.15.123:0/495658884 >> v1:172.21.15.130:6789/0 conn(0x7f43c00d0840 legacy=0x7f43c006f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:42.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.409+0000 7f43bf400640 1 -- 172.21.15.123:0/495658884 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3590057671 0 0) 0x7f43c00b0eb0 con 0x7f43c00d0840 2024-04-25T13:42:42.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.409+0000 7f43b7400640 1 -- 172.21.15.123:0/495658884 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c0070550 con 0x7f43c00cf3e0 2024-04-25T13:42:42.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.413+0000 7f43b7400640 1 --2- 172.21.15.123:0/495658884 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f43c00cf3e0 0x7f43c0072a30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f43a8006fd0 tx=0x7f43a801e9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcc13d53f2418bae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:42.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.413+0000 7f43bf400640 1 -- 172.21.15.123:0/495658884 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a80ad070 con 0x7f43c00cf3e0 2024-04-25T13:42:42.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.413+0000 7f43bf400640 1 -- 172.21.15.123:0/495658884 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a8004230 con 0x7f43c00cf3e0 2024-04-25T13:42:42.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.413+0000 7f43bf400640 1 -- 172.21.15.123:0/495658884 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a80a77d0 con 0x7f43c00cf3e0 2024-04-25T13:42:42.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.413+0000 7f43c5c00640 1 -- 172.21.15.123:0/495658884 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f43c00cf3e0 msgr2=0x7f43c0072a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:42.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.413+0000 7f43c5c00640 1 --2- 172.21.15.123:0/495658884 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f43c00cf3e0 0x7f43c0072a30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f43a8006fd0 tx=0x7f43a801e9f0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.413+0000 7f43c5c00640 1 -- 172.21.15.123:0/495658884 shutdown_connections 2024-04-25T13:42:42.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.413+0000 7f43c5c00640 1 --2- 172.21.15.123:0/495658884 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f43c00cf3e0 0x7f43c0072a30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.413+0000 7f43c5c00640 1 --2- 172.21.15.123:0/495658884 >> v2:172.21.15.130:3300/0 conn(0x7f43c00d0d90 0x7f43c00ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.413+0000 7f43c5c00640 1 -- 172.21.15.123:0/495658884 >> 172.21.15.123:0/495658884 conn(0x7f43c006c840 msgr2=0x7f43c006cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:42.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.413+0000 7f43c5c00640 1 -- 172.21.15.123:0/495658884 shutdown_connections 2024-04-25T13:42:42.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.413+0000 7f43c5c00640 1 -- 172.21.15.123:0/495658884 wait complete. 2024-04-25T13:42:42.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.417+0000 7f43c5c00640 1 Processor -- start 2024-04-25T13:42:42.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.417+0000 7f43c5c00640 1 -- start start 2024-04-25T13:42:42.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.417+0000 7f43c5c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f43c00cf3e0 0x7f43c0144030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:42.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.417+0000 7f43c5c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43c00d0840 0x7f43c015de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:42.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.417+0000 7f43c5c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43c00d0d90 0x7f43c015e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:42.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.417+0000 7f43c5c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f43c0169060 con 0x7f43c00d0840 2024-04-25T13:42:42.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.417+0000 7f43c5c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f43c0073380 con 0x7f43c00d0d90 2024-04-25T13:42:42.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.417+0000 7f43c5c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f43c01691e0 con 0x7f43c00cf3e0 2024-04-25T13:42:42.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.417+0000 7f43b7400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43c00d0840 0x7f43c015de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:42.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.417+0000 7f43b7400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43c00d0840 0x7f43c015de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35142/0 (socket says 172.21.15.123:35142) 2024-04-25T13:42:42.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.417+0000 7f43b7400640 1 -- 172.21.15.123:0/2646644664 learned_addr learned my addr 172.21.15.123:0/2646644664 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:42.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.417+0000 7f43bfe00640 1 --2- 172.21.15.123:0/2646644664 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f43c00cf3e0 0x7f43c0144030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:42.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.417+0000 7f43b7400640 1 -- 172.21.15.123:0/2646644664 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f43c00cf3e0 msgr2=0x7f43c0144030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:42.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.417+0000 7f43c5200640 1 --2- 172.21.15.123:0/2646644664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43c00d0d90 0x7f43c015e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:42.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.417+0000 7f43b7400640 1 --2- 172.21.15.123:0/2646644664 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f43c00cf3e0 0x7f43c0144030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.417+0000 7f43b7400640 1 -- 172.21.15.123:0/2646644664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43c00d0d90 msgr2=0x7f43c015e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:42.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.417+0000 7f43b7400640 1 --2- 172.21.15.123:0/2646644664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43c00d0d90 0x7f43c015e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.417+0000 7f43b7400640 1 -- 172.21.15.123:0/2646644664 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c01549f0 con 0x7f43c00d0840 2024-04-25T13:42:42.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.417+0000 7f43bfe00640 1 --2- 172.21.15.123:0/2646644664 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f43c00cf3e0 0x7f43c0144030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:42.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.417+0000 7f43c5200640 1 --2- 172.21.15.123:0/2646644664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43c00d0d90 0x7f43c015e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:42.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.417+0000 7f43b7400640 1 --2- 172.21.15.123:0/2646644664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43c00d0840 0x7f43c015de80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f43a8006fd0 tx=0x7f43a801b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:42.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.421+0000 7f43bcc00640 1 -- 172.21.15.123:0/2646644664 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a80ad040 con 0x7f43c00d0840 2024-04-25T13:42:42.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.421+0000 7f43bcc00640 1 -- 172.21.15.123:0/2646644664 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43a8003620 con 0x7f43c00d0840 2024-04-25T13:42:42.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.421+0000 7f43c5c00640 1 -- 172.21.15.123:0/2646644664 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43c0154cd0 con 0x7f43c00d0840 2024-04-25T13:42:42.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.421+0000 7f43bcc00640 1 -- 172.21.15.123:0/2646644664 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a80039f0 con 0x7f43c00d0840 2024-04-25T13:42:42.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.421+0000 7f43c5c00640 1 -- 172.21.15.123:0/2646644664 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43c00b0340 con 0x7f43c00d0840 2024-04-25T13:42:42.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.421+0000 7f43c5c00640 1 -- 172.21.15.123:0/2646644664 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43c0050750 con 0x7f43c00d0840 2024-04-25T13:42:42.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.421+0000 7f43bcc00640 1 -- 172.21.15.123:0/2646644664 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f43a80c0060 con 0x7f43c00d0840 2024-04-25T13:42:42.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.421+0000 7f43bcc00640 1 --2- 172.21.15.123:0/2646644664 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f439c06f430 0x7f439c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:42.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.421+0000 7f43bcc00640 1 -- 172.21.15.123:0/2646644664 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f43a8129170 con 0x7f43c00d0840 2024-04-25T13:42:42.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.421+0000 7f43bfe00640 1 --2- 172.21.15.123:0/2646644664 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f439c06f430 0x7f439c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:42.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.425+0000 7f43bfe00640 1 --2- 172.21.15.123:0/2646644664 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f439c06f430 0x7f439c071940 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f43b0009a40 tx=0x7f43b0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:42.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.425+0000 7f43bcc00640 1 -- 172.21.15.123:0/2646644664 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f43a80185e0 con 0x7f43c00d0840 2024-04-25T13:42:42.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.585+0000 7f43c5c00640 1 -- 172.21.15.123:0/2646644664 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f43c0154ea0 con 0x7f43c00d0840 2024-04-25T13:42:42.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.585+0000 7f43bcc00640 1 -- 172.21.15.123:0/2646644664 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f43a80f60f0 con 0x7f43c00d0840 2024-04-25T13:42:42.588 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-04-25T13:42:42.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.589+0000 7f43c5c00640 1 -- 172.21.15.123:0/2646644664 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f439c06f430 msgr2=0x7f439c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:42.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.589+0000 7f43c5c00640 1 --2- 172.21.15.123:0/2646644664 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f439c06f430 0x7f439c071940 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f43b0009a40 tx=0x7f43b0008040 comp rx=0 tx=0).stop 2024-04-25T13:42:42.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.589+0000 7f43c5c00640 1 -- 172.21.15.123:0/2646644664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43c00d0840 msgr2=0x7f43c015de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:42.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.589+0000 7f43c5c00640 1 --2- 172.21.15.123:0/2646644664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43c00d0840 0x7f43c015de80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f43a8006fd0 tx=0x7f43a801b790 comp rx=0 tx=0).stop 2024-04-25T13:42:42.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.589+0000 7f43c5c00640 1 -- 172.21.15.123:0/2646644664 shutdown_connections 2024-04-25T13:42:42.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.589+0000 7f43c5c00640 1 --2- 172.21.15.123:0/2646644664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43c00d0d90 0x7f43c015e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.589+0000 7f43c5c00640 1 --2- 172.21.15.123:0/2646644664 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f439c06f430 0x7f439c071940 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.589+0000 7f43c5c00640 1 --2- 172.21.15.123:0/2646644664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f43c00d0840 0x7f43c015de80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.589+0000 7f43c5c00640 1 --2- 172.21.15.123:0/2646644664 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f43c00cf3e0 0x7f43c0144030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.589+0000 7f43c5c00640 1 -- 172.21.15.123:0/2646644664 >> 172.21.15.123:0/2646644664 conn(0x7f43c006c840 msgr2=0x7f43c00b3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:42.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.589+0000 7f43c5c00640 1 -- 172.21.15.123:0/2646644664 shutdown_connections 2024-04-25T13:42:42.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.589+0000 7f43c5c00640 1 -- 172.21.15.123:0/2646644664 wait complete. 2024-04-25T13:42:42.610 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:42:42.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.757+0000 7ff6bd200640 1 Processor -- start 2024-04-25T13:42:42.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.757+0000 7ff6bd200640 1 -- start start 2024-04-25T13:42:42.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.757+0000 7ff6bd200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff6b80cf3e0 0x7ff6b80d0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:42.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.757+0000 7ff6bd200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff6b80cf7f0 0x7ff6b80d0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:42.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.757+0000 7ff6bd200640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6b80ce660 con 0x7ff6b80b8ea0 2024-04-25T13:42:42.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.757+0000 7ff6bd200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff6b80b92b0 con 0x7ff6b80cf7f0 2024-04-25T13:42:42.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.757+0000 7ff6bd200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff6b80ce430 con 0x7ff6b80cf3e0 2024-04-25T13:42:42.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.757+0000 7ff6b6800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff6b80cf7f0 0x7ff6b80d0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:42.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.757+0000 7ff6b6800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff6b80cf7f0 0x7ff6b80d0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35156/0 (socket says 172.21.15.123:35156) 2024-04-25T13:42:42.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.757+0000 7ff6b6800640 1 -- 172.21.15.123:0/909464296 learned_addr learned my addr 172.21.15.123:0/909464296 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:42.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.757+0000 7ff6ad400640 1 --2- 172.21.15.123:0/909464296 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff6b80cf3e0 0x7ff6b80d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:42.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.757+0000 7ff6b6800640 1 -- 172.21.15.123:0/909464296 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff6b80cf3e0 msgr2=0x7ff6b80d0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:42.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.757+0000 7ff6b6800640 1 --2- 172.21.15.123:0/909464296 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff6b80cf3e0 0x7ff6b80d0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.757+0000 7ff6b6800640 1 -- 172.21.15.123:0/909464296 >> v1:172.21.15.130:6789/0 conn(0x7ff6b80b8ea0 legacy=0x7ff6b80b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:42.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.761+0000 7ff6b6800640 1 -- 172.21.15.123:0/909464296 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6b80ce900 con 0x7ff6b80cf7f0 2024-04-25T13:42:42.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.761+0000 7ff6b6800640 1 --2- 172.21.15.123:0/909464296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b80cf7f0 0x7ff6b80d0590 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80b2fc0 tx=0x7ff6b001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd212d6645d5b462 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:42.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.761+0000 7ff6b5400640 1 -- 172.21.15.123:0/909464296 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b00ab600 con 0x7ff6b80cf7f0 2024-04-25T13:42:42.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.761+0000 7ff6b5400640 1 -- 172.21.15.123:0/909464296 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6b00b0070 con 0x7ff6b80cf7f0 2024-04-25T13:42:42.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.761+0000 7ff6b5400640 1 -- 172.21.15.123:0/909464296 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6b00ab9c0 con 0x7ff6b80cf7f0 2024-04-25T13:42:42.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.761+0000 7ff6bd200640 1 -- 172.21.15.123:0/909464296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b80cf7f0 msgr2=0x7ff6b80d0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:42.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.761+0000 7ff6bd200640 1 --2- 172.21.15.123:0/909464296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b80cf7f0 0x7ff6b80d0590 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80b2fc0 tx=0x7ff6b001c440 comp rx=0 tx=0).stop 2024-04-25T13:42:42.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.761+0000 7ff6bd200640 1 -- 172.21.15.123:0/909464296 shutdown_connections 2024-04-25T13:42:42.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.761+0000 7ff6bd200640 1 --2- 172.21.15.123:0/909464296 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b80cf7f0 0x7ff6b80d0590 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.761+0000 7ff6bd200640 1 --2- 172.21.15.123:0/909464296 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff6b80cf3e0 0x7ff6b80d0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.761+0000 7ff6bd200640 1 -- 172.21.15.123:0/909464296 >> 172.21.15.123:0/909464296 conn(0x7ff6b80d36e0 msgr2=0x7ff6b80d3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:42.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.765+0000 7ff6bd200640 1 -- 172.21.15.123:0/909464296 shutdown_connections 2024-04-25T13:42:42.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.765+0000 7ff6bd200640 1 -- 172.21.15.123:0/909464296 wait complete. 2024-04-25T13:42:42.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.765+0000 7ff6bd200640 1 Processor -- start 2024-04-25T13:42:42.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.765+0000 7ff6bd200640 1 -- start start 2024-04-25T13:42:42.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.765+0000 7ff6bd200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff6b80b8ea0 0x7ff6b815cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:42.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.765+0000 7ff6bd200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b80cf3e0 0x7ff6b815d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:42.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.765+0000 7ff6bd200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6b80cf7f0 0x7ff6b8160170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:42.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.765+0000 7ff6bd200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b816af70 con 0x7ff6b80cf3e0 2024-04-25T13:42:42.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.765+0000 7ff6bd200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b80d2800 con 0x7ff6b80cf7f0 2024-04-25T13:42:42.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.765+0000 7ff6bd200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff6b816b0f0 con 0x7ff6b80b8ea0 2024-04-25T13:42:42.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.765+0000 7ff6ad400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b80cf3e0 0x7ff6b815d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:42.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.769+0000 7ff6ad400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b80cf3e0 0x7ff6b815d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35170/0 (socket says 172.21.15.123:35170) 2024-04-25T13:42:42.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.769+0000 7ff6ad400640 1 -- 172.21.15.123:0/2297548167 learned_addr learned my addr 172.21.15.123:0/2297548167 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:42.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.769+0000 7ff6b6800640 1 --2- 172.21.15.123:0/2297548167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6b80cf7f0 0x7ff6b8160170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:42.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.769+0000 7ff6b5e00640 1 --2- 172.21.15.123:0/2297548167 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff6b80b8ea0 0x7ff6b815cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:42.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.769+0000 7ff6ad400640 1 -- 172.21.15.123:0/2297548167 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff6b80b8ea0 msgr2=0x7ff6b815cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:42.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.769+0000 7ff6ad400640 1 --2- 172.21.15.123:0/2297548167 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff6b80b8ea0 0x7ff6b815cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.769+0000 7ff6ad400640 1 -- 172.21.15.123:0/2297548167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6b80cf7f0 msgr2=0x7ff6b8160170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:42.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.769+0000 7ff6ad400640 1 --2- 172.21.15.123:0/2297548167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6b80cf7f0 0x7ff6b8160170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.769+0000 7ff6ad400640 1 -- 172.21.15.123:0/2297548167 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6b80b2360 con 0x7ff6b80cf3e0 2024-04-25T13:42:42.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.769+0000 7ff6ad400640 1 --2- 172.21.15.123:0/2297548167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b80cf3e0 0x7ff6b815d150 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000d620 tx=0x7ff6a000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:42.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.769+0000 7ff6aea00640 1 -- 172.21.15.123:0/2297548167 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a000b620 con 0x7ff6b80cf3e0 2024-04-25T13:42:42.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.769+0000 7ff6aea00640 1 -- 172.21.15.123:0/2297548167 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6a0019070 con 0x7ff6b80cf3e0 2024-04-25T13:42:42.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.769+0000 7ff6aea00640 1 -- 172.21.15.123:0/2297548167 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a000b9e0 con 0x7ff6b80cf3e0 2024-04-25T13:42:42.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.769+0000 7ff6bd200640 1 -- 172.21.15.123:0/2297548167 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6b80b25d0 con 0x7ff6b80cf3e0 2024-04-25T13:42:42.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.769+0000 7ff6bd200640 1 -- 172.21.15.123:0/2297548167 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6b81615d0 con 0x7ff6b80cf3e0 2024-04-25T13:42:42.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.769+0000 7ff6bd200640 1 -- 172.21.15.123:0/2297548167 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6b815eaf0 con 0x7ff6b80cf3e0 2024-04-25T13:42:42.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.769+0000 7ff6aea00640 1 -- 172.21.15.123:0/2297548167 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff6a000bb80 con 0x7ff6b80cf3e0 2024-04-25T13:42:42.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.773+0000 7ff6aea00640 1 --2- 172.21.15.123:0/2297548167 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff69406f430 0x7ff694071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:42.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.773+0000 7ff6aea00640 1 -- 172.21.15.123:0/2297548167 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff6a00901d0 con 0x7ff6b80cf3e0 2024-04-25T13:42:42.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.773+0000 7ff6b5e00640 1 --2- 172.21.15.123:0/2297548167 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff69406f430 0x7ff694071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:42.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.773+0000 7ff6b5e00640 1 --2- 172.21.15.123:0/2297548167 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff69406f430 0x7ff694071940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8161b90 tx=0x7ff6a80094f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:42.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.773+0000 7ff6aea00640 1 -- 172.21.15.123:0/2297548167 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff6a005d130 con 0x7ff6b80cf3e0 2024-04-25T13:42:42.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.941+0000 7ff6bd200640 1 -- 172.21.15.123:0/2297548167 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff6b8050750 con 0x7ff6b80cf3e0 2024-04-25T13:42:42.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.941+0000 7ff6aea00640 1 -- 172.21.15.123:0/2297548167 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7ff6a005ca30 con 0x7ff6b80cf3e0 2024-04-25T13:42:42.943 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-04-25T13:42:42.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.945+0000 7ff6bd200640 1 -- 172.21.15.123:0/2297548167 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff69406f430 msgr2=0x7ff694071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:42.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.945+0000 7ff6bd200640 1 --2- 172.21.15.123:0/2297548167 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff69406f430 0x7ff694071940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8161b90 tx=0x7ff6a80094f0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.945+0000 7ff6bd200640 1 -- 172.21.15.123:0/2297548167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b80cf3e0 msgr2=0x7ff6b815d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:42.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.945+0000 7ff6bd200640 1 --2- 172.21.15.123:0/2297548167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b80cf3e0 0x7ff6b815d150 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000d620 tx=0x7ff6a000dae0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.945+0000 7ff6bd200640 1 -- 172.21.15.123:0/2297548167 shutdown_connections 2024-04-25T13:42:42.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.945+0000 7ff6bd200640 1 --2- 172.21.15.123:0/2297548167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff6b80cf7f0 0x7ff6b8160170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.945+0000 7ff6bd200640 1 --2- 172.21.15.123:0/2297548167 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff69406f430 0x7ff694071940 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.945+0000 7ff6bd200640 1 --2- 172.21.15.123:0/2297548167 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff6b80cf3e0 0x7ff6b815d150 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.945+0000 7ff6bd200640 1 --2- 172.21.15.123:0/2297548167 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff6b80b8ea0 0x7ff6b815cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:42.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.945+0000 7ff6bd200640 1 -- 172.21.15.123:0/2297548167 >> 172.21.15.123:0/2297548167 conn(0x7ff6b80d36e0 msgr2=0x7ff6b80d3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:42.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.945+0000 7ff6bd200640 1 -- 172.21.15.123:0/2297548167 shutdown_connections 2024-04-25T13:42:42.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:42.945+0000 7ff6bd200640 1 -- 172.21.15.123:0/2297548167 wait complete. 2024-04-25T13:42:42.965 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-25T13:42:42.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:42.965 DEBUG:teuthology.orchestra.run.smithi130:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-04-25T13:42:43.002 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2024-04-25T13:42:43.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:43.003 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-25T13:42:43.060 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:42:43.060 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:42:43.068 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:42:43.068 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:42:43.123 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:42:43.123 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:42:43.175 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.369+0000 7fe335a00640 1 Processor -- start 2024-04-25T13:42:43.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.369+0000 7fe335a00640 1 -- start start 2024-04-25T13:42:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.369+0000 7fe335a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe330167480 0x7fe3301698a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.369+0000 7fe335a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3300b27b0 con 0x7fe3300ce2e0 2024-04-25T13:42:43.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.369+0000 7fe335a00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3300b8e80 con 0x7fe3301623a0 2024-04-25T13:42:43.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.369+0000 7fe335a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe3300d16b0 con 0x7fe330167480 2024-04-25T13:42:43.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.369+0000 7fe326000640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe3300ce2e0 0x7fe3300ce6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54358/0 (socket says 172.21.15.123:54358) 2024-04-25T13:42:43.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.369+0000 7fe326000640 1 -- 172.21.15.123:0/3315458400 learned_addr learned my addr 172.21.15.123:0/3315458400 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.369+0000 7fe32f400640 1 --2- 172.21.15.123:0/3315458400 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe330167480 0x7fe3301698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.369+0000 7fe32e000640 1 -- 172.21.15.123:0/3315458400 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2469797539 0 0) 0x7fe3300b27b0 con 0x7fe3300ce2e0 2024-04-25T13:42:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.369+0000 7fe32e000640 1 -- 172.21.15.123:0/3315458400 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe314003530 con 0x7fe3300ce2e0 2024-04-25T13:42:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.369+0000 7fe32e000640 1 -- 172.21.15.123:0/3315458400 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4109524750 0 0) 0x7fe314003530 con 0x7fe3300ce2e0 2024-04-25T13:42:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.369+0000 7fe32e000640 1 -- 172.21.15.123:0/3315458400 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe330167480 msgr2=0x7fe3301698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.369+0000 7fe32e000640 1 --2- 172.21.15.123:0/3315458400 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe330167480 0x7fe3301698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.369+0000 7fe32e000640 1 -- 172.21.15.123:0/3315458400 >> v1:172.21.15.130:6789/0 conn(0x7fe3301623a0 legacy=0x7fe3301627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.369+0000 7fe32e000640 1 -- 172.21.15.123:0/3315458400 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3300d1340 con 0x7fe3300ce2e0 2024-04-25T13:42:43.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.369+0000 7fe32e000640 1 -- 172.21.15.123:0/3315458400 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7fe318001680 con 0x7fe3300ce2e0 2024-04-25T13:42:43.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.369+0000 7fe32e000640 1 -- 172.21.15.123:0/3315458400 >> v1:172.21.15.123:6789/0 conn(0x7fe3300ce2e0 legacy=0x7fe3300ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:43.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.369+0000 7fe32e000640 1 --2- 172.21.15.123:0/3315458400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe314003a60 0x7fe314003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:43.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.369+0000 7fe32e000640 1 --2- 172.21.15.123:0/3315458400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe314004810 0x7fe314004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:43.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.373+0000 7fe32e000640 1 --2- 172.21.15.123:0/3315458400 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe330167480 0x7fe314005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:43.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.373+0000 7fe32e000640 1 -- 172.21.15.123:0/3315458400 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe3300d16b0 con 0x7fe314004810 2024-04-25T13:42:43.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.373+0000 7fe32e000640 1 -- 172.21.15.123:0/3315458400 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe31400bae0 con 0x7fe314003a60 2024-04-25T13:42:43.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.373+0000 7fe32e000640 1 -- 172.21.15.123:0/3315458400 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe31400bce0 con 0x7fe330167480 2024-04-25T13:42:43.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.373+0000 7fe326000640 1 --2- 172.21.15.123:0/3315458400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe314004810 0x7fe314004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:43.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.373+0000 7fe32ea00640 1 --2- 172.21.15.123:0/3315458400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe314003a60 0x7fe314003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:43.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.373+0000 7fe32f400640 1 --2- 172.21.15.123:0/3315458400 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe330167480 0x7fe314005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:43.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.373+0000 7fe326000640 1 -- 172.21.15.123:0/3315458400 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe330167480 msgr2=0x7fe314005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:43.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.373+0000 7fe326000640 1 --2- 172.21.15.123:0/3315458400 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe330167480 0x7fe314005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:43.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.373+0000 7fe326000640 1 -- 172.21.15.123:0/3315458400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe314003a60 msgr2=0x7fe314003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:43.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.373+0000 7fe326000640 1 --2- 172.21.15.123:0/3315458400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe314003a60 0x7fe314003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:43.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.373+0000 7fe326000640 1 -- 172.21.15.123:0/3315458400 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe314003530 con 0x7fe314004810 2024-04-25T13:42:43.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.373+0000 7fe326000640 1 --2- 172.21.15.123:0/3315458400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe314004810 0x7fe314004c20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe3300b8db0 tx=0x7fe31801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e504515369a983 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:43.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.373+0000 7fe32e000640 1 -- 172.21.15.123:0/3315458400 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe318007d40 con 0x7fe314004810 2024-04-25T13:42:43.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.373+0000 7fe32e000640 1 -- 172.21.15.123:0/3315458400 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3180a9070 con 0x7fe314004810 2024-04-25T13:42:43.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.373+0000 7fe32e000640 1 -- 172.21.15.123:0/3315458400 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3180a5d80 con 0x7fe314004810 2024-04-25T13:42:43.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.377+0000 7fe335a00640 1 -- 172.21.15.123:0/3315458400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe314004810 msgr2=0x7fe314004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:43.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.377+0000 7fe335a00640 1 --2- 172.21.15.123:0/3315458400 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe314004810 0x7fe314004c20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe3300b8db0 tx=0x7fe31801cc20 comp rx=0 tx=0).stop 2024-04-25T13:42:43.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.377+0000 7fe32f400640 1 -- 172.21.15.123:0/3315458400 reap_dead start 2024-04-25T13:42:43.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.377+0000 7fe335a00640 1 -- 172.21.15.123:0/3315458400 shutdown_connections 2024-04-25T13:42:43.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.377+0000 7fe335a00640 1 -- 172.21.15.123:0/3315458400 >> 172.21.15.123:0/3315458400 conn(0x7fe3300d0150 msgr2=0x7fe3300d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:43.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.377+0000 7fe335a00640 1 -- 172.21.15.123:0/3315458400 shutdown_connections 2024-04-25T13:42:43.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.377+0000 7fe335a00640 1 -- 172.21.15.123:0/3315458400 wait complete. 2024-04-25T13:42:43.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.377+0000 7fe335a00640 1 Processor -- start 2024-04-25T13:42:43.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.377+0000 7fe335a00640 1 -- start start 2024-04-25T13:42:43.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.381+0000 7fe335a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe314004810 0x7fe3301f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:43.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.381+0000 7fe335a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe330070dc0 0x7fe3300b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:43.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.381+0000 7fe335a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe3300b11d0 0x7fe33015cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:43.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.381+0000 7fe335a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe3300d1b40 con 0x7fe314004810 2024-04-25T13:42:43.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.381+0000 7fe335a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe3300b7530 con 0x7fe3300b11d0 2024-04-25T13:42:43.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.381+0000 7fe335a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe3300b9160 con 0x7fe330070dc0 2024-04-25T13:42:43.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.381+0000 7fe32ea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe314004810 0x7fe3301f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:43.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.381+0000 7fe32ea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe314004810 0x7fe3301f5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35194/0 (socket says 172.21.15.123:35194) 2024-04-25T13:42:43.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.381+0000 7fe32ea00640 1 -- 172.21.15.123:0/2099712542 learned_addr learned my addr 172.21.15.123:0/2099712542 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:43.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.381+0000 7fe32f400640 1 --2- 172.21.15.123:0/2099712542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe3300b11d0 0x7fe33015cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:43.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.381+0000 7fe326000640 1 --2- 172.21.15.123:0/2099712542 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe330070dc0 0x7fe3300b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:43.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.381+0000 7fe32ea00640 1 -- 172.21.15.123:0/2099712542 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe330070dc0 msgr2=0x7fe3300b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:43.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.381+0000 7fe32ea00640 1 --2- 172.21.15.123:0/2099712542 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe330070dc0 0x7fe3300b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:43.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.381+0000 7fe32ea00640 1 -- 172.21.15.123:0/2099712542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe3300b11d0 msgr2=0x7fe33015cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:43.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.381+0000 7fe32ea00640 1 --2- 172.21.15.123:0/2099712542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe3300b11d0 0x7fe33015cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:43.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.381+0000 7fe32ea00640 1 -- 172.21.15.123:0/2099712542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe330072150 con 0x7fe314004810 2024-04-25T13:42:43.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.381+0000 7fe32ea00640 1 --2- 172.21.15.123:0/2099712542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe314004810 0x7fe3301f5c60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe320011c60 tx=0x7fe32000f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:43.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.381+0000 7fe327400640 1 -- 172.21.15.123:0/2099712542 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe320019030 con 0x7fe314004810 2024-04-25T13:42:43.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.381+0000 7fe327400640 1 -- 172.21.15.123:0/2099712542 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe32000fcb0 con 0x7fe314004810 2024-04-25T13:42:43.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.381+0000 7fe327400640 1 -- 172.21.15.123:0/2099712542 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32000fe80 con 0x7fe314004810 2024-04-25T13:42:43.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.381+0000 7fe335a00640 1 -- 172.21.15.123:0/2099712542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3300b15e0 con 0x7fe314004810 2024-04-25T13:42:43.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.381+0000 7fe335a00640 1 -- 172.21.15.123:0/2099712542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3300718b0 con 0x7fe314004810 2024-04-25T13:42:43.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.381+0000 7fe335a00640 1 -- 172.21.15.123:0/2099712542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3300507c0 con 0x7fe314004810 2024-04-25T13:42:43.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.381+0000 7fe327400640 1 -- 172.21.15.123:0/2099712542 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe32001c070 con 0x7fe314004810 2024-04-25T13:42:43.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.385+0000 7fe327400640 1 --2- 172.21.15.123:0/2099712542 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe30c06f400 0x7fe30c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:43.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.385+0000 7fe327400640 1 -- 172.21.15.123:0/2099712542 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe3200920c0 con 0x7fe314004810 2024-04-25T13:42:43.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.385+0000 7fe326000640 1 --2- 172.21.15.123:0/2099712542 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe30c06f400 0x7fe30c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:43.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.385+0000 7fe326000640 1 --2- 172.21.15.123:0/2099712542 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe30c06f400 0x7fe30c071910 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe3180ab000 tx=0x7fe3180b1040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:43.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.389+0000 7fe327400640 1 -- 172.21.15.123:0/2099712542 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe320023070 con 0x7fe314004810 2024-04-25T13:42:43.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.545+0000 7fe335a00640 1 -- 172.21.15.123:0/2099712542 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe33006fd20 con 0x7fe314004810 2024-04-25T13:42:43.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.545+0000 7fe327400640 1 -- 172.21.15.123:0/2099712542 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16629 (secure 0 0 0) 0x7fe3300b15e0 con 0x7fe314004810 2024-04-25T13:42:43.547 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:43.547 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:42:07.405529+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:03.949161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:04.755682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:43.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.549+0000 7fe335a00640 1 -- 172.21.15.123:0/2099712542 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe30c06f400 msgr2=0x7fe30c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:43.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.549+0000 7fe335a00640 1 --2- 172.21.15.123:0/2099712542 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe30c06f400 0x7fe30c071910 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe3180ab000 tx=0x7fe3180b1040 comp rx=0 tx=0).stop 2024-04-25T13:42:43.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.549+0000 7fe335a00640 1 -- 172.21.15.123:0/2099712542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe314004810 msgr2=0x7fe3301f5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:43.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.549+0000 7fe335a00640 1 --2- 172.21.15.123:0/2099712542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe314004810 0x7fe3301f5c60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe320011c60 tx=0x7fe32000f5a0 comp rx=0 tx=0).stop 2024-04-25T13:42:43.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.549+0000 7fe335a00640 1 -- 172.21.15.123:0/2099712542 shutdown_connections 2024-04-25T13:42:43.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.549+0000 7fe335a00640 1 --2- 172.21.15.123:0/2099712542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe3300b11d0 0x7fe33015cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:43.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.549+0000 7fe335a00640 1 --2- 172.21.15.123:0/2099712542 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe30c06f400 0x7fe30c071910 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:43.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.549+0000 7fe335a00640 1 --2- 172.21.15.123:0/2099712542 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe330070dc0 0x7fe3300b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:43.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.549+0000 7fe335a00640 1 --2- 172.21.15.123:0/2099712542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe314004810 0x7fe3301f5c60 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:43.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.549+0000 7fe335a00640 1 -- 172.21.15.123:0/2099712542 >> 172.21.15.123:0/2099712542 conn(0x7fe3300d0150 msgr2=0x7fe3300cf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:43.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.549+0000 7fe335a00640 1 -- 172.21.15.123:0/2099712542 shutdown_connections 2024-04-25T13:42:43.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.549+0000 7fe335a00640 1 -- 172.21.15.123:0/2099712542 wait complete. 2024-04-25T13:42:43.569 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:41:53.602480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:42:03.949161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:42:04.755682+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:42:43.570 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:42:43.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.721+0000 7f3c2ca00640 1 Processor -- start 2024-04-25T13:42:43.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.721+0000 7f3c2ca00640 1 -- start start 2024-04-25T13:42:43.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.721+0000 7f3c2ca00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3c280b3870 0x7f3c280b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:43.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.721+0000 7f3c2ca00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3c28072af0 0x7f3c28072f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:43.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.721+0000 7f3c2ca00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c280b41c0 con 0x7f3c281571b0 2024-04-25T13:42:43.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.721+0000 7f3c2ca00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f3c280cdee0 con 0x7f3c280b3870 2024-04-25T13:42:43.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.721+0000 7f3c2ca00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f3c2815d570 con 0x7f3c28072af0 2024-04-25T13:42:43.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.721+0000 7f3c1d400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3c280b3870 0x7f3c280b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:43.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.721+0000 7f3c1d400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3c280b3870 0x7f3c280b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35208/0 (socket says 172.21.15.123:35208) 2024-04-25T13:42:43.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.721+0000 7f3c1d400640 1 -- 172.21.15.123:0/960628516 learned_addr learned my addr 172.21.15.123:0/960628516 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:43.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.721+0000 7f3c26800640 1 --2- 172.21.15.123:0/960628516 >> v2:172.21.15.130:3300/0 conn(0x7f3c28072af0 0x7f3c28072f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:43.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.721+0000 7f3c1d400640 1 -- 172.21.15.123:0/960628516 >> v2:172.21.15.130:3300/0 conn(0x7f3c28072af0 msgr2=0x7f3c28072f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:43.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.721+0000 7f3c1d400640 1 --2- 172.21.15.123:0/960628516 >> v2:172.21.15.130:3300/0 conn(0x7f3c28072af0 0x7f3c28072f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:43.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.721+0000 7f3c1d400640 1 -- 172.21.15.123:0/960628516 >> v1:172.21.15.130:6789/0 conn(0x7f3c281571b0 legacy=0x7f3c280cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:43.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.721+0000 7f3c1d400640 1 -- 172.21.15.123:0/960628516 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c2815d850 con 0x7f3c280b3870 2024-04-25T13:42:43.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.725+0000 7f3c1d400640 1 --2- 172.21.15.123:0/960628516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c280b3870 0x7f3c280b3c80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000bb10 tx=0x7f3c1001e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4231d0972024db25 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:43.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.725+0000 7f3c25400640 1 -- 172.21.15.123:0/960628516 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c100b4070 con 0x7f3c280b3870 2024-04-25T13:42:43.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.725+0000 7f3c25400640 1 -- 172.21.15.123:0/960628516 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c100a7900 con 0x7f3c280b3870 2024-04-25T13:42:43.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.725+0000 7f3c25400640 1 -- 172.21.15.123:0/960628516 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c100a7cd0 con 0x7f3c280b3870 2024-04-25T13:42:43.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.725+0000 7f3c2ca00640 1 -- 172.21.15.123:0/960628516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c280b3870 msgr2=0x7f3c280b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:43.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.725+0000 7f3c2ca00640 1 --2- 172.21.15.123:0/960628516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c280b3870 0x7f3c280b3c80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3c1000bb10 tx=0x7f3c1001e910 comp rx=0 tx=0).stop 2024-04-25T13:42:43.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.725+0000 7f3c2ca00640 1 -- 172.21.15.123:0/960628516 shutdown_connections 2024-04-25T13:42:43.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.725+0000 7f3c2ca00640 1 --2- 172.21.15.123:0/960628516 >> v2:172.21.15.130:3300/0 conn(0x7f3c28072af0 0x7f3c28072f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:43.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.725+0000 7f3c2ca00640 1 --2- 172.21.15.123:0/960628516 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c280b3870 0x7f3c280b3c80 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:43.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.725+0000 7f3c2ca00640 1 -- 172.21.15.123:0/960628516 >> 172.21.15.123:0/960628516 conn(0x7f3c2806ca70 msgr2=0x7f3c2806ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:43.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.725+0000 7f3c2ca00640 1 -- 172.21.15.123:0/960628516 shutdown_connections 2024-04-25T13:42:43.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.725+0000 7f3c2ca00640 1 -- 172.21.15.123:0/960628516 wait complete. 2024-04-25T13:42:43.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.729+0000 7f3c2ca00640 1 Processor -- start 2024-04-25T13:42:43.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.729+0000 7f3c2ca00640 1 -- start start 2024-04-25T13:42:43.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.729+0000 7f3c2ca00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c28072af0 0x7f3c28144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:43.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.729+0000 7f3c2ca00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c280b3870 0x7f3c28142e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:43.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.729+0000 7f3c2ca00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c281571b0 0x7f3c280cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:43.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.729+0000 7f3c2ca00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3c28157740 con 0x7f3c281571b0 2024-04-25T13:42:43.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.729+0000 7f3c2ca00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3c281575c0 con 0x7f3c280b3870 2024-04-25T13:42:43.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.729+0000 7f3c2ca00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3c28073850 con 0x7f3c28072af0 2024-04-25T13:42:43.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.729+0000 7f3c26800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c281571b0 0x7f3c280cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:43.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.729+0000 7f3c26800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c281571b0 0x7f3c280cc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35224/0 (socket says 172.21.15.123:35224) 2024-04-25T13:42:43.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.729+0000 7f3c26800640 1 -- 172.21.15.123:0/3931411182 learned_addr learned my addr 172.21.15.123:0/3931411182 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:43.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.729+0000 7f3c1d400640 1 --2- 172.21.15.123:0/3931411182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c280b3870 0x7f3c28142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:43.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.729+0000 7f3c25e00640 1 --2- 172.21.15.123:0/3931411182 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c28072af0 0x7f3c28144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:43.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.729+0000 7f3c26800640 1 -- 172.21.15.123:0/3931411182 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c28072af0 msgr2=0x7f3c28144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:43.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.729+0000 7f3c26800640 1 --2- 172.21.15.123:0/3931411182 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c28072af0 0x7f3c28144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:43.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.729+0000 7f3c26800640 1 -- 172.21.15.123:0/3931411182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c280b3870 msgr2=0x7f3c28142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:43.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.729+0000 7f3c26800640 1 --2- 172.21.15.123:0/3931411182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c280b3870 0x7f3c28142e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:43.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.729+0000 7f3c26800640 1 -- 172.21.15.123:0/3931411182 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c28145420 con 0x7f3c281571b0 2024-04-25T13:42:43.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.729+0000 7f3c26800640 1 --2- 172.21.15.123:0/3931411182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c281571b0 0x7f3c280cc330 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000d550 tx=0x7f3c2000da10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:43.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.733+0000 7f3c1ea00640 1 -- 172.21.15.123:0/3931411182 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c200125f0 con 0x7f3c281571b0 2024-04-25T13:42:43.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.733+0000 7f3c1ea00640 1 -- 172.21.15.123:0/3931411182 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c20019070 con 0x7f3c281571b0 2024-04-25T13:42:43.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.733+0000 7f3c1ea00640 1 -- 172.21.15.123:0/3931411182 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c200129d0 con 0x7f3c281571b0 2024-04-25T13:42:43.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.733+0000 7f3c2ca00640 1 -- 172.21.15.123:0/3931411182 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c28145700 con 0x7f3c281571b0 2024-04-25T13:42:43.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.733+0000 7f3c2ca00640 1 -- 172.21.15.123:0/3931411182 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c28145cc0 con 0x7f3c281571b0 2024-04-25T13:42:43.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.733+0000 7f3c2ca00640 1 -- 172.21.15.123:0/3931411182 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c28050750 con 0x7f3c281571b0 2024-04-25T13:42:43.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.733+0000 7f3c1ea00640 1 -- 172.21.15.123:0/3931411182 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3c20012b70 con 0x7f3c281571b0 2024-04-25T13:42:43.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.733+0000 7f3c1ea00640 1 --2- 172.21.15.123:0/3931411182 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3c0406f430 0x7f3c04071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:43.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.733+0000 7f3c1ea00640 1 -- 172.21.15.123:0/3931411182 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3c2008f510 con 0x7f3c281571b0 2024-04-25T13:42:43.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.733+0000 7f3c25e00640 1 --2- 172.21.15.123:0/3931411182 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3c0406f430 0x7f3c04071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:43.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.737+0000 7f3c25e00640 1 --2- 172.21.15.123:0/3931411182 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3c0406f430 0x7f3c04071940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3c28070f70 tx=0x7f3c1800d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:43.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.737+0000 7f3c1ea00640 1 -- 172.21.15.123:0/3931411182 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3c2005bda0 con 0x7f3c281571b0 2024-04-25T13:42:43.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.897+0000 7f3c2ca00640 1 -- 172.21.15.123:0/3931411182 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3c28074cc0 con 0x7f3c281571b0 2024-04-25T13:42:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.897+0000 7f3c1ea00640 1 -- 172.21.15.123:0/3931411182 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f3c200600a0 con 0x7f3c281571b0 2024-04-25T13:42:43.898 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-04-25T13:42:43.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.901+0000 7f3c2ca00640 1 -- 172.21.15.123:0/3931411182 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3c0406f430 msgr2=0x7f3c04071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:43.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.901+0000 7f3c2ca00640 1 --2- 172.21.15.123:0/3931411182 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3c0406f430 0x7f3c04071940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3c28070f70 tx=0x7f3c1800d040 comp rx=0 tx=0).stop 2024-04-25T13:42:43.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.901+0000 7f3c2ca00640 1 -- 172.21.15.123:0/3931411182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c281571b0 msgr2=0x7f3c280cc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:43.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.901+0000 7f3c2ca00640 1 --2- 172.21.15.123:0/3931411182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c281571b0 0x7f3c280cc330 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000d550 tx=0x7f3c2000da10 comp rx=0 tx=0).stop 2024-04-25T13:42:43.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.901+0000 7f3c2ca00640 1 -- 172.21.15.123:0/3931411182 shutdown_connections 2024-04-25T13:42:43.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.901+0000 7f3c2ca00640 1 --2- 172.21.15.123:0/3931411182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c280b3870 0x7f3c28142e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:43.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.901+0000 7f3c2ca00640 1 --2- 172.21.15.123:0/3931411182 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3c0406f430 0x7f3c04071940 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:43.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.901+0000 7f3c2ca00640 1 --2- 172.21.15.123:0/3931411182 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c281571b0 0x7f3c280cc330 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:43.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.901+0000 7f3c2ca00640 1 --2- 172.21.15.123:0/3931411182 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c28072af0 0x7f3c28144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:43.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.901+0000 7f3c2ca00640 1 -- 172.21.15.123:0/3931411182 >> 172.21.15.123:0/3931411182 conn(0x7f3c2806ca70 msgr2=0x7f3c2815f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:43.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.901+0000 7f3c2ca00640 1 -- 172.21.15.123:0/3931411182 shutdown_connections 2024-04-25T13:42:43.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:43.901+0000 7f3c2ca00640 1 -- 172.21.15.123:0/3931411182 wait complete. 2024-04-25T13:42:43.920 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:42:44.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.069+0000 7f13dce00640 1 Processor -- start 2024-04-25T13:42:44.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.069+0000 7f13dce00640 1 -- start start 2024-04-25T13:42:44.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.069+0000 7f13dce00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f13d81571b0 0x7f13d80cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:44.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.069+0000 7f13dce00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f13d80b3870 0x7f13d80b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:44.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.069+0000 7f13dce00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13d80b4770 0x7f13d80b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:44.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.069+0000 7f13dce00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f13d80b41c0 con 0x7f13d81571b0 2024-04-25T13:42:44.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.069+0000 7f13dce00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f13d80cdee0 con 0x7f13d80b3870 2024-04-25T13:42:44.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.069+0000 7f13dce00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f13d815d570 con 0x7f13d80b4770 2024-04-25T13:42:44.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.069+0000 7f13d5e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f13d81571b0 0x7f13d80cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:44.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.069+0000 7f13d5e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f13d81571b0 0x7f13d80cd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35230/0 (socket says 172.21.15.123:35230) 2024-04-25T13:42:44.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.069+0000 7f13d5e00640 1 -- 172.21.15.123:0/666474602 learned_addr learned my addr 172.21.15.123:0/666474602 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:44.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.069+0000 7f13cd400640 1 --2- 172.21.15.123:0/666474602 >> v2:172.21.15.130:3300/0 conn(0x7f13d80b3870 0x7f13d80b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:44.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.069+0000 7f13d6800640 1 --2- 172.21.15.123:0/666474602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13d80b4770 0x7f13d80b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:44.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.069+0000 7f13d5e00640 1 -- 172.21.15.123:0/666474602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13d80b4770 msgr2=0x7f13d80b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:44.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.069+0000 7f13d5e00640 1 --2- 172.21.15.123:0/666474602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13d80b4770 0x7f13d80b4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.069+0000 7f13d5e00640 1 -- 172.21.15.123:0/666474602 >> v2:172.21.15.130:3300/0 conn(0x7f13d80b3870 msgr2=0x7f13d80b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:44.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.069+0000 7f13d5e00640 1 --2- 172.21.15.123:0/666474602 >> v2:172.21.15.130:3300/0 conn(0x7f13d80b3870 0x7f13d80b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.069+0000 7f13d5e00640 1 -- 172.21.15.123:0/666474602 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d815d850 con 0x7f13d81571b0 2024-04-25T13:42:44.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.073+0000 7f13d5e00640 1 --2- 172.21.15.123:0/666474602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13d81571b0 0x7f13d80cd6b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f13d80c7720 tx=0x7f13c801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17fe0757ed669d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:44.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.073+0000 7f13d5400640 1 -- 172.21.15.123:0/666474602 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c80ab600 con 0x7f13d81571b0 2024-04-25T13:42:44.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.073+0000 7f13d5400640 1 -- 172.21.15.123:0/666474602 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13c80b0070 con 0x7f13d81571b0 2024-04-25T13:42:44.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.073+0000 7f13d5400640 1 -- 172.21.15.123:0/666474602 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c80ab9c0 con 0x7f13d81571b0 2024-04-25T13:42:44.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.073+0000 7f13dce00640 1 -- 172.21.15.123:0/666474602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13d81571b0 msgr2=0x7f13d80cd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:44.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.073+0000 7f13dce00640 1 --2- 172.21.15.123:0/666474602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13d81571b0 0x7f13d80cd6b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f13d80c7720 tx=0x7f13c801c460 comp rx=0 tx=0).stop 2024-04-25T13:42:44.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.073+0000 7f13dce00640 1 -- 172.21.15.123:0/666474602 shutdown_connections 2024-04-25T13:42:44.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.073+0000 7f13dce00640 1 --2- 172.21.15.123:0/666474602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13d80b4770 0x7f13d80b4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.073+0000 7f13dce00640 1 --2- 172.21.15.123:0/666474602 >> v2:172.21.15.130:3300/0 conn(0x7f13d80b3870 0x7f13d80b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.073+0000 7f13dce00640 1 --2- 172.21.15.123:0/666474602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13d81571b0 0x7f13d80cd6b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.073+0000 7f13dce00640 1 -- 172.21.15.123:0/666474602 >> 172.21.15.123:0/666474602 conn(0x7f13d806ca70 msgr2=0x7f13d806ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:44.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.073+0000 7f13dce00640 1 -- 172.21.15.123:0/666474602 shutdown_connections 2024-04-25T13:42:44.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.073+0000 7f13dce00640 1 -- 172.21.15.123:0/666474602 wait complete. 2024-04-25T13:42:44.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.077+0000 7f13dce00640 1 Processor -- start 2024-04-25T13:42:44.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.077+0000 7f13dce00640 1 -- start start 2024-04-25T13:42:44.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.077+0000 7f13dce00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13d80b3870 0x7f13d81f9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:44.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.077+0000 7f13dce00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13d80b4770 0x7f13d814a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:44.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.077+0000 7f13dce00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13d81571b0 0x7f13d814c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:44.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.077+0000 7f13dce00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f13d815e050 con 0x7f13d81571b0 2024-04-25T13:42:44.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.077+0000 7f13dce00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f13d80b54d0 con 0x7f13d80b4770 2024-04-25T13:42:44.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.077+0000 7f13dce00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f13d81fa210 con 0x7f13d80b3870 2024-04-25T13:42:44.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.077+0000 7f13d6800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13d81571b0 0x7f13d814c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:44.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.077+0000 7f13d6800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13d81571b0 0x7f13d814c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35244/0 (socket says 172.21.15.123:35244) 2024-04-25T13:42:44.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.077+0000 7f13d6800640 1 -- 172.21.15.123:0/3962933273 learned_addr learned my addr 172.21.15.123:0/3962933273 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:44.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.077+0000 7f13cd400640 1 --2- 172.21.15.123:0/3962933273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13d80b4770 0x7f13d814a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:44.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.077+0000 7f13d5e00640 1 --2- 172.21.15.123:0/3962933273 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13d80b3870 0x7f13d81f9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:44.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.081+0000 7f13d6800640 1 -- 172.21.15.123:0/3962933273 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13d80b3870 msgr2=0x7f13d81f9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:44.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.081+0000 7f13d6800640 1 --2- 172.21.15.123:0/3962933273 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13d80b3870 0x7f13d81f9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.081+0000 7f13d6800640 1 -- 172.21.15.123:0/3962933273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13d80b4770 msgr2=0x7f13d814a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:44.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.081+0000 7f13d6800640 1 --2- 172.21.15.123:0/3962933273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13d80b4770 0x7f13d814a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.081+0000 7f13d6800640 1 -- 172.21.15.123:0/3962933273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d814c300 con 0x7f13d81571b0 2024-04-25T13:42:44.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.081+0000 7f13d6800640 1 --2- 172.21.15.123:0/3962933273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13d81571b0 0x7f13d814c7e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f13d0009fd0 tx=0x7f13d000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:44.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.081+0000 7f13cea00640 1 -- 172.21.15.123:0/3962933273 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d0014420 con 0x7f13d81571b0 2024-04-25T13:42:44.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.081+0000 7f13cea00640 1 -- 172.21.15.123:0/3962933273 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d0019070 con 0x7f13d81571b0 2024-04-25T13:42:44.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.081+0000 7f13cea00640 1 -- 172.21.15.123:0/3962933273 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d0014800 con 0x7f13d81571b0 2024-04-25T13:42:44.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.081+0000 7f13dce00640 1 -- 172.21.15.123:0/3962933273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13d81503f0 con 0x7f13d81571b0 2024-04-25T13:42:44.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.081+0000 7f13dce00640 1 -- 172.21.15.123:0/3962933273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13d81509b0 con 0x7f13d81571b0 2024-04-25T13:42:44.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.081+0000 7f13dce00640 1 -- 172.21.15.123:0/3962933273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13d8050750 con 0x7f13d81571b0 2024-04-25T13:42:44.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.081+0000 7f13cea00640 1 -- 172.21.15.123:0/3962933273 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f13d00149a0 con 0x7f13d81571b0 2024-04-25T13:42:44.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.081+0000 7f13cea00640 1 --2- 172.21.15.123:0/3962933273 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f13b406f430 0x7f13b4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:44.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.081+0000 7f13cea00640 1 -- 172.21.15.123:0/3962933273 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f13d008fa10 con 0x7f13d81571b0 2024-04-25T13:42:44.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.085+0000 7f13d5e00640 1 --2- 172.21.15.123:0/3962933273 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f13b406f430 0x7f13b4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:44.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.085+0000 7f13d5e00640 1 --2- 172.21.15.123:0/3962933273 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f13b406f430 0x7f13b4071940 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f13c80af000 tx=0x7f13c80a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:44.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.089+0000 7f13cea00640 1 -- 172.21.15.123:0/3962933273 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f13d005c210 con 0x7f13d81571b0 2024-04-25T13:42:44.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.241+0000 7f13dce00640 1 -- 172.21.15.123:0/3962933273 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f13d8074cc0 con 0x7f13d81571b0 2024-04-25T13:42:44.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.241+0000 7f13cea00640 1 -- 172.21.15.123:0/3962933273 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f13d0060510 con 0x7f13d81571b0 2024-04-25T13:42:44.243 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-04-25T13:42:44.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.245+0000 7f13dce00640 1 -- 172.21.15.123:0/3962933273 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f13b406f430 msgr2=0x7f13b4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:44.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.245+0000 7f13dce00640 1 --2- 172.21.15.123:0/3962933273 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f13b406f430 0x7f13b4071940 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f13c80af000 tx=0x7f13c80a7000 comp rx=0 tx=0).stop 2024-04-25T13:42:44.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.245+0000 7f13dce00640 1 -- 172.21.15.123:0/3962933273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13d81571b0 msgr2=0x7f13d814c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:44.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.245+0000 7f13dce00640 1 --2- 172.21.15.123:0/3962933273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13d81571b0 0x7f13d814c7e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f13d0009fd0 tx=0x7f13d000e4b0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.245+0000 7f13dce00640 1 -- 172.21.15.123:0/3962933273 shutdown_connections 2024-04-25T13:42:44.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.245+0000 7f13dce00640 1 --2- 172.21.15.123:0/3962933273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f13d80b4770 0x7f13d814a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.245+0000 7f13dce00640 1 --2- 172.21.15.123:0/3962933273 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f13b406f430 0x7f13b4071940 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.245+0000 7f13dce00640 1 --2- 172.21.15.123:0/3962933273 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f13d81571b0 0x7f13d814c7e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.245+0000 7f13dce00640 1 --2- 172.21.15.123:0/3962933273 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13d80b3870 0x7f13d81f9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.245+0000 7f13dce00640 1 -- 172.21.15.123:0/3962933273 >> 172.21.15.123:0/3962933273 conn(0x7f13d806ca70 msgr2=0x7f13d8156590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:44.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.245+0000 7f13dce00640 1 -- 172.21.15.123:0/3962933273 shutdown_connections 2024-04-25T13:42:44.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.245+0000 7f13dce00640 1 -- 172.21.15.123:0/3962933273 wait complete. 2024-04-25T13:42:44.264 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:42:44.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.409+0000 7f3d96400640 1 Processor -- start 2024-04-25T13:42:44.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.409+0000 7f3d96400640 1 -- start start 2024-04-25T13:42:44.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.413+0000 7f3d96400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3d900b3870 0x7f3d900b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:44.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.413+0000 7f3d96400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d9015de80 0x7f3d9015e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:44.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.413+0000 7f3d96400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d900b41c0 con 0x7f3d900ceac0 2024-04-25T13:42:44.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.413+0000 7f3d96400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f3d900c7140 con 0x7f3d900b3870 2024-04-25T13:42:44.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.413+0000 7f3d96400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3d900cf060 con 0x7f3d9015de80 2024-04-25T13:42:44.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.413+0000 7f3d86a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3d900b3870 0x7f3d900b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:44.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.413+0000 7f3d86a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3d900b3870 0x7f3d900b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35248/0 (socket says 172.21.15.123:35248) 2024-04-25T13:42:44.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.413+0000 7f3d86a00640 1 -- 172.21.15.123:0/3769973324 learned_addr learned my addr 172.21.15.123:0/3769973324 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:44.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.413+0000 7f3d8fe00640 1 --2- 172.21.15.123:0/3769973324 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d9015de80 0x7f3d9015e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:44.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.413+0000 7f3d86a00640 1 -- 172.21.15.123:0/3769973324 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d9015de80 msgr2=0x7f3d9015e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:44.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.413+0000 7f3d86a00640 1 --2- 172.21.15.123:0/3769973324 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d9015de80 0x7f3d9015e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.413+0000 7f3d86a00640 1 -- 172.21.15.123:0/3769973324 >> v1:172.21.15.130:6789/0 conn(0x7f3d900ceac0 legacy=0x7f3d900c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:44.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.413+0000 7f3d86a00640 1 -- 172.21.15.123:0/3769973324 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d900c6810 con 0x7f3d900b3870 2024-04-25T13:42:44.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.417+0000 7f3d86a00640 1 --2- 172.21.15.123:0/3769973324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d900b3870 0x7f3d900b3c80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009870 tx=0x7f3d7801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bbb1d1d03fd01f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:44.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.417+0000 7f3d8ea00640 1 -- 172.21.15.123:0/3769973324 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d780aa600 con 0x7f3d900b3870 2024-04-25T13:42:44.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.417+0000 7f3d8ea00640 1 -- 172.21.15.123:0/3769973324 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d780af070 con 0x7f3d900b3870 2024-04-25T13:42:44.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.417+0000 7f3d8ea00640 1 -- 172.21.15.123:0/3769973324 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d780aa9c0 con 0x7f3d900b3870 2024-04-25T13:42:44.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.417+0000 7f3d96400640 1 -- 172.21.15.123:0/3769973324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d900b3870 msgr2=0x7f3d900b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:44.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.417+0000 7f3d96400640 1 --2- 172.21.15.123:0/3769973324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d900b3870 0x7f3d900b3c80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009870 tx=0x7f3d7801c4a0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.417+0000 7f3d96400640 1 -- 172.21.15.123:0/3769973324 shutdown_connections 2024-04-25T13:42:44.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.417+0000 7f3d96400640 1 --2- 172.21.15.123:0/3769973324 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d9015de80 0x7f3d9015e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.417+0000 7f3d96400640 1 --2- 172.21.15.123:0/3769973324 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d900b3870 0x7f3d900b3c80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.417+0000 7f3d96400640 1 -- 172.21.15.123:0/3769973324 >> 172.21.15.123:0/3769973324 conn(0x7f3d9006ca70 msgr2=0x7f3d9006ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:44.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.417+0000 7f3d96400640 1 -- 172.21.15.123:0/3769973324 shutdown_connections 2024-04-25T13:42:44.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.417+0000 7f3d96400640 1 -- 172.21.15.123:0/3769973324 wait complete. 2024-04-25T13:42:44.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.421+0000 7f3d96400640 1 Processor -- start 2024-04-25T13:42:44.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.421+0000 7f3d96400640 1 -- start start 2024-04-25T13:42:44.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.421+0000 7f3d96400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d900b3870 0x7f3d900731c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:44.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.421+0000 7f3d96400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d900ceac0 0x7f3d9015c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:44.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.421+0000 7f3d96400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d9015de80 0x7f3d9014ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:44.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.421+0000 7f3d96400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9016aae0 con 0x7f3d900ceac0 2024-04-25T13:42:44.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.421+0000 7f3d96400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9016a960 con 0x7f3d900b3870 2024-04-25T13:42:44.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.421+0000 7f3d96400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3d9016ac60 con 0x7f3d9015de80 2024-04-25T13:42:44.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.421+0000 7f3d86a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d900ceac0 0x7f3d9015c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:44.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.421+0000 7f3d86a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d900ceac0 0x7f3d9015c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35252/0 (socket says 172.21.15.123:35252) 2024-04-25T13:42:44.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.421+0000 7f3d86a00640 1 -- 172.21.15.123:0/463173781 learned_addr learned my addr 172.21.15.123:0/463173781 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:44.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.421+0000 7f3d8f400640 1 --2- 172.21.15.123:0/463173781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d900b3870 0x7f3d900731c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:44.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.421+0000 7f3d8fe00640 1 --2- 172.21.15.123:0/463173781 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d9015de80 0x7f3d9014ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:44.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.421+0000 7f3d86a00640 1 -- 172.21.15.123:0/463173781 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d9015de80 msgr2=0x7f3d9014ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:44.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.421+0000 7f3d86a00640 1 --2- 172.21.15.123:0/463173781 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d9015de80 0x7f3d9014ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.421+0000 7f3d86a00640 1 -- 172.21.15.123:0/463173781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d900b3870 msgr2=0x7f3d900731c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:44.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.421+0000 7f3d86a00640 1 --2- 172.21.15.123:0/463173781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d900b3870 0x7f3d900731c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.421+0000 7f3d86a00640 1 -- 172.21.15.123:0/463173781 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d90073700 con 0x7f3d900ceac0 2024-04-25T13:42:44.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.421+0000 7f3d86a00640 1 --2- 172.21.15.123:0/463173781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d900ceac0 0x7f3d9015c880 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3d7801ab50 tx=0x7f3d7801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:44.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.421+0000 7f3d87e00640 1 -- 172.21.15.123:0/463173781 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d780bd5f0 con 0x7f3d900ceac0 2024-04-25T13:42:44.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.421+0000 7f3d87e00640 1 -- 172.21.15.123:0/463173781 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d780bd7b0 con 0x7f3d900ceac0 2024-04-25T13:42:44.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.421+0000 7f3d87e00640 1 -- 172.21.15.123:0/463173781 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d780bdba0 con 0x7f3d900ceac0 2024-04-25T13:42:44.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.421+0000 7f3d96400640 1 -- 172.21.15.123:0/463173781 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d9015bac0 con 0x7f3d900ceac0 2024-04-25T13:42:44.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.421+0000 7f3d96400640 1 -- 172.21.15.123:0/463173781 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d9015c080 con 0x7f3d900ceac0 2024-04-25T13:42:44.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.425+0000 7f3d96400640 1 -- 172.21.15.123:0/463173781 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d901fdce0 con 0x7f3d900ceac0 2024-04-25T13:42:44.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.425+0000 7f3d87e00640 1 -- 172.21.15.123:0/463173781 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3d780a9070 con 0x7f3d900ceac0 2024-04-25T13:42:44.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.425+0000 7f3d87e00640 1 --2- 172.21.15.123:0/463173781 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3d6c06f400 0x7f3d6c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:44.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.425+0000 7f3d87e00640 1 -- 172.21.15.123:0/463173781 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3d78129210 con 0x7f3d900ceac0 2024-04-25T13:42:44.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.425+0000 7f3d8f400640 1 --2- 172.21.15.123:0/463173781 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3d6c06f400 0x7f3d6c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:44.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.425+0000 7f3d8f400640 1 --2- 172.21.15.123:0/463173781 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3d6c06f400 0x7f3d6c071910 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3d80001770 tx=0x7f3d80009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:44.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.429+0000 7f3d87e00640 1 -- 172.21.15.123:0/463173781 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3d78016150 con 0x7f3d900ceac0 2024-04-25T13:42:44.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.589+0000 7f3d96400640 1 -- 172.21.15.123:0/463173781 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3d9006d600 con 0x7f3d900ceac0 2024-04-25T13:42:44.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.589+0000 7f3d87e00640 1 -- 172.21.15.123:0/463173781 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f3d780f5aa0 con 0x7f3d900ceac0 2024-04-25T13:42:44.590 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-04-25T13:42:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.589+0000 7f3d96400640 1 -- 172.21.15.123:0/463173781 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3d6c06f400 msgr2=0x7f3d6c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.589+0000 7f3d96400640 1 --2- 172.21.15.123:0/463173781 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3d6c06f400 0x7f3d6c071910 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3d80001770 tx=0x7f3d80009040 comp rx=0 tx=0).stop 2024-04-25T13:42:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.589+0000 7f3d96400640 1 -- 172.21.15.123:0/463173781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d900ceac0 msgr2=0x7f3d9015c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.589+0000 7f3d96400640 1 --2- 172.21.15.123:0/463173781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d900ceac0 0x7f3d9015c880 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3d7801ab50 tx=0x7f3d7801ace0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.593+0000 7f3d96400640 1 -- 172.21.15.123:0/463173781 shutdown_connections 2024-04-25T13:42:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.593+0000 7f3d96400640 1 --2- 172.21.15.123:0/463173781 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3d6c06f400 0x7f3d6c071910 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.593+0000 7f3d96400640 1 --2- 172.21.15.123:0/463173781 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d9015de80 0x7f3d9014ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.593+0000 7f3d96400640 1 --2- 172.21.15.123:0/463173781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3d900ceac0 0x7f3d9015c880 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.593+0000 7f3d96400640 1 --2- 172.21.15.123:0/463173781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d900b3870 0x7f3d900731c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.593+0000 7f3d96400640 1 -- 172.21.15.123:0/463173781 >> 172.21.15.123:0/463173781 conn(0x7f3d9006ca70 msgr2=0x7f3d900687a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:44.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.593+0000 7f3d96400640 1 -- 172.21.15.123:0/463173781 shutdown_connections 2024-04-25T13:42:44.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.593+0000 7f3d96400640 1 -- 172.21.15.123:0/463173781 wait complete. 2024-04-25T13:42:44.612 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:42:44.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.757+0000 7f911b600640 1 Processor -- start 2024-04-25T13:42:44.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.757+0000 7f911b600640 1 -- start start 2024-04-25T13:42:44.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.761+0000 7f911b600640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f91140ceac0 0x7f91140c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:44.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.761+0000 7f911b600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f91140b3870 0x7f91140b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:44.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.761+0000 7f911b600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91140b5980 0x7f91140b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:44.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.761+0000 7f911b600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f91140c7140 con 0x7f91140b3870 2024-04-25T13:42:44.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.761+0000 7f911b600640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f91140cf060 con 0x7f91140ceac0 2024-04-25T13:42:44.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.761+0000 7f911b600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f91140b41c0 con 0x7f91140b5980 2024-04-25T13:42:44.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.761+0000 7f910be00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f91140b3870 0x7f91140b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:44.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.761+0000 7f910be00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f91140b3870 0x7f91140b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35258/0 (socket says 172.21.15.123:35258) 2024-04-25T13:42:44.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.761+0000 7f910be00640 1 -- 172.21.15.123:0/3328588396 learned_addr learned my addr 172.21.15.123:0/3328588396 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:44.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.761+0000 7f9118c00640 1 --2- 172.21.15.123:0/3328588396 >> v2:172.21.15.130:3300/0 conn(0x7f91140ceac0 0x7f91140c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:44.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.761+0000 7f9119600640 1 --2- 172.21.15.123:0/3328588396 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91140b5980 0x7f91140b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:44.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.761+0000 7f910be00640 1 -- 172.21.15.123:0/3328588396 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91140b5980 msgr2=0x7f91140b5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:44.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.761+0000 7f910be00640 1 --2- 172.21.15.123:0/3328588396 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91140b5980 0x7f91140b5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.761+0000 7f910be00640 1 -- 172.21.15.123:0/3328588396 >> v2:172.21.15.130:3300/0 conn(0x7f91140ceac0 msgr2=0x7f91140c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:44.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.761+0000 7f910be00640 1 --2- 172.21.15.123:0/3328588396 >> v2:172.21.15.130:3300/0 conn(0x7f91140ceac0 0x7f91140c75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.761+0000 7f910be00640 1 -- 172.21.15.123:0/3328588396 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91140c7b10 con 0x7f91140b3870 2024-04-25T13:42:44.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.765+0000 7f910be00640 1 --2- 172.21.15.123:0/3328588396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91140b3870 0x7f91140b3c80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f91140b4370 tx=0x7f90fc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d7f2671b7a33a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:44.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.765+0000 7f9113e00640 1 -- 172.21.15.123:0/3328588396 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90fc0ab620 con 0x7f91140b3870 2024-04-25T13:42:44.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.765+0000 7f9113e00640 1 -- 172.21.15.123:0/3328588396 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90fc0b0070 con 0x7f91140b3870 2024-04-25T13:42:44.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.765+0000 7f9113e00640 1 -- 172.21.15.123:0/3328588396 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90fc0ab9e0 con 0x7f91140b3870 2024-04-25T13:42:44.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.765+0000 7f911b600640 1 -- 172.21.15.123:0/3328588396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91140b3870 msgr2=0x7f91140b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:44.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.765+0000 7f911b600640 1 --2- 172.21.15.123:0/3328588396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91140b3870 0x7f91140b3c80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f91140b4370 tx=0x7f90fc01c460 comp rx=0 tx=0).stop 2024-04-25T13:42:44.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.765+0000 7f911b600640 1 -- 172.21.15.123:0/3328588396 shutdown_connections 2024-04-25T13:42:44.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.765+0000 7f911b600640 1 --2- 172.21.15.123:0/3328588396 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91140b5980 0x7f91140b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.765+0000 7f911b600640 1 --2- 172.21.15.123:0/3328588396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91140b3870 0x7f91140b3c80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.765+0000 7f911b600640 1 --2- 172.21.15.123:0/3328588396 >> v2:172.21.15.130:3300/0 conn(0x7f91140ceac0 0x7f91140c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.765+0000 7f911b600640 1 -- 172.21.15.123:0/3328588396 >> 172.21.15.123:0/3328588396 conn(0x7f911406ca70 msgr2=0x7f911406ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:44.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.765+0000 7f911b600640 1 -- 172.21.15.123:0/3328588396 shutdown_connections 2024-04-25T13:42:44.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.765+0000 7f911b600640 1 -- 172.21.15.123:0/3328588396 wait complete. 2024-04-25T13:42:44.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.769+0000 7f911b600640 1 Processor -- start 2024-04-25T13:42:44.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.769+0000 7f911b600640 1 -- start start 2024-04-25T13:42:44.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.769+0000 7f911b600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91140b3870 0x7f911414daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:44.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.769+0000 7f911b600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f91140b5980 0x7f911414e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:44.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.769+0000 7f911b600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91140ceac0 0x7f9114140970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:44.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.769+0000 7f911b600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f91140b5110 con 0x7f91140b3870 2024-04-25T13:42:44.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.769+0000 7f911b600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f91140b66e0 con 0x7f91140b5980 2024-04-25T13:42:44.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.769+0000 7f911b600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f91140b5290 con 0x7f91140ceac0 2024-04-25T13:42:44.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.769+0000 7f9118c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91140b3870 0x7f911414daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:44.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.769+0000 7f9118c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91140b3870 0x7f911414daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35270/0 (socket says 172.21.15.123:35270) 2024-04-25T13:42:44.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.769+0000 7f9118c00640 1 -- 172.21.15.123:0/2336579443 learned_addr learned my addr 172.21.15.123:0/2336579443 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:44.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.769+0000 7f9119600640 1 --2- 172.21.15.123:0/2336579443 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91140ceac0 0x7f9114140970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:44.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.769+0000 7f910be00640 1 --2- 172.21.15.123:0/2336579443 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f91140b5980 0x7f911414e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:44.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.769+0000 7f9118c00640 1 -- 172.21.15.123:0/2336579443 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91140ceac0 msgr2=0x7f9114140970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:44.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.769+0000 7f9118c00640 1 --2- 172.21.15.123:0/2336579443 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91140ceac0 0x7f9114140970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.769+0000 7f9118c00640 1 -- 172.21.15.123:0/2336579443 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f91140b5980 msgr2=0x7f911414e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:44.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.769+0000 7f9118c00640 1 --2- 172.21.15.123:0/2336579443 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f91140b5980 0x7f911414e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.769+0000 7f9118c00640 1 -- 172.21.15.123:0/2336579443 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9114151860 con 0x7f91140b3870 2024-04-25T13:42:44.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.769+0000 7f9118c00640 1 --2- 172.21.15.123:0/2336579443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91140b3870 0x7f911414daa0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f910400d620 tx=0x7f910400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:44.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.769+0000 7f9111600640 1 -- 172.21.15.123:0/2336579443 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910400b620 con 0x7f91140b3870 2024-04-25T13:42:44.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.769+0000 7f9111600640 1 -- 172.21.15.123:0/2336579443 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9104019070 con 0x7f91140b3870 2024-04-25T13:42:44.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.769+0000 7f9111600640 1 -- 172.21.15.123:0/2336579443 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910400b9e0 con 0x7f91140b3870 2024-04-25T13:42:44.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.769+0000 7f911b600640 1 -- 172.21.15.123:0/2336579443 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9114073b70 con 0x7f91140b3870 2024-04-25T13:42:44.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.769+0000 7f911b600640 1 -- 172.21.15.123:0/2336579443 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9114074130 con 0x7f91140b3870 2024-04-25T13:42:44.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.773+0000 7f911b600640 1 -- 172.21.15.123:0/2336579443 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f911406d600 con 0x7f91140b3870 2024-04-25T13:42:44.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.773+0000 7f9111600640 1 -- 172.21.15.123:0/2336579443 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f910400bb80 con 0x7f91140b3870 2024-04-25T13:42:44.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.773+0000 7f9111600640 1 --2- 172.21.15.123:0/2336579443 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f90f006f400 0x7f90f0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:44.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.773+0000 7f9111600640 1 -- 172.21.15.123:0/2336579443 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f910408f810 con 0x7f91140b3870 2024-04-25T13:42:44.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.773+0000 7f910be00640 1 --2- 172.21.15.123:0/2336579443 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f90f006f400 0x7f90f0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:44.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.773+0000 7f910be00640 1 --2- 172.21.15.123:0/2336579443 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f90f006f400 0x7f90f0071910 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f90fc0af000 tx=0x7f90fc0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:44.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.777+0000 7f9111600640 1 -- 172.21.15.123:0/2336579443 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f910405c660 con 0x7f91140b3870 2024-04-25T13:42:44.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.945+0000 7f911b600640 1 -- 172.21.15.123:0/2336579443 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f91140cf810 con 0x7f91140b3870 2024-04-25T13:42:44.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.945+0000 7f9111600640 1 -- 172.21.15.123:0/2336579443 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f910405bf60 con 0x7f91140b3870 2024-04-25T13:42:44.947 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-04-25T13:42:44.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.949+0000 7f911b600640 1 -- 172.21.15.123:0/2336579443 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f90f006f400 msgr2=0x7f90f0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:44.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.949+0000 7f911b600640 1 --2- 172.21.15.123:0/2336579443 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f90f006f400 0x7f90f0071910 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f90fc0af000 tx=0x7f90fc0a7000 comp rx=0 tx=0).stop 2024-04-25T13:42:44.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.949+0000 7f911b600640 1 -- 172.21.15.123:0/2336579443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91140b3870 msgr2=0x7f911414daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:44.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.949+0000 7f911b600640 1 --2- 172.21.15.123:0/2336579443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91140b3870 0x7f911414daa0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f910400d620 tx=0x7f910400dae0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.949+0000 7f911b600640 1 -- 172.21.15.123:0/2336579443 shutdown_connections 2024-04-25T13:42:44.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.949+0000 7f911b600640 1 --2- 172.21.15.123:0/2336579443 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f91140b5980 0x7f911414e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.949+0000 7f911b600640 1 --2- 172.21.15.123:0/2336579443 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f90f006f400 0x7f90f0071910 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.949+0000 7f911b600640 1 --2- 172.21.15.123:0/2336579443 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91140ceac0 0x7f9114140970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.949+0000 7f911b600640 1 --2- 172.21.15.123:0/2336579443 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91140b3870 0x7f911414daa0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:44.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.949+0000 7f911b600640 1 -- 172.21.15.123:0/2336579443 >> 172.21.15.123:0/2336579443 conn(0x7f911406ca70 msgr2=0x7f91141545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:44.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.949+0000 7f911b600640 1 -- 172.21.15.123:0/2336579443 shutdown_connections 2024-04-25T13:42:44.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:44.949+0000 7f911b600640 1 -- 172.21.15.123:0/2336579443 wait complete. 2024-04-25T13:42:44.968 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-25T13:42:44.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:44.968 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-04-25T13:42:44.990 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-04-25T13:42:44.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:44.991 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-25T13:42:45.044 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:42:45.044 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:42:45.054 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:42:45.054 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:42:45.108 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:42:45.108 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:42:45.164 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:45.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.309+0000 7f46bfa00640 1 Processor -- start 2024-04-25T13:42:45.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.309+0000 7f46bfa00640 1 -- start start 2024-04-25T13:42:45.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46bfa00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46b80b32f0 0x7f46b80b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:45.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46bfa00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f46b80b4660 0x7f46b80b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:45.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46bfa00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46b80b3c40 con 0x7f46b8165310 2024-04-25T13:42:45.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46bfa00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f46b8072c00 con 0x7f46b80b4660 2024-04-25T13:42:45.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46bfa00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f46b8072ea0 con 0x7f46b80b32f0 2024-04-25T13:42:45.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46bd000640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f46b8165310 0x7f46b80b6130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54364/0 (socket says 172.21.15.123:54364) 2024-04-25T13:42:45.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46bd000640 1 -- 172.21.15.123:0/1421120271 learned_addr learned my addr 172.21.15.123:0/1421120271 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:45.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46bda00640 1 --2- 172.21.15.123:0/1421120271 >> v2:172.21.15.130:3300/0 conn(0x7f46b80b4660 0x7f46b80b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:45.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46afe00640 1 --2- 172.21.15.123:0/1421120271 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46b80b32f0 0x7f46b80b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:45.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46b7e00640 1 -- 172.21.15.123:0/1421120271 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2198950035 0 0) 0x7f46a8001120 con 0x7f46b8165310 2024-04-25T13:42:45.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46b7e00640 1 -- 172.21.15.123:0/1421120271 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f469c003530 con 0x7f46b8165310 2024-04-25T13:42:45.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46b7e00640 1 -- 172.21.15.123:0/1421120271 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3523803481 0 0) 0x7f469c003530 con 0x7f46b8165310 2024-04-25T13:42:45.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46b7e00640 1 -- 172.21.15.123:0/1421120271 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46b80b32f0 msgr2=0x7f46b80b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:45.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46b7e00640 1 --2- 172.21.15.123:0/1421120271 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46b80b32f0 0x7f46b80b3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:45.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46b7e00640 1 -- 172.21.15.123:0/1421120271 >> v2:172.21.15.130:3300/0 conn(0x7f46b80b4660 msgr2=0x7f46b80b4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:45.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46b7e00640 1 --2- 172.21.15.123:0/1421120271 >> v2:172.21.15.130:3300/0 conn(0x7f46b80b4660 0x7f46b80b4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:45.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46b7e00640 1 -- 172.21.15.123:0/1421120271 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b8073180 con 0x7f46b8165310 2024-04-25T13:42:45.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46b7e00640 1 -- 172.21.15.123:0/1421120271 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7f46a8001850 con 0x7f46b8165310 2024-04-25T13:42:45.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46b7e00640 1 -- 172.21.15.123:0/1421120271 >> v1:172.21.15.123:6789/0 conn(0x7f46b8165310 legacy=0x7f46b80b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:45.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46b7e00640 1 --2- 172.21.15.123:0/1421120271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f469c003a30 0x7f469c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:45.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46b7e00640 1 --2- 172.21.15.123:0/1421120271 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46b80b32f0 0x7f469c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:45.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46b7e00640 1 --2- 172.21.15.123:0/1421120271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f469c004d50 0x7f469c005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:45.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46b7e00640 1 -- 172.21.15.123:0/1421120271 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f46b8072c00 con 0x7f469c004d50 2024-04-25T13:42:45.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46b7e00640 1 -- 172.21.15.123:0/1421120271 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f46b8072ea0 con 0x7f469c003a30 2024-04-25T13:42:45.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46b7e00640 1 -- 172.21.15.123:0/1421120271 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f469c00bb00 con 0x7f46b80b32f0 2024-04-25T13:42:45.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46bda00640 1 --2- 172.21.15.123:0/1421120271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f469c004d50 0x7f469c005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:45.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46bd000640 1 --2- 172.21.15.123:0/1421120271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f469c003a30 0x7f469c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:45.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46afe00640 1 --2- 172.21.15.123:0/1421120271 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46b80b32f0 0x7f469c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:45.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46bda00640 1 -- 172.21.15.123:0/1421120271 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46b80b32f0 msgr2=0x7f469c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:45.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46bda00640 1 --2- 172.21.15.123:0/1421120271 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46b80b32f0 0x7f469c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:45.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46bda00640 1 -- 172.21.15.123:0/1421120271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f469c003a30 msgr2=0x7f469c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:45.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46bda00640 1 --2- 172.21.15.123:0/1421120271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f469c003a30 0x7f469c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:45.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.313+0000 7f46bda00640 1 -- 172.21.15.123:0/1421120271 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f469c003530 con 0x7f469c004d50 2024-04-25T13:42:45.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.317+0000 7f46bda00640 1 --2- 172.21.15.123:0/1421120271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f469c004d50 0x7f469c005160 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f46b0009fc0 tx=0x7f46b001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361594ee2d73d338 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:45.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.317+0000 7f46b7e00640 1 -- 172.21.15.123:0/1421120271 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b00b2070 con 0x7f469c004d50 2024-04-25T13:42:45.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.317+0000 7f46b7e00640 1 -- 172.21.15.123:0/1421120271 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b00a5bc0 con 0x7f469c004d50 2024-04-25T13:42:45.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.317+0000 7f46b7e00640 1 -- 172.21.15.123:0/1421120271 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b0009c10 con 0x7f469c004d50 2024-04-25T13:42:45.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.317+0000 7f46bfa00640 1 -- 172.21.15.123:0/1421120271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f469c004d50 msgr2=0x7f469c005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:45.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.317+0000 7f46bfa00640 1 --2- 172.21.15.123:0/1421120271 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f469c004d50 0x7f469c005160 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f46b0009fc0 tx=0x7f46b001ccc0 comp rx=0 tx=0).stop 2024-04-25T13:42:45.318 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.317+0000 7f46bda00640 1 -- 172.21.15.123:0/1421120271 reap_dead start 2024-04-25T13:42:45.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.317+0000 7f46bfa00640 1 -- 172.21.15.123:0/1421120271 shutdown_connections 2024-04-25T13:42:45.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.317+0000 7f46bfa00640 1 -- 172.21.15.123:0/1421120271 >> 172.21.15.123:0/1421120271 conn(0x7f46b806d210 msgr2=0x7f46b806ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:45.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.317+0000 7f46bfa00640 1 -- 172.21.15.123:0/1421120271 shutdown_connections 2024-04-25T13:42:45.319 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.317+0000 7f46bfa00640 1 -- 172.21.15.123:0/1421120271 wait complete. 2024-04-25T13:42:45.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.321+0000 7f46bfa00640 1 Processor -- start 2024-04-25T13:42:45.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.321+0000 7f46bfa00640 1 -- start start 2024-04-25T13:42:45.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.321+0000 7f46bfa00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46b80b53e0 0x7f46b80aa460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:45.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.321+0000 7f46bfa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46b815e910 0x7f46b80b1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:45.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.321+0000 7f46bfa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46b815ed20 0x7f46b80b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:45.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.321+0000 7f46bfa00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f46b8073980 con 0x7f46b815e910 2024-04-25T13:42:45.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.321+0000 7f46bfa00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f46b80b6a10 con 0x7f46b815ed20 2024-04-25T13:42:45.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.321+0000 7f46bfa00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f46b80aacb0 con 0x7f46b80b53e0 2024-04-25T13:42:45.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.321+0000 7f46afe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46b815e910 0x7f46b80b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:45.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.321+0000 7f46afe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46b815e910 0x7f46b80b1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35276/0 (socket says 172.21.15.123:35276) 2024-04-25T13:42:45.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.321+0000 7f46afe00640 1 -- 172.21.15.123:0/3679103350 learned_addr learned my addr 172.21.15.123:0/3679103350 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:45.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.321+0000 7f46bd000640 1 --2- 172.21.15.123:0/3679103350 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46b80b53e0 0x7f46b80aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:45.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.321+0000 7f46bda00640 1 --2- 172.21.15.123:0/3679103350 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46b815ed20 0x7f46b80b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:45.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.321+0000 7f46afe00640 1 -- 172.21.15.123:0/3679103350 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46b80b53e0 msgr2=0x7f46b80aa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:45.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.321+0000 7f46afe00640 1 --2- 172.21.15.123:0/3679103350 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46b80b53e0 0x7f46b80aa460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:45.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.321+0000 7f46afe00640 1 -- 172.21.15.123:0/3679103350 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46b815ed20 msgr2=0x7f46b80b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:45.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.321+0000 7f46afe00640 1 --2- 172.21.15.123:0/3679103350 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46b815ed20 0x7f46b80b1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:45.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.321+0000 7f46afe00640 1 -- 172.21.15.123:0/3679103350 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b80aaf90 con 0x7f46b815e910 2024-04-25T13:42:45.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.321+0000 7f46bda00640 1 --2- 172.21.15.123:0/3679103350 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46b815ed20 0x7f46b80b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:45.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.321+0000 7f46bd000640 1 --2- 172.21.15.123:0/3679103350 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46b80b53e0 0x7f46b80aa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:45.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.321+0000 7f46afe00640 1 --2- 172.21.15.123:0/3679103350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46b815e910 0x7f46b80b1600 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f46a00119d0 tx=0x7f46a0011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:45.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.321+0000 7f46b5600640 1 -- 172.21.15.123:0/3679103350 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a000fb50 con 0x7f46b815e910 2024-04-25T13:42:45.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.321+0000 7f46b5600640 1 -- 172.21.15.123:0/3679103350 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a000fcf0 con 0x7f46b815e910 2024-04-25T13:42:45.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.321+0000 7f46bfa00640 1 -- 172.21.15.123:0/3679103350 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b80ab270 con 0x7f46b815e910 2024-04-25T13:42:45.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.321+0000 7f46b5600640 1 -- 172.21.15.123:0/3679103350 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a000fea0 con 0x7f46b815e910 2024-04-25T13:42:45.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.321+0000 7f46bfa00640 1 -- 172.21.15.123:0/3679103350 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b80aa9a0 con 0x7f46b815e910 2024-04-25T13:42:45.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.325+0000 7f46bfa00640 1 -- 172.21.15.123:0/3679103350 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46b80507c0 con 0x7f46b815e910 2024-04-25T13:42:45.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.325+0000 7f46b5600640 1 -- 172.21.15.123:0/3679103350 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f46a0012040 con 0x7f46b815e910 2024-04-25T13:42:45.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.325+0000 7f46b5600640 1 --2- 172.21.15.123:0/3679103350 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f469406f400 0x7f4694071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:45.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.325+0000 7f46b5600640 1 -- 172.21.15.123:0/3679103350 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f46a008fa60 con 0x7f46b815e910 2024-04-25T13:42:45.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.325+0000 7f46bd000640 1 --2- 172.21.15.123:0/3679103350 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f469406f400 0x7f4694071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:45.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.325+0000 7f46bd000640 1 --2- 172.21.15.123:0/3679103350 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f469406f400 0x7f4694071910 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f46a8004850 tx=0x7f46a8007af0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:45.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.329+0000 7f46b5600640 1 -- 172.21.15.123:0/3679103350 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f46a0019030 con 0x7f46b815e910 2024-04-25T13:42:45.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.493+0000 7f46bfa00640 1 -- 172.21.15.123:0/3679103350 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f46b80741a0 con 0x7f46b815e910 2024-04-25T13:42:45.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.493+0000 7f46b5600640 1 -- 172.21.15.123:0/3679103350 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16629 (secure 0 0 0) 0x7f46a005ca00 con 0x7f46b815e910 2024-04-25T13:42:45.495 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:45.495 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":21,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:42:07.405529+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:03.949161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:04.755682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:45.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.493+0000 7f46bfa00640 1 -- 172.21.15.123:0/3679103350 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f469406f400 msgr2=0x7f4694071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:45.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.493+0000 7f46bfa00640 1 --2- 172.21.15.123:0/3679103350 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f469406f400 0x7f4694071910 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f46a8004850 tx=0x7f46a8007af0 comp rx=0 tx=0).stop 2024-04-25T13:42:45.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.493+0000 7f46bfa00640 1 -- 172.21.15.123:0/3679103350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46b815e910 msgr2=0x7f46b80b1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:45.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.493+0000 7f46bfa00640 1 --2- 172.21.15.123:0/3679103350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46b815e910 0x7f46b80b1600 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f46a00119d0 tx=0x7f46a0011e90 comp rx=0 tx=0).stop 2024-04-25T13:42:45.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.497+0000 7f46bfa00640 1 -- 172.21.15.123:0/3679103350 shutdown_connections 2024-04-25T13:42:45.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.497+0000 7f46bfa00640 1 --2- 172.21.15.123:0/3679103350 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46b815ed20 0x7f46b80b1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:45.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.497+0000 7f46bfa00640 1 --2- 172.21.15.123:0/3679103350 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f469406f400 0x7f4694071910 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:45.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.497+0000 7f46bfa00640 1 --2- 172.21.15.123:0/3679103350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f46b815e910 0x7f46b80b1600 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:45.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.497+0000 7f46bfa00640 1 --2- 172.21.15.123:0/3679103350 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46b80b53e0 0x7f46b80aa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:45.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.497+0000 7f46bfa00640 1 -- 172.21.15.123:0/3679103350 >> 172.21.15.123:0/3679103350 conn(0x7f46b806d210 msgr2=0x7f46b815fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:45.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.497+0000 7f46bfa00640 1 -- 172.21.15.123:0/3679103350 shutdown_connections 2024-04-25T13:42:45.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.497+0000 7f46bfa00640 1 -- 172.21.15.123:0/3679103350 wait complete. 2024-04-25T13:42:45.516 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:41:53.602480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:42:03.949161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:42:04.755682+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:42:45.516 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:42:45.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.665+0000 7f8813a00640 1 Processor -- start 2024-04-25T13:42:45.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.665+0000 7f8813a00640 1 -- start start 2024-04-25T13:42:45.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.669+0000 7f8813a00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f880c0cf3e0 0x7f880c0d0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:45.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.669+0000 7f8813a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f880c0cf7f0 0x7f880c0d0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:45.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.669+0000 7f8813a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f880c0ce660 con 0x7f880c0b8ea0 2024-04-25T13:42:45.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.669+0000 7f8813a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f880c0b92b0 con 0x7f880c0cf7f0 2024-04-25T13:42:45.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.669+0000 7f8813a00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f880c0ce430 con 0x7f880c0cf3e0 2024-04-25T13:42:45.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.669+0000 7f8811a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f880c0cf7f0 0x7f880c0d0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:45.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.669+0000 7f8811000640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f880c0b8ea0 0x7f880c0b28b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54378/0 (socket says 172.21.15.123:54378) 2024-04-25T13:42:45.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.669+0000 7f8811000640 1 -- 172.21.15.123:0/807588963 learned_addr learned my addr 172.21.15.123:0/807588963 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:45.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.669+0000 7f880be00640 1 --2- 172.21.15.123:0/807588963 >> v2:172.21.15.130:3300/0 conn(0x7f880c0cf3e0 0x7f880c0d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:45.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.669+0000 7f8811a00640 1 -- 172.21.15.123:0/807588963 >> v2:172.21.15.130:3300/0 conn(0x7f880c0cf3e0 msgr2=0x7f880c0d0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:45.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.669+0000 7f8811a00640 1 --2- 172.21.15.123:0/807588963 >> v2:172.21.15.130:3300/0 conn(0x7f880c0cf3e0 0x7f880c0d0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:45.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.669+0000 7f8811a00640 1 -- 172.21.15.123:0/807588963 >> v1:172.21.15.123:6789/0 conn(0x7f880c0b8ea0 legacy=0x7f880c0b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:45.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.669+0000 7f8811a00640 1 -- 172.21.15.123:0/807588963 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f880c0ce900 con 0x7f880c0cf7f0 2024-04-25T13:42:45.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.669+0000 7f880b400640 1 -- 172.21.15.123:0/807588963 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3889289018 0 0) 0x7f880c0ce660 con 0x7f880c0b8ea0 2024-04-25T13:42:45.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.673+0000 7f8811a00640 1 --2- 172.21.15.123:0/807588963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f880c0cf7f0 0x7f880c0d0590 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f880c074530 tx=0x7f880401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebbee26253099bed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:45.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.673+0000 7f880b400640 1 -- 172.21.15.123:0/807588963 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88040b1070 con 0x7f880c0cf7f0 2024-04-25T13:42:45.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.673+0000 7f880b400640 1 -- 172.21.15.123:0/807588963 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88040ac620 con 0x7f880c0cf7f0 2024-04-25T13:42:45.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.673+0000 7f880b400640 1 -- 172.21.15.123:0/807588963 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88040ac9f0 con 0x7f880c0cf7f0 2024-04-25T13:42:45.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.673+0000 7f8813a00640 1 -- 172.21.15.123:0/807588963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f880c0cf7f0 msgr2=0x7f880c0d0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:45.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.673+0000 7f8813a00640 1 --2- 172.21.15.123:0/807588963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f880c0cf7f0 0x7f880c0d0590 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f880c074530 tx=0x7f880401c3c0 comp rx=0 tx=0).stop 2024-04-25T13:42:45.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.673+0000 7f8813a00640 1 -- 172.21.15.123:0/807588963 shutdown_connections 2024-04-25T13:42:45.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.673+0000 7f8813a00640 1 --2- 172.21.15.123:0/807588963 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f880c0cf7f0 0x7f880c0d0590 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:45.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.673+0000 7f8813a00640 1 --2- 172.21.15.123:0/807588963 >> v2:172.21.15.130:3300/0 conn(0x7f880c0cf3e0 0x7f880c0d0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:45.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.673+0000 7f8813a00640 1 -- 172.21.15.123:0/807588963 >> 172.21.15.123:0/807588963 conn(0x7f880c0d36e0 msgr2=0x7f880c0d3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:45.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.673+0000 7f8813a00640 1 -- 172.21.15.123:0/807588963 shutdown_connections 2024-04-25T13:42:45.674 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.673+0000 7f8813a00640 1 -- 172.21.15.123:0/807588963 wait complete. 2024-04-25T13:42:45.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.677+0000 7f8813a00640 1 Processor -- start 2024-04-25T13:42:45.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.677+0000 7f8813a00640 1 -- start start 2024-04-25T13:42:45.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.677+0000 7f8813a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f880c0b8ea0 0x7f880c166a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:45.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.677+0000 7f8813a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f880c0cf3e0 0x7f880c15f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:45.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.677+0000 7f8813a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f880c0cf7f0 0x7f880c15fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:45.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.677+0000 7f8813a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f880c16af70 con 0x7f880c0cf3e0 2024-04-25T13:42:45.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.677+0000 7f8813a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f880c0d2800 con 0x7f880c0b8ea0 2024-04-25T13:42:45.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.677+0000 7f8813a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f880c16b0f0 con 0x7f880c0cf7f0 2024-04-25T13:42:45.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.677+0000 7f880be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f880c0cf3e0 0x7f880c15f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:45.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.677+0000 7f880be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f880c0cf3e0 0x7f880c15f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35292/0 (socket says 172.21.15.123:35292) 2024-04-25T13:42:45.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.677+0000 7f880be00640 1 -- 172.21.15.123:0/3840387679 learned_addr learned my addr 172.21.15.123:0/3840387679 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:45.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.677+0000 7f8811000640 1 --2- 172.21.15.123:0/3840387679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f880c0b8ea0 0x7f880c166a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:45.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.677+0000 7f8811a00640 1 --2- 172.21.15.123:0/3840387679 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f880c0cf7f0 0x7f880c15fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:45.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.677+0000 7f880be00640 1 -- 172.21.15.123:0/3840387679 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f880c0cf7f0 msgr2=0x7f880c15fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:45.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.677+0000 7f880be00640 1 --2- 172.21.15.123:0/3840387679 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f880c0cf7f0 0x7f880c15fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:45.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.677+0000 7f880be00640 1 -- 172.21.15.123:0/3840387679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f880c0b8ea0 msgr2=0x7f880c166a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:45.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.677+0000 7f880be00640 1 --2- 172.21.15.123:0/3840387679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f880c0b8ea0 0x7f880c166a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:45.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.677+0000 7f880be00640 1 -- 172.21.15.123:0/3840387679 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f880c166fc0 con 0x7f880c0cf3e0 2024-04-25T13:42:45.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.677+0000 7f880be00640 1 --2- 172.21.15.123:0/3840387679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f880c0cf3e0 0x7f880c15f890 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f87f800e870 tx=0x7f87f800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:45.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.677+0000 7f8808c00640 1 -- 172.21.15.123:0/3840387679 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f8017070 con 0x7f880c0cf3e0 2024-04-25T13:42:45.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.677+0000 7f8808c00640 1 -- 172.21.15.123:0/3840387679 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87f800c940 con 0x7f880c0cf3e0 2024-04-25T13:42:45.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.677+0000 7f8808c00640 1 -- 172.21.15.123:0/3840387679 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f800ccf0 con 0x7f880c0cf3e0 2024-04-25T13:42:45.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.677+0000 7f8813a00640 1 -- 172.21.15.123:0/3840387679 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f880c168c70 con 0x7f880c0cf3e0 2024-04-25T13:42:45.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.677+0000 7f8813a00640 1 -- 172.21.15.123:0/3840387679 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f880c06e4a0 con 0x7f880c0cf3e0 2024-04-25T13:42:45.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.681+0000 7f8813a00640 1 -- 172.21.15.123:0/3840387679 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f880c050750 con 0x7f880c0cf3e0 2024-04-25T13:42:45.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.681+0000 7f8808c00640 1 -- 172.21.15.123:0/3840387679 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f87f801a070 con 0x7f880c0cf3e0 2024-04-25T13:42:45.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.681+0000 7f8808c00640 1 --2- 172.21.15.123:0/3840387679 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f87ec06f400 0x7f87ec071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:45.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.681+0000 7f8808c00640 1 -- 172.21.15.123:0/3840387679 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f87f808f120 con 0x7f880c0cf3e0 2024-04-25T13:42:45.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.681+0000 7f8811000640 1 --2- 172.21.15.123:0/3840387679 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f87ec06f400 0x7f87ec071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:45.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.681+0000 7f8811000640 1 --2- 172.21.15.123:0/3840387679 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f87ec06f400 0x7f87ec071910 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f87fc001470 tx=0x7f87fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:45.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.685+0000 7f8808c00640 1 -- 172.21.15.123:0/3840387679 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f87f805b9c0 con 0x7f880c0cf3e0 2024-04-25T13:42:45.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.841+0000 7f8813a00640 1 -- 172.21.15.123:0/3840387679 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f880c0d0dd0 con 0x7f880c0cf3e0 2024-04-25T13:42:45.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.841+0000 7f8808c00640 1 -- 172.21.15.123:0/3840387679 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f87f805fcc0 con 0x7f880c0cf3e0 2024-04-25T13:42:45.842 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-04-25T13:42:45.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.845+0000 7f8813a00640 1 -- 172.21.15.123:0/3840387679 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f87ec06f400 msgr2=0x7f87ec071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:45.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.845+0000 7f8813a00640 1 --2- 172.21.15.123:0/3840387679 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f87ec06f400 0x7f87ec071910 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f87fc001470 tx=0x7f87fc009040 comp rx=0 tx=0).stop 2024-04-25T13:42:45.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.845+0000 7f8813a00640 1 -- 172.21.15.123:0/3840387679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f880c0cf3e0 msgr2=0x7f880c15f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:45.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.845+0000 7f8813a00640 1 --2- 172.21.15.123:0/3840387679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f880c0cf3e0 0x7f880c15f890 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f87f800e870 tx=0x7f87f800ec70 comp rx=0 tx=0).stop 2024-04-25T13:42:45.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.845+0000 7f8813a00640 1 -- 172.21.15.123:0/3840387679 shutdown_connections 2024-04-25T13:42:45.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.845+0000 7f8813a00640 1 --2- 172.21.15.123:0/3840387679 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f87ec06f400 0x7f87ec071910 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:45.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.845+0000 7f8813a00640 1 --2- 172.21.15.123:0/3840387679 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f880c0cf7f0 0x7f880c15fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:45.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.845+0000 7f8813a00640 1 --2- 172.21.15.123:0/3840387679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f880c0cf3e0 0x7f880c15f890 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:45.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.845+0000 7f8813a00640 1 --2- 172.21.15.123:0/3840387679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f880c0b8ea0 0x7f880c166a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:45.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.845+0000 7f8813a00640 1 -- 172.21.15.123:0/3840387679 >> 172.21.15.123:0/3840387679 conn(0x7f880c0d36e0 msgr2=0x7f880c070d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:45.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.845+0000 7f8813a00640 1 -- 172.21.15.123:0/3840387679 shutdown_connections 2024-04-25T13:42:45.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:45.845+0000 7f8813a00640 1 -- 172.21.15.123:0/3840387679 wait complete. 2024-04-25T13:42:45.864 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:42:46.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.013+0000 7f146c600640 1 Processor -- start 2024-04-25T13:42:46.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.013+0000 7f146c600640 1 -- start start 2024-04-25T13:42:46.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.013+0000 7f146c600640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f146406c670 0x7f14640b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:46.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.013+0000 7f146c600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1464162750 con 0x7f14640b6c00 2024-04-25T13:42:46.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.017+0000 7f146c600640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14640af9a0 con 0x7f146415ecc0 2024-04-25T13:42:46.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.017+0000 7f146c600640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f14640af750 con 0x7f146406c670 2024-04-25T13:42:46.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.017+0000 7f1469200640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f14640b6c00 0x7f1464161930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54384/0 (socket says 172.21.15.123:54384) 2024-04-25T13:42:46.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.017+0000 7f1469200640 1 -- 172.21.15.123:0/1899214353 learned_addr learned my addr 172.21.15.123:0/1899214353 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:46.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.017+0000 7f1469c00640 1 --2- 172.21.15.123:0/1899214353 >> v2:172.21.15.130:3300/0 conn(0x7f146406c670 0x7f14640b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:46.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.017+0000 7f1463e00640 1 -- 172.21.15.123:0/1899214353 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1133652455 0 0) 0x7f1464162750 con 0x7f14640b6c00 2024-04-25T13:42:46.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.017+0000 7f1463e00640 1 -- 172.21.15.123:0/1899214353 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f144c003530 con 0x7f14640b6c00 2024-04-25T13:42:46.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.017+0000 7f1469c00640 1 -- 172.21.15.123:0/1899214353 >> v1:172.21.15.130:6789/0 conn(0x7f146415ecc0 legacy=0x7f1464162040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:46.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.017+0000 7f1469c00640 1 -- 172.21.15.123:0/1899214353 >> v1:172.21.15.123:6789/0 conn(0x7f14640b6c00 legacy=0x7f1464161930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:46.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.017+0000 7f1469c00640 1 -- 172.21.15.123:0/1899214353 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14640afc80 con 0x7f146406c670 2024-04-25T13:42:46.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.017+0000 7f1469c00640 1 --2- 172.21.15.123:0/1899214353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f146406c670 0x7f14640b66c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f14580097c0 tx=0x7f145801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b5421c01397b13e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:46.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.021+0000 7f1463e00640 1 -- 172.21.15.123:0/1899214353 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14580b0070 con 0x7f146406c670 2024-04-25T13:42:46.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.021+0000 7f1463e00640 1 -- 172.21.15.123:0/1899214353 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14580ab600 con 0x7f146406c670 2024-04-25T13:42:46.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.021+0000 7f1463e00640 1 -- 172.21.15.123:0/1899214353 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14580ab9b0 con 0x7f146406c670 2024-04-25T13:42:46.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.021+0000 7f146c600640 1 -- 172.21.15.123:0/1899214353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f146406c670 msgr2=0x7f14640b66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:46.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.021+0000 7f146c600640 1 --2- 172.21.15.123:0/1899214353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f146406c670 0x7f14640b66c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f14580097c0 tx=0x7f145801c410 comp rx=0 tx=0).stop 2024-04-25T13:42:46.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.021+0000 7f146c600640 1 -- 172.21.15.123:0/1899214353 shutdown_connections 2024-04-25T13:42:46.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.021+0000 7f146c600640 1 --2- 172.21.15.123:0/1899214353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f146406c670 0x7f14640b66c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.021+0000 7f146c600640 1 -- 172.21.15.123:0/1899214353 >> 172.21.15.123:0/1899214353 conn(0x7f14640d2180 msgr2=0x7f14640d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:46.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.021+0000 7f146c600640 1 -- 172.21.15.123:0/1899214353 shutdown_connections 2024-04-25T13:42:46.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.021+0000 7f146c600640 1 -- 172.21.15.123:0/1899214353 wait complete. 2024-04-25T13:42:46.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.021+0000 7f146c600640 1 Processor -- start 2024-04-25T13:42:46.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.021+0000 7f146c600640 1 -- start start 2024-04-25T13:42:46.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.025+0000 7f146c600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f146406c670 0x7f1464157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:46.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.025+0000 7f146c600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14640b6c00 0x7f1464143780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:46.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.025+0000 7f146c600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f146415ecc0 0x7f14641684b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:46.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.025+0000 7f146c600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f14640b7190 con 0x7f14640b6c00 2024-04-25T13:42:46.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.025+0000 7f146c600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f14640b7010 con 0x7f146406c670 2024-04-25T13:42:46.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.025+0000 7f146c600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f146416c4f0 con 0x7f146415ecc0 2024-04-25T13:42:46.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.025+0000 7f1469200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14640b6c00 0x7f1464143780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:46.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.025+0000 7f1469200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14640b6c00 0x7f1464143780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35304/0 (socket says 172.21.15.123:35304) 2024-04-25T13:42:46.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.025+0000 7f1469200640 1 -- 172.21.15.123:0/1727302764 learned_addr learned my addr 172.21.15.123:0/1727302764 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:46.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.025+0000 7f1469c00640 1 --2- 172.21.15.123:0/1727302764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f146406c670 0x7f1464157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:46.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.025+0000 7f146a600640 1 --2- 172.21.15.123:0/1727302764 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f146415ecc0 0x7f14641684b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:46.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.025+0000 7f1469200640 1 -- 172.21.15.123:0/1727302764 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f146415ecc0 msgr2=0x7f14641684b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:46.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.025+0000 7f1469200640 1 --2- 172.21.15.123:0/1727302764 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f146415ecc0 0x7f14641684b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.025+0000 7f1469200640 1 -- 172.21.15.123:0/1727302764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f146406c670 msgr2=0x7f1464157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:46.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.025+0000 7f1469200640 1 --2- 172.21.15.123:0/1727302764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f146406c670 0x7f1464157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.025+0000 7f1469200640 1 -- 172.21.15.123:0/1727302764 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14640ce0f0 con 0x7f14640b6c00 2024-04-25T13:42:46.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.025+0000 7f1469200640 1 --2- 172.21.15.123:0/1727302764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14640b6c00 0x7f1464143780 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f145000c420 tx=0x7f145000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:46.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.025+0000 7f1461600640 1 -- 172.21.15.123:0/1727302764 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1450017070 con 0x7f14640b6c00 2024-04-25T13:42:46.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.025+0000 7f1461600640 1 -- 172.21.15.123:0/1727302764 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1450005cf0 con 0x7f14640b6c00 2024-04-25T13:42:46.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.025+0000 7f1461600640 1 -- 172.21.15.123:0/1727302764 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14500072d0 con 0x7f14640b6c00 2024-04-25T13:42:46.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.025+0000 7f146c600640 1 -- 172.21.15.123:0/1727302764 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1464155860 con 0x7f14640b6c00 2024-04-25T13:42:46.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.025+0000 7f146c600640 1 -- 172.21.15.123:0/1727302764 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14640cfaf0 con 0x7f14640b6c00 2024-04-25T13:42:46.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.025+0000 7f146c600640 1 -- 172.21.15.123:0/1727302764 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14640cf600 con 0x7f14640b6c00 2024-04-25T13:42:46.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.029+0000 7f1461600640 1 -- 172.21.15.123:0/1727302764 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f145001a070 con 0x7f14640b6c00 2024-04-25T13:42:46.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.029+0000 7f1461600640 1 --2- 172.21.15.123:0/1727302764 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f144406f400 0x7f1444071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:46.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.029+0000 7f1461600640 1 -- 172.21.15.123:0/1727302764 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f145008e610 con 0x7f14640b6c00 2024-04-25T13:42:46.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.029+0000 7f1469c00640 1 --2- 172.21.15.123:0/1727302764 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f144406f400 0x7f1444071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:46.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.029+0000 7f1469c00640 1 --2- 172.21.15.123:0/1727302764 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f144406f400 0x7f1444071910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f14580ad000 tx=0x7f14580a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:46.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.033+0000 7f1461600640 1 -- 172.21.15.123:0/1727302764 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f145005aeb0 con 0x7f14640b6c00 2024-04-25T13:42:46.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.193+0000 7f146c600640 1 -- 172.21.15.123:0/1727302764 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1464050750 con 0x7f14640b6c00 2024-04-25T13:42:46.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.193+0000 7f1461600640 1 -- 172.21.15.123:0/1727302764 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f145005f1b0 con 0x7f14640b6c00 2024-04-25T13:42:46.194 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-04-25T13:42:46.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.197+0000 7f146c600640 1 -- 172.21.15.123:0/1727302764 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f144406f400 msgr2=0x7f1444071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:46.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.197+0000 7f146c600640 1 --2- 172.21.15.123:0/1727302764 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f144406f400 0x7f1444071910 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f14580ad000 tx=0x7f14580a6000 comp rx=0 tx=0).stop 2024-04-25T13:42:46.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.197+0000 7f146c600640 1 -- 172.21.15.123:0/1727302764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14640b6c00 msgr2=0x7f1464143780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:46.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.197+0000 7f146c600640 1 --2- 172.21.15.123:0/1727302764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14640b6c00 0x7f1464143780 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f145000c420 tx=0x7f145000c8e0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.197+0000 7f146c600640 1 -- 172.21.15.123:0/1727302764 shutdown_connections 2024-04-25T13:42:46.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.197+0000 7f146c600640 1 --2- 172.21.15.123:0/1727302764 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f144406f400 0x7f1444071910 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.197+0000 7f146c600640 1 --2- 172.21.15.123:0/1727302764 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f146415ecc0 0x7f14641684b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.197+0000 7f146c600640 1 --2- 172.21.15.123:0/1727302764 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f14640b6c00 0x7f1464143780 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.197+0000 7f146c600640 1 --2- 172.21.15.123:0/1727302764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f146406c670 0x7f1464157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.197+0000 7f146c600640 1 -- 172.21.15.123:0/1727302764 >> 172.21.15.123:0/1727302764 conn(0x7f14640d2180 msgr2=0x7f146406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:46.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.197+0000 7f146c600640 1 -- 172.21.15.123:0/1727302764 shutdown_connections 2024-04-25T13:42:46.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.197+0000 7f146c600640 1 -- 172.21.15.123:0/1727302764 wait complete. 2024-04-25T13:42:46.216 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:42:46.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.365+0000 7fed4f200640 1 Processor -- start 2024-04-25T13:42:46.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.365+0000 7fed4f200640 1 -- start start 2024-04-25T13:42:46.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.365+0000 7fed4f200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed4806e5a0 0x7fed4806e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:46.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.365+0000 7fed4f200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fed480ce740 0x7fed480ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:46.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.365+0000 7fed4f200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed480d0c80 con 0x7fed48164480 2024-04-25T13:42:46.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.365+0000 7fed4f200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fed4809cf90 con 0x7fed480ce740 2024-04-25T13:42:46.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.365+0000 7fed4f200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fed4809ccb0 con 0x7fed4806e5a0 2024-04-25T13:42:46.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.365+0000 7fed3f400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fed480ce740 0x7fed480ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:46.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.365+0000 7fed4d200640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fed48164480 0x7fed48164890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54392/0 (socket says 172.21.15.123:54392) 2024-04-25T13:42:46.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.365+0000 7fed4d200640 1 -- 172.21.15.123:0/3871885929 learned_addr learned my addr 172.21.15.123:0/3871885929 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:46.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.365+0000 7fed47e00640 1 --2- 172.21.15.123:0/3871885929 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed4806e5a0 0x7fed4806e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:46.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.365+0000 7fed3f400640 1 -- 172.21.15.123:0/3871885929 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed4806e5a0 msgr2=0x7fed4806e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:46.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.365+0000 7fed3f400640 1 --2- 172.21.15.123:0/3871885929 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed4806e5a0 0x7fed4806e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.365+0000 7fed3f400640 1 -- 172.21.15.123:0/3871885929 >> v1:172.21.15.123:6789/0 conn(0x7fed48164480 legacy=0x7fed48164890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:46.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.365+0000 7fed3f400640 1 -- 172.21.15.123:0/3871885929 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed480b8cd0 con 0x7fed480ce740 2024-04-25T13:42:46.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.365+0000 7fed47400640 1 -- 172.21.15.123:0/3871885929 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3489882587 0 0) 0x7fed480d0c80 con 0x7fed48164480 2024-04-25T13:42:46.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.369+0000 7fed3f400640 1 --2- 172.21.15.123:0/3871885929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed480ce740 0x7fed480ceb50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fed300097c0 tx=0x7fed3001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6f057927e530da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:46.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.369+0000 7fed47400640 1 -- 172.21.15.123:0/3871885929 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed300b0070 con 0x7fed480ce740 2024-04-25T13:42:46.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.369+0000 7fed47400640 1 -- 172.21.15.123:0/3871885929 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed300ab600 con 0x7fed480ce740 2024-04-25T13:42:46.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.369+0000 7fed47400640 1 -- 172.21.15.123:0/3871885929 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed300ab9d0 con 0x7fed480ce740 2024-04-25T13:42:46.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.369+0000 7fed4f200640 1 -- 172.21.15.123:0/3871885929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed480ce740 msgr2=0x7fed480ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:46.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.369+0000 7fed4f200640 1 --2- 172.21.15.123:0/3871885929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed480ce740 0x7fed480ceb50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fed300097c0 tx=0x7fed3001c4a0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.369+0000 7fed4f200640 1 -- 172.21.15.123:0/3871885929 shutdown_connections 2024-04-25T13:42:46.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.369+0000 7fed4f200640 1 --2- 172.21.15.123:0/3871885929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed480ce740 0x7fed480ceb50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.369+0000 7fed4f200640 1 --2- 172.21.15.123:0/3871885929 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed4806e5a0 0x7fed4806e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.369+0000 7fed4f200640 1 -- 172.21.15.123:0/3871885929 >> 172.21.15.123:0/3871885929 conn(0x7fed480d0160 msgr2=0x7fed480d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:46.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.369+0000 7fed4f200640 1 -- 172.21.15.123:0/3871885929 shutdown_connections 2024-04-25T13:42:46.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.369+0000 7fed4f200640 1 -- 172.21.15.123:0/3871885929 wait complete. 2024-04-25T13:42:46.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.373+0000 7fed4f200640 1 Processor -- start 2024-04-25T13:42:46.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.373+0000 7fed4f200640 1 -- start start 2024-04-25T13:42:46.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.373+0000 7fed4f200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed4806e5a0 0x7fed4815b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:46.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.373+0000 7fed4f200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed480ce740 0x7fed480cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:46.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.373+0000 7fed4f200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed48164480 0x7fed480c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:46.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.373+0000 7fed4f200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fed4806f070 con 0x7fed48164480 2024-04-25T13:42:46.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.373+0000 7fed4f200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fed4806eef0 con 0x7fed4806e5a0 2024-04-25T13:42:46.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.373+0000 7fed4f200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fed4806d930 con 0x7fed480ce740 2024-04-25T13:42:46.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.373+0000 7fed4d200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed48164480 0x7fed480c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:46.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.373+0000 7fed4d200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed48164480 0x7fed480c9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35322/0 (socket says 172.21.15.123:35322) 2024-04-25T13:42:46.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.373+0000 7fed4d200640 1 -- 172.21.15.123:0/1230082942 learned_addr learned my addr 172.21.15.123:0/1230082942 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:46.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.373+0000 7fed47e00640 1 --2- 172.21.15.123:0/1230082942 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed4806e5a0 0x7fed4815b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:46.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.373+0000 7fed3f400640 1 --2- 172.21.15.123:0/1230082942 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed480ce740 0x7fed480cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:46.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.377+0000 7fed4d200640 1 -- 172.21.15.123:0/1230082942 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed480ce740 msgr2=0x7fed480cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:46.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.377+0000 7fed4d200640 1 --2- 172.21.15.123:0/1230082942 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed480ce740 0x7fed480cb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.377+0000 7fed4d200640 1 -- 172.21.15.123:0/1230082942 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed4806e5a0 msgr2=0x7fed4815b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:46.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.377+0000 7fed4d200640 1 --2- 172.21.15.123:0/1230082942 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed4806e5a0 0x7fed4815b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.377+0000 7fed4d200640 1 -- 172.21.15.123:0/1230082942 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed4815b730 con 0x7fed48164480 2024-04-25T13:42:46.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.377+0000 7fed4d200640 1 --2- 172.21.15.123:0/1230082942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed48164480 0x7fed480c9610 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fed4000c6d0 tx=0x7fed4000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:46.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.377+0000 7fed44c00640 1 -- 172.21.15.123:0/1230082942 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed40018070 con 0x7fed48164480 2024-04-25T13:42:46.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.377+0000 7fed44c00640 1 -- 172.21.15.123:0/1230082942 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed40004d70 con 0x7fed48164480 2024-04-25T13:42:46.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.377+0000 7fed44c00640 1 -- 172.21.15.123:0/1230082942 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4000a880 con 0x7fed48164480 2024-04-25T13:42:46.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.377+0000 7fed4f200640 1 -- 172.21.15.123:0/1230082942 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed480cb6e0 con 0x7fed48164480 2024-04-25T13:42:46.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.377+0000 7fed4f200640 1 -- 172.21.15.123:0/1230082942 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed480cbed0 con 0x7fed48164480 2024-04-25T13:42:46.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.377+0000 7fed4f200640 1 -- 172.21.15.123:0/1230082942 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed48050750 con 0x7fed48164480 2024-04-25T13:42:46.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.377+0000 7fed44c00640 1 -- 172.21.15.123:0/1230082942 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fed4000aa20 con 0x7fed48164480 2024-04-25T13:42:46.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.381+0000 7fed44c00640 1 --2- 172.21.15.123:0/1230082942 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fed2406f430 0x7fed24071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:46.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.381+0000 7fed44c00640 1 -- 172.21.15.123:0/1230082942 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fed4008e630 con 0x7fed48164480 2024-04-25T13:42:46.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.381+0000 7fed47e00640 1 --2- 172.21.15.123:0/1230082942 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fed2406f430 0x7fed24071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:46.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.381+0000 7fed47e00640 1 --2- 172.21.15.123:0/1230082942 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fed2406f430 0x7fed24071940 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fed4806e360 tx=0x7fed38008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:46.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.385+0000 7fed44c00640 1 -- 172.21.15.123:0/1230082942 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fed4815b730 con 0x7fed48164480 2024-04-25T13:42:46.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.545+0000 7fed4f200640 1 -- 172.21.15.123:0/1230082942 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fed480c93f0 con 0x7fed48164480 2024-04-25T13:42:46.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.545+0000 7fed44c00640 1 -- 172.21.15.123:0/1230082942 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fed4005af40 con 0x7fed48164480 2024-04-25T13:42:46.547 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-04-25T13:42:46.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.549+0000 7fed4f200640 1 -- 172.21.15.123:0/1230082942 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fed2406f430 msgr2=0x7fed24071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:46.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.549+0000 7fed4f200640 1 --2- 172.21.15.123:0/1230082942 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fed2406f430 0x7fed24071940 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fed4806e360 tx=0x7fed38008040 comp rx=0 tx=0).stop 2024-04-25T13:42:46.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.549+0000 7fed4f200640 1 -- 172.21.15.123:0/1230082942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed48164480 msgr2=0x7fed480c9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:46.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.549+0000 7fed4f200640 1 --2- 172.21.15.123:0/1230082942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed48164480 0x7fed480c9610 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fed4000c6d0 tx=0x7fed4000cb90 comp rx=0 tx=0).stop 2024-04-25T13:42:46.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.549+0000 7fed4f200640 1 -- 172.21.15.123:0/1230082942 shutdown_connections 2024-04-25T13:42:46.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.549+0000 7fed4f200640 1 --2- 172.21.15.123:0/1230082942 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fed2406f430 0x7fed24071940 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.549+0000 7fed4f200640 1 --2- 172.21.15.123:0/1230082942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed48164480 0x7fed480c9610 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.549+0000 7fed4f200640 1 --2- 172.21.15.123:0/1230082942 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed480ce740 0x7fed480cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.549+0000 7fed4f200640 1 --2- 172.21.15.123:0/1230082942 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed4806e5a0 0x7fed4815b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.549+0000 7fed4f200640 1 -- 172.21.15.123:0/1230082942 >> 172.21.15.123:0/1230082942 conn(0x7fed480d0160 msgr2=0x7fed48072470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:46.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.549+0000 7fed4f200640 1 -- 172.21.15.123:0/1230082942 shutdown_connections 2024-04-25T13:42:46.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.549+0000 7fed4f200640 1 -- 172.21.15.123:0/1230082942 wait complete. 2024-04-25T13:42:46.568 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:42:46.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.721+0000 7ffb33e00640 1 Processor -- start 2024-04-25T13:42:46.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.721+0000 7ffb33e00640 1 -- start start 2024-04-25T13:42:46.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.721+0000 7ffb33e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffb2c0ceac0 0x7ffb2c0c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:46.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.721+0000 7ffb33e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb2c0b3870 0x7ffb2c0b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:46.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.721+0000 7ffb33e00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb2c0b41c0 con 0x7ffb2c0b5980 2024-04-25T13:42:46.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.721+0000 7ffb33e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ffb2c0c7140 con 0x7ffb2c0ceac0 2024-04-25T13:42:46.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.721+0000 7ffb33e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ffb2c0cf060 con 0x7ffb2c0b3870 2024-04-25T13:42:46.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.721+0000 7ffb31400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffb2c0ceac0 0x7ffb2c0c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:46.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.721+0000 7ffb31400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffb2c0ceac0 0x7ffb2c0c75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35326/0 (socket says 172.21.15.123:35326) 2024-04-25T13:42:46.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.721+0000 7ffb31400640 1 -- 172.21.15.123:0/2174406782 learned_addr learned my addr 172.21.15.123:0/2174406782 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:46.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.721+0000 7ffb30a00640 1 --2- 172.21.15.123:0/2174406782 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb2c0b3870 0x7ffb2c0b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:46.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.721+0000 7ffb31400640 1 -- 172.21.15.123:0/2174406782 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb2c0b3870 msgr2=0x7ffb2c0b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:46.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.721+0000 7ffb31400640 1 --2- 172.21.15.123:0/2174406782 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb2c0b3870 0x7ffb2c0b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.721+0000 7ffb31400640 1 -- 172.21.15.123:0/2174406782 >> v1:172.21.15.130:6789/0 conn(0x7ffb2c0b5980 legacy=0x7ffb2c0b5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:46.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.721+0000 7ffb31400640 1 -- 172.21.15.123:0/2174406782 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2c0c7b10 con 0x7ffb2c0ceac0 2024-04-25T13:42:46.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.725+0000 7ffb31400640 1 --2- 172.21.15.123:0/2174406782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb2c0ceac0 0x7ffb2c0c75d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ffb20009870 tx=0x7ffb2001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a84e5feec43b2a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:46.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.725+0000 7ffb2be00640 1 -- 172.21.15.123:0/2174406782 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb200aa600 con 0x7ffb2c0ceac0 2024-04-25T13:42:46.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.725+0000 7ffb2be00640 1 -- 172.21.15.123:0/2174406782 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb200af070 con 0x7ffb2c0ceac0 2024-04-25T13:42:46.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.725+0000 7ffb2be00640 1 -- 172.21.15.123:0/2174406782 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb200aa9c0 con 0x7ffb2c0ceac0 2024-04-25T13:42:46.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.725+0000 7ffb33e00640 1 -- 172.21.15.123:0/2174406782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb2c0ceac0 msgr2=0x7ffb2c0c75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:46.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.725+0000 7ffb33e00640 1 --2- 172.21.15.123:0/2174406782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb2c0ceac0 0x7ffb2c0c75d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ffb20009870 tx=0x7ffb2001c4a0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.725+0000 7ffb33e00640 1 -- 172.21.15.123:0/2174406782 shutdown_connections 2024-04-25T13:42:46.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.725+0000 7ffb33e00640 1 --2- 172.21.15.123:0/2174406782 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb2c0b3870 0x7ffb2c0b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.725+0000 7ffb33e00640 1 --2- 172.21.15.123:0/2174406782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb2c0ceac0 0x7ffb2c0c75d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.725+0000 7ffb33e00640 1 -- 172.21.15.123:0/2174406782 >> 172.21.15.123:0/2174406782 conn(0x7ffb2c06ca70 msgr2=0x7ffb2c06ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:46.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.725+0000 7ffb33e00640 1 -- 172.21.15.123:0/2174406782 shutdown_connections 2024-04-25T13:42:46.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.725+0000 7ffb33e00640 1 -- 172.21.15.123:0/2174406782 wait complete. 2024-04-25T13:42:46.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.729+0000 7ffb33e00640 1 Processor -- start 2024-04-25T13:42:46.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.729+0000 7ffb33e00640 1 -- start start 2024-04-25T13:42:46.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.729+0000 7ffb33e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb2c0b3870 0x7ffb2c145be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:46.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.729+0000 7ffb33e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb2c0b5980 0x7ffb2c073330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:46.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.729+0000 7ffb33e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb2c0ceac0 0x7ffb2c142f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:46.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.729+0000 7ffb33e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ffb2c15ee90 con 0x7ffb2c0ceac0 2024-04-25T13:42:46.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.729+0000 7ffb33e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ffb2c0b5110 con 0x7ffb2c0b3870 2024-04-25T13:42:46.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.729+0000 7ffb33e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ffb2c073c30 con 0x7ffb2c0b5980 2024-04-25T13:42:46.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.729+0000 7ffb31e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb2c0ceac0 0x7ffb2c142f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:46.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.729+0000 7ffb31e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb2c0ceac0 0x7ffb2c142f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35336/0 (socket says 172.21.15.123:35336) 2024-04-25T13:42:46.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.729+0000 7ffb31e00640 1 -- 172.21.15.123:0/885261373 learned_addr learned my addr 172.21.15.123:0/885261373 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:46.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.729+0000 7ffb30a00640 1 --2- 172.21.15.123:0/885261373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb2c0b5980 0x7ffb2c073330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:46.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.729+0000 7ffb31400640 1 --2- 172.21.15.123:0/885261373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb2c0b3870 0x7ffb2c145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:46.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.729+0000 7ffb31e00640 1 -- 172.21.15.123:0/885261373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb2c0b5980 msgr2=0x7ffb2c073330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:46.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.729+0000 7ffb31e00640 1 --2- 172.21.15.123:0/885261373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb2c0b5980 0x7ffb2c073330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.729+0000 7ffb31e00640 1 -- 172.21.15.123:0/885261373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb2c0b3870 msgr2=0x7ffb2c145be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:46.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.729+0000 7ffb31e00640 1 --2- 172.21.15.123:0/885261373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb2c0b3870 0x7ffb2c145be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.729+0000 7ffb31e00640 1 -- 172.21.15.123:0/885261373 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2c068ce0 con 0x7ffb2c0ceac0 2024-04-25T13:42:46.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.733+0000 7ffb31e00640 1 --2- 172.21.15.123:0/885261373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb2c0ceac0 0x7ffb2c142f90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400c730 tx=0x7ffb2400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:46.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.733+0000 7ffb29600640 1 -- 172.21.15.123:0/885261373 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb24003b80 con 0x7ffb2c0ceac0 2024-04-25T13:42:46.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.733+0000 7ffb29600640 1 -- 172.21.15.123:0/885261373 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb24003d20 con 0x7ffb2c0ceac0 2024-04-25T13:42:46.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.733+0000 7ffb29600640 1 -- 172.21.15.123:0/885261373 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb24005310 con 0x7ffb2c0ceac0 2024-04-25T13:42:46.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.733+0000 7ffb33e00640 1 -- 172.21.15.123:0/885261373 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb2c155060 con 0x7ffb2c0ceac0 2024-04-25T13:42:46.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.733+0000 7ffb33e00640 1 -- 172.21.15.123:0/885261373 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb2c146680 con 0x7ffb2c0ceac0 2024-04-25T13:42:46.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.733+0000 7ffb33e00640 1 -- 172.21.15.123:0/885261373 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb2c06d600 con 0x7ffb2c0ceac0 2024-04-25T13:42:46.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.733+0000 7ffb29600640 1 -- 172.21.15.123:0/885261373 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ffb240056c0 con 0x7ffb2c0ceac0 2024-04-25T13:42:46.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.733+0000 7ffb29600640 1 --2- 172.21.15.123:0/885261373 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ffb0c06f400 0x7ffb0c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:46.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.733+0000 7ffb29600640 1 -- 172.21.15.123:0/885261373 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7ffb2408f290 con 0x7ffb2c0ceac0 2024-04-25T13:42:46.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.737+0000 7ffb31400640 1 --2- 172.21.15.123:0/885261373 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ffb0c06f400 0x7ffb0c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:46.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.737+0000 7ffb31400640 1 --2- 172.21.15.123:0/885261373 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ffb0c06f400 0x7ffb0c071910 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffb200ae000 tx=0x7ffb200a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:46.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.741+0000 7ffb29600640 1 -- 172.21.15.123:0/885261373 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffb2c0b41c0 con 0x7ffb2c0ceac0 2024-04-25T13:42:46.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.905+0000 7ffb33e00640 1 -- 172.21.15.123:0/885261373 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ffb2c146130 con 0x7ffb2c0ceac0 2024-04-25T13:42:46.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.905+0000 7ffb29600640 1 -- 172.21.15.123:0/885261373 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7ffb2405bab0 con 0x7ffb2c0ceac0 2024-04-25T13:42:46.908 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-04-25T13:42:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.909+0000 7ffb33e00640 1 -- 172.21.15.123:0/885261373 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ffb0c06f400 msgr2=0x7ffb0c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.909+0000 7ffb33e00640 1 --2- 172.21.15.123:0/885261373 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ffb0c06f400 0x7ffb0c071910 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffb200ae000 tx=0x7ffb200a7000 comp rx=0 tx=0).stop 2024-04-25T13:42:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.909+0000 7ffb33e00640 1 -- 172.21.15.123:0/885261373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb2c0ceac0 msgr2=0x7ffb2c142f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.909+0000 7ffb33e00640 1 --2- 172.21.15.123:0/885261373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb2c0ceac0 0x7ffb2c142f90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400c730 tx=0x7ffb2400cbf0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.909+0000 7ffb33e00640 1 -- 172.21.15.123:0/885261373 shutdown_connections 2024-04-25T13:42:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.909+0000 7ffb33e00640 1 --2- 172.21.15.123:0/885261373 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ffb0c06f400 0x7ffb0c071910 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.909+0000 7ffb33e00640 1 --2- 172.21.15.123:0/885261373 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffb2c0ceac0 0x7ffb2c142f90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.909+0000 7ffb33e00640 1 --2- 172.21.15.123:0/885261373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb2c0b5980 0x7ffb2c073330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.909+0000 7ffb33e00640 1 --2- 172.21.15.123:0/885261373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb2c0b3870 0x7ffb2c145be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:46.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.909+0000 7ffb33e00640 1 -- 172.21.15.123:0/885261373 >> 172.21.15.123:0/885261373 conn(0x7ffb2c06ca70 msgr2=0x7ffb2c06ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:46.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.909+0000 7ffb33e00640 1 -- 172.21.15.123:0/885261373 shutdown_connections 2024-04-25T13:42:46.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:46.909+0000 7ffb33e00640 1 -- 172.21.15.123:0/885261373 wait complete. 2024-04-25T13:42:46.929 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-25T13:42:46.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:46.929 DEBUG:teuthology.orchestra.run.smithi130:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-04-25T13:42:46.956 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2024-04-25T13:42:46.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:42:46.957 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-25T13:42:47.010 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T13:42:47.010 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:42:47.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.157+0000 7fd7d2800640 1 Processor -- start 2024-04-25T13:42:47.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.157+0000 7fd7d2800640 1 -- start start 2024-04-25T13:42:47.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.157+0000 7fd7d2800640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd7cc06cd80 0x7fd7cc0b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:47.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.157+0000 7fd7d2800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd7cc0ce9d0 0x7fd7cc0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:47.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.157+0000 7fd7d2800640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7cc0b2e20 con 0x7fd7cc0d30a0 2024-04-25T13:42:47.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.157+0000 7fd7d2800640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fd7cc0b2320 con 0x7fd7cc06cd80 2024-04-25T13:42:47.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.157+0000 7fd7d2800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fd7cc0b2580 con 0x7fd7cc0ce9d0 2024-04-25T13:42:47.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.157+0000 7fd7cb400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd7cc0d30a0 0x7fd7cc06c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54398/0 (socket says 172.21.15.123:54398) 2024-04-25T13:42:47.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.157+0000 7fd7cb400640 1 -- 172.21.15.123:0/100763105 learned_addr learned my addr 172.21.15.123:0/100763105 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:47.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.157+0000 7fd7cbe00640 1 --2- 172.21.15.123:0/100763105 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd7cc0ce9d0 0x7fd7cc0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:47.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.157+0000 7fd7caa00640 1 --2- 172.21.15.123:0/100763105 >> v2:172.21.15.130:3300/0 conn(0x7fd7cc06cd80 0x7fd7cc0b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:47.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.157+0000 7fd7ca000640 1 -- 172.21.15.123:0/100763105 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3215338834 0 0) 0x7fd7cc0b2e20 con 0x7fd7cc0d30a0 2024-04-25T13:42:47.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.157+0000 7fd7ca000640 1 -- 172.21.15.123:0/100763105 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7b0003530 con 0x7fd7cc0d30a0 2024-04-25T13:42:47.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.157+0000 7fd7caa00640 1 -- 172.21.15.123:0/100763105 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd7cc0ce9d0 msgr2=0x7fd7cc0cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:47.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.157+0000 7fd7caa00640 1 --2- 172.21.15.123:0/100763105 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd7cc0ce9d0 0x7fd7cc0cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.157+0000 7fd7caa00640 1 -- 172.21.15.123:0/100763105 >> v1:172.21.15.123:6789/0 conn(0x7fd7cc0d30a0 legacy=0x7fd7cc06c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:47.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.157+0000 7fd7caa00640 1 -- 172.21.15.123:0/100763105 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7cc0b2860 con 0x7fd7cc06cd80 2024-04-25T13:42:47.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.161+0000 7fd7caa00640 1 --2- 172.21.15.123:0/100763105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7cc06cd80 0x7fd7cc0b1de0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd7b80097c0 tx=0x7fd7b801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0c7b0d149371395 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:47.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.161+0000 7fd7ca000640 1 -- 172.21.15.123:0/100763105 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b80b0070 con 0x7fd7cc06cd80 2024-04-25T13:42:47.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.161+0000 7fd7ca000640 1 -- 172.21.15.123:0/100763105 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b80ab600 con 0x7fd7cc06cd80 2024-04-25T13:42:47.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.161+0000 7fd7ca000640 1 -- 172.21.15.123:0/100763105 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b80ab9b0 con 0x7fd7cc06cd80 2024-04-25T13:42:47.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.161+0000 7fd7d2800640 1 -- 172.21.15.123:0/100763105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7cc06cd80 msgr2=0x7fd7cc0b1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:47.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.161+0000 7fd7d2800640 1 --2- 172.21.15.123:0/100763105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7cc06cd80 0x7fd7cc0b1de0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd7b80097c0 tx=0x7fd7b801c4a0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.161+0000 7fd7d2800640 1 -- 172.21.15.123:0/100763105 shutdown_connections 2024-04-25T13:42:47.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.161+0000 7fd7d2800640 1 --2- 172.21.15.123:0/100763105 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd7cc0ce9d0 0x7fd7cc0cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.161+0000 7fd7d2800640 1 --2- 172.21.15.123:0/100763105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7cc06cd80 0x7fd7cc0b1de0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.161+0000 7fd7d2800640 1 -- 172.21.15.123:0/100763105 >> 172.21.15.123:0/100763105 conn(0x7fd7cc0d2580 msgr2=0x7fd7cc0d2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:47.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.161+0000 7fd7d2800640 1 -- 172.21.15.123:0/100763105 shutdown_connections 2024-04-25T13:42:47.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.161+0000 7fd7d2800640 1 -- 172.21.15.123:0/100763105 wait complete. 2024-04-25T13:42:47.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.165+0000 7fd7d2800640 1 Processor -- start 2024-04-25T13:42:47.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.165+0000 7fd7d2800640 1 -- start start 2024-04-25T13:42:47.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.165+0000 7fd7d2800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7cc0ce9d0 0x7fd7cc14c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:47.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.165+0000 7fd7d2800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd7cc0d30a0 0x7fd7cc0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:47.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.165+0000 7fd7d2800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7cc15cd60 0x7fd7cc0b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:47.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.165+0000 7fd7d2800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd7cc16ad80 con 0x7fd7cc0ce9d0 2024-04-25T13:42:47.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.165+0000 7fd7d2800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd7cc16ac00 con 0x7fd7cc15cd60 2024-04-25T13:42:47.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.165+0000 7fd7d2800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fd7cc16af00 con 0x7fd7cc0d30a0 2024-04-25T13:42:47.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.165+0000 7fd7cb400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7cc0ce9d0 0x7fd7cc14c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:47.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.165+0000 7fd7cb400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7cc0ce9d0 0x7fd7cc14c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35344/0 (socket says 172.21.15.123:35344) 2024-04-25T13:42:47.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.165+0000 7fd7cb400640 1 -- 172.21.15.123:0/1328109265 learned_addr learned my addr 172.21.15.123:0/1328109265 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:47.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.165+0000 7fd7caa00640 1 --2- 172.21.15.123:0/1328109265 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd7cc0d30a0 0x7fd7cc0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:47.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.165+0000 7fd7cb400640 1 -- 172.21.15.123:0/1328109265 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd7cc0d30a0 msgr2=0x7fd7cc0b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:47.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.165+0000 7fd7cb400640 1 --2- 172.21.15.123:0/1328109265 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd7cc0d30a0 0x7fd7cc0b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.165+0000 7fd7cb400640 1 -- 172.21.15.123:0/1328109265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7cc15cd60 msgr2=0x7fd7cc0b0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:47.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.165+0000 7fd7cbe00640 1 --2- 172.21.15.123:0/1328109265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7cc15cd60 0x7fd7cc0b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:47.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.165+0000 7fd7cb400640 1 --2- 172.21.15.123:0/1328109265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7cc15cd60 0x7fd7cc0b0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.165+0000 7fd7cb400640 1 -- 172.21.15.123:0/1328109265 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7cc09cd60 con 0x7fd7cc0ce9d0 2024-04-25T13:42:47.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.165+0000 7fd7caa00640 1 --2- 172.21.15.123:0/1328109265 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd7cc0d30a0 0x7fd7cc0b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:47.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.165+0000 7fd7cbe00640 1 --2- 172.21.15.123:0/1328109265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7cc15cd60 0x7fd7cc0b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:47.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.169+0000 7fd7cb400640 1 --2- 172.21.15.123:0/1328109265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7cc0ce9d0 0x7fd7cc14c7f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc00c3a0 tx=0x7fd7bc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:47.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.169+0000 7fd7c3400640 1 -- 172.21.15.123:0/1328109265 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc017070 con 0x7fd7cc0ce9d0 2024-04-25T13:42:47.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.169+0000 7fd7c3400640 1 -- 172.21.15.123:0/1328109265 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7bc0074e0 con 0x7fd7cc0ce9d0 2024-04-25T13:42:47.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.169+0000 7fd7d2800640 1 -- 172.21.15.123:0/1328109265 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7cc09d000 con 0x7fd7cc0ce9d0 2024-04-25T13:42:47.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.169+0000 7fd7c3400640 1 -- 172.21.15.123:0/1328109265 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc0059d0 con 0x7fd7cc0ce9d0 2024-04-25T13:42:47.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.169+0000 7fd7d2800640 1 -- 172.21.15.123:0/1328109265 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7cc0cbbe0 con 0x7fd7cc0ce9d0 2024-04-25T13:42:47.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.169+0000 7fd7d2800640 1 -- 172.21.15.123:0/1328109265 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7cc0507c0 con 0x7fd7cc0ce9d0 2024-04-25T13:42:47.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.169+0000 7fd7c3400640 1 -- 172.21.15.123:0/1328109265 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd7bc01a070 con 0x7fd7cc0ce9d0 2024-04-25T13:42:47.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.169+0000 7fd7c3400640 1 --2- 172.21.15.123:0/1328109265 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd7ac06f400 0x7fd7ac071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:47.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.169+0000 7fd7c3400640 1 -- 172.21.15.123:0/1328109265 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7fd7bc08e7c0 con 0x7fd7cc0ce9d0 2024-04-25T13:42:47.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.169+0000 7fd7caa00640 1 --2- 172.21.15.123:0/1328109265 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd7ac06f400 0x7fd7ac071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:47.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.173+0000 7fd7caa00640 1 --2- 172.21.15.123:0/1328109265 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd7ac06f400 0x7fd7ac071910 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd7b80ad000 tx=0x7fd7b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:47.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.173+0000 7fd7c3400640 1 -- 172.21.15.123:0/1328109265 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd7bc05b590 con 0x7fd7cc0ce9d0 2024-04-25T13:42:47.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.365+0000 7fd7d2800640 1 -- 172.21.15.123:0/1328109265 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7cc0ca4c0 con 0x7fd7cc0ce9d0 2024-04-25T13:42:47.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.365+0000 7fd7c3400640 1 -- 172.21.15.123:0/1328109265 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7fd7bc05ae90 con 0x7fd7cc0ce9d0 2024-04-25T13:42:47.365 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:47.365 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6836/1018722177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1018722177},{"type":"v1","addr":"172.21.15.123:6836","nonce":1018722177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/606716425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":606716425},{"type":"v1","addr":"172.21.15.123:6837","nonce":606716425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/466677289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":466677289},{"type":"v1","addr":"172.21.15.130:6835","nonce":466677289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:42:05.806897+0000","modified":"2024-04-25T13:42:08.807565+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6834/1645626215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1645626215},{"type":"v1","addr":"172.21.15.130:6834","nonce":1645626215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T13:42:47.365 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 8 2024-04-25T13:42:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.365+0000 7fd7d2800640 1 -- 172.21.15.123:0/1328109265 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd7ac06f400 msgr2=0x7fd7ac071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.365+0000 7fd7d2800640 1 --2- 172.21.15.123:0/1328109265 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd7ac06f400 0x7fd7ac071910 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd7b80ad000 tx=0x7fd7b8008040 comp rx=0 tx=0).stop 2024-04-25T13:42:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.365+0000 7fd7d2800640 1 -- 172.21.15.123:0/1328109265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7cc0ce9d0 msgr2=0x7fd7cc14c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.365+0000 7fd7d2800640 1 --2- 172.21.15.123:0/1328109265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7cc0ce9d0 0x7fd7cc14c7f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc00c3a0 tx=0x7fd7bc00c860 comp rx=0 tx=0).stop 2024-04-25T13:42:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.365+0000 7fd7d2800640 1 -- 172.21.15.123:0/1328109265 shutdown_connections 2024-04-25T13:42:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.365+0000 7fd7d2800640 1 --2- 172.21.15.123:0/1328109265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7cc15cd60 0x7fd7cc0b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.365+0000 7fd7d2800640 1 --2- 172.21.15.123:0/1328109265 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd7ac06f400 0x7fd7ac071910 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.365+0000 7fd7d2800640 1 --2- 172.21.15.123:0/1328109265 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd7cc0d30a0 0x7fd7cc0b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.365+0000 7fd7d2800640 1 --2- 172.21.15.123:0/1328109265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7cc0ce9d0 0x7fd7cc14c7f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.365+0000 7fd7d2800640 1 -- 172.21.15.123:0/1328109265 >> 172.21.15.123:0/1328109265 conn(0x7fd7cc0d2580 msgr2=0x7fd7cc0b2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:47.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.365+0000 7fd7d2800640 1 -- 172.21.15.123:0/1328109265 shutdown_connections 2024-04-25T13:42:47.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.365+0000 7fd7d2800640 1 -- 172.21.15.123:0/1328109265 wait complete. 2024-04-25T13:42:47.387 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:47.531 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.529+0000 7ffa05c00640 1 Processor -- start 2024-04-25T13:42:47.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.529+0000 7ffa05c00640 1 -- start start 2024-04-25T13:42:47.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.533+0000 7ffa05c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffa000747a0 0x7ffa0015fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:47.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.533+0000 7ffa05c00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ffa001602e0 0x7ffa00072ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:47.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.533+0000 7ffa05c00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa00145d70 con 0x7ffa00073010 2024-04-25T13:42:47.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.533+0000 7ffa05c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ffa00074290 con 0x7ffa000747a0 2024-04-25T13:42:47.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.533+0000 7ffa05c00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7ffa001606f0 con 0x7ffa001602e0 2024-04-25T13:42:47.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.533+0000 7ff9fea00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffa000747a0 0x7ffa0015fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:47.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.533+0000 7ff9fea00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffa000747a0 0x7ffa0015fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35346/0 (socket says 172.21.15.123:35346) 2024-04-25T13:42:47.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.533+0000 7ff9fea00640 1 -- 172.21.15.123:0/1001310439 learned_addr learned my addr 172.21.15.123:0/1001310439 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:47.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.533+0000 7ff9f6000640 1 --2- 172.21.15.123:0/1001310439 >> v2:172.21.15.130:3300/0 conn(0x7ffa001602e0 0x7ffa00072ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:47.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.533+0000 7ff9fea00640 1 -- 172.21.15.123:0/1001310439 >> v2:172.21.15.130:3300/0 conn(0x7ffa001602e0 msgr2=0x7ffa00072ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:47.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.533+0000 7ff9fea00640 1 --2- 172.21.15.123:0/1001310439 >> v2:172.21.15.130:3300/0 conn(0x7ffa001602e0 0x7ffa00072ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.533+0000 7ff9fea00640 1 -- 172.21.15.123:0/1001310439 >> v1:172.21.15.130:6789/0 conn(0x7ffa00073010 legacy=0x7ffa00073420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:47.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.533+0000 7ff9fea00640 1 -- 172.21.15.123:0/1001310439 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa00073c80 con 0x7ffa000747a0 2024-04-25T13:42:47.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.537+0000 7ff9fea00640 1 --2- 172.21.15.123:0/1001310439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa000747a0 0x7ffa0015fda0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ffa00071a00 tx=0x7ff9f001c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a5c140f1cf8151 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:47.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.537+0000 7ff9fe000640 1 -- 172.21.15.123:0/1001310439 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f00a5580 con 0x7ffa000747a0 2024-04-25T13:42:47.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.537+0000 7ff9fe000640 1 -- 172.21.15.123:0/1001310439 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9f00a5720 con 0x7ffa000747a0 2024-04-25T13:42:47.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.537+0000 7ff9fe000640 1 -- 172.21.15.123:0/1001310439 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f00a5af0 con 0x7ffa000747a0 2024-04-25T13:42:47.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.537+0000 7ffa05c00640 1 -- 172.21.15.123:0/1001310439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa000747a0 msgr2=0x7ffa0015fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:47.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.537+0000 7ffa05c00640 1 --2- 172.21.15.123:0/1001310439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa000747a0 0x7ffa0015fda0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ffa00071a00 tx=0x7ff9f001c7d0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.537+0000 7ffa05c00640 1 -- 172.21.15.123:0/1001310439 shutdown_connections 2024-04-25T13:42:47.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.537+0000 7ffa05c00640 1 --2- 172.21.15.123:0/1001310439 >> v2:172.21.15.130:3300/0 conn(0x7ffa001602e0 0x7ffa00072ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.537+0000 7ffa05c00640 1 --2- 172.21.15.123:0/1001310439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa000747a0 0x7ffa0015fda0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.537+0000 7ffa05c00640 1 -- 172.21.15.123:0/1001310439 >> 172.21.15.123:0/1001310439 conn(0x7ffa0006d210 msgr2=0x7ffa0006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:47.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.537+0000 7ffa05c00640 1 -- 172.21.15.123:0/1001310439 shutdown_connections 2024-04-25T13:42:47.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.537+0000 7ffa05c00640 1 -- 172.21.15.123:0/1001310439 wait complete. 2024-04-25T13:42:47.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.541+0000 7ffa05c00640 1 Processor -- start 2024-04-25T13:42:47.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.541+0000 7ffa05c00640 1 -- start start 2024-04-25T13:42:47.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.541+0000 7ffa05c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa00073010 0x7ffa0015bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:47.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.541+0000 7ffa05c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa000747a0 0x7ffa0015d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:47.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.541+0000 7ffa05c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa001602e0 0x7ffa0015dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:47.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.541+0000 7ffa05c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ffa000b6380 con 0x7ffa00073010 2024-04-25T13:42:47.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.541+0000 7ffa05c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ffa00074bb0 con 0x7ffa000747a0 2024-04-25T13:42:47.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.541+0000 7ffa05c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ffa000b6500 con 0x7ffa001602e0 2024-04-25T13:42:47.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.541+0000 7ff9fea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa00073010 0x7ffa0015bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:47.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.541+0000 7ff9fea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa00073010 0x7ffa0015bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35360/0 (socket says 172.21.15.123:35360) 2024-04-25T13:42:47.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.541+0000 7ff9fea00640 1 -- 172.21.15.123:0/1533647360 learned_addr learned my addr 172.21.15.123:0/1533647360 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:47.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.541+0000 7ff9fea00640 1 -- 172.21.15.123:0/1533647360 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa001602e0 msgr2=0x7ffa0015dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:47.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.541+0000 7ff9fea00640 1 --2- 172.21.15.123:0/1533647360 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa001602e0 0x7ffa0015dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.541+0000 7ff9fea00640 1 -- 172.21.15.123:0/1533647360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa000747a0 msgr2=0x7ffa0015d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:47.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.541+0000 7ff9fea00640 1 --2- 172.21.15.123:0/1533647360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa000747a0 0x7ffa0015d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.541+0000 7ff9fea00640 1 -- 172.21.15.123:0/1533647360 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa000d06c0 con 0x7ffa00073010 2024-04-25T13:42:47.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.541+0000 7ff9fea00640 1 --2- 172.21.15.123:0/1533647360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa00073010 0x7ffa0015bb40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff9f00af040 tx=0x7ff9f0019570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:47.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.541+0000 7ff9f7400640 1 -- 172.21.15.123:0/1533647360 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f00a5580 con 0x7ffa00073010 2024-04-25T13:42:47.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.541+0000 7ff9f7400640 1 -- 172.21.15.123:0/1533647360 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9f00be070 con 0x7ffa00073010 2024-04-25T13:42:47.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.541+0000 7ff9f7400640 1 -- 172.21.15.123:0/1533647360 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0009510 con 0x7ffa00073010 2024-04-25T13:42:47.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.541+0000 7ffa05c00640 1 -- 172.21.15.123:0/1533647360 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa000d0100 con 0x7ffa00073010 2024-04-25T13:42:47.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.541+0000 7ffa05c00640 1 -- 172.21.15.123:0/1533647360 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa000ae910 con 0x7ffa00073010 2024-04-25T13:42:47.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.541+0000 7ffa05c00640 1 -- 172.21.15.123:0/1533647360 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa000507c0 con 0x7ffa00073010 2024-04-25T13:42:47.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.545+0000 7ff9f7400640 1 -- 172.21.15.123:0/1533647360 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff9f00b8ac0 con 0x7ffa00073010 2024-04-25T13:42:47.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.545+0000 7ff9f7400640 1 --2- 172.21.15.123:0/1533647360 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff9dc06f400 0x7ff9dc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:47.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.545+0000 7ff9f7400640 1 -- 172.21.15.123:0/1533647360 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5825+0+0 (secure 0 0 0) 0x7ff9f012a630 con 0x7ffa00073010 2024-04-25T13:42:47.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.545+0000 7ff9f6000640 1 --2- 172.21.15.123:0/1533647360 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff9dc06f400 0x7ff9dc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:47.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.545+0000 7ff9f6000640 1 --2- 172.21.15.123:0/1533647360 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff9dc06f400 0x7ff9dc071910 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffa00145cc0 tx=0x7ff9e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:47.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.549+0000 7ff9f7400640 1 -- 172.21.15.123:0/1533647360 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffa00145d70 con 0x7ffa00073010 2024-04-25T13:42:47.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.713+0000 7ffa05c00640 1 -- 172.21.15.123:0/1533647360 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffa000b6780 con 0x7ffa00073010 2024-04-25T13:42:47.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.713+0000 7ff9f7400640 1 -- 172.21.15.123:0/1533647360 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16879 (secure 0 0 0) 0x7ff9f00f7410 con 0x7ffa00073010 2024-04-25T13:42:47.714 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:47.714 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":23,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:42:47.587063+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:03.949161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:04.755682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:47.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.717+0000 7ffa05c00640 1 -- 172.21.15.123:0/1533647360 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff9dc06f400 msgr2=0x7ff9dc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:47.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.717+0000 7ffa05c00640 1 --2- 172.21.15.123:0/1533647360 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff9dc06f400 0x7ff9dc071910 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffa00145cc0 tx=0x7ff9e8008040 comp rx=0 tx=0).stop 2024-04-25T13:42:47.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.717+0000 7ffa05c00640 1 -- 172.21.15.123:0/1533647360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa00073010 msgr2=0x7ffa0015bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:47.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.717+0000 7ffa05c00640 1 --2- 172.21.15.123:0/1533647360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa00073010 0x7ffa0015bb40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff9f00af040 tx=0x7ff9f0019570 comp rx=0 tx=0).stop 2024-04-25T13:42:47.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.717+0000 7ffa05c00640 1 -- 172.21.15.123:0/1533647360 shutdown_connections 2024-04-25T13:42:47.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.717+0000 7ffa05c00640 1 --2- 172.21.15.123:0/1533647360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa000747a0 0x7ffa0015d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.717+0000 7ffa05c00640 1 --2- 172.21.15.123:0/1533647360 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff9dc06f400 0x7ff9dc071910 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.717+0000 7ffa05c00640 1 --2- 172.21.15.123:0/1533647360 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa001602e0 0x7ffa0015dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.717+0000 7ffa05c00640 1 --2- 172.21.15.123:0/1533647360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa00073010 0x7ffa0015bb40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.717+0000 7ffa05c00640 1 -- 172.21.15.123:0/1533647360 >> 172.21.15.123:0/1533647360 conn(0x7ffa0006d210 msgr2=0x7ffa000b3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:47.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.717+0000 7ffa05c00640 1 -- 172.21.15.123:0/1533647360 shutdown_connections 2024-04-25T13:42:47.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.717+0000 7ffa05c00640 1 -- 172.21.15.123:0/1533647360 wait complete. 2024-04-25T13:42:47.736 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:41:53.602480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:42:03.949161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:42:04.755682+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:42:47.737 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:42:47.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.885+0000 7fa54ba00640 1 Processor -- start 2024-04-25T13:42:47.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.885+0000 7fa54ba00640 1 -- start start 2024-04-25T13:42:47.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.885+0000 7fa54ba00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa5441571b0 0x7fa5440cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:47.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.885+0000 7fa54ba00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa5440b3870 0x7fa5440b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:47.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.885+0000 7fa54ba00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5440b41c0 con 0x7fa5440b4770 2024-04-25T13:42:47.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.885+0000 7fa54ba00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa5440cdee0 con 0x7fa5441571b0 2024-04-25T13:42:47.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.885+0000 7fa54ba00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fa54415d570 con 0x7fa5440b3870 2024-04-25T13:42:47.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.885+0000 7fa549a00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fa5440b4770 0x7fa5440b4b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54404/0 (socket says 172.21.15.123:54404) 2024-04-25T13:42:47.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.885+0000 7fa549a00640 1 -- 172.21.15.123:0/2770152568 learned_addr learned my addr 172.21.15.123:0/2770152568 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:47.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.885+0000 7fa549000640 1 --2- 172.21.15.123:0/2770152568 >> v2:172.21.15.123:3300/0 conn(0x7fa5441571b0 0x7fa5440cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:47.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.885+0000 7fa53be00640 1 --2- 172.21.15.123:0/2770152568 >> v2:172.21.15.130:3300/0 conn(0x7fa5440b3870 0x7fa5440b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:47.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.885+0000 7fa549000640 1 -- 172.21.15.123:0/2770152568 >> v2:172.21.15.130:3300/0 conn(0x7fa5440b3870 msgr2=0x7fa5440b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:47.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.889+0000 7fa549000640 1 --2- 172.21.15.123:0/2770152568 >> v2:172.21.15.130:3300/0 conn(0x7fa5440b3870 0x7fa5440b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.889+0000 7fa549000640 1 -- 172.21.15.123:0/2770152568 >> v1:172.21.15.123:6789/0 conn(0x7fa5440b4770 legacy=0x7fa5440b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:47.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.889+0000 7fa549000640 1 -- 172.21.15.123:0/2770152568 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa54415d850 con 0x7fa5441571b0 2024-04-25T13:42:47.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.889+0000 7fa543e00640 1 -- 172.21.15.123:0/2770152568 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1070807568 0 0) 0x7fa53c0014a0 con 0x7fa5440b4770 2024-04-25T13:42:47.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.889+0000 7fa53be00640 1 --2- 172.21.15.123:0/2770152568 >> v2:172.21.15.130:3300/0 conn(0x7fa5440b3870 0x7fa5440b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:47.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.889+0000 7fa549000640 1 --2- 172.21.15.123:0/2770152568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5441571b0 0x7fa5440cd6b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa5440c7720 tx=0x7fa53401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a4452a46e0b63d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:47.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.889+0000 7fa543e00640 1 -- 172.21.15.123:0/2770152568 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5340b0070 con 0x7fa5441571b0 2024-04-25T13:42:47.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.889+0000 7fa543e00640 1 -- 172.21.15.123:0/2770152568 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5340ab600 con 0x7fa5441571b0 2024-04-25T13:42:47.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.889+0000 7fa543e00640 1 -- 172.21.15.123:0/2770152568 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5340ab9d0 con 0x7fa5441571b0 2024-04-25T13:42:47.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.889+0000 7fa54ba00640 1 -- 172.21.15.123:0/2770152568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5441571b0 msgr2=0x7fa5440cd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:47.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.889+0000 7fa54ba00640 1 --2- 172.21.15.123:0/2770152568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5441571b0 0x7fa5440cd6b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa5440c7720 tx=0x7fa53401c3f0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.893+0000 7fa54ba00640 1 -- 172.21.15.123:0/2770152568 shutdown_connections 2024-04-25T13:42:47.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.893+0000 7fa54ba00640 1 --2- 172.21.15.123:0/2770152568 >> v2:172.21.15.130:3300/0 conn(0x7fa5440b3870 0x7fa5440b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.893+0000 7fa54ba00640 1 --2- 172.21.15.123:0/2770152568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5441571b0 0x7fa5440cd6b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.893+0000 7fa54ba00640 1 -- 172.21.15.123:0/2770152568 >> 172.21.15.123:0/2770152568 conn(0x7fa54406ca70 msgr2=0x7fa54406ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:47.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.893+0000 7fa54ba00640 1 -- 172.21.15.123:0/2770152568 shutdown_connections 2024-04-25T13:42:47.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.893+0000 7fa54ba00640 1 -- 172.21.15.123:0/2770152568 wait complete. 2024-04-25T13:42:47.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.893+0000 7fa54ba00640 1 Processor -- start 2024-04-25T13:42:47.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.893+0000 7fa54ba00640 1 -- start start 2024-04-25T13:42:47.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.893+0000 7fa54ba00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5440b3870 0x7fa544146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:47.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.893+0000 7fa54ba00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5440b4770 0x7fa544143020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:47.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.893+0000 7fa54ba00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5441571b0 0x7fa5440ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:47.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.893+0000 7fa54ba00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa54415e050 con 0x7fa5441571b0 2024-04-25T13:42:47.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.893+0000 7fa54ba00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa5441575c0 con 0x7fa5440b3870 2024-04-25T13:42:47.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.893+0000 7fa54ba00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa544147580 con 0x7fa5440b4770 2024-04-25T13:42:47.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.897+0000 7fa549a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5441571b0 0x7fa5440ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:47.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.897+0000 7fa549a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5441571b0 0x7fa5440ccb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35376/0 (socket says 172.21.15.123:35376) 2024-04-25T13:42:47.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.897+0000 7fa549a00640 1 -- 172.21.15.123:0/2923541613 learned_addr learned my addr 172.21.15.123:0/2923541613 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:47.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.897+0000 7fa549000640 1 --2- 172.21.15.123:0/2923541613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5440b3870 0x7fa544146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:47.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.897+0000 7fa53be00640 1 --2- 172.21.15.123:0/2923541613 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5440b4770 0x7fa544143020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:47.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.897+0000 7fa549a00640 1 -- 172.21.15.123:0/2923541613 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5440b4770 msgr2=0x7fa544143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:47.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.897+0000 7fa549a00640 1 --2- 172.21.15.123:0/2923541613 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5440b4770 0x7fa544143020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.897+0000 7fa549a00640 1 -- 172.21.15.123:0/2923541613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5440b3870 msgr2=0x7fa544146cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:47.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.897+0000 7fa549a00640 1 --2- 172.21.15.123:0/2923541613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5440b3870 0x7fa544146cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:47.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.897+0000 7fa549a00640 1 -- 172.21.15.123:0/2923541613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa544143560 con 0x7fa5441571b0 2024-04-25T13:42:47.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.897+0000 7fa549000640 1 --2- 172.21.15.123:0/2923541613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5440b3870 0x7fa544146cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:47.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.897+0000 7fa549a00640 1 --2- 172.21.15.123:0/2923541613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5441571b0 0x7fa5440ccb20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa53c00c6d0 tx=0x7fa53c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:47.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.897+0000 7fa541600640 1 -- 172.21.15.123:0/2923541613 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c018070 con 0x7fa5441571b0 2024-04-25T13:42:47.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.897+0000 7fa541600640 1 -- 172.21.15.123:0/2923541613 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa53c004d70 con 0x7fa5441571b0 2024-04-25T13:42:47.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.897+0000 7fa541600640 1 -- 172.21.15.123:0/2923541613 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c00a880 con 0x7fa5441571b0 2024-04-25T13:42:47.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.897+0000 7fa54ba00640 1 -- 172.21.15.123:0/2923541613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa54414ab60 con 0x7fa5441571b0 2024-04-25T13:42:47.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.897+0000 7fa54ba00640 1 -- 172.21.15.123:0/2923541613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa54414b120 con 0x7fa5441571b0 2024-04-25T13:42:47.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.897+0000 7fa54ba00640 1 -- 172.21.15.123:0/2923541613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa544050750 con 0x7fa5441571b0 2024-04-25T13:42:47.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.897+0000 7fa541600640 1 -- 172.21.15.123:0/2923541613 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa53c01b070 con 0x7fa5441571b0 2024-04-25T13:42:47.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.901+0000 7fa541600640 1 --2- 172.21.15.123:0/2923541613 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa52006f430 0x7fa520071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:47.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.901+0000 7fa541600640 1 -- 172.21.15.123:0/2923541613 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fa53c08eab0 con 0x7fa5441571b0 2024-04-25T13:42:47.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.901+0000 7fa549000640 1 --2- 172.21.15.123:0/2923541613 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa52006f430 0x7fa520071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:47.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.901+0000 7fa549000640 1 --2- 172.21.15.123:0/2923541613 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa52006f430 0x7fa520071940 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa5340ad000 tx=0x7fa5340a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:47.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:47.905+0000 7fa541600640 1 -- 172.21.15.123:0/2923541613 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa5440b41c0 con 0x7fa5441571b0 2024-04-25T13:42:48.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.061+0000 7fa54ba00640 1 -- 172.21.15.123:0/2923541613 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa544074cc0 con 0x7fa5441571b0 2024-04-25T13:42:48.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.065+0000 7fa541600640 1 -- 172.21.15.123:0/2923541613 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fa53c05b910 con 0x7fa5441571b0 2024-04-25T13:42:48.064 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-04-25T13:42:48.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.065+0000 7fa54ba00640 1 -- 172.21.15.123:0/2923541613 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa52006f430 msgr2=0x7fa520071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:48.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.065+0000 7fa54ba00640 1 --2- 172.21.15.123:0/2923541613 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa52006f430 0x7fa520071940 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa5340ad000 tx=0x7fa5340a6000 comp rx=0 tx=0).stop 2024-04-25T13:42:48.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.065+0000 7fa54ba00640 1 -- 172.21.15.123:0/2923541613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5441571b0 msgr2=0x7fa5440ccb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:48.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.065+0000 7fa54ba00640 1 --2- 172.21.15.123:0/2923541613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5441571b0 0x7fa5440ccb20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa53c00c6d0 tx=0x7fa53c00cb90 comp rx=0 tx=0).stop 2024-04-25T13:42:48.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.065+0000 7fa54ba00640 1 -- 172.21.15.123:0/2923541613 shutdown_connections 2024-04-25T13:42:48.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.065+0000 7fa54ba00640 1 --2- 172.21.15.123:0/2923541613 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa52006f430 0x7fa520071940 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.065+0000 7fa54ba00640 1 --2- 172.21.15.123:0/2923541613 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa5441571b0 0x7fa5440ccb20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.065+0000 7fa54ba00640 1 --2- 172.21.15.123:0/2923541613 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5440b4770 0x7fa544143020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.065+0000 7fa54ba00640 1 --2- 172.21.15.123:0/2923541613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa5440b3870 0x7fa544146cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.065+0000 7fa54ba00640 1 -- 172.21.15.123:0/2923541613 >> 172.21.15.123:0/2923541613 conn(0x7fa54406ca70 msgr2=0x7fa54406ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:48.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.065+0000 7fa54ba00640 1 -- 172.21.15.123:0/2923541613 shutdown_connections 2024-04-25T13:42:48.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.065+0000 7fa54ba00640 1 -- 172.21.15.123:0/2923541613 wait complete. 2024-04-25T13:42:48.086 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:42:48.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f11600640 1 Processor -- start 2024-04-25T13:42:48.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f11600640 1 -- start start 2024-04-25T13:42:48.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f11600640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1f0c0ceac0 0x7f1f0c0c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:48.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f11600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f0c0c7b10 con 0x7f1f0c0b3870 2024-04-25T13:42:48.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f11600640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f0c0c6810 con 0x7f1f0c15de80 2024-04-25T13:42:48.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f11600640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f1f0c0c7140 con 0x7f1f0c0ceac0 2024-04-25T13:42:48.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f0a000640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1f0c0b3870 0x7f1f0c0b3c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54414/0 (socket says 172.21.15.123:54414) 2024-04-25T13:42:48.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f0a000640 1 -- 172.21.15.123:0/1322700065 learned_addr learned my addr 172.21.15.123:0/1322700065 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:48.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f0aa00640 1 --2- 172.21.15.123:0/1322700065 >> v2:172.21.15.130:3300/0 conn(0x7f1f0c0ceac0 0x7f1f0c0c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:48.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f09600640 1 -- 172.21.15.123:0/1322700065 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2402121248 0 0) 0x7f1f0c0c7b10 con 0x7f1f0c0b3870 2024-04-25T13:42:48.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f09600640 1 -- 172.21.15.123:0/1322700065 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ef0003530 con 0x7f1f0c0b3870 2024-04-25T13:42:48.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f09600640 1 -- 172.21.15.123:0/1322700065 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2673888437 0 0) 0x7f1f0c0c6810 con 0x7f1f0c15de80 2024-04-25T13:42:48.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f09600640 1 -- 172.21.15.123:0/1322700065 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f0c0c7b10 con 0x7f1f0c15de80 2024-04-25T13:42:48.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f09600640 1 -- 172.21.15.123:0/1322700065 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2188543484 0 0) 0x7f1ef0003530 con 0x7f1f0c0b3870 2024-04-25T13:42:48.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f09600640 1 -- 172.21.15.123:0/1322700065 >> v2:172.21.15.130:3300/0 conn(0x7f1f0c0ceac0 msgr2=0x7f1f0c0c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:48.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f09600640 1 --2- 172.21.15.123:0/1322700065 >> v2:172.21.15.130:3300/0 conn(0x7f1f0c0ceac0 0x7f1f0c0c75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f09600640 1 -- 172.21.15.123:0/1322700065 >> v1:172.21.15.130:6789/0 conn(0x7f1f0c15de80 legacy=0x7f1f0c15e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:48.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f09600640 1 -- 172.21.15.123:0/1322700065 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0c0c6af0 con 0x7f1f0c0b3870 2024-04-25T13:42:48.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f09600640 1 -- 172.21.15.123:0/1322700065 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7f1ef8001680 con 0x7f1f0c0b3870 2024-04-25T13:42:48.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f09600640 1 -- 172.21.15.123:0/1322700065 >> v1:172.21.15.123:6789/0 conn(0x7f1f0c0b3870 legacy=0x7f1f0c0b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:48.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f09600640 1 --2- 172.21.15.123:0/1322700065 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ef0003c30 0x7f1ef0004080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:48.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f09600640 1 --2- 172.21.15.123:0/1322700065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ef0004810 0x7f1ef0004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:48.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f09600640 1 --2- 172.21.15.123:0/1322700065 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ef0005330 0x7f1ef000b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:48.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f09600640 1 -- 172.21.15.123:0/1322700065 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c0c7140 con 0x7f1ef0005330 2024-04-25T13:42:48.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f09600640 1 -- 172.21.15.123:0/1322700065 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef000c2d0 con 0x7f1ef0004810 2024-04-25T13:42:48.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f09600640 1 -- 172.21.15.123:0/1322700065 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef000c4d0 con 0x7f1ef0003c30 2024-04-25T13:42:48.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f0b400640 1 --2- 172.21.15.123:0/1322700065 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ef0005330 0x7f1ef000b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:48.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f0aa00640 1 --2- 172.21.15.123:0/1322700065 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ef0003c30 0x7f1ef0004080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:48.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.237+0000 7f1f0a000640 1 --2- 172.21.15.123:0/1322700065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ef0004810 0x7f1ef0004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:48.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.241+0000 7f1f0b400640 1 -- 172.21.15.123:0/1322700065 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ef0003c30 msgr2=0x7f1ef0004080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:48.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.241+0000 7f1f0b400640 1 --2- 172.21.15.123:0/1322700065 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ef0003c30 0x7f1ef0004080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.241+0000 7f1f0b400640 1 -- 172.21.15.123:0/1322700065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ef0004810 msgr2=0x7f1ef0004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:48.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.241+0000 7f1f0b400640 1 --2- 172.21.15.123:0/1322700065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ef0004810 0x7f1ef0004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.241+0000 7f1f0b400640 1 -- 172.21.15.123:0/1322700065 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef0003530 con 0x7f1ef0005330 2024-04-25T13:42:48.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.241+0000 7f1f0aa00640 1 --2- 172.21.15.123:0/1322700065 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ef0003c30 0x7f1ef0004080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:48.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.241+0000 7f1f0b400640 1 -- 172.21.15.123:0/1322700065 reap_dead start 2024-04-25T13:42:48.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.241+0000 7f1f0b400640 1 --2- 172.21.15.123:0/1322700065 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ef0005330 0x7f1ef000b9f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c0b6e40 tx=0x7f1f0401f010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176e10b4185d49b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:48.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.241+0000 7f1f09600640 1 -- 172.21.15.123:0/1322700065 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc0096b0 con 0x7f1ef0005330 2024-04-25T13:42:48.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.241+0000 7f1f09600640 1 -- 172.21.15.123:0/1322700065 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f040a8c30 con 0x7f1ef0005330 2024-04-25T13:42:48.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.241+0000 7f1f09600640 1 -- 172.21.15.123:0/1322700065 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f04001c20 con 0x7f1ef0005330 2024-04-25T13:42:48.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.245+0000 7f1f11600640 1 -- 172.21.15.123:0/1322700065 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ef0005330 msgr2=0x7f1ef000b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:48.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.245+0000 7f1f11600640 1 --2- 172.21.15.123:0/1322700065 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ef0005330 0x7f1ef000b9f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c0b6e40 tx=0x7f1f0401f010 comp rx=0 tx=0).stop 2024-04-25T13:42:48.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.245+0000 7f1f11600640 1 -- 172.21.15.123:0/1322700065 shutdown_connections 2024-04-25T13:42:48.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.245+0000 7f1f11600640 1 --2- 172.21.15.123:0/1322700065 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1ef0005330 0x7f1ef000b9f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.245+0000 7f1f11600640 1 -- 172.21.15.123:0/1322700065 >> 172.21.15.123:0/1322700065 conn(0x7f1f0c06ca70 msgr2=0x7f1f0c06ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:48.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.245+0000 7f1f11600640 1 -- 172.21.15.123:0/1322700065 shutdown_connections 2024-04-25T13:42:48.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.245+0000 7f1f11600640 1 -- 172.21.15.123:0/1322700065 wait complete. 2024-04-25T13:42:48.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.245+0000 7f1f11600640 1 Processor -- start 2024-04-25T13:42:48.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.245+0000 7f1f11600640 1 -- start start 2024-04-25T13:42:48.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.249+0000 7f1f11600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ef0005330 0x7f1f0c0ab530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:48.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.249+0000 7f1f11600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f0c074820 0x7f1f0c148e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:48.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.249+0000 7f1f11600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f0c0cd3c0 0x7f1f0c0cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:48.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.249+0000 7f1f11600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c0b5290 con 0x7f1f0c0cd3c0 2024-04-25T13:42:48.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.249+0000 7f1f11600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c0b5110 con 0x7f1f0c074820 2024-04-25T13:42:48.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.249+0000 7f1f11600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f1f0c0ceed0 con 0x7f1ef0005330 2024-04-25T13:42:48.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.249+0000 7f1f0b400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f0c0cd3c0 0x7f1f0c0cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:48.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.249+0000 7f1f0b400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f0c0cd3c0 0x7f1f0c0cd7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35386/0 (socket says 172.21.15.123:35386) 2024-04-25T13:42:48.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.249+0000 7f1f0b400640 1 -- 172.21.15.123:0/2203556757 learned_addr learned my addr 172.21.15.123:0/2203556757 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:48.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.249+0000 7f1f0b400640 1 -- 172.21.15.123:0/2203556757 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ef0005330 msgr2=0x7f1f0c0ab530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:48.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.249+0000 7f1f0b400640 1 --2- 172.21.15.123:0/2203556757 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ef0005330 0x7f1f0c0ab530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.249+0000 7f1f0b400640 1 -- 172.21.15.123:0/2203556757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f0c074820 msgr2=0x7f1f0c148e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:48.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.249+0000 7f1f0b400640 1 --2- 172.21.15.123:0/2203556757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f0c074820 0x7f1f0c148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.249+0000 7f1f0b400640 1 -- 172.21.15.123:0/2203556757 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0c0cdd10 con 0x7f1f0c0cd3c0 2024-04-25T13:42:48.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.249+0000 7f1f0b400640 1 --2- 172.21.15.123:0/2203556757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f0c0cd3c0 0x7f1f0c0cd7d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1f0401ee40 tx=0x7f1ef0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:48.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.249+0000 7f1f02a00640 1 -- 172.21.15.123:0/2203556757 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f04001c00 con 0x7f1f0c0cd3c0 2024-04-25T13:42:48.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.249+0000 7f1f02a00640 1 -- 172.21.15.123:0/2203556757 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f040050d0 con 0x7f1f0c0cd3c0 2024-04-25T13:42:48.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.249+0000 7f1f02a00640 1 -- 172.21.15.123:0/2203556757 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f040054a0 con 0x7f1f0c0cd3c0 2024-04-25T13:42:48.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.249+0000 7f1f11600640 1 -- 172.21.15.123:0/2203556757 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f0c073780 con 0x7f1f0c0cd3c0 2024-04-25T13:42:48.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.249+0000 7f1f11600640 1 -- 172.21.15.123:0/2203556757 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f0c073d40 con 0x7f1f0c0cd3c0 2024-04-25T13:42:48.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.249+0000 7f1f11600640 1 -- 172.21.15.123:0/2203556757 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f0c06d600 con 0x7f1f0c0cd3c0 2024-04-25T13:42:48.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.249+0000 7f1f02a00640 1 -- 172.21.15.123:0/2203556757 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1f040bf060 con 0x7f1f0c0cd3c0 2024-04-25T13:42:48.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.253+0000 7f1f02a00640 1 --2- 172.21.15.123:0/2203556757 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1eec06f430 0x7f1eec071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:48.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.253+0000 7f1f02a00640 1 -- 172.21.15.123:0/2203556757 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f1f0412bfa0 con 0x7f1f0c0cd3c0 2024-04-25T13:42:48.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.253+0000 7f1f0aa00640 1 --2- 172.21.15.123:0/2203556757 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1eec06f430 0x7f1eec071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:48.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.253+0000 7f1f0aa00640 1 --2- 172.21.15.123:0/2203556757 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1eec06f430 0x7f1eec071940 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1efc006b20 tx=0x7f1efc006ab0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:48.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.257+0000 7f1f02a00640 1 -- 172.21.15.123:0/2203556757 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1f0c0cdd10 con 0x7f1f0c0cd3c0 2024-04-25T13:42:48.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.409+0000 7f1f11600640 1 -- 172.21.15.123:0/2203556757 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1f0c0ce690 con 0x7f1f0c0cd3c0 2024-04-25T13:42:48.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.409+0000 7f1f02a00640 1 -- 172.21.15.123:0/2203556757 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f1f04018d20 con 0x7f1f0c0cd3c0 2024-04-25T13:42:48.412 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-04-25T13:42:48.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.413+0000 7f1f11600640 1 -- 172.21.15.123:0/2203556757 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1eec06f430 msgr2=0x7f1eec071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:48.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.413+0000 7f1f11600640 1 --2- 172.21.15.123:0/2203556757 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1eec06f430 0x7f1eec071940 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1efc006b20 tx=0x7f1efc006ab0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.413+0000 7f1f11600640 1 -- 172.21.15.123:0/2203556757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f0c0cd3c0 msgr2=0x7f1f0c0cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:48.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.413+0000 7f1f11600640 1 --2- 172.21.15.123:0/2203556757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f0c0cd3c0 0x7f1f0c0cd7d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1f0401ee40 tx=0x7f1ef0005840 comp rx=0 tx=0).stop 2024-04-25T13:42:48.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.413+0000 7f1f11600640 1 -- 172.21.15.123:0/2203556757 shutdown_connections 2024-04-25T13:42:48.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.413+0000 7f1f11600640 1 --2- 172.21.15.123:0/2203556757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f0c074820 0x7f1f0c148e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.413+0000 7f1f11600640 1 --2- 172.21.15.123:0/2203556757 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1eec06f430 0x7f1eec071940 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.413+0000 7f1f11600640 1 --2- 172.21.15.123:0/2203556757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f0c0cd3c0 0x7f1f0c0cd7d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.413+0000 7f1f11600640 1 --2- 172.21.15.123:0/2203556757 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ef0005330 0x7f1f0c0ab530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.413+0000 7f1f11600640 1 -- 172.21.15.123:0/2203556757 >> 172.21.15.123:0/2203556757 conn(0x7f1f0c06ca70 msgr2=0x7f1f0c15e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:48.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.413+0000 7f1f11600640 1 -- 172.21.15.123:0/2203556757 shutdown_connections 2024-04-25T13:42:48.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.413+0000 7f1f11600640 1 -- 172.21.15.123:0/2203556757 wait complete. 2024-04-25T13:42:48.433 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:42:48.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.581+0000 7f9be0400640 1 Processor -- start 2024-04-25T13:42:48.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9be0400640 1 -- start start 2024-04-25T13:42:48.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9be0400640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9bd815fe90 0x7f9bd80cb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:48.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9be0400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd80cffd0 con 0x7f9bd806c670 2024-04-25T13:42:48.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9be0400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd80cbe80 con 0x7f9bd8163e30 2024-04-25T13:42:48.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9be0400640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd80d2890 con 0x7f9bd815fe90 2024-04-25T13:42:48.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bdd000640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9bd806c670 0x7f9bd806ca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54430/0 (socket says 172.21.15.123:54430) 2024-04-25T13:42:48.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bdd000640 1 -- 172.21.15.123:0/1891624472 learned_addr learned my addr 172.21.15.123:0/1891624472 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:48.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bdda00640 1 --2- 172.21.15.123:0/1891624472 >> v2:172.21.15.130:3300/0 conn(0x7f9bd815fe90 0x7f9bd80cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:48.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bd7e00640 1 -- 172.21.15.123:0/1891624472 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2380470436 0 0) 0x7f9bd80cffd0 con 0x7f9bd806c670 2024-04-25T13:42:48.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bd7e00640 1 -- 172.21.15.123:0/1891624472 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bc0003530 con 0x7f9bd806c670 2024-04-25T13:42:48.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bd7e00640 1 -- 172.21.15.123:0/1891624472 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1180793571 0 0) 0x7f9bd80cbe80 con 0x7f9bd8163e30 2024-04-25T13:42:48.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bd7e00640 1 -- 172.21.15.123:0/1891624472 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bd80cffd0 con 0x7f9bd8163e30 2024-04-25T13:42:48.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bd7e00640 1 -- 172.21.15.123:0/1891624472 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1503232593 0 0) 0x7f9bc0003530 con 0x7f9bd806c670 2024-04-25T13:42:48.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bd7e00640 1 -- 172.21.15.123:0/1891624472 >> v2:172.21.15.130:3300/0 conn(0x7f9bd815fe90 msgr2=0x7f9bd80cb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:48.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bd7e00640 1 --2- 172.21.15.123:0/1891624472 >> v2:172.21.15.130:3300/0 conn(0x7f9bd815fe90 0x7f9bd80cb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bd7e00640 1 -- 172.21.15.123:0/1891624472 >> v1:172.21.15.130:6789/0 conn(0x7f9bd8163e30 legacy=0x7f9bd8164240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:48.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bd7e00640 1 -- 172.21.15.123:0/1891624472 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd80d2b70 con 0x7f9bd806c670 2024-04-25T13:42:48.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bd7e00640 1 -- 172.21.15.123:0/1891624472 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7f9bc4001680 con 0x7f9bd806c670 2024-04-25T13:42:48.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bd7e00640 1 -- 172.21.15.123:0/1891624472 >> v1:172.21.15.123:6789/0 conn(0x7f9bd806c670 legacy=0x7f9bd806ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:48.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bd7e00640 1 --2- 172.21.15.123:0/1891624472 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9bc0003c30 0x7f9bc0004080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:48.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bd7e00640 1 --2- 172.21.15.123:0/1891624472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bc0004810 0x7f9bc0004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:48.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bd7e00640 1 --2- 172.21.15.123:0/1891624472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9bc0005330 0x7f9bc000b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:48.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bd7e00640 1 -- 172.21.15.123:0/1891624472 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd80d2890 con 0x7f9bc0004810 2024-04-25T13:42:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bd7e00640 1 -- 172.21.15.123:0/1891624472 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc000c2d0 con 0x7f9bc0005330 2024-04-25T13:42:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bd7e00640 1 -- 172.21.15.123:0/1891624472 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9bc000c4d0 con 0x7f9bc0003c30 2024-04-25T13:42:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bdd000640 1 --2- 172.21.15.123:0/1891624472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bc0004810 0x7f9bc0004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bdda00640 1 --2- 172.21.15.123:0/1891624472 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9bc0003c30 0x7f9bc0004080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bde400640 1 --2- 172.21.15.123:0/1891624472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9bc0005330 0x7f9bc000b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bdd000640 1 -- 172.21.15.123:0/1891624472 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9bc0003c30 msgr2=0x7f9bc0004080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bdd000640 1 --2- 172.21.15.123:0/1891624472 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9bc0003c30 0x7f9bc0004080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bdd000640 1 -- 172.21.15.123:0/1891624472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9bc0005330 msgr2=0x7f9bc000b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bdd000640 1 --2- 172.21.15.123:0/1891624472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9bc0005330 0x7f9bc000b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bdd000640 1 -- 172.21.15.123:0/1891624472 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc0003530 con 0x7f9bc0004810 2024-04-25T13:42:48.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.585+0000 7f9bde400640 1 -- 172.21.15.123:0/1891624472 reap_dead start 2024-04-25T13:42:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.589+0000 7f9bdd000640 1 --2- 172.21.15.123:0/1891624472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bc0004810 0x7f9bc0004c20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9bc400c190 tx=0x7f9bc401cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df45d82047cc9068 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.589+0000 7f9bd7e00640 1 -- 172.21.15.123:0/1891624472 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4007cd0 con 0x7f9bc0004810 2024-04-25T13:42:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.589+0000 7f9bd7e00640 1 -- 172.21.15.123:0/1891624472 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc40a9020 con 0x7f9bc0004810 2024-04-25T13:42:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.589+0000 7f9bd7e00640 1 -- 172.21.15.123:0/1891624472 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4005b00 con 0x7f9bc0004810 2024-04-25T13:42:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.589+0000 7f9be0400640 1 -- 172.21.15.123:0/1891624472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bc0004810 msgr2=0x7f9bc0004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:48.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.589+0000 7f9be0400640 1 --2- 172.21.15.123:0/1891624472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bc0004810 0x7f9bc0004c20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9bc400c190 tx=0x7f9bc401cbe0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.589+0000 7f9be0400640 1 -- 172.21.15.123:0/1891624472 shutdown_connections 2024-04-25T13:42:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.589+0000 7f9be0400640 1 --2- 172.21.15.123:0/1891624472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bc0004810 0x7f9bc0004c20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.589+0000 7f9be0400640 1 -- 172.21.15.123:0/1891624472 >> 172.21.15.123:0/1891624472 conn(0x7f9bd806e120 msgr2=0x7f9bd80b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.589+0000 7f9be0400640 1 -- 172.21.15.123:0/1891624472 shutdown_connections 2024-04-25T13:42:48.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.589+0000 7f9be0400640 1 -- 172.21.15.123:0/1891624472 wait complete. 2024-04-25T13:42:48.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.593+0000 7f9be0400640 1 Processor -- start 2024-04-25T13:42:48.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.593+0000 7f9be0400640 1 -- start start 2024-04-25T13:42:48.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.597+0000 7f9be0400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9bc0004810 0x7f9bd81f9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:48.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.597+0000 7f9be0400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bd80b7670 0x7f9bd80b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:48.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.597+0000 7f9be0400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9bd80b7fc0 0x7f9bd80aa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:48.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.597+0000 7f9be0400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd81602a0 con 0x7f9bd80b7670 2024-04-25T13:42:48.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.597+0000 7f9be0400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd8164a50 con 0x7f9bd80b7fc0 2024-04-25T13:42:48.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.597+0000 7f9be0400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd806ce90 con 0x7f9bc0004810 2024-04-25T13:42:48.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.597+0000 7f9bdd000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bd80b7670 0x7f9bd80b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:48.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.597+0000 7f9bdd000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bd80b7670 0x7f9bd80b7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35400/0 (socket says 172.21.15.123:35400) 2024-04-25T13:42:48.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.597+0000 7f9bdd000640 1 -- 172.21.15.123:0/3945188836 learned_addr learned my addr 172.21.15.123:0/3945188836 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:48.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.597+0000 7f9bdda00640 1 --2- 172.21.15.123:0/3945188836 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9bc0004810 0x7f9bd81f9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:48.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.597+0000 7f9bde400640 1 --2- 172.21.15.123:0/3945188836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9bd80b7fc0 0x7f9bd80aa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:48.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.597+0000 7f9bdd000640 1 -- 172.21.15.123:0/3945188836 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9bc0004810 msgr2=0x7f9bd81f9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:48.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.597+0000 7f9bdd000640 1 --2- 172.21.15.123:0/3945188836 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9bc0004810 0x7f9bd81f9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.597+0000 7f9bdd000640 1 -- 172.21.15.123:0/3945188836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9bd80b7fc0 msgr2=0x7f9bd80aa6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:48.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.597+0000 7f9bdd000640 1 --2- 172.21.15.123:0/3945188836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9bd80b7fc0 0x7f9bd80aa6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.597+0000 7f9bdd000640 1 -- 172.21.15.123:0/3945188836 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd80b5f00 con 0x7f9bd80b7670 2024-04-25T13:42:48.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.597+0000 7f9bdd000640 1 --2- 172.21.15.123:0/3945188836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bd80b7670 0x7f9bd80b7a80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4001900 tx=0x7f9bc0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:48.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.597+0000 7f9bd5600640 1 -- 172.21.15.123:0/3945188836 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc40049f0 con 0x7f9bd80b7670 2024-04-25T13:42:48.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.597+0000 7f9bd5600640 1 -- 172.21.15.123:0/3945188836 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc40b2070 con 0x7f9bd80b7670 2024-04-25T13:42:48.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.597+0000 7f9bd5600640 1 -- 172.21.15.123:0/3945188836 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc4004dd0 con 0x7f9bd80b7670 2024-04-25T13:42:48.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.597+0000 7f9be0400640 1 -- 172.21.15.123:0/3945188836 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bd80b61e0 con 0x7f9bd80b7670 2024-04-25T13:42:48.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.597+0000 7f9be0400640 1 -- 172.21.15.123:0/3945188836 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bd80b67a0 con 0x7f9bd80b7670 2024-04-25T13:42:48.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.597+0000 7f9be0400640 1 -- 172.21.15.123:0/3945188836 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bd80b5c50 con 0x7f9bd80b7670 2024-04-25T13:42:48.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.601+0000 7f9bd5600640 1 -- 172.21.15.123:0/3945188836 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9bc40a56c0 con 0x7f9bd80b7670 2024-04-25T13:42:48.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.601+0000 7f9bd5600640 1 --2- 172.21.15.123:0/3945188836 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9bb806f400 0x7f9bb8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:48.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.601+0000 7f9bd5600640 1 -- 172.21.15.123:0/3945188836 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f9bc4128500 con 0x7f9bd80b7670 2024-04-25T13:42:48.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.601+0000 7f9bdda00640 1 --2- 172.21.15.123:0/3945188836 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9bb806f400 0x7f9bb8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:48.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.601+0000 7f9bdda00640 1 --2- 172.21.15.123:0/3945188836 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9bb806f400 0x7f9bb8071910 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc009b40 tx=0x7f9bcc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:48.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.605+0000 7f9bd5600640 1 -- 172.21.15.123:0/3945188836 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9bc40168f0 con 0x7f9bd80b7670 2024-04-25T13:42:48.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.761+0000 7f9be0400640 1 -- 172.21.15.123:0/3945188836 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9bd80b2130 con 0x7f9bd80b7670 2024-04-25T13:42:48.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.761+0000 7f9bd5600640 1 -- 172.21.15.123:0/3945188836 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f9bc40f5390 con 0x7f9bd80b7670 2024-04-25T13:42:48.766 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-04-25T13:42:48.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.761+0000 7f9be0400640 1 -- 172.21.15.123:0/3945188836 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9bb806f400 msgr2=0x7f9bb8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:48.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.761+0000 7f9be0400640 1 --2- 172.21.15.123:0/3945188836 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9bb806f400 0x7f9bb8071910 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc009b40 tx=0x7f9bcc009190 comp rx=0 tx=0).stop 2024-04-25T13:42:48.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.761+0000 7f9be0400640 1 -- 172.21.15.123:0/3945188836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bd80b7670 msgr2=0x7f9bd80b7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:48.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.761+0000 7f9be0400640 1 --2- 172.21.15.123:0/3945188836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bd80b7670 0x7f9bd80b7a80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9bc4001900 tx=0x7f9bc0005840 comp rx=0 tx=0).stop 2024-04-25T13:42:48.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.765+0000 7f9be0400640 1 -- 172.21.15.123:0/3945188836 shutdown_connections 2024-04-25T13:42:48.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.765+0000 7f9be0400640 1 --2- 172.21.15.123:0/3945188836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9bd80b7fc0 0x7f9bd80aa6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.765+0000 7f9be0400640 1 --2- 172.21.15.123:0/3945188836 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9bb806f400 0x7f9bb8071910 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.765+0000 7f9be0400640 1 --2- 172.21.15.123:0/3945188836 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bd80b7670 0x7f9bd80b7a80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.765+0000 7f9be0400640 1 --2- 172.21.15.123:0/3945188836 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9bc0004810 0x7f9bd81f9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.765+0000 7f9be0400640 1 -- 172.21.15.123:0/3945188836 >> 172.21.15.123:0/3945188836 conn(0x7f9bd806e120 msgr2=0x7f9bd815c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:48.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.765+0000 7f9be0400640 1 -- 172.21.15.123:0/3945188836 shutdown_connections 2024-04-25T13:42:48.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.765+0000 7f9be0400640 1 -- 172.21.15.123:0/3945188836 wait complete. 2024-04-25T13:42:48.783 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:42:48.929 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.929+0000 7fabac600640 1 Processor -- start 2024-04-25T13:42:48.930 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.929+0000 7fabac600640 1 -- start start 2024-04-25T13:42:48.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.929+0000 7fabac600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faba40d3110 0x7faba40b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:48.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.929+0000 7fabac600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faba40cd0e0 con 0x7faba40d0360 2024-04-25T13:42:48.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.929+0000 7fabac600640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faba40cd380 con 0x7faba40cf3f0 2024-04-25T13:42:48.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.929+0000 7fabac600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7faba40d3520 con 0x7faba40d3110 2024-04-25T13:42:48.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.929+0000 7faba9200640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7faba40d0360 0x7faba40cece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54444/0 (socket says 172.21.15.123:54444) 2024-04-25T13:42:48.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.929+0000 7faba9200640 1 -- 172.21.15.123:0/1905456439 learned_addr learned my addr 172.21.15.123:0/1905456439 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:48.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.929+0000 7faba9c00640 1 --2- 172.21.15.123:0/1905456439 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faba40d3110 0x7faba40b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:48.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.929+0000 7faba3e00640 1 -- 172.21.15.123:0/1905456439 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2205243586 0 0) 0x7faba40cd0e0 con 0x7faba40d0360 2024-04-25T13:42:48.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.929+0000 7faba3e00640 1 -- 172.21.15.123:0/1905456439 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab8c005740 con 0x7faba40d0360 2024-04-25T13:42:48.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.933+0000 7faba3e00640 1 -- 172.21.15.123:0/1905456439 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 269570379 0 0) 0x7fab8c005740 con 0x7faba40d0360 2024-04-25T13:42:48.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.933+0000 7faba3e00640 1 -- 172.21.15.123:0/1905456439 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faba40d3110 msgr2=0x7faba40b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:48.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.933+0000 7faba3e00640 1 --2- 172.21.15.123:0/1905456439 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faba40d3110 0x7faba40b3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.933+0000 7faba3e00640 1 -- 172.21.15.123:0/1905456439 >> v1:172.21.15.130:6789/0 conn(0x7faba40cf3f0 legacy=0x7faba40b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.933+0000 7faba3e00640 1 -- 172.21.15.123:0/1905456439 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba40cd660 con 0x7faba40d0360 2024-04-25T13:42:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.933+0000 7faba3e00640 1 -- 172.21.15.123:0/1905456439 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7fab900016a0 con 0x7faba40d0360 2024-04-25T13:42:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.933+0000 7faba9c00640 1 --2- 172.21.15.123:0/1905456439 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faba40d3110 0x7faba40b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.933+0000 7faba3e00640 1 -- 172.21.15.123:0/1905456439 >> v1:172.21.15.123:6789/0 conn(0x7faba40d0360 legacy=0x7faba40cece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.933+0000 7faba3e00640 1 --2- 172.21.15.123:0/1905456439 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faba40d3110 0x7fab8c005c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.933+0000 7faba3e00640 1 --2- 172.21.15.123:0/1905456439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab8c0061d0 0x7fab8c006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.933+0000 7faba3e00640 1 --2- 172.21.15.123:0/1905456439 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab8c006f60 0x7fab8c0073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.933+0000 7faba3e00640 1 -- 172.21.15.123:0/1905456439 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c00dda0 con 0x7fab8c0061d0 2024-04-25T13:42:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.933+0000 7faba3e00640 1 -- 172.21.15.123:0/1905456439 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c00df50 con 0x7fab8c006f60 2024-04-25T13:42:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.933+0000 7faba3e00640 1 -- 172.21.15.123:0/1905456439 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fab8c00e150 con 0x7faba40d3110 2024-04-25T13:42:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.933+0000 7faba9200640 1 --2- 172.21.15.123:0/1905456439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab8c0061d0 0x7fab8c006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.933+0000 7faba9c00640 1 --2- 172.21.15.123:0/1905456439 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faba40d3110 0x7fab8c005c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:48.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.933+0000 7fabaa600640 1 --2- 172.21.15.123:0/1905456439 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab8c006f60 0x7fab8c0073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:48.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.933+0000 7faba9200640 1 -- 172.21.15.123:0/1905456439 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faba40d3110 msgr2=0x7fab8c005c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:48.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.933+0000 7faba9200640 1 --2- 172.21.15.123:0/1905456439 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faba40d3110 0x7fab8c005c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.933+0000 7faba9200640 1 -- 172.21.15.123:0/1905456439 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab8c006f60 msgr2=0x7fab8c0073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:48.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.933+0000 7faba9200640 1 --2- 172.21.15.123:0/1905456439 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab8c006f60 0x7fab8c0073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.933+0000 7faba9200640 1 -- 172.21.15.123:0/1905456439 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab8c005740 con 0x7fab8c0061d0 2024-04-25T13:42:48.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.933+0000 7fabaa600640 1 --2- 172.21.15.123:0/1905456439 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab8c006f60 0x7fab8c0073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:48.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.933+0000 7faba9200640 1 --2- 172.21.15.123:0/1905456439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab8c0061d0 0x7fab8c006a20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7faba40b7ba0 tx=0x7fab9001f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb4fb16a6cf76f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:48.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.937+0000 7faba3e00640 1 -- 172.21.15.123:0/1905456439 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab90007d60 con 0x7fab8c0061d0 2024-04-25T13:42:48.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.937+0000 7faba3e00640 1 -- 172.21.15.123:0/1905456439 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab90005b00 con 0x7fab8c0061d0 2024-04-25T13:42:48.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.937+0000 7faba3e00640 1 -- 172.21.15.123:0/1905456439 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab90007070 con 0x7fab8c0061d0 2024-04-25T13:42:48.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.937+0000 7fabac600640 1 -- 172.21.15.123:0/1905456439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab8c0061d0 msgr2=0x7fab8c006a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:48.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.937+0000 7fabac600640 1 --2- 172.21.15.123:0/1905456439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab8c0061d0 0x7fab8c006a20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7faba40b7ba0 tx=0x7fab9001f450 comp rx=0 tx=0).stop 2024-04-25T13:42:48.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.937+0000 7fabaa600640 1 -- 172.21.15.123:0/1905456439 reap_dead start 2024-04-25T13:42:48.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.937+0000 7fabac600640 1 -- 172.21.15.123:0/1905456439 shutdown_connections 2024-04-25T13:42:48.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.937+0000 7fabac600640 1 -- 172.21.15.123:0/1905456439 >> 172.21.15.123:0/1905456439 conn(0x7faba40d2580 msgr2=0x7faba40d2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:48.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.937+0000 7fabac600640 1 -- 172.21.15.123:0/1905456439 shutdown_connections 2024-04-25T13:42:48.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.937+0000 7fabac600640 1 -- 172.21.15.123:0/1905456439 wait complete. 2024-04-25T13:42:48.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.937+0000 7fabac600640 1 Processor -- start 2024-04-25T13:42:48.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.937+0000 7fabac600640 1 -- start start 2024-04-25T13:42:48.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.941+0000 7fabac600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab8c0061d0 0x7faba4150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:48.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.941+0000 7fabac600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faba4151440 0x7faba40b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:48.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.941+0000 7fabac600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faba40b6700 0x7faba415d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:48.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.941+0000 7fabac600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7faba40d0770 con 0x7faba40b6700 2024-04-25T13:42:48.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.941+0000 7fabac600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faba40cdc20 con 0x7fab8c0061d0 2024-04-25T13:42:48.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.941+0000 7fabac600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7faba40d08f0 con 0x7faba4151440 2024-04-25T13:42:48.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.941+0000 7fabaa600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faba40b6700 0x7faba415d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:48.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.941+0000 7fabaa600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faba40b6700 0x7faba415d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35412/0 (socket says 172.21.15.123:35412) 2024-04-25T13:42:48.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.941+0000 7fabaa600640 1 -- 172.21.15.123:0/17147736 learned_addr learned my addr 172.21.15.123:0/17147736 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:48.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.941+0000 7faba9200640 1 --2- 172.21.15.123:0/17147736 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faba4151440 0x7faba40b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:48.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.941+0000 7faba9c00640 1 --2- 172.21.15.123:0/17147736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab8c0061d0 0x7faba4150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:48.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.941+0000 7fabaa600640 1 -- 172.21.15.123:0/17147736 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faba4151440 msgr2=0x7faba40b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:48.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.941+0000 7fabaa600640 1 --2- 172.21.15.123:0/17147736 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faba4151440 0x7faba40b61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.941+0000 7fabaa600640 1 -- 172.21.15.123:0/17147736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab8c0061d0 msgr2=0x7faba4150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:48.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.941+0000 7fabaa600640 1 --2- 172.21.15.123:0/17147736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab8c0061d0 0x7faba4150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:48.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.941+0000 7fabaa600640 1 -- 172.21.15.123:0/17147736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba40b6b10 con 0x7faba40b6700 2024-04-25T13:42:48.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.941+0000 7faba9200640 1 --2- 172.21.15.123:0/17147736 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faba4151440 0x7faba40b61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:48.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.941+0000 7faba9c00640 1 --2- 172.21.15.123:0/17147736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab8c0061d0 0x7faba4150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:48.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.941+0000 7fabaa600640 1 --2- 172.21.15.123:0/17147736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faba40b6700 0x7faba415d400 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0069a0 tx=0x7fab9c00e760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:48.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.941+0000 7faba1600640 1 -- 172.21.15.123:0/17147736 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c019070 con 0x7faba40b6700 2024-04-25T13:42:48.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.941+0000 7faba1600640 1 -- 172.21.15.123:0/17147736 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab9c0052e0 con 0x7faba40b6700 2024-04-25T13:42:48.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.941+0000 7faba1600640 1 -- 172.21.15.123:0/17147736 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9c003840 con 0x7faba40b6700 2024-04-25T13:42:48.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.941+0000 7fabac600640 1 -- 172.21.15.123:0/17147736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faba4153c60 con 0x7faba40b6700 2024-04-25T13:42:48.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.941+0000 7fabac600640 1 -- 172.21.15.123:0/17147736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faba4154220 con 0x7faba40b6700 2024-04-25T13:42:48.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.941+0000 7fabac600640 1 -- 172.21.15.123:0/17147736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faba41579e0 con 0x7faba40b6700 2024-04-25T13:42:48.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.945+0000 7faba1600640 1 -- 172.21.15.123:0/17147736 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fab9c0039e0 con 0x7faba40b6700 2024-04-25T13:42:48.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.945+0000 7faba1600640 1 --2- 172.21.15.123:0/17147736 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fab8406f400 0x7fab84071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:48.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.945+0000 7faba1600640 1 -- 172.21.15.123:0/17147736 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fab9c08e480 con 0x7faba40b6700 2024-04-25T13:42:48.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.945+0000 7faba9c00640 1 --2- 172.21.15.123:0/17147736 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fab8406f400 0x7fab84071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:48.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.945+0000 7faba9c00640 1 --2- 172.21.15.123:0/17147736 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fab8406f400 0x7fab84071910 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faba40735d0 tx=0x7fab9800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:48.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:48.949+0000 7faba1600640 1 -- 172.21.15.123:0/17147736 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7faba40b6b10 con 0x7faba40b6700 2024-04-25T13:42:49.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.137+0000 7fabac600640 1 -- 172.21.15.123:0/17147736 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faba40507c0 con 0x7faba40b6700 2024-04-25T13:42:49.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.137+0000 7faba1600640 1 -- 172.21.15.123:0/17147736 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7fab9c05b410 con 0x7faba40b6700 2024-04-25T13:42:49.140 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:49.140 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6836/1018722177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1018722177},{"type":"v1","addr":"172.21.15.123:6836","nonce":1018722177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/606716425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":606716425},{"type":"v1","addr":"172.21.15.123:6837","nonce":606716425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/466677289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":466677289},{"type":"v1","addr":"172.21.15.130:6835","nonce":466677289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:42:05.806897+0000","modified":"2024-04-25T13:42:08.807565+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6834/1645626215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1645626215},{"type":"v1","addr":"172.21.15.130:6834","nonce":1645626215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T13:42:49.140 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 8 2024-04-25T13:42:49.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.141+0000 7fabac600640 1 -- 172.21.15.123:0/17147736 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fab8406f400 msgr2=0x7fab84071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:49.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.141+0000 7fabac600640 1 --2- 172.21.15.123:0/17147736 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fab8406f400 0x7fab84071910 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faba40735d0 tx=0x7fab9800b040 comp rx=0 tx=0).stop 2024-04-25T13:42:49.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.141+0000 7fabac600640 1 -- 172.21.15.123:0/17147736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faba40b6700 msgr2=0x7faba415d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:49.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.141+0000 7fabac600640 1 --2- 172.21.15.123:0/17147736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faba40b6700 0x7faba415d400 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0069a0 tx=0x7fab9c00e760 comp rx=0 tx=0).stop 2024-04-25T13:42:49.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.141+0000 7fabac600640 1 -- 172.21.15.123:0/17147736 shutdown_connections 2024-04-25T13:42:49.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.141+0000 7fabac600640 1 --2- 172.21.15.123:0/17147736 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fab8406f400 0x7fab84071910 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:49.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.141+0000 7fabac600640 1 --2- 172.21.15.123:0/17147736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faba40b6700 0x7faba415d400 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:49.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.141+0000 7fabac600640 1 --2- 172.21.15.123:0/17147736 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faba4151440 0x7faba40b61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:49.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.141+0000 7fabac600640 1 --2- 172.21.15.123:0/17147736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fab8c0061d0 0x7faba4150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:49.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.141+0000 7fabac600640 1 -- 172.21.15.123:0/17147736 >> 172.21.15.123:0/17147736 conn(0x7faba40d2580 msgr2=0x7faba415a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:49.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.141+0000 7fabac600640 1 -- 172.21.15.123:0/17147736 shutdown_connections 2024-04-25T13:42:49.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.141+0000 7fabac600640 1 -- 172.21.15.123:0/17147736 wait complete. 2024-04-25T13:42:49.161 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:49.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.305+0000 7f44f6c00640 1 Processor -- start 2024-04-25T13:42:49.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.305+0000 7f44f6c00640 1 -- start start 2024-04-25T13:42:49.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.309+0000 7f44f6c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f44f01474f0 0x7f44f015eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:49.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.309+0000 7f44f6c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44f015f0d0 con 0x7f44f00b6970 2024-04-25T13:42:49.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.309+0000 7f44f6c00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44f0073400 con 0x7f44f00cd8e0 2024-04-25T13:42:49.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.309+0000 7f44f6c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f44f00d0d10 con 0x7f44f01474f0 2024-04-25T13:42:49.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.309+0000 7f44e7400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f44f00b6970 0x7f44f00b6d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54452/0 (socket says 172.21.15.123:54452) 2024-04-25T13:42:49.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.309+0000 7f44e7400640 1 -- 172.21.15.123:0/3186943932 learned_addr learned my addr 172.21.15.123:0/3186943932 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:49.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.309+0000 7f44efe00640 1 --2- 172.21.15.123:0/3186943932 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f44f01474f0 0x7f44f015eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:49.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.309+0000 7f44ef400640 1 -- 172.21.15.123:0/3186943932 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4015636285 0 0) 0x7f44d8001120 con 0x7f44f00b6970 2024-04-25T13:42:49.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.309+0000 7f44ef400640 1 -- 172.21.15.123:0/3186943932 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44d4003530 con 0x7f44f00b6970 2024-04-25T13:42:49.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.309+0000 7f44ef400640 1 -- 172.21.15.123:0/3186943932 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2151349805 0 0) 0x7f44f0073400 con 0x7f44f00cd8e0 2024-04-25T13:42:49.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.309+0000 7f44ef400640 1 -- 172.21.15.123:0/3186943932 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44d8001120 con 0x7f44f00cd8e0 2024-04-25T13:42:49.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.309+0000 7f44ef400640 1 -- 172.21.15.123:0/3186943932 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3459465449 0 0) 0x7f44d4003530 con 0x7f44f00b6970 2024-04-25T13:42:49.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.309+0000 7f44efe00640 1 -- 172.21.15.123:0/3186943932 >> v1:172.21.15.130:6789/0 conn(0x7f44f00cd8e0 legacy=0x7f44f00cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:49.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.309+0000 7f44efe00640 1 -- 172.21.15.123:0/3186943932 >> v1:172.21.15.123:6789/0 conn(0x7f44f00b6970 legacy=0x7f44f00b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:49.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.309+0000 7f44efe00640 1 -- 172.21.15.123:0/3186943932 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f00736e0 con 0x7f44f01474f0 2024-04-25T13:42:49.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.313+0000 7f44efe00640 1 --2- 172.21.15.123:0/3186943932 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f44f01474f0 0x7f44f015eb90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f44e00097f0 tx=0x7f44e001c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3567ba84046e303c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:49.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.313+0000 7f44ef400640 1 -- 172.21.15.123:0/3186943932 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e00b0070 con 0x7f44f01474f0 2024-04-25T13:42:49.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.313+0000 7f44ef400640 1 -- 172.21.15.123:0/3186943932 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44e0004030 con 0x7f44f01474f0 2024-04-25T13:42:49.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.313+0000 7f44ef400640 1 -- 172.21.15.123:0/3186943932 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d8001850 con 0x7f44f01474f0 2024-04-25T13:42:49.314 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.313+0000 7f44f6c00640 1 -- 172.21.15.123:0/3186943932 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f44f01474f0 msgr2=0x7f44f015eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:49.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.313+0000 7f44f6c00640 1 --2- 172.21.15.123:0/3186943932 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f44f01474f0 0x7f44f015eb90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f44e00097f0 tx=0x7f44e001c3d0 comp rx=0 tx=0).stop 2024-04-25T13:42:49.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.313+0000 7f44f6c00640 1 -- 172.21.15.123:0/3186943932 shutdown_connections 2024-04-25T13:42:49.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.313+0000 7f44f6c00640 1 --2- 172.21.15.123:0/3186943932 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f44f01474f0 0x7f44f015eb90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:49.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.313+0000 7f44f6c00640 1 -- 172.21.15.123:0/3186943932 >> 172.21.15.123:0/3186943932 conn(0x7f44f006d210 msgr2=0x7f44f006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:49.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.313+0000 7f44f6c00640 1 -- 172.21.15.123:0/3186943932 shutdown_connections 2024-04-25T13:42:49.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.313+0000 7f44f6c00640 1 -- 172.21.15.123:0/3186943932 wait complete. 2024-04-25T13:42:49.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.317+0000 7f44f6c00640 1 Processor -- start 2024-04-25T13:42:49.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.317+0000 7f44f6c00640 1 -- start start 2024-04-25T13:42:49.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.317+0000 7f44f6c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44f00b6970 0x7f44f01fc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:49.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.317+0000 7f44f6c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f00cd8e0 0x7f44f00b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:49.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.317+0000 7f44f6c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f44f01474f0 0x7f44f013ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:49.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.317+0000 7f44f6c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f44f00744a0 con 0x7f44f00cd8e0 2024-04-25T13:42:49.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.317+0000 7f44f6c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f44f00ce810 con 0x7f44f00b6970 2024-04-25T13:42:49.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.317+0000 7f44f6c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f44f016bf70 con 0x7f44f01474f0 2024-04-25T13:42:49.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.317+0000 7f44e7400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f00cd8e0 0x7f44f00b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:49.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.317+0000 7f44e7400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f00cd8e0 0x7f44f00b3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35428/0 (socket says 172.21.15.123:35428) 2024-04-25T13:42:49.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.317+0000 7f44e7400640 1 -- 172.21.15.123:0/2100006121 learned_addr learned my addr 172.21.15.123:0/2100006121 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:49.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.317+0000 7f44efe00640 1 --2- 172.21.15.123:0/2100006121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44f00b6970 0x7f44f01fc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:49.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.317+0000 7f44f4c00640 1 --2- 172.21.15.123:0/2100006121 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f44f01474f0 0x7f44f013ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:49.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.317+0000 7f44e7400640 1 -- 172.21.15.123:0/2100006121 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f44f01474f0 msgr2=0x7f44f013ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:49.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.317+0000 7f44e7400640 1 --2- 172.21.15.123:0/2100006121 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f44f01474f0 0x7f44f013ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:49.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.317+0000 7f44e7400640 1 -- 172.21.15.123:0/2100006121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44f00b6970 msgr2=0x7f44f01fc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:49.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.317+0000 7f44e7400640 1 --2- 172.21.15.123:0/2100006121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44f00b6970 0x7f44f01fc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:49.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.317+0000 7f44e7400640 1 -- 172.21.15.123:0/2100006121 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f0138150 con 0x7f44f00cd8e0 2024-04-25T13:42:49.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.317+0000 7f44efe00640 1 --2- 172.21.15.123:0/2100006121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44f00b6970 0x7f44f01fc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:49.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.317+0000 7f44f4c00640 1 --2- 172.21.15.123:0/2100006121 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f44f01474f0 0x7f44f013ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:49.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.317+0000 7f44e7400640 1 --2- 172.21.15.123:0/2100006121 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f00cd8e0 0x7f44f00b3460 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f44d800c7b0 tx=0x7f44d800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:49.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.317+0000 7f44ecc00640 1 -- 172.21.15.123:0/2100006121 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d8017070 con 0x7f44f00cd8e0 2024-04-25T13:42:49.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.317+0000 7f44ecc00640 1 -- 172.21.15.123:0/2100006121 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44d8005d10 con 0x7f44f00cd8e0 2024-04-25T13:42:49.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.317+0000 7f44ecc00640 1 -- 172.21.15.123:0/2100006121 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d80072b0 con 0x7f44f00cd8e0 2024-04-25T13:42:49.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.317+0000 7f44f6c00640 1 -- 172.21.15.123:0/2100006121 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f01383c0 con 0x7f44f00cd8e0 2024-04-25T13:42:49.321 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.317+0000 7f44f6c00640 1 -- 172.21.15.123:0/2100006121 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f0138980 con 0x7f44f00cd8e0 2024-04-25T13:42:49.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.321+0000 7f44f6c00640 1 -- 172.21.15.123:0/2100006121 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44f00507c0 con 0x7f44f00cd8e0 2024-04-25T13:42:49.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.321+0000 7f44ecc00640 1 -- 172.21.15.123:0/2100006121 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f44d801a070 con 0x7f44f00cd8e0 2024-04-25T13:42:49.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.321+0000 7f44ecc00640 1 --2- 172.21.15.123:0/2100006121 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f44cc06f400 0x7f44cc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:49.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.321+0000 7f44ecc00640 1 -- 172.21.15.123:0/2100006121 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f44d808ea10 con 0x7f44f00cd8e0 2024-04-25T13:42:49.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.321+0000 7f44efe00640 1 --2- 172.21.15.123:0/2100006121 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f44cc06f400 0x7f44cc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:49.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.325+0000 7f44efe00640 1 --2- 172.21.15.123:0/2100006121 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f44cc06f400 0x7f44cc071910 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f44e00ad000 tx=0x7f44e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:49.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.325+0000 7f44ecc00640 1 -- 172.21.15.123:0/2100006121 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f44f015f0d0 con 0x7f44f00cd8e0 2024-04-25T13:42:49.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.480+0000 7f44f6c00640 1 -- 172.21.15.123:0/2100006121 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f44f0146b10 con 0x7f44f00cd8e0 2024-04-25T13:42:49.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.484+0000 7f44ecc00640 1 -- 172.21.15.123:0/2100006121 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16879 (secure 0 0 0) 0x7f44d805b880 con 0x7f44f00cd8e0 2024-04-25T13:42:49.485 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:49.485 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":23,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:42:47.587063+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:03.949161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:04.755682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:49.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.484+0000 7f44f6c00640 1 -- 172.21.15.123:0/2100006121 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f44cc06f400 msgr2=0x7f44cc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:49.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.484+0000 7f44f6c00640 1 --2- 172.21.15.123:0/2100006121 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f44cc06f400 0x7f44cc071910 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f44e00ad000 tx=0x7f44e0008040 comp rx=0 tx=0).stop 2024-04-25T13:42:49.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.484+0000 7f44f6c00640 1 -- 172.21.15.123:0/2100006121 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f00cd8e0 msgr2=0x7f44f00b3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:49.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.484+0000 7f44f6c00640 1 --2- 172.21.15.123:0/2100006121 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f00cd8e0 0x7f44f00b3460 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f44d800c7b0 tx=0x7f44d800cc70 comp rx=0 tx=0).stop 2024-04-25T13:42:49.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.484+0000 7f44f6c00640 1 -- 172.21.15.123:0/2100006121 shutdown_connections 2024-04-25T13:42:49.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.484+0000 7f44f6c00640 1 --2- 172.21.15.123:0/2100006121 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f44cc06f400 0x7f44cc071910 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:49.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.484+0000 7f44f6c00640 1 --2- 172.21.15.123:0/2100006121 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f44f01474f0 0x7f44f013ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:49.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.484+0000 7f44f6c00640 1 --2- 172.21.15.123:0/2100006121 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44f00cd8e0 0x7f44f00b3460 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:49.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.484+0000 7f44f6c00640 1 --2- 172.21.15.123:0/2100006121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f44f00b6970 0x7f44f01fc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:49.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.484+0000 7f44f6c00640 1 -- 172.21.15.123:0/2100006121 >> 172.21.15.123:0/2100006121 conn(0x7f44f006d210 msgr2=0x7f44f00cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:49.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.484+0000 7f44f6c00640 1 -- 172.21.15.123:0/2100006121 shutdown_connections 2024-04-25T13:42:49.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.484+0000 7f44f6c00640 1 -- 172.21.15.123:0/2100006121 wait complete. 2024-04-25T13:42:49.507 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T13:42:49.508 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:42:49.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.656+0000 7f0965c00640 1 Processor -- start 2024-04-25T13:42:49.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.656+0000 7f0965c00640 1 -- start start 2024-04-25T13:42:49.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.656+0000 7f0965c00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f096015de90 0x7f09600b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:49.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.656+0000 7f0965c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09600ce090 con 0x7f09600cf860 2024-04-25T13:42:49.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.656+0000 7f0965c00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09600b35b0 con 0x7f09600b2250 2024-04-25T13:42:49.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.656+0000 7f0965c00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f09600b3890 con 0x7f096015de90 2024-04-25T13:42:49.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.656+0000 7f0965200640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f09600cf860 0x7f096006cd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56262/0 (socket says 172.21.15.123:56262) 2024-04-25T13:42:49.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.656+0000 7f0965200640 1 -- 172.21.15.123:0/145855820 learned_addr learned my addr 172.21.15.123:0/145855820 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:49.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.656+0000 7f095fe00640 1 --2- 172.21.15.123:0/145855820 >> v2:172.21.15.130:3300/0 conn(0x7f096015de90 0x7f09600b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:49.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.656+0000 7f095f400640 1 -- 172.21.15.123:0/145855820 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3799510111 0 0) 0x7f09600ce090 con 0x7f09600cf860 2024-04-25T13:42:49.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.656+0000 7f095f400640 1 -- 172.21.15.123:0/145855820 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0944003530 con 0x7f09600cf860 2024-04-25T13:42:49.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.656+0000 7f095f400640 1 -- 172.21.15.123:0/145855820 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2413319729 0 0) 0x7f0944003530 con 0x7f09600cf860 2024-04-25T13:42:49.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.656+0000 7f095f400640 1 -- 172.21.15.123:0/145855820 >> v2:172.21.15.130:3300/0 conn(0x7f096015de90 msgr2=0x7f09600b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:49.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.656+0000 7f095f400640 1 --2- 172.21.15.123:0/145855820 >> v2:172.21.15.130:3300/0 conn(0x7f096015de90 0x7f09600b1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:49.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.656+0000 7f095f400640 1 -- 172.21.15.123:0/145855820 >> v1:172.21.15.130:6789/0 conn(0x7f09600b2250 legacy=0x7f096006c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:49.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.656+0000 7f095f400640 1 -- 172.21.15.123:0/145855820 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09600b3b70 con 0x7f09600cf860 2024-04-25T13:42:49.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.656+0000 7f095f400640 1 -- 172.21.15.123:0/145855820 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7f0958001a00 con 0x7f09600cf860 2024-04-25T13:42:49.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.656+0000 7f095f400640 1 -- 172.21.15.123:0/145855820 >> v1:172.21.15.123:6789/0 conn(0x7f09600cf860 legacy=0x7f096006cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:49.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.656+0000 7f095f400640 1 --2- 172.21.15.123:0/145855820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09440039c0 0x7f0944003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:49.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.656+0000 7f095f400640 1 --2- 172.21.15.123:0/145855820 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0944004810 0x7f0944004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:49.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.656+0000 7f095f400640 1 --2- 172.21.15.123:0/145855820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09440051d0 0x7f094400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:49.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.656+0000 7f095f400640 1 -- 172.21.15.123:0/145855820 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f09600b3890 con 0x7f09440039c0 2024-04-25T13:42:49.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.656+0000 7f095f400640 1 -- 172.21.15.123:0/145855820 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f094400c170 con 0x7f09440051d0 2024-04-25T13:42:49.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.656+0000 7f095f400640 1 -- 172.21.15.123:0/145855820 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f094400c370 con 0x7f0944004810 2024-04-25T13:42:49.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.656+0000 7f095fe00640 1 --2- 172.21.15.123:0/145855820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09440039c0 0x7f0944003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:49.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.656+0000 7f0965200640 1 --2- 172.21.15.123:0/145855820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09440051d0 0x7f094400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:49.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.660+0000 7f0957e00640 1 --2- 172.21.15.123:0/145855820 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0944004810 0x7f0944004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:49.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.660+0000 7f095fe00640 1 -- 172.21.15.123:0/145855820 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0944004810 msgr2=0x7f0944004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:49.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.660+0000 7f095fe00640 1 --2- 172.21.15.123:0/145855820 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0944004810 0x7f0944004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:49.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.660+0000 7f095fe00640 1 -- 172.21.15.123:0/145855820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09440051d0 msgr2=0x7f094400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:49.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.660+0000 7f095fe00640 1 --2- 172.21.15.123:0/145855820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09440051d0 0x7f094400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:49.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.660+0000 7f095fe00640 1 -- 172.21.15.123:0/145855820 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0944003530 con 0x7f09440039c0 2024-04-25T13:42:49.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.660+0000 7f0965200640 1 --2- 172.21.15.123:0/145855820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09440051d0 0x7f094400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:49.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.660+0000 7f0965200640 1 -- 172.21.15.123:0/145855820 reap_dead start 2024-04-25T13:42:49.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.660+0000 7f095fe00640 1 --2- 172.21.15.123:0/145855820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09440039c0 0x7f0944003e30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f09600cd840 tx=0x7f095001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471a4f3e84293319 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:49.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.660+0000 7f095f400640 1 -- 172.21.15.123:0/145855820 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0950009690 con 0x7f09440039c0 2024-04-25T13:42:49.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.660+0000 7f095f400640 1 -- 172.21.15.123:0/145855820 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09500059a0 con 0x7f09440039c0 2024-04-25T13:42:49.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.660+0000 7f095f400640 1 -- 172.21.15.123:0/145855820 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0950005d90 con 0x7f09440039c0 2024-04-25T13:42:49.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.660+0000 7f0965c00640 1 -- 172.21.15.123:0/145855820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09440039c0 msgr2=0x7f0944003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:49.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.660+0000 7f0965c00640 1 --2- 172.21.15.123:0/145855820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09440039c0 0x7f0944003e30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f09600cd840 tx=0x7f095001c900 comp rx=0 tx=0).stop 2024-04-25T13:42:49.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.664+0000 7f0965c00640 1 -- 172.21.15.123:0/145855820 shutdown_connections 2024-04-25T13:42:49.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.664+0000 7f0965c00640 1 --2- 172.21.15.123:0/145855820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09440039c0 0x7f0944003e30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:49.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.664+0000 7f0965c00640 1 -- 172.21.15.123:0/145855820 >> 172.21.15.123:0/145855820 conn(0x7f09600d2490 msgr2=0x7f09600d28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:49.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.664+0000 7f0965c00640 1 -- 172.21.15.123:0/145855820 shutdown_connections 2024-04-25T13:42:49.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.664+0000 7f0965c00640 1 -- 172.21.15.123:0/145855820 wait complete. 2024-04-25T13:42:49.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.664+0000 7f0965c00640 1 Processor -- start 2024-04-25T13:42:49.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.664+0000 7f0965c00640 1 -- start start 2024-04-25T13:42:49.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.664+0000 7f0965c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09440039c0 0x7f096014e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:49.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.664+0000 7f0965c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09600d07e0 0x7f09600d0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:49.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.664+0000 7f0965c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09600d1130 0x7f09600ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:49.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.664+0000 7f0965c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f09600cf1e0 con 0x7f09440039c0 2024-04-25T13:42:49.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.664+0000 7f0965c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f09600cf060 con 0x7f09600d07e0 2024-04-25T13:42:49.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.664+0000 7f0965c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f09600cf360 con 0x7f09600d1130 2024-04-25T13:42:49.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.668+0000 7f095fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09440039c0 0x7f096014e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:49.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.668+0000 7f095fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09440039c0 0x7f096014e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36530/0 (socket says 172.21.15.123:36530) 2024-04-25T13:42:49.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.668+0000 7f095fe00640 1 -- 172.21.15.123:0/711866866 learned_addr learned my addr 172.21.15.123:0/711866866 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:49.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.668+0000 7f0965200640 1 --2- 172.21.15.123:0/711866866 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09600d1130 0x7f09600ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:49.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.668+0000 7f0957e00640 1 --2- 172.21.15.123:0/711866866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09600d07e0 0x7f09600d0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:49.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.668+0000 7f095fe00640 1 -- 172.21.15.123:0/711866866 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09600d1130 msgr2=0x7f09600ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:49.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.668+0000 7f095fe00640 1 --2- 172.21.15.123:0/711866866 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09600d1130 0x7f09600ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:49.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.668+0000 7f095fe00640 1 -- 172.21.15.123:0/711866866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09600d07e0 msgr2=0x7f09600d0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:49.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.668+0000 7f095fe00640 1 --2- 172.21.15.123:0/711866866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09600d07e0 0x7f09600d0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:49.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.668+0000 7f095fe00640 1 -- 172.21.15.123:0/711866866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09600b5f40 con 0x7f09440039c0 2024-04-25T13:42:49.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.668+0000 7f0957e00640 1 --2- 172.21.15.123:0/711866866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09600d07e0 0x7f09600d0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:49.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.668+0000 7f095fe00640 1 --2- 172.21.15.123:0/711866866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09440039c0 0x7f096014e720 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f095001cde0 tx=0x7f09500196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:49.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.668+0000 7f095cc00640 1 -- 172.21.15.123:0/711866866 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0950006030 con 0x7f09440039c0 2024-04-25T13:42:49.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.668+0000 7f095cc00640 1 -- 172.21.15.123:0/711866866 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09500061d0 con 0x7f09440039c0 2024-04-25T13:42:49.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.668+0000 7f0965c00640 1 -- 172.21.15.123:0/711866866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09600b6220 con 0x7f09440039c0 2024-04-25T13:42:49.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.668+0000 7f095cc00640 1 -- 172.21.15.123:0/711866866 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0950006580 con 0x7f09440039c0 2024-04-25T13:42:49.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.668+0000 7f0965c00640 1 -- 172.21.15.123:0/711866866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09600ca0c0 con 0x7f09440039c0 2024-04-25T13:42:49.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.668+0000 7f0965c00640 1 -- 172.21.15.123:0/711866866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0960050750 con 0x7f09440039c0 2024-04-25T13:42:49.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.668+0000 7f095cc00640 1 -- 172.21.15.123:0/711866866 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f09500a6040 con 0x7f09440039c0 2024-04-25T13:42:49.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.672+0000 7f095cc00640 1 --2- 172.21.15.123:0/711866866 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f093c06f400 0x7f093c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:49.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.672+0000 7f095cc00640 1 -- 172.21.15.123:0/711866866 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f0950129160 con 0x7f09440039c0 2024-04-25T13:42:49.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.672+0000 7f0957e00640 1 --2- 172.21.15.123:0/711866866 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f093c06f400 0x7f093c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:49.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.672+0000 7f0957e00640 1 --2- 172.21.15.123:0/711866866 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f093c06f400 0x7f093c071910 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0948000c10 tx=0x7f0948009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:49.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.676+0000 7f095cc00640 1 -- 172.21.15.123:0/711866866 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f09500ac070 con 0x7f09440039c0 2024-04-25T13:42:49.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.864+0000 7f0965c00640 1 -- 172.21.15.123:0/711866866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0960071850 con 0x7f09440039c0 2024-04-25T13:42:49.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.864+0000 7f095cc00640 1 -- 172.21.15.123:0/711866866 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f0950016640 con 0x7f09440039c0 2024-04-25T13:42:49.868 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:49.868 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6836/1018722177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1018722177},{"type":"v1","addr":"172.21.15.123:6836","nonce":1018722177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/606716425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":606716425},{"type":"v1","addr":"172.21.15.123:6837","nonce":606716425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/466677289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":466677289},{"type":"v1","addr":"172.21.15.130:6835","nonce":466677289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:42:05.806897+0000","modified":"2024-04-25T13:42:08.807565+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6834/1645626215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1645626215},{"type":"v1","addr":"172.21.15.130:6834","nonce":1645626215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T13:42:49.868 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 8 2024-04-25T13:42:49.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.868+0000 7f0965c00640 1 -- 172.21.15.123:0/711866866 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f093c06f400 msgr2=0x7f093c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.868+0000 7f0965c00640 1 --2- 172.21.15.123:0/711866866 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f093c06f400 0x7f093c071910 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0948000c10 tx=0x7f0948009040 comp rx=0 tx=0).stop 2024-04-25T13:42:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.868+0000 7f0965c00640 1 -- 172.21.15.123:0/711866866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09440039c0 msgr2=0x7f096014e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.868+0000 7f0965c00640 1 --2- 172.21.15.123:0/711866866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09440039c0 0x7f096014e720 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f095001cde0 tx=0x7f09500196a0 comp rx=0 tx=0).stop 2024-04-25T13:42:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.868+0000 7f0965c00640 1 -- 172.21.15.123:0/711866866 shutdown_connections 2024-04-25T13:42:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.868+0000 7f0965c00640 1 --2- 172.21.15.123:0/711866866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09600d07e0 0x7f09600d0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.868+0000 7f0965c00640 1 --2- 172.21.15.123:0/711866866 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f093c06f400 0x7f093c071910 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.868+0000 7f0965c00640 1 --2- 172.21.15.123:0/711866866 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09600d1130 0x7f09600ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.868+0000 7f0965c00640 1 --2- 172.21.15.123:0/711866866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09440039c0 0x7f096014e720 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.868+0000 7f0965c00640 1 -- 172.21.15.123:0/711866866 >> 172.21.15.123:0/711866866 conn(0x7f09600d2490 msgr2=0x7f09600ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.868+0000 7f0965c00640 1 -- 172.21.15.123:0/711866866 shutdown_connections 2024-04-25T13:42:49.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:49.868+0000 7f0965c00640 1 -- 172.21.15.123:0/711866866 wait complete. 2024-04-25T13:42:49.888 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:42:50.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.032+0000 7f5654400640 1 Processor -- start 2024-04-25T13:42:50.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.032+0000 7f5654400640 1 -- start start 2024-04-25T13:42:50.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.036+0000 7f5654400640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f564c1623a0 0x7f564c1627b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:50.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.036+0000 7f5654400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f564c162cf0 0x7f564c0b6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:50.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.036+0000 7f5654400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f564c0b27b0 con 0x7f564c0b6a60 2024-04-25T13:42:50.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.036+0000 7f5654400640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f564c0d16b0 con 0x7f564c1623a0 2024-04-25T13:42:50.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.036+0000 7f5654400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f564c0b8e80 con 0x7f564c162cf0 2024-04-25T13:42:50.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.036+0000 7f5652400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f564c0b6a60 0x7f564c0b6e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56266/0 (socket says 172.21.15.123:56266) 2024-04-25T13:42:50.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.036+0000 7f5652400640 1 -- 172.21.15.123:0/1587831340 learned_addr learned my addr 172.21.15.123:0/1587831340 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:50.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.036+0000 7f5651a00640 1 --2- 172.21.15.123:0/1587831340 >> v2:172.21.15.130:3300/0 conn(0x7f564c1623a0 0x7f564c1627b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:50.037 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.036+0000 7f5651000640 1 --2- 172.21.15.123:0/1587831340 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f564c162cf0 0x7f564c0b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:50.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.036+0000 7f564be00640 1 -- 172.21.15.123:0/1587831340 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1647694259 0 0) 0x7f564c0b27b0 con 0x7f564c0b6a60 2024-04-25T13:42:50.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.036+0000 7f564be00640 1 -- 172.21.15.123:0/1587831340 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5634003530 con 0x7f564c0b6a60 2024-04-25T13:42:50.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.036+0000 7f5651000640 1 -- 172.21.15.123:0/1587831340 >> v2:172.21.15.130:3300/0 conn(0x7f564c1623a0 msgr2=0x7f564c1627b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:50.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.036+0000 7f5651000640 1 --2- 172.21.15.123:0/1587831340 >> v2:172.21.15.130:3300/0 conn(0x7f564c1623a0 0x7f564c1627b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.038 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.036+0000 7f5651000640 1 -- 172.21.15.123:0/1587831340 >> v1:172.21.15.123:6789/0 conn(0x7f564c0b6a60 legacy=0x7f564c0b6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:50.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.036+0000 7f5651000640 1 -- 172.21.15.123:0/1587831340 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f564c0d1340 con 0x7f564c162cf0 2024-04-25T13:42:50.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.036+0000 7f5651a00640 1 --2- 172.21.15.123:0/1587831340 >> v2:172.21.15.130:3300/0 conn(0x7f564c1623a0 0x7f564c1627b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:50.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.040+0000 7f5651000640 1 --2- 172.21.15.123:0/1587831340 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f564c162cf0 0x7f564c0b6520 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f56380097c0 tx=0x7f563801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae7a120be6881ba1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:50.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.040+0000 7f564be00640 1 -- 172.21.15.123:0/1587831340 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56380b0070 con 0x7f564c162cf0 2024-04-25T13:42:50.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.040+0000 7f564be00640 1 -- 172.21.15.123:0/1587831340 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56380ab600 con 0x7f564c162cf0 2024-04-25T13:42:50.041 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.040+0000 7f564be00640 1 -- 172.21.15.123:0/1587831340 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56380ab9d0 con 0x7f564c162cf0 2024-04-25T13:42:50.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.040+0000 7f5654400640 1 -- 172.21.15.123:0/1587831340 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f564c162cf0 msgr2=0x7f564c0b6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:50.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.040+0000 7f5654400640 1 --2- 172.21.15.123:0/1587831340 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f564c162cf0 0x7f564c0b6520 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f56380097c0 tx=0x7f563801c4a0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.040+0000 7f5654400640 1 -- 172.21.15.123:0/1587831340 shutdown_connections 2024-04-25T13:42:50.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.040+0000 7f5654400640 1 --2- 172.21.15.123:0/1587831340 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f564c162cf0 0x7f564c0b6520 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.040+0000 7f5654400640 1 --2- 172.21.15.123:0/1587831340 >> v2:172.21.15.130:3300/0 conn(0x7f564c1623a0 0x7f564c1627b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.040+0000 7f5654400640 1 -- 172.21.15.123:0/1587831340 >> 172.21.15.123:0/1587831340 conn(0x7f564c0d0150 msgr2=0x7f564c0d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:50.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.040+0000 7f5654400640 1 -- 172.21.15.123:0/1587831340 shutdown_connections 2024-04-25T13:42:50.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.040+0000 7f5654400640 1 -- 172.21.15.123:0/1587831340 wait complete. 2024-04-25T13:42:50.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.040+0000 7f5654400640 1 Processor -- start 2024-04-25T13:42:50.044 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.044+0000 7f5654400640 1 -- start start 2024-04-25T13:42:50.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.044+0000 7f5654400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f564c0b6a60 0x7f564c151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:50.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.044+0000 7f5654400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f564c1623a0 0x7f564c15eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:50.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.044+0000 7f5654400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f564c162cf0 0x7f564c070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:50.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.044+0000 7f5654400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f564c0b88d0 con 0x7f564c162cf0 2024-04-25T13:42:50.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.044+0000 7f5654400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f564c0b2a20 con 0x7f564c0b6a60 2024-04-25T13:42:50.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.044+0000 7f5654400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f564c0b8a50 con 0x7f564c1623a0 2024-04-25T13:42:50.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.044+0000 7f5652400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f564c162cf0 0x7f564c070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:50.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.044+0000 7f5652400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f564c162cf0 0x7f564c070dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36532/0 (socket says 172.21.15.123:36532) 2024-04-25T13:42:50.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.044+0000 7f5651000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f564c1623a0 0x7f564c15eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:50.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.044+0000 7f5652400640 1 -- 172.21.15.123:0/4167004782 learned_addr learned my addr 172.21.15.123:0/4167004782 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:50.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.044+0000 7f5651a00640 1 --2- 172.21.15.123:0/4167004782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f564c0b6a60 0x7f564c151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:50.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.044+0000 7f5652400640 1 -- 172.21.15.123:0/4167004782 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f564c1623a0 msgr2=0x7f564c15eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:50.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.044+0000 7f5652400640 1 --2- 172.21.15.123:0/4167004782 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f564c1623a0 0x7f564c15eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.044+0000 7f5652400640 1 -- 172.21.15.123:0/4167004782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f564c0b6a60 msgr2=0x7f564c151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:50.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.044+0000 7f5652400640 1 --2- 172.21.15.123:0/4167004782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f564c0b6a60 0x7f564c151490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.044+0000 7f5652400640 1 -- 172.21.15.123:0/4167004782 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f564c15d880 con 0x7f564c162cf0 2024-04-25T13:42:50.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.044+0000 7f5652400640 1 --2- 172.21.15.123:0/4167004782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f564c162cf0 0x7f564c070dc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f564400caa0 tx=0x7f564400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:50.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.044+0000 7f5649600640 1 -- 172.21.15.123:0/4167004782 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5644017070 con 0x7f564c162cf0 2024-04-25T13:42:50.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.044+0000 7f5649600640 1 -- 172.21.15.123:0/4167004782 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f564400ac00 con 0x7f564c162cf0 2024-04-25T13:42:50.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.044+0000 7f5649600640 1 -- 172.21.15.123:0/4167004782 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5644012400 con 0x7f564c162cf0 2024-04-25T13:42:50.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.044+0000 7f5654400640 1 -- 172.21.15.123:0/4167004782 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f564c15db20 con 0x7f564c162cf0 2024-04-25T13:42:50.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.044+0000 7f5654400640 1 -- 172.21.15.123:0/4167004782 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f564c15e0e0 con 0x7f564c162cf0 2024-04-25T13:42:50.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.044+0000 7f5654400640 1 -- 172.21.15.123:0/4167004782 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f564c0507c0 con 0x7f564c162cf0 2024-04-25T13:42:50.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.048+0000 7f5649600640 1 -- 172.21.15.123:0/4167004782 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f564401a070 con 0x7f564c162cf0 2024-04-25T13:42:50.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.048+0000 7f5649600640 1 --2- 172.21.15.123:0/4167004782 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f562c06f400 0x7f562c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:50.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.048+0000 7f5649600640 1 -- 172.21.15.123:0/4167004782 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f564408efe0 con 0x7f564c162cf0 2024-04-25T13:42:50.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.048+0000 7f5651a00640 1 --2- 172.21.15.123:0/4167004782 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f562c06f400 0x7f562c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:50.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.048+0000 7f5651a00640 1 --2- 172.21.15.123:0/4167004782 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f562c06f400 0x7f562c071910 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5640009580 tx=0x7f5640009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:50.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.052+0000 7f5649600640 1 -- 172.21.15.123:0/4167004782 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f564405b7a0 con 0x7f564c162cf0 2024-04-25T13:42:50.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.240+0000 7f5654400640 1 -- 172.21.15.123:0/4167004782 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f564c0b4f50 con 0x7f564c162cf0 2024-04-25T13:42:50.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.240+0000 7f5649600640 1 -- 172.21.15.123:0/4167004782 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5181 (secure 0 0 0) 0x7f5644062e20 con 0x7f564c162cf0 2024-04-25T13:42:50.244 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:50.244 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6836/1018722177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1018722177},{"type":"v1","addr":"172.21.15.123:6836","nonce":1018722177}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/606716425","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":606716425},{"type":"v1","addr":"172.21.15.123:6837","nonce":606716425}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/466677289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":466677289},{"type":"v1","addr":"172.21.15.130:6835","nonce":466677289}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:42:05.806897+0000","modified":"2024-04-25T13:42:08.807565+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6834/1645626215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1645626215},{"type":"v1","addr":"172.21.15.130:6834","nonce":1645626215}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-04-25T13:42:50.244 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 8 2024-04-25T13:42:50.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.244+0000 7f5654400640 1 -- 172.21.15.123:0/4167004782 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f562c06f400 msgr2=0x7f562c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:50.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.244+0000 7f5654400640 1 --2- 172.21.15.123:0/4167004782 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f562c06f400 0x7f562c071910 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5640009580 tx=0x7f5640009190 comp rx=0 tx=0).stop 2024-04-25T13:42:50.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.244+0000 7f5654400640 1 -- 172.21.15.123:0/4167004782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f564c162cf0 msgr2=0x7f564c070dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:50.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.244+0000 7f5654400640 1 --2- 172.21.15.123:0/4167004782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f564c162cf0 0x7f564c070dc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f564400caa0 tx=0x7f564400cf60 comp rx=0 tx=0).stop 2024-04-25T13:42:50.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.244+0000 7f5654400640 1 -- 172.21.15.123:0/4167004782 shutdown_connections 2024-04-25T13:42:50.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.244+0000 7f5654400640 1 --2- 172.21.15.123:0/4167004782 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f562c06f400 0x7f562c071910 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.244+0000 7f5654400640 1 --2- 172.21.15.123:0/4167004782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f564c162cf0 0x7f564c070dc0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.244+0000 7f5654400640 1 --2- 172.21.15.123:0/4167004782 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f564c1623a0 0x7f564c15eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.244+0000 7f5654400640 1 --2- 172.21.15.123:0/4167004782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f564c0b6a60 0x7f564c151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.244+0000 7f5654400640 1 -- 172.21.15.123:0/4167004782 >> 172.21.15.123:0/4167004782 conn(0x7f564c0d0150 msgr2=0x7f564c072560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:50.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.244+0000 7f5654400640 1 -- 172.21.15.123:0/4167004782 shutdown_connections 2024-04-25T13:42:50.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.244+0000 7f5654400640 1 -- 172.21.15.123:0/4167004782 wait complete. 2024-04-25T13:42:50.265 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:50.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.408+0000 7f1f34400640 1 Processor -- start 2024-04-25T13:42:50.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.408+0000 7f1f34400640 1 -- start start 2024-04-25T13:42:50.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.412+0000 7f1f34400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f2c0d0f80 0x7f1f2c160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:50.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.412+0000 7f1f34400640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1f2c0b32f0 0x7f1f2c0b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:50.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.412+0000 7f1f34400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1f2c073be0 0x7f1f2c073ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:50.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.412+0000 7f1f34400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f1f2c15cfe0 con 0x7f1f2c073be0 2024-04-25T13:42:50.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.412+0000 7f1f34400640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f1f2c0b3c40 con 0x7f1f2c0b32f0 2024-04-25T13:42:50.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.412+0000 7f1f34400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f1f2c161520 con 0x7f1f2c0d0f80 2024-04-25T13:42:50.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.412+0000 7f1f32400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1f2c073be0 0x7f1f2c073ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:50.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.412+0000 7f1f32400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1f2c073be0 0x7f1f2c073ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36538/0 (socket says 172.21.15.123:36538) 2024-04-25T13:42:50.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.412+0000 7f1f32400640 1 -- 172.21.15.123:0/1128763099 learned_addr learned my addr 172.21.15.123:0/1128763099 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:50.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.412+0000 7f1f31000640 1 --2- 172.21.15.123:0/1128763099 >> v2:172.21.15.130:3300/0 conn(0x7f1f2c0b32f0 0x7f1f2c0b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:50.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.412+0000 7f1f31a00640 1 --2- 172.21.15.123:0/1128763099 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f2c0d0f80 0x7f1f2c160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:50.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.412+0000 7f1f32400640 1 -- 172.21.15.123:0/1128763099 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f2c0d0f80 msgr2=0x7f1f2c160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:50.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.412+0000 7f1f32400640 1 --2- 172.21.15.123:0/1128763099 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f2c0d0f80 0x7f1f2c160fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.412+0000 7f1f32400640 1 -- 172.21.15.123:0/1128763099 >> v2:172.21.15.130:3300/0 conn(0x7f1f2c0b32f0 msgr2=0x7f1f2c0b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:50.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.412+0000 7f1f32400640 1 --2- 172.21.15.123:0/1128763099 >> v2:172.21.15.130:3300/0 conn(0x7f1f2c0b32f0 0x7f1f2c0b3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.412+0000 7f1f32400640 1 -- 172.21.15.123:0/1128763099 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f2c15d240 con 0x7f1f2c073be0 2024-04-25T13:42:50.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.412+0000 7f1f31a00640 1 --2- 172.21.15.123:0/1128763099 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f2c0d0f80 0x7f1f2c160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:50.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.416+0000 7f1f32400640 1 --2- 172.21.15.123:0/1128763099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f2c073be0 0x7f1f2c073ff0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c070eb0 tx=0x7f1f2401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b5713aa967bb41 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:50.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.416+0000 7f1f2be00640 1 -- 172.21.15.123:0/1128763099 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f240a57b0 con 0x7f1f2c073be0 2024-04-25T13:42:50.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.416+0000 7f1f2be00640 1 -- 172.21.15.123:0/1128763099 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f240a5950 con 0x7f1f2c073be0 2024-04-25T13:42:50.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.416+0000 7f1f2be00640 1 -- 172.21.15.123:0/1128763099 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f240a5d20 con 0x7f1f2c073be0 2024-04-25T13:42:50.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.416+0000 7f1f34400640 1 -- 172.21.15.123:0/1128763099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f2c073be0 msgr2=0x7f1f2c073ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:50.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.416+0000 7f1f34400640 1 --2- 172.21.15.123:0/1128763099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f2c073be0 0x7f1f2c073ff0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c070eb0 tx=0x7f1f2401c930 comp rx=0 tx=0).stop 2024-04-25T13:42:50.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.416+0000 7f1f34400640 1 -- 172.21.15.123:0/1128763099 shutdown_connections 2024-04-25T13:42:50.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.416+0000 7f1f34400640 1 --2- 172.21.15.123:0/1128763099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f2c073be0 0x7f1f2c073ff0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.416+0000 7f1f34400640 1 --2- 172.21.15.123:0/1128763099 >> v2:172.21.15.130:3300/0 conn(0x7f1f2c0b32f0 0x7f1f2c0b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.416+0000 7f1f34400640 1 --2- 172.21.15.123:0/1128763099 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f2c0d0f80 0x7f1f2c160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.416+0000 7f1f34400640 1 -- 172.21.15.123:0/1128763099 >> 172.21.15.123:0/1128763099 conn(0x7f1f2c06d210 msgr2=0x7f1f2c06ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:50.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.416+0000 7f1f34400640 1 -- 172.21.15.123:0/1128763099 shutdown_connections 2024-04-25T13:42:50.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.416+0000 7f1f34400640 1 -- 172.21.15.123:0/1128763099 wait complete. 2024-04-25T13:42:50.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.420+0000 7f1f34400640 1 Processor -- start 2024-04-25T13:42:50.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.420+0000 7f1f34400640 1 -- start start 2024-04-25T13:42:50.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.420+0000 7f1f34400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f2c073be0 0x7f1f2c15c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:50.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.420+0000 7f1f34400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f2c0b32f0 0x7f1f2c157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:50.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.420+0000 7f1f34400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f2c0d0f80 0x7f1f2c158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:50.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.420+0000 7f1f34400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2c0b6470 con 0x7f1f2c0d0f80 2024-04-25T13:42:50.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.420+0000 7f1f34400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2c15ddc0 con 0x7f1f2c0b32f0 2024-04-25T13:42:50.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.420+0000 7f1f34400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f1f2c074940 con 0x7f1f2c073be0 2024-04-25T13:42:50.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.420+0000 7f1f31000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f2c0b32f0 0x7f1f2c157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:50.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.420+0000 7f1f32400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f2c0d0f80 0x7f1f2c158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:50.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.420+0000 7f1f31a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f2c073be0 0x7f1f2c15c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:50.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.420+0000 7f1f31000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f2c0b32f0 0x7f1f2c157ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:46514/0 (socket says 172.21.15.123:46514) 2024-04-25T13:42:50.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.420+0000 7f1f31000640 1 -- 172.21.15.123:0/3037103730 learned_addr learned my addr 172.21.15.123:0/3037103730 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:50.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.420+0000 7f1f32400640 1 -- 172.21.15.123:0/3037103730 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f2c073be0 msgr2=0x7f1f2c15c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:50.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.420+0000 7f1f32400640 1 --2- 172.21.15.123:0/3037103730 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f2c073be0 0x7f1f2c15c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.420+0000 7f1f32400640 1 -- 172.21.15.123:0/3037103730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f2c0b32f0 msgr2=0x7f1f2c157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:50.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.420+0000 7f1f32400640 1 --2- 172.21.15.123:0/3037103730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f2c0b32f0 0x7f1f2c157ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.420+0000 7f1f32400640 1 -- 172.21.15.123:0/3037103730 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f2c14f380 con 0x7f1f2c0d0f80 2024-04-25T13:42:50.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.420+0000 7f1f31000640 1 --2- 172.21.15.123:0/3037103730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f2c0b32f0 0x7f1f2c157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:50.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.420+0000 7f1f32400640 1 --2- 172.21.15.123:0/3037103730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f2c0d0f80 0x7f1f2c158400 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1f240ab000 tx=0x7f1f240196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:50.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.420+0000 7f1f29600640 1 -- 172.21.15.123:0/3037103730 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f240bc030 con 0x7f1f2c0d0f80 2024-04-25T13:42:50.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.420+0000 7f1f29600640 1 -- 172.21.15.123:0/3037103730 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f240b8470 con 0x7f1f2c0d0f80 2024-04-25T13:42:50.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.420+0000 7f1f34400640 1 -- 172.21.15.123:0/3037103730 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f2c15f0d0 con 0x7f1f2c0d0f80 2024-04-25T13:42:50.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.420+0000 7f1f29600640 1 -- 172.21.15.123:0/3037103730 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f24009510 con 0x7f1f2c0d0f80 2024-04-25T13:42:50.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.420+0000 7f1f34400640 1 -- 172.21.15.123:0/3037103730 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f2c15f690 con 0x7f1f2c0d0f80 2024-04-25T13:42:50.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.424+0000 7f1f34400640 1 -- 172.21.15.123:0/3037103730 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f2c0507c0 con 0x7f1f2c0d0f80 2024-04-25T13:42:50.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.424+0000 7f1f29600640 1 -- 172.21.15.123:0/3037103730 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1f240bf070 con 0x7f1f2c0d0f80 2024-04-25T13:42:50.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.424+0000 7f1f29600640 1 --2- 172.21.15.123:0/3037103730 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1f0c06f400 0x7f1f0c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:50.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.424+0000 7f1f29600640 1 -- 172.21.15.123:0/3037103730 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f1f24129a50 con 0x7f1f2c0d0f80 2024-04-25T13:42:50.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.424+0000 7f1f31a00640 1 --2- 172.21.15.123:0/3037103730 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1f0c06f400 0x7f1f0c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:50.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.428+0000 7f1f31a00640 1 --2- 172.21.15.123:0/3037103730 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1f0c06f400 0x7f1f0c071910 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c070fa0 tx=0x7f1f20008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:50.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.432+0000 7f1f29600640 1 -- 172.21.15.123:0/3037103730 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1f240165e0 con 0x7f1f2c0d0f80 2024-04-25T13:42:50.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.588+0000 7f1f34400640 1 -- 172.21.15.123:0/3037103730 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f2c073630 con 0x7f1f2c0d0f80 2024-04-25T13:42:50.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.588+0000 7f1f29600640 1 -- 172.21.15.123:0/3037103730 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16879 (secure 0 0 0) 0x7f1f240f6300 con 0x7f1f2c0d0f80 2024-04-25T13:42:50.591 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:50.591 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":23,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:42:47.587063+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:03.949161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T13:42:04.755682+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:50.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.592+0000 7f1f34400640 1 -- 172.21.15.123:0/3037103730 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1f0c06f400 msgr2=0x7f1f0c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:50.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.592+0000 7f1f34400640 1 --2- 172.21.15.123:0/3037103730 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1f0c06f400 0x7f1f0c071910 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c070fa0 tx=0x7f1f20008040 comp rx=0 tx=0).stop 2024-04-25T13:42:50.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.592+0000 7f1f34400640 1 -- 172.21.15.123:0/3037103730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f2c0d0f80 msgr2=0x7f1f2c158400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:50.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.592+0000 7f1f34400640 1 --2- 172.21.15.123:0/3037103730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f2c0d0f80 0x7f1f2c158400 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1f240ab000 tx=0x7f1f240196d0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.592+0000 7f1f34400640 1 -- 172.21.15.123:0/3037103730 shutdown_connections 2024-04-25T13:42:50.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.592+0000 7f1f34400640 1 --2- 172.21.15.123:0/3037103730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f2c0b32f0 0x7f1f2c157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.592+0000 7f1f34400640 1 --2- 172.21.15.123:0/3037103730 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1f0c06f400 0x7f1f0c071910 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.592+0000 7f1f34400640 1 --2- 172.21.15.123:0/3037103730 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1f2c0d0f80 0x7f1f2c158400 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.592+0000 7f1f34400640 1 --2- 172.21.15.123:0/3037103730 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1f2c073be0 0x7f1f2c15c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.592+0000 7f1f34400640 1 -- 172.21.15.123:0/3037103730 >> 172.21.15.123:0/3037103730 conn(0x7f1f2c06d210 msgr2=0x7f1f2c0b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:50.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.592+0000 7f1f34400640 1 -- 172.21.15.123:0/3037103730 shutdown_connections 2024-04-25T13:42:50.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.592+0000 7f1f34400640 1 -- 172.21.15.123:0/3037103730 wait complete. 2024-04-25T13:42:50.615 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T13:42:50.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.760+0000 7f37afc00640 1 Processor -- start 2024-04-25T13:42:50.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.760+0000 7f37afc00640 1 -- start start 2024-04-25T13:42:50.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.764+0000 7f37afc00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37a80cc700 0x7f37a80cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:50.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.764+0000 7f37afc00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37a80cbb40 con 0x7f37a80d1280 2024-04-25T13:42:50.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.764+0000 7f37afc00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37a80730e0 con 0x7f37a8073fe0 2024-04-25T13:42:50.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.764+0000 7f37afc00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f37a80cbe20 con 0x7f37a80cc700 2024-04-25T13:42:50.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.764+0000 7f379fe00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f37a80d1280 0x7f37a80cbff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56278/0 (socket says 172.21.15.123:56278) 2024-04-25T13:42:50.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.764+0000 7f379fe00640 1 -- 172.21.15.123:0/2558376053 learned_addr learned my addr 172.21.15.123:0/2558376053 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:50.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.764+0000 7f37adc00640 1 --2- 172.21.15.123:0/2558376053 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37a80cc700 0x7f37a80cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:50.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.764+0000 7f37a7e00640 1 -- 172.21.15.123:0/2558376053 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3528683389 0 0) 0x7f37a80cbb40 con 0x7f37a80d1280 2024-04-25T13:42:50.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.764+0000 7f37a7e00640 1 -- 172.21.15.123:0/2558376053 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f378c003530 con 0x7f37a80d1280 2024-04-25T13:42:50.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.764+0000 7f37a7e00640 1 -- 172.21.15.123:0/2558376053 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 700945103 0 0) 0x7f37a80730e0 con 0x7f37a8073fe0 2024-04-25T13:42:50.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.764+0000 7f37a7e00640 1 -- 172.21.15.123:0/2558376053 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37a80cbb40 con 0x7f37a8073fe0 2024-04-25T13:42:50.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.764+0000 7f37adc00640 1 -- 172.21.15.123:0/2558376053 >> v1:172.21.15.130:6789/0 conn(0x7f37a8073fe0 legacy=0x7f37a80d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:50.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.764+0000 7f37adc00640 1 -- 172.21.15.123:0/2558376053 >> v1:172.21.15.123:6789/0 conn(0x7f37a80d1280 legacy=0x7f37a80cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:50.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.764+0000 7f37adc00640 1 -- 172.21.15.123:0/2558376053 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a80733c0 con 0x7f37a80cc700 2024-04-25T13:42:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.764+0000 7f37adc00640 1 --2- 172.21.15.123:0/2558376053 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37a80cc700 0x7f37a80cadd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f37a0009dc0 tx=0x7f37a001c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d0c35a944fdaf5b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.768+0000 7f37a7e00640 1 -- 172.21.15.123:0/2558376053 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a00b2070 con 0x7f37a80cc700 2024-04-25T13:42:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.768+0000 7f37a7e00640 1 -- 172.21.15.123:0/2558376053 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37a00a57c0 con 0x7f37a80cc700 2024-04-25T13:42:50.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.768+0000 7f37a7e00640 1 -- 172.21.15.123:0/2558376053 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a00a5b70 con 0x7f37a80cc700 2024-04-25T13:42:50.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.768+0000 7f37afc00640 1 -- 172.21.15.123:0/2558376053 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37a80cc700 msgr2=0x7f37a80cadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:50.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.768+0000 7f37afc00640 1 --2- 172.21.15.123:0/2558376053 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37a80cc700 0x7f37a80cadd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f37a0009dc0 tx=0x7f37a001c900 comp rx=0 tx=0).stop 2024-04-25T13:42:50.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.768+0000 7f37afc00640 1 -- 172.21.15.123:0/2558376053 shutdown_connections 2024-04-25T13:42:50.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.768+0000 7f37afc00640 1 --2- 172.21.15.123:0/2558376053 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37a80cc700 0x7f37a80cadd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.768+0000 7f37afc00640 1 -- 172.21.15.123:0/2558376053 >> 172.21.15.123:0/2558376053 conn(0x7f37a80d19a0 msgr2=0x7f37a80d1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:50.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.768+0000 7f37afc00640 1 -- 172.21.15.123:0/2558376053 shutdown_connections 2024-04-25T13:42:50.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.768+0000 7f37afc00640 1 -- 172.21.15.123:0/2558376053 wait complete. 2024-04-25T13:42:50.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.768+0000 7f37afc00640 1 Processor -- start 2024-04-25T13:42:50.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.768+0000 7f37afc00640 1 -- start start 2024-04-25T13:42:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.772+0000 7f37afc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37a80cc700 0x7f37a813ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.772+0000 7f37afc00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37a80d1280 0x7f37a815c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.772+0000 7f37afc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37a813d700 0x7f37a8145c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.772+0000 7f37afc00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f37a816e730 con 0x7f37a813d700 2024-04-25T13:42:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.772+0000 7f37afc00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f37a816e8b0 con 0x7f37a80cc700 2024-04-25T13:42:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.772+0000 7f37afc00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f37a816ea30 con 0x7f37a80d1280 2024-04-25T13:42:50.774 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.772+0000 7f37adc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37a813d700 0x7f37a8145c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.772+0000 7f37adc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37a813d700 0x7f37a8145c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36556/0 (socket says 172.21.15.123:36556) 2024-04-25T13:42:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.772+0000 7f37adc00640 1 -- 172.21.15.123:0/4052710695 learned_addr learned my addr 172.21.15.123:0/4052710695 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.772+0000 7f379fe00640 1 --2- 172.21.15.123:0/4052710695 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37a80d1280 0x7f37a815c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.772+0000 7f37ad200640 1 --2- 172.21.15.123:0/4052710695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37a80cc700 0x7f37a813ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.772+0000 7f37adc00640 1 -- 172.21.15.123:0/4052710695 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37a80d1280 msgr2=0x7f37a815c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.772+0000 7f37adc00640 1 --2- 172.21.15.123:0/4052710695 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37a80d1280 0x7f37a815c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.772+0000 7f37adc00640 1 -- 172.21.15.123:0/4052710695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37a80cc700 msgr2=0x7f37a813ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.772+0000 7f37adc00640 1 --2- 172.21.15.123:0/4052710695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37a80cc700 0x7f37a813ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.772+0000 7f37adc00640 1 -- 172.21.15.123:0/4052710695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a8143a90 con 0x7f37a813d700 2024-04-25T13:42:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.772+0000 7f37adc00640 1 --2- 172.21.15.123:0/4052710695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37a813d700 0x7f37a8145c90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f37a001a530 tx=0x7f37a00196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.772+0000 7f37a5600640 1 -- 172.21.15.123:0/4052710695 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a00b2040 con 0x7f37a813d700 2024-04-25T13:42:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.772+0000 7f37a5600640 1 -- 172.21.15.123:0/4052710695 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37a00bd070 con 0x7f37a813d700 2024-04-25T13:42:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.772+0000 7f37afc00640 1 -- 172.21.15.123:0/4052710695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37a8143d70 con 0x7f37a813d700 2024-04-25T13:42:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.772+0000 7f37a5600640 1 -- 172.21.15.123:0/4052710695 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a00a5b70 con 0x7f37a813d700 2024-04-25T13:42:50.775 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.772+0000 7f37afc00640 1 -- 172.21.15.123:0/4052710695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37a8136480 con 0x7f37a813d700 2024-04-25T13:42:50.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.772+0000 7f37afc00640 1 -- 172.21.15.123:0/4052710695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37a813d2c0 con 0x7f37a813d700 2024-04-25T13:42:50.776 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.776+0000 7f37a5600640 1 -- 172.21.15.123:0/4052710695 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f37a00a5d10 con 0x7f37a813d700 2024-04-25T13:42:50.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.776+0000 7f37a5600640 1 --2- 172.21.15.123:0/4052710695 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f378406f430 0x7f3784071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:50.777 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.776+0000 7f37a5600640 1 -- 172.21.15.123:0/4052710695 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f37a01298c0 con 0x7f37a813d700 2024-04-25T13:42:50.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.776+0000 7f37ad200640 1 --2- 172.21.15.123:0/4052710695 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f378406f430 0x7f3784071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:50.778 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.776+0000 7f37ad200640 1 --2- 172.21.15.123:0/4052710695 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f378406f430 0x7f3784071940 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f37a80d1880 tx=0x7f3798009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:50.782 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.780+0000 7f37a5600640 1 -- 172.21.15.123:0/4052710695 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f37a0016580 con 0x7f37a813d700 2024-04-25T13:42:50.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.968+0000 7f37afc00640 1 -- 172.21.15.123:0/4052710695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f37a8050750 con 0x7f37a813d700 2024-04-25T13:42:50.971 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-04-25T13:42:50.968+0000 7f6025000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T13:42:50.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.972+0000 7f37a5600640 1 -- 172.21.15.123:0/4052710695 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f37a00f60e0 con 0x7f37a813d700 2024-04-25T13:42:50.974 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T13:42:50.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.972+0000 7f37afc00640 1 -- 172.21.15.123:0/4052710695 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f378406f430 msgr2=0x7f3784071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:50.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.972+0000 7f37afc00640 1 --2- 172.21.15.123:0/4052710695 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f378406f430 0x7f3784071940 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f37a80d1880 tx=0x7f3798009040 comp rx=0 tx=0).stop 2024-04-25T13:42:50.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.972+0000 7f37afc00640 1 -- 172.21.15.123:0/4052710695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37a813d700 msgr2=0x7f37a8145c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:50.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.972+0000 7f37afc00640 1 --2- 172.21.15.123:0/4052710695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37a813d700 0x7f37a8145c90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f37a001a530 tx=0x7f37a00196a0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.972+0000 7f37afc00640 1 -- 172.21.15.123:0/4052710695 shutdown_connections 2024-04-25T13:42:50.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.972+0000 7f37afc00640 1 --2- 172.21.15.123:0/4052710695 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f378406f430 0x7f3784071940 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.972+0000 7f37afc00640 1 --2- 172.21.15.123:0/4052710695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f37a813d700 0x7f37a8145c90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.972+0000 7f37afc00640 1 --2- 172.21.15.123:0/4052710695 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f37a80d1280 0x7f37a815c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.972+0000 7f37afc00640 1 --2- 172.21.15.123:0/4052710695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f37a80cc700 0x7f37a813ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:50.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.972+0000 7f37afc00640 1 -- 172.21.15.123:0/4052710695 >> 172.21.15.123:0/4052710695 conn(0x7f37a80d19a0 msgr2=0x7f37a806fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:50.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.976+0000 7f37afc00640 1 -- 172.21.15.123:0/4052710695 shutdown_connections 2024-04-25T13:42:50.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:50.976+0000 7f37afc00640 1 -- 172.21.15.123:0/4052710695 wait complete. 2024-04-25T13:42:50.990 INFO:tasks.ceph.mds.b.smithi130.stderr: -7720> 2024-04-25T13:42:10.221+0000 7f2692800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T13:42:50.997 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T13:42:51.108 INFO:tasks.ceph.mds.b.smithi130.stdout:starting mds.b at 2024-04-25T13:42:51.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.144+0000 7f7a9de00640 1 Processor -- start 2024-04-25T13:42:51.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.144+0000 7f7a9de00640 1 -- start start 2024-04-25T13:42:51.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.144+0000 7f7a9de00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7a980d0e10 0x7f7a981611b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:51.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.144+0000 7f7a9de00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a981616f0 0x7f7a98161b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:51.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.144+0000 7f7a9de00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a980b4910 con 0x7f7a980d02f0 2024-04-25T13:42:51.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.144+0000 7f7a9de00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f7a98162040 con 0x7f7a980d0e10 2024-04-25T13:42:51.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.144+0000 7f7a9de00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7a980ce440 con 0x7f7a981616f0 2024-04-25T13:42:51.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.144+0000 7f7a9ca00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f7a980d02f0 0x7f7a980d0700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56288/0 (socket says 172.21.15.123:56288) 2024-04-25T13:42:51.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.144+0000 7f7a9ca00640 1 -- 172.21.15.123:0/2884606319 learned_addr learned my addr 172.21.15.123:0/2884606319 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:51.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.144+0000 7f7a8fe00640 1 --2- 172.21.15.123:0/2884606319 >> v2:172.21.15.130:3300/0 conn(0x7f7a980d0e10 0x7f7a981611b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:51.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.144+0000 7f7a9d400640 1 --2- 172.21.15.123:0/2884606319 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a981616f0 0x7f7a98161b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:51.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.148+0000 7f7a97e00640 1 -- 172.21.15.123:0/2884606319 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3380943184 0 0) 0x7f7a980b4910 con 0x7f7a980d02f0 2024-04-25T13:42:51.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.148+0000 7f7a97e00640 1 -- 172.21.15.123:0/2884606319 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a7c003530 con 0x7f7a980d02f0 2024-04-25T13:42:51.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.148+0000 7f7a8fe00640 1 -- 172.21.15.123:0/2884606319 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a981616f0 msgr2=0x7f7a98161b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:51.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.148+0000 7f7a8fe00640 1 --2- 172.21.15.123:0/2884606319 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a981616f0 0x7f7a98161b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:51.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.148+0000 7f7a8fe00640 1 -- 172.21.15.123:0/2884606319 >> v1:172.21.15.123:6789/0 conn(0x7f7a980d02f0 legacy=0x7f7a980d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:51.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.148+0000 7f7a8fe00640 1 -- 172.21.15.123:0/2884606319 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a980cdc40 con 0x7f7a980d0e10 2024-04-25T13:42:51.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.148+0000 7f7a8fe00640 1 --2- 172.21.15.123:0/2884606319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a980d0e10 0x7f7a981611b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7a800097c0 tx=0x7f7a8001c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e021d3d819327c7a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:51.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.148+0000 7f7a97e00640 1 -- 172.21.15.123:0/2884606319 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a800b0070 con 0x7f7a980d0e10 2024-04-25T13:42:51.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.148+0000 7f7a97e00640 1 -- 172.21.15.123:0/2884606319 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a800ab600 con 0x7f7a980d0e10 2024-04-25T13:42:51.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.148+0000 7f7a97e00640 1 -- 172.21.15.123:0/2884606319 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a800ab9d0 con 0x7f7a980d0e10 2024-04-25T13:42:51.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.152+0000 7f7a9de00640 1 -- 172.21.15.123:0/2884606319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a980d0e10 msgr2=0x7f7a981611b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:51.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.152+0000 7f7a9de00640 1 --2- 172.21.15.123:0/2884606319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a980d0e10 0x7f7a981611b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7a800097c0 tx=0x7f7a8001c380 comp rx=0 tx=0).stop 2024-04-25T13:42:51.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.152+0000 7f7a9de00640 1 -- 172.21.15.123:0/2884606319 shutdown_connections 2024-04-25T13:42:51.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.152+0000 7f7a9de00640 1 --2- 172.21.15.123:0/2884606319 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a981616f0 0x7f7a98161b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:51.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.152+0000 7f7a9de00640 1 --2- 172.21.15.123:0/2884606319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a980d0e10 0x7f7a981611b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:51.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.152+0000 7f7a9de00640 1 -- 172.21.15.123:0/2884606319 >> 172.21.15.123:0/2884606319 conn(0x7f7a9809ba00 msgr2=0x7f7a980b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:51.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.152+0000 7f7a9de00640 1 -- 172.21.15.123:0/2884606319 shutdown_connections 2024-04-25T13:42:51.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.152+0000 7f7a9de00640 1 -- 172.21.15.123:0/2884606319 wait complete. 2024-04-25T13:42:51.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.152+0000 7f7a9de00640 1 Processor -- start 2024-04-25T13:42:51.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.152+0000 7f7a9de00640 1 -- start start 2024-04-25T13:42:51.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.156+0000 7f7a9de00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a980d02f0 0x7f7a98150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:51.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.156+0000 7f7a9de00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a980d0e10 0x7f7a980ca4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:51.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.156+0000 7f7a9de00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a981616f0 0x7f7a980c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:51.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.156+0000 7f7a9de00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7a980b5f00 con 0x7f7a981616f0 2024-04-25T13:42:51.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.156+0000 7f7a9de00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7a980b5d80 con 0x7f7a980d0e10 2024-04-25T13:42:51.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.156+0000 7f7a9de00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7a980b6080 con 0x7f7a980d02f0 2024-04-25T13:42:51.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.156+0000 7f7a9d400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a981616f0 0x7f7a980c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:51.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.156+0000 7f7a9d400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a981616f0 0x7f7a980c9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36558/0 (socket says 172.21.15.123:36558) 2024-04-25T13:42:51.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.156+0000 7f7a9d400640 1 -- 172.21.15.123:0/14087354 learned_addr learned my addr 172.21.15.123:0/14087354 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:51.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.156+0000 7f7a9ca00640 1 --2- 172.21.15.123:0/14087354 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a980d02f0 0x7f7a98150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:51.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.156+0000 7f7a8fe00640 1 --2- 172.21.15.123:0/14087354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a980d0e10 0x7f7a980ca4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:51.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.156+0000 7f7a9d400640 1 -- 172.21.15.123:0/14087354 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a980d02f0 msgr2=0x7f7a98150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:51.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.156+0000 7f7a9d400640 1 --2- 172.21.15.123:0/14087354 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a980d02f0 0x7f7a98150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:51.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.156+0000 7f7a9d400640 1 -- 172.21.15.123:0/14087354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a980d0e10 msgr2=0x7f7a980ca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:51.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.156+0000 7f7a9d400640 1 --2- 172.21.15.123:0/14087354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a980d0e10 0x7f7a980ca4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:51.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.156+0000 7f7a9d400640 1 -- 172.21.15.123:0/14087354 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a981512a0 con 0x7f7a981616f0 2024-04-25T13:42:51.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.156+0000 7f7a9d400640 1 --2- 172.21.15.123:0/14087354 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a981616f0 0x7f7a980c9c50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7a90009cb0 tx=0x7f7a9000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:51.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.156+0000 7f7a95600640 1 -- 172.21.15.123:0/14087354 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a90018020 con 0x7f7a981616f0 2024-04-25T13:42:51.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.156+0000 7f7a95600640 1 -- 172.21.15.123:0/14087354 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a90014480 con 0x7f7a981616f0 2024-04-25T13:42:51.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.156+0000 7f7a9de00640 1 -- 172.21.15.123:0/14087354 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a98152e40 con 0x7f7a981616f0 2024-04-25T13:42:51.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.156+0000 7f7a95600640 1 -- 172.21.15.123:0/14087354 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a90014870 con 0x7f7a981616f0 2024-04-25T13:42:51.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.156+0000 7f7a9de00640 1 -- 172.21.15.123:0/14087354 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a9815a1d0 con 0x7f7a981616f0 2024-04-25T13:42:51.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.156+0000 7f7a9de00640 1 -- 172.21.15.123:0/14087354 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a98050750 con 0x7f7a981616f0 2024-04-25T13:42:51.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.160+0000 7f7a95600640 1 -- 172.21.15.123:0/14087354 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7a9001b020 con 0x7f7a981616f0 2024-04-25T13:42:51.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.160+0000 7f7a95600640 1 --2- 172.21.15.123:0/14087354 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f7a7406f430 0x7f7a74071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:51.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.160+0000 7f7a95600640 1 -- 172.21.15.123:0/14087354 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5911+0+0 (secure 0 0 0) 0x7f7a900901f0 con 0x7f7a981616f0 2024-04-25T13:42:51.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.160+0000 7f7a9ca00640 1 --2- 172.21.15.123:0/14087354 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f7a7406f430 0x7f7a74071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:51.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.160+0000 7f7a9ca00640 1 --2- 172.21.15.123:0/14087354 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f7a7406f430 0x7f7a74071940 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7a88005890 tx=0x7f7a88009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:51.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.164+0000 7f7a95600640 1 -- 172.21.15.123:0/14087354 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7a90022030 con 0x7f7a981616f0 2024-04-25T13:42:51.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.352+0000 7f7a9de00640 1 -- 172.21.15.123:0/14087354 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f7a980b4860 con 0x7f7a981616f0 2024-04-25T13:42:51.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.976+0000 7f7a95600640 1 -- 172.21.15.123:0/14087354 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f7a90010040 con 0x7f7a981616f0 2024-04-25T13:42:51.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.980+0000 7f7a9de00640 1 -- 172.21.15.123:0/14087354 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f7a7406f430 msgr2=0x7f7a74071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:51.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.980+0000 7f7a9de00640 1 --2- 172.21.15.123:0/14087354 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f7a7406f430 0x7f7a74071940 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7a88005890 tx=0x7f7a88009040 comp rx=0 tx=0).stop 2024-04-25T13:42:51.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.980+0000 7f7a9de00640 1 -- 172.21.15.123:0/14087354 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a981616f0 msgr2=0x7f7a980c9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:51.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.980+0000 7f7a9de00640 1 --2- 172.21.15.123:0/14087354 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a981616f0 0x7f7a980c9c50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7a90009cb0 tx=0x7f7a9000c490 comp rx=0 tx=0).stop 2024-04-25T13:42:51.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.980+0000 7f7a9de00640 1 -- 172.21.15.123:0/14087354 shutdown_connections 2024-04-25T13:42:51.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.980+0000 7f7a9de00640 1 --2- 172.21.15.123:0/14087354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a980d0e10 0x7f7a980ca4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:51.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.980+0000 7f7a9de00640 1 --2- 172.21.15.123:0/14087354 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f7a7406f430 0x7f7a74071940 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:51.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.980+0000 7f7a9de00640 1 --2- 172.21.15.123:0/14087354 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a981616f0 0x7f7a980c9c50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:51.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.980+0000 7f7a9de00640 1 --2- 172.21.15.123:0/14087354 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a980d02f0 0x7f7a98150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:51.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.980+0000 7f7a9de00640 1 -- 172.21.15.123:0/14087354 >> 172.21.15.123:0/14087354 conn(0x7f7a9809ba00 msgr2=0x7f7a980d0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:51.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.980+0000 7f7a9de00640 1 -- 172.21.15.123:0/14087354 shutdown_connections 2024-04-25T13:42:51.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:51.980+0000 7f7a9de00640 1 -- 172.21.15.123:0/14087354 wait complete. 2024-04-25T13:42:52.005 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T13:42:52.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.156+0000 7f9359c00640 1 Processor -- start 2024-04-25T13:42:52.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.156+0000 7f9359c00640 1 -- start start 2024-04-25T13:42:52.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.156+0000 7f9359c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f935415d410 0x7f935415ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:52.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.156+0000 7f9359c00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9354073290 0x7f93540b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:52.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.156+0000 7f9359c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f935415c940 con 0x7f93541604c0 2024-04-25T13:42:52.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.156+0000 7f9359c00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f93541609d0 con 0x7f9354073290 2024-04-25T13:42:52.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.156+0000 7f9359c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9354160cb0 con 0x7f935415d410 2024-04-25T13:42:52.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.156+0000 7f9352000640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f93541604c0 0x7f9354072b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56298/0 (socket says 172.21.15.123:56298) 2024-04-25T13:42:52.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.156+0000 7f9352000640 1 -- 172.21.15.123:0/3518792634 learned_addr learned my addr 172.21.15.123:0/3518792634 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:52.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.160+0000 7f9352a00640 1 --2- 172.21.15.123:0/3518792634 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f935415d410 0x7f935415ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:52.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.160+0000 7f9353400640 1 --2- 172.21.15.123:0/3518792634 >> v2:172.21.15.130:3300/0 conn(0x7f9354073290 0x7f93540b45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:52.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.160+0000 7f9351600640 1 -- 172.21.15.123:0/3518792634 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3415469911 0 0) 0x7f935415c940 con 0x7f93541604c0 2024-04-25T13:42:52.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.160+0000 7f9351600640 1 -- 172.21.15.123:0/3518792634 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9338003530 con 0x7f93541604c0 2024-04-25T13:42:52.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.160+0000 7f9351600640 1 -- 172.21.15.123:0/3518792634 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1807391214 0 0) 0x7f9338003530 con 0x7f93541604c0 2024-04-25T13:42:52.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.160+0000 7f9351600640 1 -- 172.21.15.123:0/3518792634 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f935415d410 msgr2=0x7f935415ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:52.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.160+0000 7f9351600640 1 --2- 172.21.15.123:0/3518792634 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f935415d410 0x7f935415ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:52.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.160+0000 7f9351600640 1 -- 172.21.15.123:0/3518792634 >> v2:172.21.15.130:3300/0 conn(0x7f9354073290 msgr2=0x7f93540b45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:52.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.160+0000 7f9351600640 1 --2- 172.21.15.123:0/3518792634 >> v2:172.21.15.130:3300/0 conn(0x7f9354073290 0x7f93540b45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:52.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.160+0000 7f9351600640 1 -- 172.21.15.123:0/3518792634 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f935415cc10 con 0x7f93541604c0 2024-04-25T13:42:52.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.160+0000 7f9351600640 1 -- 172.21.15.123:0/3518792634 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7f9340001680 con 0x7f93541604c0 2024-04-25T13:42:52.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.160+0000 7f9351600640 1 -- 172.21.15.123:0/3518792634 >> v1:172.21.15.123:6789/0 conn(0x7f93541604c0 legacy=0x7f9354072b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:52.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.160+0000 7f9351600640 1 --2- 172.21.15.123:0/3518792634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93380039c0 0x7f9338003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:52.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.160+0000 7f9351600640 1 --2- 172.21.15.123:0/3518792634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9338004810 0x7f9338004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:52.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.160+0000 7f9351600640 1 --2- 172.21.15.123:0/3518792634 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f935415d410 0x7f9338005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:52.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.160+0000 7f9351600640 1 -- 172.21.15.123:0/3518792634 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f93541609d0 con 0x7f93380039c0 2024-04-25T13:42:52.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.160+0000 7f9351600640 1 -- 172.21.15.123:0/3518792634 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9354160cb0 con 0x7f9338004810 2024-04-25T13:42:52.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.160+0000 7f9351600640 1 -- 172.21.15.123:0/3518792634 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f933800ba80 con 0x7f935415d410 2024-04-25T13:42:52.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.160+0000 7f9352a00640 1 --2- 172.21.15.123:0/3518792634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93380039c0 0x7f9338003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:52.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.160+0000 7f9353400640 1 --2- 172.21.15.123:0/3518792634 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f935415d410 0x7f9338005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:52.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.160+0000 7f9352000640 1 --2- 172.21.15.123:0/3518792634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9338004810 0x7f9338004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:52.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.160+0000 7f9352a00640 1 -- 172.21.15.123:0/3518792634 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f935415d410 msgr2=0x7f9338005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:52.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.160+0000 7f9352a00640 1 --2- 172.21.15.123:0/3518792634 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f935415d410 0x7f9338005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:52.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.160+0000 7f9352a00640 1 -- 172.21.15.123:0/3518792634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9338004810 msgr2=0x7f9338004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:52.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.160+0000 7f9352a00640 1 --2- 172.21.15.123:0/3518792634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9338004810 0x7f9338004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:52.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.160+0000 7f9352a00640 1 -- 172.21.15.123:0/3518792634 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9338003530 con 0x7f93380039c0 2024-04-25T13:42:52.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.164+0000 7f9352a00640 1 --2- 172.21.15.123:0/3518792634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93380039c0 0x7f9338003e30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9344009fc0 tx=0x7f934401cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7efa258eb5bd64d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:52.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.164+0000 7f9351600640 1 -- 172.21.15.123:0/3518792634 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93440b2070 con 0x7f93380039c0 2024-04-25T13:42:52.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.164+0000 7f9351600640 1 -- 172.21.15.123:0/3518792634 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93440a5af0 con 0x7f93380039c0 2024-04-25T13:42:52.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.164+0000 7f9351600640 1 -- 172.21.15.123:0/3518792634 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9344009c10 con 0x7f93380039c0 2024-04-25T13:42:52.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.164+0000 7f9359c00640 1 -- 172.21.15.123:0/3518792634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93380039c0 msgr2=0x7f9338003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:52.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.164+0000 7f9359c00640 1 --2- 172.21.15.123:0/3518792634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93380039c0 0x7f9338003e30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9344009fc0 tx=0x7f934401cc70 comp rx=0 tx=0).stop 2024-04-25T13:42:52.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.164+0000 7f9353400640 1 -- 172.21.15.123:0/3518792634 reap_dead start 2024-04-25T13:42:52.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.164+0000 7f9359c00640 1 -- 172.21.15.123:0/3518792634 shutdown_connections 2024-04-25T13:42:52.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.164+0000 7f9359c00640 1 -- 172.21.15.123:0/3518792634 >> 172.21.15.123:0/3518792634 conn(0x7f93540b38a0 msgr2=0x7f93540d15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:52.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.164+0000 7f9359c00640 1 -- 172.21.15.123:0/3518792634 shutdown_connections 2024-04-25T13:42:52.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.164+0000 7f9359c00640 1 -- 172.21.15.123:0/3518792634 wait complete. 2024-04-25T13:42:52.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.164+0000 7f9359c00640 1 Processor -- start 2024-04-25T13:42:52.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.164+0000 7f9359c00640 1 -- start start 2024-04-25T13:42:52.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.168+0000 7f9359c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93380039c0 0x7f9354148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:52.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.168+0000 7f9359c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93541556a0 0x7f93540b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:52.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.168+0000 7f9359c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9354153100 0x7f93540b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:52.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.168+0000 7f9359c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f93540b4c60 con 0x7f93541556a0 2024-04-25T13:42:52.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.168+0000 7f9359c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f93540b4ae0 con 0x7f93380039c0 2024-04-25T13:42:52.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.168+0000 7f9359c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f93540b4de0 con 0x7f9354153100 2024-04-25T13:42:52.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.168+0000 7f9352000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93541556a0 0x7f93540b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:52.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.168+0000 7f9352000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93541556a0 0x7f93540b1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36578/0 (socket says 172.21.15.123:36578) 2024-04-25T13:42:52.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.168+0000 7f9352000640 1 -- 172.21.15.123:0/1994278614 learned_addr learned my addr 172.21.15.123:0/1994278614 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:52.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.168+0000 7f9352a00640 1 --2- 172.21.15.123:0/1994278614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93380039c0 0x7f9354148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:52.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.168+0000 7f9353400640 1 --2- 172.21.15.123:0/1994278614 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9354153100 0x7f93540b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:52.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.168+0000 7f9352000640 1 -- 172.21.15.123:0/1994278614 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9354153100 msgr2=0x7f93540b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:52.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.168+0000 7f9352000640 1 --2- 172.21.15.123:0/1994278614 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9354153100 0x7f93540b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:52.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.168+0000 7f9352000640 1 -- 172.21.15.123:0/1994278614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93380039c0 msgr2=0x7f9354148030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:52.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.168+0000 7f9352000640 1 --2- 172.21.15.123:0/1994278614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93380039c0 0x7f9354148030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:52.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.168+0000 7f9352000640 1 -- 172.21.15.123:0/1994278614 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9354148570 con 0x7f93541556a0 2024-04-25T13:42:52.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.168+0000 7f9352000640 1 --2- 172.21.15.123:0/1994278614 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93541556a0 0x7f93540b1cb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f934000e780 tx=0x7f934000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:52.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.168+0000 7f934aa00640 1 -- 172.21.15.123:0/1994278614 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934000c6c0 con 0x7f93541556a0 2024-04-25T13:42:52.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.168+0000 7f934aa00640 1 -- 172.21.15.123:0/1994278614 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9340018070 con 0x7f93541556a0 2024-04-25T13:42:52.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.168+0000 7f934aa00640 1 -- 172.21.15.123:0/1994278614 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934000caa0 con 0x7f93541556a0 2024-04-25T13:42:52.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.168+0000 7f9359c00640 1 -- 172.21.15.123:0/1994278614 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f935415eef0 con 0x7f93541556a0 2024-04-25T13:42:52.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.168+0000 7f9359c00640 1 -- 172.21.15.123:0/1994278614 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f935415f4b0 con 0x7f93541556a0 2024-04-25T13:42:52.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.168+0000 7f9359c00640 1 -- 172.21.15.123:0/1994278614 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9354155bf0 con 0x7f93541556a0 2024-04-25T13:42:52.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.172+0000 7f934aa00640 1 -- 172.21.15.123:0/1994278614 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f934000cc40 con 0x7f93541556a0 2024-04-25T13:42:52.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.172+0000 7f934aa00640 1 --2- 172.21.15.123:0/1994278614 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f933406f430 0x7f9334071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:52.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.172+0000 7f934aa00640 1 -- 172.21.15.123:0/1994278614 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5911+0+0 (secure 0 0 0) 0x7f934008ef70 con 0x7f93541556a0 2024-04-25T13:42:52.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.172+0000 7f9352a00640 1 --2- 172.21.15.123:0/1994278614 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f933406f430 0x7f9334071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:52.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.172+0000 7f9352a00640 1 --2- 172.21.15.123:0/1994278614 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f933406f430 0x7f9334071940 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f93440b0040 tx=0x7f9344004ac0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:52.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.176+0000 7f934aa00640 1 -- 172.21.15.123:0/1994278614 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f934005b7c0 con 0x7f93541556a0 2024-04-25T13:42:52.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.332+0000 7f9359c00640 1 -- 172.21.15.123:0/1994278614 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f935406a210 con 0x7f93541556a0 2024-04-25T13:42:52.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.980+0000 7f934aa00640 1 -- 172.21.15.123:0/1994278614 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) ==== 181+0+0 (secure 0 0 0) 0x7f934005fac0 con 0x7f93541556a0 2024-04-25T13:42:52.982 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2024-04-25T13:42:52.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.984+0000 7f9359c00640 1 -- 172.21.15.123:0/1994278614 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f933406f430 msgr2=0x7f9334071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:52.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.984+0000 7f9359c00640 1 --2- 172.21.15.123:0/1994278614 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f933406f430 0x7f9334071940 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f93440b0040 tx=0x7f9344004ac0 comp rx=0 tx=0).stop 2024-04-25T13:42:52.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.984+0000 7f9359c00640 1 -- 172.21.15.123:0/1994278614 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93541556a0 msgr2=0x7f93540b1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:52.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.984+0000 7f9359c00640 1 --2- 172.21.15.123:0/1994278614 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93541556a0 0x7f93540b1cb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f934000e780 tx=0x7f934000ec40 comp rx=0 tx=0).stop 2024-04-25T13:42:52.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.984+0000 7f9359c00640 1 -- 172.21.15.123:0/1994278614 shutdown_connections 2024-04-25T13:42:52.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.984+0000 7f9359c00640 1 --2- 172.21.15.123:0/1994278614 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f933406f430 0x7f9334071940 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:52.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.984+0000 7f9359c00640 1 --2- 172.21.15.123:0/1994278614 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9354153100 0x7f93540b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:52.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.984+0000 7f9359c00640 1 --2- 172.21.15.123:0/1994278614 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f93541556a0 0x7f93540b1cb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:52.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.984+0000 7f9359c00640 1 --2- 172.21.15.123:0/1994278614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93380039c0 0x7f9354148030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:52.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.984+0000 7f9359c00640 1 -- 172.21.15.123:0/1994278614 >> 172.21.15.123:0/1994278614 conn(0x7f93540b38a0 msgr2=0x7f93540b5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:52.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.984+0000 7f9359c00640 1 -- 172.21.15.123:0/1994278614 shutdown_connections 2024-04-25T13:42:52.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:52.984+0000 7f9359c00640 1 -- 172.21.15.123:0/1994278614 wait complete. 2024-04-25T13:42:53.009 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T13:42:53.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.160+0000 7faed7600640 1 Processor -- start 2024-04-25T13:42:53.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.160+0000 7faed7600640 1 -- start start 2024-04-25T13:42:53.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.160+0000 7faed7600640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7faed00b4910 0x7faed006c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:53.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.160+0000 7faed7600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faed006cbb0 0x7faed00d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:53.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.160+0000 7faed7600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faed006cfc0 con 0x7faed00b2f40 2024-04-25T13:42:53.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.160+0000 7faed7600640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7faed00b3f00 con 0x7faed00b4910 2024-04-25T13:42:53.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.160+0000 7faed7600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7faed00b2180 con 0x7faed006cbb0 2024-04-25T13:42:53.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.160+0000 7faed4c00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7faed00b2f40 0x7faed00cdf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56304/0 (socket says 172.21.15.123:56304) 2024-04-25T13:42:53.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.160+0000 7faed4c00640 1 -- 172.21.15.123:0/2350031936 learned_addr learned my addr 172.21.15.123:0/2350031936 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:53.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.164+0000 7faecfe00640 1 --2- 172.21.15.123:0/2350031936 >> v2:172.21.15.130:3300/0 conn(0x7faed00b4910 0x7faed006c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:53.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.164+0000 7faed5600640 1 --2- 172.21.15.123:0/2350031936 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faed006cbb0 0x7faed00d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:53.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.164+0000 7faecf400640 1 -- 172.21.15.123:0/2350031936 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 691851298 0 0) 0x7faec4001120 con 0x7faed00b2f40 2024-04-25T13:42:53.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.164+0000 7faecf400640 1 -- 172.21.15.123:0/2350031936 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faeb8003530 con 0x7faed00b2f40 2024-04-25T13:42:53.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.164+0000 7faecf400640 1 -- 172.21.15.123:0/2350031936 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3457456101 0 0) 0x7faeb8003530 con 0x7faed00b2f40 2024-04-25T13:42:53.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.164+0000 7faecf400640 1 -- 172.21.15.123:0/2350031936 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faed006cbb0 msgr2=0x7faed00d1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:53.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.164+0000 7faecf400640 1 --2- 172.21.15.123:0/2350031936 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faed006cbb0 0x7faed00d1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:53.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.164+0000 7faecf400640 1 -- 172.21.15.123:0/2350031936 >> v2:172.21.15.130:3300/0 conn(0x7faed00b4910 msgr2=0x7faed006c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:53.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.164+0000 7faecf400640 1 --2- 172.21.15.123:0/2350031936 >> v2:172.21.15.130:3300/0 conn(0x7faed00b4910 0x7faed006c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:53.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.164+0000 7faecf400640 1 -- 172.21.15.123:0/2350031936 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed00b2460 con 0x7faed00b2f40 2024-04-25T13:42:53.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.164+0000 7faecf400640 1 -- 172.21.15.123:0/2350031936 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7faec4001850 con 0x7faed00b2f40 2024-04-25T13:42:53.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.164+0000 7faecf400640 1 -- 172.21.15.123:0/2350031936 >> v1:172.21.15.123:6789/0 conn(0x7faed00b2f40 legacy=0x7faed00cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:53.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.164+0000 7faecf400640 1 --2- 172.21.15.123:0/2350031936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faeb80039c0 0x7faeb8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:53.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.164+0000 7faecf400640 1 --2- 172.21.15.123:0/2350031936 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faed006cbb0 0x7faeb8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:53.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.164+0000 7faecf400640 1 --2- 172.21.15.123:0/2350031936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faeb8004d50 0x7faeb8005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:53.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.164+0000 7faecf400640 1 -- 172.21.15.123:0/2350031936 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7faed00b3f00 con 0x7faeb80039c0 2024-04-25T13:42:53.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.164+0000 7faecf400640 1 -- 172.21.15.123:0/2350031936 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faed00b2180 con 0x7faeb8004d50 2024-04-25T13:42:53.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.164+0000 7faecf400640 1 -- 172.21.15.123:0/2350031936 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7faeb800bb00 con 0x7faed006cbb0 2024-04-25T13:42:53.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.164+0000 7faed4c00640 1 --2- 172.21.15.123:0/2350031936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faeb80039c0 0x7faeb8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:53.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.164+0000 7faed5600640 1 --2- 172.21.15.123:0/2350031936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faeb8004d50 0x7faeb8005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:53.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.164+0000 7faecfe00640 1 --2- 172.21.15.123:0/2350031936 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faed006cbb0 0x7faeb8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:53.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.164+0000 7faed4c00640 1 -- 172.21.15.123:0/2350031936 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faed006cbb0 msgr2=0x7faeb8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:53.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.164+0000 7faed4c00640 1 --2- 172.21.15.123:0/2350031936 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faed006cbb0 0x7faeb8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:53.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.164+0000 7faed4c00640 1 -- 172.21.15.123:0/2350031936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faeb8004d50 msgr2=0x7faeb8005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:53.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.164+0000 7faed4c00640 1 --2- 172.21.15.123:0/2350031936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faeb8004d50 0x7faeb8005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:53.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.164+0000 7faed4c00640 1 -- 172.21.15.123:0/2350031936 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faeb8003530 con 0x7faeb80039c0 2024-04-25T13:42:53.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.168+0000 7faed4c00640 1 --2- 172.21.15.123:0/2350031936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faeb80039c0 0x7faeb8003e30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7faed0164d80 tx=0x7faec401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c0cbccc80744cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:53.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.168+0000 7faecf400640 1 -- 172.21.15.123:0/2350031936 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec400c0e0 con 0x7faeb80039c0 2024-04-25T13:42:53.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.168+0000 7faecf400640 1 -- 172.21.15.123:0/2350031936 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faec40a9020 con 0x7faeb80039c0 2024-04-25T13:42:53.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.168+0000 7faecf400640 1 -- 172.21.15.123:0/2350031936 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec4005b20 con 0x7faeb80039c0 2024-04-25T13:42:53.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.168+0000 7faed7600640 1 -- 172.21.15.123:0/2350031936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faeb80039c0 msgr2=0x7faeb8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:53.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.168+0000 7faed7600640 1 --2- 172.21.15.123:0/2350031936 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faeb80039c0 0x7faeb8003e30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7faed0164d80 tx=0x7faec401cc60 comp rx=0 tx=0).stop 2024-04-25T13:42:53.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.168+0000 7faed5600640 1 -- 172.21.15.123:0/2350031936 reap_dead start 2024-04-25T13:42:53.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.168+0000 7faed7600640 1 -- 172.21.15.123:0/2350031936 shutdown_connections 2024-04-25T13:42:53.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.168+0000 7faed7600640 1 -- 172.21.15.123:0/2350031936 >> 172.21.15.123:0/2350031936 conn(0x7faed009ba00 msgr2=0x7faed00b4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:53.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.168+0000 7faed7600640 1 -- 172.21.15.123:0/2350031936 shutdown_connections 2024-04-25T13:42:53.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.168+0000 7faed7600640 1 -- 172.21.15.123:0/2350031936 wait complete. 2024-04-25T13:42:53.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.172+0000 7faed7600640 1 Processor -- start 2024-04-25T13:42:53.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.172+0000 7faed7600640 1 -- start start 2024-04-25T13:42:53.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.172+0000 7faed7600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faeb80039c0 0x7faed0150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:53.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.172+0000 7faed7600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faed00b0d90 0x7faed015a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:53.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.172+0000 7faed7600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faed015aae0 0x7faed00af470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:53.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.172+0000 7faed7600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7faed00d2110 con 0x7faed00b0d90 2024-04-25T13:42:53.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.172+0000 7faed7600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faed00b82a0 con 0x7faeb80039c0 2024-04-25T13:42:53.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.172+0000 7faed7600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7faed00d2290 con 0x7faed015aae0 2024-04-25T13:42:53.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.172+0000 7faecfe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faed00b0d90 0x7faed015a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:53.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.172+0000 7faecfe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faed00b0d90 0x7faed015a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36604/0 (socket says 172.21.15.123:36604) 2024-04-25T13:42:53.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.172+0000 7faecfe00640 1 -- 172.21.15.123:0/3942388866 learned_addr learned my addr 172.21.15.123:0/3942388866 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:53.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.172+0000 7faed4c00640 1 --2- 172.21.15.123:0/3942388866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faeb80039c0 0x7faed0150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:53.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.172+0000 7faed5600640 1 --2- 172.21.15.123:0/3942388866 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faed015aae0 0x7faed00af470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:53.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.172+0000 7faecfe00640 1 -- 172.21.15.123:0/3942388866 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faed015aae0 msgr2=0x7faed00af470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:53.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.172+0000 7faecfe00640 1 --2- 172.21.15.123:0/3942388866 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faed015aae0 0x7faed00af470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:53.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.172+0000 7faecfe00640 1 -- 172.21.15.123:0/3942388866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faeb80039c0 msgr2=0x7faed0150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:53.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.172+0000 7faecfe00640 1 --2- 172.21.15.123:0/3942388866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faeb80039c0 0x7faed0150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:53.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.172+0000 7faecfe00640 1 -- 172.21.15.123:0/3942388866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faed015aef0 con 0x7faed00b0d90 2024-04-25T13:42:53.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.172+0000 7faecfe00640 1 --2- 172.21.15.123:0/3942388866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faed00b0d90 0x7faed015a5a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faebc011a00 tx=0x7faebc011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:53.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.172+0000 7faeccc00640 1 -- 172.21.15.123:0/3942388866 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc00fb50 con 0x7faed00b0d90 2024-04-25T13:42:53.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.172+0000 7faeccc00640 1 -- 172.21.15.123:0/3942388866 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faebc00fcf0 con 0x7faed00b0d90 2024-04-25T13:42:53.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.172+0000 7faed7600640 1 -- 172.21.15.123:0/3942388866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faed0150ec0 con 0x7faed00b0d90 2024-04-25T13:42:53.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.172+0000 7faeccc00640 1 -- 172.21.15.123:0/3942388866 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc00fea0 con 0x7faed00b0d90 2024-04-25T13:42:53.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.172+0000 7faed7600640 1 -- 172.21.15.123:0/3942388866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faed0158730 con 0x7faed00b0d90 2024-04-25T13:42:53.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.176+0000 7faed7600640 1 -- 172.21.15.123:0/3942388866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faed01584a0 con 0x7faed00b0d90 2024-04-25T13:42:53.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.176+0000 7faeccc00640 1 -- 172.21.15.123:0/3942388866 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7faebc012040 con 0x7faed00b0d90 2024-04-25T13:42:53.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.176+0000 7faeccc00640 1 --2- 172.21.15.123:0/3942388866 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7faeb006f400 0x7faeb0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:53.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.176+0000 7faeccc00640 1 -- 172.21.15.123:0/3942388866 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5473+0+0 (secure 0 0 0) 0x7faebc08f7a0 con 0x7faed00b0d90 2024-04-25T13:42:53.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.176+0000 7faed4c00640 1 --2- 172.21.15.123:0/3942388866 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7faeb006f400 0x7faeb0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:53.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.176+0000 7faed4c00640 1 --2- 172.21.15.123:0/3942388866 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7faeb006f400 0x7faeb0071910 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faec40aa000 tx=0x7faec40b1040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:53.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.180+0000 7faeccc00640 1 -- 172.21.15.123:0/3942388866 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7faed015aef0 con 0x7faed00b0d90 2024-04-25T13:42:53.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.340+0000 7faed7600640 1 -- 172.21.15.123:0/3942388866 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7faed006a210 con 0x7faed00b0d90 2024-04-25T13:42:53.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.984+0000 7faeccc00640 1 -- 172.21.15.123:0/3942388866 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) ==== 169+0+0 (secure 0 0 0) 0x7faebc019030 con 0x7faed00b0d90 2024-04-25T13:42:53.987 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2024-04-25T13:42:53.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.988+0000 7faed7600640 1 -- 172.21.15.123:0/3942388866 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7faeb006f400 msgr2=0x7faeb0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:53.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.988+0000 7faed7600640 1 --2- 172.21.15.123:0/3942388866 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7faeb006f400 0x7faeb0071910 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faec40aa000 tx=0x7faec40b1040 comp rx=0 tx=0).stop 2024-04-25T13:42:53.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.988+0000 7faed7600640 1 -- 172.21.15.123:0/3942388866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faed00b0d90 msgr2=0x7faed015a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:53.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.988+0000 7faed7600640 1 --2- 172.21.15.123:0/3942388866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faed00b0d90 0x7faed015a5a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faebc011a00 tx=0x7faebc011ec0 comp rx=0 tx=0).stop 2024-04-25T13:42:53.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.992+0000 7faed7600640 1 -- 172.21.15.123:0/3942388866 shutdown_connections 2024-04-25T13:42:53.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.992+0000 7faed7600640 1 --2- 172.21.15.123:0/3942388866 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7faeb006f400 0x7faeb0071910 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:53.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.992+0000 7faed7600640 1 --2- 172.21.15.123:0/3942388866 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faed015aae0 0x7faed00af470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:53.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.992+0000 7faed7600640 1 --2- 172.21.15.123:0/3942388866 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faed00b0d90 0x7faed015a5a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:53.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.992+0000 7faed7600640 1 --2- 172.21.15.123:0/3942388866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faeb80039c0 0x7faed0150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:53.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.992+0000 7faed7600640 1 -- 172.21.15.123:0/3942388866 >> 172.21.15.123:0/3942388866 conn(0x7faed009ba00 msgr2=0x7faed00b5c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:53.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.992+0000 7faed7600640 1 -- 172.21.15.123:0/3942388866 shutdown_connections 2024-04-25T13:42:53.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:53.992+0000 7faed7600640 1 -- 172.21.15.123:0/3942388866 wait complete. 2024-04-25T13:42:54.015 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T13:42:54.015 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T13:42:54.016 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T13:42:54.016 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:42:54.016 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T13:42:54.016 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T13:42:54.016 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T13:42:54.016 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:42:54.016 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T13:42:54.017 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T13:42:54.017 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T13:42:54.017 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:42:54.017 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T13:42:54.017 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T13:42:54.017 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T13:42:54.017 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:42:54.028 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T13:42:54.029 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T13:42:54.029 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T13:42:54.029 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T13:42:54.034 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T13:42:54.034 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T13:42:54.041 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T13:42:54.041 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T13:42:54.074 INFO:tasks.ceph.mds.c:Started 2024-04-25T13:42:54.075 DEBUG:teuthology.parallel:result is None 2024-04-25T13:42:54.076 INFO:tasks.ceph.mds.a:Started 2024-04-25T13:42:54.076 DEBUG:teuthology.parallel:result is None 2024-04-25T13:42:54.090 INFO:tasks.ceph.mds.d:Started 2024-04-25T13:42:54.090 DEBUG:teuthology.parallel:result is None 2024-04-25T13:42:54.094 INFO:tasks.ceph.mds.b:Started 2024-04-25T13:42:54.095 DEBUG:teuthology.parallel:result is None 2024-04-25T13:42:54.095 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T13:42:54.172 INFO:tasks.ceph.mds.a.smithi123.stdout:starting mds.a at 2024-04-25T13:42:54.173 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-04-25T13:42:54.194 INFO:tasks.ceph.mds.d.smithi130.stdout:starting mds.d at 2024-04-25T13:42:54.195 INFO:tasks.ceph.mds.b.smithi130.stdout:starting mds.b at 2024-04-25T13:42:54.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.248+0000 7f587d800640 1 Processor -- start 2024-04-25T13:42:54.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.248+0000 7f587d800640 1 -- start start 2024-04-25T13:42:54.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.252+0000 7f587d800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f58780b3870 0x7f58780b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:54.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.252+0000 7f587d800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f587815de80 0x7f587815e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:54.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.252+0000 7f587d800640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58780b41c0 con 0x7f58780ceac0 2024-04-25T13:42:54.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.252+0000 7f587d800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f58780c7140 con 0x7f58780b3870 2024-04-25T13:42:54.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.252+0000 7f587d800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f58780cf060 con 0x7f587815de80 2024-04-25T13:42:54.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.252+0000 7f5876000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f58780b3870 0x7f58780b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:54.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.252+0000 7f5876000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f58780b3870 0x7f58780b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36654/0 (socket says 172.21.15.123:36654) 2024-04-25T13:42:54.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.252+0000 7f5876000640 1 -- 172.21.15.123:0/1232472066 learned_addr learned my addr 172.21.15.123:0/1232472066 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:54.254 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.252+0000 7f5877400640 1 --2- 172.21.15.123:0/1232472066 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f587815de80 0x7f587815e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:54.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.252+0000 7f5876000640 1 -- 172.21.15.123:0/1232472066 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f587815de80 msgr2=0x7f587815e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:54.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.252+0000 7f5876000640 1 --2- 172.21.15.123:0/1232472066 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f587815de80 0x7f587815e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:54.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.252+0000 7f5876000640 1 -- 172.21.15.123:0/1232472066 >> v1:172.21.15.130:6789/0 conn(0x7f58780ceac0 legacy=0x7f58780c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:54.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.252+0000 7f5876000640 1 -- 172.21.15.123:0/1232472066 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58780c6810 con 0x7f58780b3870 2024-04-25T13:42:54.255 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.252+0000 7f5875600640 1 -- 172.21.15.123:0/1232472066 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1610655035 0 0) 0x7f5868001120 con 0x7f58780ceac0 2024-04-25T13:42:54.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.256+0000 7f5876000640 1 --2- 172.21.15.123:0/1232472066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58780b3870 0x7f58780b3c80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5864009870 tx=0x7f586401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1203db932ea455a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:54.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.256+0000 7f5875600640 1 -- 172.21.15.123:0/1232472066 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58640aa600 con 0x7f58780b3870 2024-04-25T13:42:54.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.256+0000 7f5875600640 1 -- 172.21.15.123:0/1232472066 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58640af070 con 0x7f58780b3870 2024-04-25T13:42:54.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.256+0000 7f5875600640 1 -- 172.21.15.123:0/1232472066 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58640aa9c0 con 0x7f58780b3870 2024-04-25T13:42:54.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.256+0000 7f587d800640 1 -- 172.21.15.123:0/1232472066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58780b3870 msgr2=0x7f58780b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:54.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.256+0000 7f587d800640 1 --2- 172.21.15.123:0/1232472066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58780b3870 0x7f58780b3c80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5864009870 tx=0x7f586401c4a0 comp rx=0 tx=0).stop 2024-04-25T13:42:54.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.256+0000 7f587d800640 1 -- 172.21.15.123:0/1232472066 shutdown_connections 2024-04-25T13:42:54.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.256+0000 7f587d800640 1 --2- 172.21.15.123:0/1232472066 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f587815de80 0x7f587815e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:54.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.256+0000 7f587d800640 1 --2- 172.21.15.123:0/1232472066 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58780b3870 0x7f58780b3c80 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:54.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.256+0000 7f587d800640 1 -- 172.21.15.123:0/1232472066 >> 172.21.15.123:0/1232472066 conn(0x7f587806ca70 msgr2=0x7f587806ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:54.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.256+0000 7f587d800640 1 -- 172.21.15.123:0/1232472066 shutdown_connections 2024-04-25T13:42:54.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.256+0000 7f587d800640 1 -- 172.21.15.123:0/1232472066 wait complete. 2024-04-25T13:42:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.260+0000 7f587d800640 1 Processor -- start 2024-04-25T13:42:54.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.260+0000 7f587d800640 1 -- start start 2024-04-25T13:42:54.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.260+0000 7f587d800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58780b3870 0x7f5878157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:54.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.260+0000 7f587d800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58780ceac0 0x7f587814f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:54.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.260+0000 7f587d800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f587815de80 0x7f58781fcd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:54.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.260+0000 7f587d800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f587816aae0 con 0x7f58780b3870 2024-04-25T13:42:54.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.260+0000 7f587d800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f587816a960 con 0x7f587815de80 2024-04-25T13:42:54.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.260+0000 7f587d800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f587816ac60 con 0x7f58780ceac0 2024-04-25T13:42:54.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.260+0000 7f5876a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58780b3870 0x7f5878157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:54.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.260+0000 7f5876a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58780b3870 0x7f5878157f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36664/0 (socket says 172.21.15.123:36664) 2024-04-25T13:42:54.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.260+0000 7f5876a00640 1 -- 172.21.15.123:0/4182941131 learned_addr learned my addr 172.21.15.123:0/4182941131 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:54.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.260+0000 7f5876000640 1 --2- 172.21.15.123:0/4182941131 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58780ceac0 0x7f587814f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:54.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.260+0000 7f5877400640 1 --2- 172.21.15.123:0/4182941131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f587815de80 0x7f58781fcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:54.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.260+0000 7f5876a00640 1 -- 172.21.15.123:0/4182941131 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58780ceac0 msgr2=0x7f587814f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:54.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.260+0000 7f5876a00640 1 --2- 172.21.15.123:0/4182941131 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58780ceac0 0x7f587814f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:54.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.260+0000 7f5876a00640 1 -- 172.21.15.123:0/4182941131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f587815de80 msgr2=0x7f58781fcd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:54.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.260+0000 7f5876a00640 1 --2- 172.21.15.123:0/4182941131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f587815de80 0x7f58781fcd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:54.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.260+0000 7f5876a00640 1 -- 172.21.15.123:0/4182941131 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5878158780 con 0x7f58780b3870 2024-04-25T13:42:54.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.260+0000 7f5876a00640 1 --2- 172.21.15.123:0/4182941131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58780b3870 0x7f5878157f50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5868001ec0 tx=0x7f586800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:54.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.260+0000 7f586ea00640 1 -- 172.21.15.123:0/4182941131 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5868017070 con 0x7f58780b3870 2024-04-25T13:42:54.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.260+0000 7f586ea00640 1 -- 172.21.15.123:0/4182941131 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5868003600 con 0x7f58780b3870 2024-04-25T13:42:54.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.260+0000 7f587d800640 1 -- 172.21.15.123:0/4182941131 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5878158a60 con 0x7f58780b3870 2024-04-25T13:42:54.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.260+0000 7f586ea00640 1 -- 172.21.15.123:0/4182941131 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58680039f0 con 0x7f58780b3870 2024-04-25T13:42:54.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.260+0000 7f587d800640 1 -- 172.21.15.123:0/4182941131 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58781521f0 con 0x7f58780b3870 2024-04-25T13:42:54.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.264+0000 7f587d800640 1 -- 172.21.15.123:0/4182941131 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f587806d600 con 0x7f58780b3870 2024-04-25T13:42:54.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.264+0000 7f586ea00640 1 -- 172.21.15.123:0/4182941131 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f586801a070 con 0x7f58780b3870 2024-04-25T13:42:54.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.264+0000 7f586ea00640 1 --2- 172.21.15.123:0/4182941131 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f585806f400 0x7f5858071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:54.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.264+0000 7f586ea00640 1 -- 172.21.15.123:0/4182941131 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 4943+0+0 (secure 0 0 0) 0x7f586808e320 con 0x7f58780b3870 2024-04-25T13:42:54.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.264+0000 7f5876000640 1 --2- 172.21.15.123:0/4182941131 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f585806f400 0x7f5858071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:54.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.264+0000 7f5876000640 1 --2- 172.21.15.123:0/4182941131 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f585806f400 0x7f5858071910 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f58640ae000 tx=0x7f58640a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:54.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.268+0000 7f586ea00640 1 -- 172.21.15.123:0/4182941131 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f58780b41c0 con 0x7f58780b3870 2024-04-25T13:42:54.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.440+0000 7f587d800640 1 -- 172.21.15.123:0/4182941131 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f5878150a40 con 0x7f58780b3870 2024-04-25T13:42:54.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:54.996+0000 7f586ea00640 1 -- 172.21.15.123:0/4182941131 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) ==== 97+0+0 (secure 0 0 0) 0x7f586805aeb0 con 0x7f58780b3870 2024-04-25T13:42:54.999 INFO:teuthology.orchestra.run.smithi123.stderr: removed all blocklist entries 2024-04-25T13:42:55.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.000+0000 7f587d800640 1 -- 172.21.15.123:0/4182941131 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f585806f400 msgr2=0x7f5858071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:55.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.000+0000 7f587d800640 1 --2- 172.21.15.123:0/4182941131 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f585806f400 0x7f5858071910 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f58640ae000 tx=0x7f58640a7000 comp rx=0 tx=0).stop 2024-04-25T13:42:55.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.000+0000 7f587d800640 1 -- 172.21.15.123:0/4182941131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58780b3870 msgr2=0x7f5878157f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:55.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.000+0000 7f587d800640 1 --2- 172.21.15.123:0/4182941131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58780b3870 0x7f5878157f50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5868001ec0 tx=0x7f586800c8e0 comp rx=0 tx=0).stop 2024-04-25T13:42:55.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.000+0000 7f587d800640 1 -- 172.21.15.123:0/4182941131 shutdown_connections 2024-04-25T13:42:55.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.000+0000 7f587d800640 1 --2- 172.21.15.123:0/4182941131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f587815de80 0x7f58781fcd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:55.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.000+0000 7f587d800640 1 --2- 172.21.15.123:0/4182941131 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f585806f400 0x7f5858071910 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:55.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.000+0000 7f587d800640 1 --2- 172.21.15.123:0/4182941131 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58780ceac0 0x7f587814f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:55.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.000+0000 7f587d800640 1 --2- 172.21.15.123:0/4182941131 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f58780b3870 0x7f5878157f50 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:55.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.000+0000 7f587d800640 1 -- 172.21.15.123:0/4182941131 >> 172.21.15.123:0/4182941131 conn(0x7f587806ca70 msgr2=0x7f58780cf5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:55.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.000+0000 7f587d800640 1 -- 172.21.15.123:0/4182941131 shutdown_connections 2024-04-25T13:42:55.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.000+0000 7f587d800640 1 -- 172.21.15.123:0/4182941131 wait complete. 2024-04-25T13:42:55.025 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T13:42:55.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.172+0000 7fd6fd400640 1 Processor -- start 2024-04-25T13:42:55.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.172+0000 7fd6fd400640 1 -- start start 2024-04-25T13:42:55.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.176+0000 7fd6fd400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd6f80747a0 0x7fd6f815fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:55.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.176+0000 7fd6fd400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6f8145d70 con 0x7fd6f80b5670 2024-04-25T13:42:55.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.176+0000 7fd6fd400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6f81606f0 con 0x7fd6f81602e0 2024-04-25T13:42:55.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.176+0000 7fd6fd400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd6f8074290 con 0x7fd6f80747a0 2024-04-25T13:42:55.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.176+0000 7fd6f6800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd6f80747a0 0x7fd6f815fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:55.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.176+0000 7fd6f6800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd6f80747a0 0x7fd6f815fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36674/0 (socket says 172.21.15.123:36674) 2024-04-25T13:42:55.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.176+0000 7fd6f7200640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fd6f80b5670 0x7fd6f80731e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56336/0 (socket says 172.21.15.123:56336) 2024-04-25T13:42:55.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.176+0000 7fd6f6800640 1 -- 172.21.15.123:0/3620633731 learned_addr learned my addr 172.21.15.123:0/3620633731 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:55.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.176+0000 7fd6f6800640 1 -- 172.21.15.123:0/3620633731 >> v1:172.21.15.130:6789/0 conn(0x7fd6f81602e0 legacy=0x7fd6f8072ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:55.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.176+0000 7fd6f6800640 1 -- 172.21.15.123:0/3620633731 >> v1:172.21.15.123:6789/0 conn(0x7fd6f80b5670 legacy=0x7fd6f80731e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:55.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.176+0000 7fd6f6800640 1 -- 172.21.15.123:0/3620633731 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f8073c80 con 0x7fd6f80747a0 2024-04-25T13:42:55.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.176+0000 7fd6f5400640 1 -- 172.21.15.123:0/3620633731 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 745867738 0 0) 0x7fd6f00014a0 con 0x7fd6f80b5670 2024-04-25T13:42:55.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.180+0000 7fd6f6800640 1 --2- 172.21.15.123:0/3620633731 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6f80747a0 0x7fd6f815fda0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800aa10 tx=0x7fd6e801d930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5a11721efa2480 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:55.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.180+0000 7fd6f5400640 1 -- 172.21.15.123:0/3620633731 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e80b3070 con 0x7fd6f80747a0 2024-04-25T13:42:55.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.180+0000 7fd6f5400640 1 -- 172.21.15.123:0/3620633731 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e80a6860 con 0x7fd6f80747a0 2024-04-25T13:42:55.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.180+0000 7fd6f5400640 1 -- 172.21.15.123:0/3620633731 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e800b040 con 0x7fd6f80747a0 2024-04-25T13:42:55.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.180+0000 7fd6fd400640 1 -- 172.21.15.123:0/3620633731 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6f80747a0 msgr2=0x7fd6f815fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:55.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.180+0000 7fd6fd400640 1 --2- 172.21.15.123:0/3620633731 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6f80747a0 0x7fd6f815fda0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800aa10 tx=0x7fd6e801d930 comp rx=0 tx=0).stop 2024-04-25T13:42:55.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.180+0000 7fd6fd400640 1 -- 172.21.15.123:0/3620633731 shutdown_connections 2024-04-25T13:42:55.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.180+0000 7fd6fd400640 1 --2- 172.21.15.123:0/3620633731 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6f80747a0 0x7fd6f815fda0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:55.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.180+0000 7fd6fd400640 1 -- 172.21.15.123:0/3620633731 >> 172.21.15.123:0/3620633731 conn(0x7fd6f806d210 msgr2=0x7fd6f806ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:55.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.180+0000 7fd6fd400640 1 -- 172.21.15.123:0/3620633731 shutdown_connections 2024-04-25T13:42:55.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.180+0000 7fd6fd400640 1 -- 172.21.15.123:0/3620633731 wait complete. 2024-04-25T13:42:55.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.180+0000 7fd6fd400640 1 Processor -- start 2024-04-25T13:42:55.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.180+0000 7fd6fd400640 1 -- start start 2024-04-25T13:42:55.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.184+0000 7fd6fd400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6f80747a0 0x7fd6f815ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:55.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.184+0000 7fd6fd400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd6f80b5670 0x7fd6f80b4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:55.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.184+0000 7fd6fd400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6f81602e0 0x7fd6f815b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:55.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.184+0000 7fd6fd400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f80738f0 con 0x7fd6f80747a0 2024-04-25T13:42:55.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.184+0000 7fd6fd400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f8074bb0 con 0x7fd6f81602e0 2024-04-25T13:42:55.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.184+0000 7fd6fd400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fd6f80b6380 con 0x7fd6f80b5670 2024-04-25T13:42:55.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.184+0000 7fd6f6800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6f80747a0 0x7fd6f815ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:55.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.184+0000 7fd6f6800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6f80747a0 0x7fd6f815ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36682/0 (socket says 172.21.15.123:36682) 2024-04-25T13:42:55.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.184+0000 7fd6f6800640 1 -- 172.21.15.123:0/1659521920 learned_addr learned my addr 172.21.15.123:0/1659521920 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:55.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.184+0000 7fd6f6800640 1 -- 172.21.15.123:0/1659521920 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd6f80b5670 msgr2=0x7fd6f80b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:55.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.184+0000 7fd6f6800640 1 --2- 172.21.15.123:0/1659521920 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd6f80b5670 0x7fd6f80b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:55.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.184+0000 7fd6f6800640 1 -- 172.21.15.123:0/1659521920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6f81602e0 msgr2=0x7fd6f815b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:55.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.184+0000 7fd6f6800640 1 --2- 172.21.15.123:0/1659521920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6f81602e0 0x7fd6f815b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:55.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.184+0000 7fd6f6800640 1 -- 172.21.15.123:0/1659521920 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f815d2d0 con 0x7fd6f80747a0 2024-04-25T13:42:55.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.184+0000 7fd6f6800640 1 --2- 172.21.15.123:0/1659521920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6f80747a0 0x7fd6f815ca80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd6e801a540 tx=0x7fd6e801c170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:55.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.184+0000 7fd6eea00640 1 -- 172.21.15.123:0/1659521920 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e80be070 con 0x7fd6f80747a0 2024-04-25T13:42:55.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.184+0000 7fd6eea00640 1 -- 172.21.15.123:0/1659521920 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e80aecc0 con 0x7fd6f80747a0 2024-04-25T13:42:55.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.184+0000 7fd6fd400640 1 -- 172.21.15.123:0/1659521920 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f815d5b0 con 0x7fd6f80747a0 2024-04-25T13:42:55.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.184+0000 7fd6eea00640 1 -- 172.21.15.123:0/1659521920 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e80b3070 con 0x7fd6f80747a0 2024-04-25T13:42:55.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.184+0000 7fd6fd400640 1 -- 172.21.15.123:0/1659521920 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f815db70 con 0x7fd6f80747a0 2024-04-25T13:42:55.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.184+0000 7fd6fd400640 1 -- 172.21.15.123:0/1659521920 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6f80507c0 con 0x7fd6f80747a0 2024-04-25T13:42:55.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.188+0000 7fd6eea00640 1 -- 172.21.15.123:0/1659521920 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd6e80c1070 con 0x7fd6f80747a0 2024-04-25T13:42:55.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.188+0000 7fd6eea00640 1 --2- 172.21.15.123:0/1659521920 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd6d806f430 0x7fd6d8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:55.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.188+0000 7fd6eea00640 1 -- 172.21.15.123:0/1659521920 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fd6e81291e0 con 0x7fd6f80747a0 2024-04-25T13:42:55.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.188+0000 7fd6f5e00640 1 --2- 172.21.15.123:0/1659521920 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd6d806f430 0x7fd6d8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:55.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.188+0000 7fd6f5e00640 1 --2- 172.21.15.123:0/1659521920 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd6d806f430 0x7fd6d8071940 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4000f70 tx=0x7fd6e40079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:55.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.192+0000 7fd6eea00640 1 -- 172.21.15.123:0/1659521920 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd6e800a020 con 0x7fd6f80747a0 2024-04-25T13:42:55.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.404+0000 7fd6fd400640 1 -- 172.21.15.123:0/1659521920 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fd6f80d0330 con 0x7fd6f80747a0 2024-04-25T13:42:55.405 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.404+0000 7fd6eea00640 1 -- 172.21.15.123:0/1659521920 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) ==== 80+0+6645 (secure 0 0 0) 0x7fd6e8017520 con 0x7fd6f80747a0 2024-04-25T13:42:55.405 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:55.405 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-04-25T13:42:55.405 INFO:teuthology.orchestra.run.smithi123.stdout: "auth_dump": [ 2024-04-25T13:42:55.405 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:42:55.405 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.a", 2024-04-25T13:42:55.406 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBxXSpmRZaqNRAASgiqTZucFo3RrAbbhKu5Pg==", 2024-04-25T13:42:55.406 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-04-25T13:42:55.406 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-04-25T13:42:55.406 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-04-25T13:42:55.406 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-04-25T13:42:55.406 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-04-25T13:42:55.406 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:55.406 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-25T13:42:55.406 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:42:55.406 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.b", 2024-04-25T13:42:55.406 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQByXSpm7AzfBhAAsoGaX/CTbsr7+15VsMAsdQ==", 2024-04-25T13:42:55.406 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-04-25T13:42:55.406 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-04-25T13:42:55.407 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-04-25T13:42:55.407 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-04-25T13:42:55.407 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-04-25T13:42:55.407 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:55.407 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-25T13:42:55.407 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:42:55.407 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.c", 2024-04-25T13:42:55.407 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQByXSpmMserARAAG6o8F9KLwRvmIElW/Rh1Dw==", 2024-04-25T13:42:55.407 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-04-25T13:42:55.407 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-04-25T13:42:55.407 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-04-25T13:42:55.407 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-04-25T13:42:55.407 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-04-25T13:42:55.407 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:55.407 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-25T13:42:55.408 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:42:55.408 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mds.d", 2024-04-25T13:42:55.408 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQByXSpmxDmbDhAAWZlsPqet/ypXRBHTRAqmkw==", 2024-04-25T13:42:55.408 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-04-25T13:42:55.408 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-04-25T13:42:55.408 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-04-25T13:42:55.408 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-04-25T13:42:55.408 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-04-25T13:42:55.408 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:55.408 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-25T13:42:55.408 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:42:55.408 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.0", 2024-04-25T13:42:55.408 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQB1XSpmWEx0ERAA4Uma0pcbPw0EyMgNZU2Kig==", 2024-04-25T13:42:55.408 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-04-25T13:42:55.409 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-04-25T13:42:55.409 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-04-25T13:42:55.409 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-04-25T13:42:55.409 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:55.409 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-25T13:42:55.409 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:42:55.409 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.1", 2024-04-25T13:42:55.409 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQB4XSpmdMsjGxAAL2JlBtPGd3atzhJd0jfy6g==", 2024-04-25T13:42:55.409 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-04-25T13:42:55.409 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-04-25T13:42:55.409 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-04-25T13:42:55.409 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-04-25T13:42:55.410 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:55.410 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-25T13:42:55.410 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:42:55.410 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.2", 2024-04-25T13:42:55.410 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQB7XSpmQw45JBAAleUiNvgeqz+HeYPQD4GNVQ==", 2024-04-25T13:42:55.410 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-04-25T13:42:55.410 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-04-25T13:42:55.410 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-04-25T13:42:55.410 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-04-25T13:42:55.410 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:55.410 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-25T13:42:55.410 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:42:55.410 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.3", 2024-04-25T13:42:55.410 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQB+XSpmAxMKLhAAqlfhlADFBqOKCSSOPF0sjQ==", 2024-04-25T13:42:55.411 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-04-25T13:42:55.411 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-04-25T13:42:55.411 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-04-25T13:42:55.411 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-04-25T13:42:55.411 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:55.411 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-25T13:42:55.411 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:42:55.411 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.4", 2024-04-25T13:42:55.411 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCEXSpmEiqMKBAArXA3ELWHvqRE2eQYRCLMQw==", 2024-04-25T13:42:55.411 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-04-25T13:42:55.411 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-04-25T13:42:55.411 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-04-25T13:42:55.411 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-04-25T13:42:55.411 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:55.411 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-25T13:42:55.412 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:42:55.412 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.5", 2024-04-25T13:42:55.412 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCHXSpmayygNRAA2/mUoEYXZ1uyRc3cF9kj7A==", 2024-04-25T13:42:55.412 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-04-25T13:42:55.412 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-04-25T13:42:55.412 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-04-25T13:42:55.412 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-04-25T13:42:55.412 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:55.412 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-25T13:42:55.412 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:42:55.412 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.6", 2024-04-25T13:42:55.412 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCLXSpmy21GAxAArA7CE1eY0wNRopmQ8GVtTw==", 2024-04-25T13:42:55.412 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-04-25T13:42:55.412 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-04-25T13:42:55.413 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-04-25T13:42:55.413 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-04-25T13:42:55.413 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:55.413 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-25T13:42:55.413 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:42:55.413 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "osd.7", 2024-04-25T13:42:55.413 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCOXSpmzoLQDBAA2lf1gfE1JeB8YngkzsC9tg==", 2024-04-25T13:42:55.413 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-04-25T13:42:55.413 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow profile osd", 2024-04-25T13:42:55.413 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile osd", 2024-04-25T13:42:55.413 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-04-25T13:42:55.413 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:55.413 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-25T13:42:55.414 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:42:55.414 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.0", 2024-04-25T13:42:55.414 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQByXSpmo/9OExAA/kno6dfYddtdaT2e+prGDQ==", 2024-04-25T13:42:55.414 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-04-25T13:42:55.414 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-04-25T13:42:55.414 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-04-25T13:42:55.414 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-04-25T13:42:55.414 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-04-25T13:42:55.414 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:55.414 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-25T13:42:55.414 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:42:55.414 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.1", 2024-04-25T13:42:55.414 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQByXSpmN+M7GxAA4lZGIViFb/tdOzAdbUF4OQ==", 2024-04-25T13:42:55.415 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-04-25T13:42:55.415 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-04-25T13:42:55.415 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-04-25T13:42:55.415 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-04-25T13:42:55.415 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-04-25T13:42:55.415 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:55.415 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-25T13:42:55.415 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:42:55.415 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.2", 2024-04-25T13:42:55.415 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQByXSpmzuVXFxAAl3m6mpLW2EncYTtCXGdBnw==", 2024-04-25T13:42:55.415 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-04-25T13:42:55.415 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-04-25T13:42:55.415 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-04-25T13:42:55.415 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-04-25T13:42:55.415 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-04-25T13:42:55.416 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:55.416 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-25T13:42:55.416 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:42:55.416 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.3", 2024-04-25T13:42:55.416 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQByXSpmFu4/HxAAk/rh3sG3egQD8F80sgGicg==", 2024-04-25T13:42:55.416 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-04-25T13:42:55.416 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow", 2024-04-25T13:42:55.416 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow r", 2024-04-25T13:42:55.416 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow rw", 2024-04-25T13:42:55.416 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow rwx" 2024-04-25T13:42:55.416 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:55.416 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-25T13:42:55.416 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:42:55.417 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.admin", 2024-04-25T13:42:55.417 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBxXSpmsE42GBAA3//z6PJD251R6QpLSIJ5lA==", 2024-04-25T13:42:55.417 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-04-25T13:42:55.417 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-04-25T13:42:55.417 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr": "allow *", 2024-04-25T13:42:55.417 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow *", 2024-04-25T13:42:55.417 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-04-25T13:42:55.417 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:55.417 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-25T13:42:55.417 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:42:55.417 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-mds", 2024-04-25T13:42:55.417 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCUXSpm+uh2HhAA8tH/vQFztXbIRZDnDkTluA==", 2024-04-25T13:42:55.417 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-04-25T13:42:55.417 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-mds" 2024-04-25T13:42:55.418 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:55.418 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-25T13:42:55.418 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:42:55.418 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-mgr", 2024-04-25T13:42:55.418 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCUXSpmrvJ2HhAA96FXkM65VtE3F9UqLYizag==", 2024-04-25T13:42:55.418 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-04-25T13:42:55.418 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-25T13:42:55.418 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:55.418 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-25T13:42:55.418 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:42:55.418 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-osd", 2024-04-25T13:42:55.418 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCUXSpmM/t2HhAAQYGD9CgmSsqio+5CYO/1KA==", 2024-04-25T13:42:55.418 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-04-25T13:42:55.418 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-osd" 2024-04-25T13:42:55.418 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:55.419 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-25T13:42:55.419 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:42:55.419 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-rbd", 2024-04-25T13:42:55.419 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCUXSpmXQN3HhAAn+7ljdt5Q3f/JdMDHfCSUA==", 2024-04-25T13:42:55.419 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-04-25T13:42:55.419 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-25T13:42:55.419 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:55.419 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-25T13:42:55.419 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:42:55.419 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-25T13:42:55.419 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCUXSpmnwt3HhAAjocFydYGjOaU/pEi/KTbew==", 2024-04-25T13:42:55.419 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-04-25T13:42:55.419 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-25T13:42:55.419 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:55.420 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-25T13:42:55.420 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:42:55.420 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "client.bootstrap-rgw", 2024-04-25T13:42:55.420 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQCUXSpmExR3HhAA1l/hXsQSAecCR1Qy9GbioA==", 2024-04-25T13:42:55.420 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-04-25T13:42:55.420 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-25T13:42:55.420 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:55.420 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-25T13:42:55.420 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:42:55.420 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.x", 2024-04-25T13:42:55.420 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBxXSpmva5kMBAAgeNzDPSYDMoyKpXNtx1UMg==", 2024-04-25T13:42:55.420 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-04-25T13:42:55.420 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-04-25T13:42:55.420 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-04-25T13:42:55.420 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-04-25T13:42:55.421 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:55.421 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-25T13:42:55.421 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:42:55.421 INFO:teuthology.orchestra.run.smithi123.stdout: "entity": "mgr.y", 2024-04-25T13:42:55.421 INFO:teuthology.orchestra.run.smithi123.stdout: "key": "AQBxXSpmY5kkLBAAavfr9iawJrEVad/HlzZJAg==", 2024-04-25T13:42:55.421 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": { 2024-04-25T13:42:55.421 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": "allow *", 2024-04-25T13:42:55.421 INFO:teuthology.orchestra.run.smithi123.stdout: "mon": "allow profile mgr", 2024-04-25T13:42:55.421 INFO:teuthology.orchestra.run.smithi123.stdout: "osd": "allow *" 2024-04-25T13:42:55.421 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:55.421 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:55.421 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-04-25T13:42:55.421 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-04-25T13:42:55.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.404+0000 7fd6fd400640 1 -- 172.21.15.123:0/1659521920 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd6d806f430 msgr2=0x7fd6d8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:55.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.404+0000 7fd6fd400640 1 --2- 172.21.15.123:0/1659521920 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd6d806f430 0x7fd6d8071940 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4000f70 tx=0x7fd6e40079c0 comp rx=0 tx=0).stop 2024-04-25T13:42:55.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.404+0000 7fd6fd400640 1 -- 172.21.15.123:0/1659521920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6f80747a0 msgr2=0x7fd6f815ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:55.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.404+0000 7fd6fd400640 1 --2- 172.21.15.123:0/1659521920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6f80747a0 0x7fd6f815ca80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd6e801a540 tx=0x7fd6e801c170 comp rx=0 tx=0).stop 2024-04-25T13:42:55.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.404+0000 7fd6fd400640 1 -- 172.21.15.123:0/1659521920 shutdown_connections 2024-04-25T13:42:55.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.404+0000 7fd6fd400640 1 --2- 172.21.15.123:0/1659521920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6f81602e0 0x7fd6f815b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:55.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.404+0000 7fd6fd400640 1 --2- 172.21.15.123:0/1659521920 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd6d806f430 0x7fd6d8071940 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:55.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.404+0000 7fd6fd400640 1 --2- 172.21.15.123:0/1659521920 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd6f80b5670 0x7fd6f80b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:55.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.404+0000 7fd6fd400640 1 --2- 172.21.15.123:0/1659521920 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6f80747a0 0x7fd6f815ca80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:55.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.404+0000 7fd6fd400640 1 -- 172.21.15.123:0/1659521920 >> 172.21.15.123:0/1659521920 conn(0x7fd6f806d210 msgr2=0x7fd6f80b2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:55.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.404+0000 7fd6fd400640 1 -- 172.21.15.123:0/1659521920 shutdown_connections 2024-04-25T13:42:55.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.404+0000 7fd6fd400640 1 -- 172.21.15.123:0/1659521920 wait complete. 2024-04-25T13:42:55.426 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-25T13:42:55.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.572+0000 7f4ebb400640 1 Processor -- start 2024-04-25T13:42:55.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.572+0000 7f4ebb400640 1 -- start start 2024-04-25T13:42:55.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.572+0000 7f4ebb400640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4eb406e610 0x7f4eb406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:55.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.572+0000 7f4ebb400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4eb4164ec0 0x7f4eb40ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:55.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.572+0000 7f4ebb400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4eb40746f0 con 0x7f4eb41643a0 2024-04-25T13:42:55.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.572+0000 7f4ebb400640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f4eb409cde0 con 0x7f4eb406e610 2024-04-25T13:42:55.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.572+0000 7f4ebb400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4eb406e090 con 0x7f4eb4164ec0 2024-04-25T13:42:55.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.572+0000 7f4eb9400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4eb4164ec0 0x7f4eb40ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:55.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.572+0000 7f4eb8a00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4eb406e610 0x7f4eb406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:55.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.572+0000 7f4eb8a00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4eb406e610 0x7f4eb406ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:46652/0 (socket says 172.21.15.123:46652) 2024-04-25T13:42:55.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.572+0000 7f4eb9400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4eb4164ec0 0x7f4eb40ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:56902/0 (socket says 172.21.15.123:56902) 2024-04-25T13:42:55.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.576+0000 7f4eb8a00640 1 -- 172.21.15.123:0/2289000478 learned_addr learned my addr 172.21.15.123:0/2289000478 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:55.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.576+0000 7f4eb8a00640 1 -- 172.21.15.123:0/2289000478 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4eb4164ec0 msgr2=0x7f4eb40ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:55.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.576+0000 7f4eb8a00640 1 --2- 172.21.15.123:0/2289000478 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4eb4164ec0 0x7f4eb40ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:55.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.576+0000 7f4eb8a00640 1 -- 172.21.15.123:0/2289000478 >> v1:172.21.15.130:6789/0 conn(0x7f4eb41643a0 legacy=0x7f4eb41647b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:55.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.576+0000 7f4eb8a00640 1 -- 172.21.15.123:0/2289000478 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb40b5d90 con 0x7f4eb406e610 2024-04-25T13:42:55.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.576+0000 7f4eb9400640 1 --2- 172.21.15.123:0/2289000478 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4eb4164ec0 0x7f4eb40ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:55.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.576+0000 7f4eb3400640 1 -- 172.21.15.123:0/2289000478 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 960965999 0 0) 0x7f4eb40746f0 con 0x7f4eb41643a0 2024-04-25T13:42:55.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.576+0000 7f4eb8a00640 1 --2- 172.21.15.123:0/2289000478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4eb406e610 0x7f4eb406ea20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4006fd0 tx=0x7f4ea401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42a570efec9e7eb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:55.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.576+0000 7f4eb3400640 1 -- 172.21.15.123:0/2289000478 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea40aa600 con 0x7f4eb406e610 2024-04-25T13:42:55.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.576+0000 7f4eb3400640 1 -- 172.21.15.123:0/2289000478 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea40af070 con 0x7f4eb406e610 2024-04-25T13:42:55.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.576+0000 7f4eb3400640 1 -- 172.21.15.123:0/2289000478 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea40aa9c0 con 0x7f4eb406e610 2024-04-25T13:42:55.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.580+0000 7f4ebb400640 1 -- 172.21.15.123:0/2289000478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4eb406e610 msgr2=0x7f4eb406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:55.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.580+0000 7f4ebb400640 1 --2- 172.21.15.123:0/2289000478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4eb406e610 0x7f4eb406ea20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4006fd0 tx=0x7f4ea401c480 comp rx=0 tx=0).stop 2024-04-25T13:42:55.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.580+0000 7f4ebb400640 1 -- 172.21.15.123:0/2289000478 shutdown_connections 2024-04-25T13:42:55.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.580+0000 7f4ebb400640 1 --2- 172.21.15.123:0/2289000478 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4eb4164ec0 0x7f4eb40ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:55.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.580+0000 7f4ebb400640 1 --2- 172.21.15.123:0/2289000478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4eb406e610 0x7f4eb406ea20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:55.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.580+0000 7f4ebb400640 1 -- 172.21.15.123:0/2289000478 >> 172.21.15.123:0/2289000478 conn(0x7f4eb40b51d0 msgr2=0x7f4eb40b55e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:55.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.580+0000 7f4ebb400640 1 -- 172.21.15.123:0/2289000478 shutdown_connections 2024-04-25T13:42:55.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.580+0000 7f4ebb400640 1 -- 172.21.15.123:0/2289000478 wait complete. 2024-04-25T13:42:55.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.580+0000 7f4ebb400640 1 Processor -- start 2024-04-25T13:42:55.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.580+0000 7f4ebb400640 1 -- start start 2024-04-25T13:42:55.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.584+0000 7f4ebb400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4eb406e610 0x7f4eb40b0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:55.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.584+0000 7f4ebb400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4eb41643a0 0x7f4eb4071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:55.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.584+0000 7f4ebb400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4eb4164ec0 0x7f4eb4071740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:55.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.584+0000 7f4ebb400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb40b9170 con 0x7f4eb4164ec0 2024-04-25T13:42:55.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.584+0000 7f4ebb400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb40b8ff0 con 0x7f4eb41643a0 2024-04-25T13:42:55.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.584+0000 7f4ebb400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4eb40cf500 con 0x7f4eb406e610 2024-04-25T13:42:55.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.584+0000 7f4eb9400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4eb4164ec0 0x7f4eb4071740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:55.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.584+0000 7f4eb9400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4eb4164ec0 0x7f4eb4071740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36698/0 (socket says 172.21.15.123:36698) 2024-04-25T13:42:55.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.584+0000 7f4eb9400640 1 -- 172.21.15.123:0/2219768709 learned_addr learned my addr 172.21.15.123:0/2219768709 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:55.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.584+0000 7f4eb8a00640 1 --2- 172.21.15.123:0/2219768709 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4eb406e610 0x7f4eb40b0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:55.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.584+0000 7f4eb3e00640 1 --2- 172.21.15.123:0/2219768709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4eb41643a0 0x7f4eb4071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:55.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.584+0000 7f4eb9400640 1 -- 172.21.15.123:0/2219768709 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4eb406e610 msgr2=0x7f4eb40b0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:55.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.584+0000 7f4eb9400640 1 --2- 172.21.15.123:0/2219768709 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4eb406e610 0x7f4eb40b0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:55.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.584+0000 7f4eb9400640 1 -- 172.21.15.123:0/2219768709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4eb41643a0 msgr2=0x7f4eb4071200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:55.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.584+0000 7f4eb9400640 1 --2- 172.21.15.123:0/2219768709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4eb41643a0 0x7f4eb4071200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:55.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.584+0000 7f4eb9400640 1 -- 172.21.15.123:0/2219768709 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb40b1220 con 0x7f4eb4164ec0 2024-04-25T13:42:55.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.584+0000 7f4eb9400640 1 --2- 172.21.15.123:0/2219768709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4eb4164ec0 0x7f4eb4071740 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4eac009e10 tx=0x7f4eac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:55.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.584+0000 7f4eb0c00640 1 -- 172.21.15.123:0/2219768709 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eac018020 con 0x7f4eb4164ec0 2024-04-25T13:42:55.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.584+0000 7f4eb0c00640 1 -- 172.21.15.123:0/2219768709 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eac014480 con 0x7f4eb4164ec0 2024-04-25T13:42:55.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.584+0000 7f4ebb400640 1 -- 172.21.15.123:0/2219768709 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eb415dc60 con 0x7f4eb4164ec0 2024-04-25T13:42:55.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.584+0000 7f4eb0c00640 1 -- 172.21.15.123:0/2219768709 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eac014850 con 0x7f4eb4164ec0 2024-04-25T13:42:55.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.584+0000 7f4ebb400640 1 -- 172.21.15.123:0/2219768709 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eb415df40 con 0x7f4eb4164ec0 2024-04-25T13:42:55.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.584+0000 7f4ebb400640 1 -- 172.21.15.123:0/2219768709 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eb4050750 con 0x7f4eb4164ec0 2024-04-25T13:42:55.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.588+0000 7f4eb0c00640 1 -- 172.21.15.123:0/2219768709 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4eac01b020 con 0x7f4eb4164ec0 2024-04-25T13:42:55.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.588+0000 7f4eb0c00640 1 --2- 172.21.15.123:0/2219768709 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4e9406f430 0x7f4e94071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:55.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.588+0000 7f4eb0c00640 1 -- 172.21.15.123:0/2219768709 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f4eac08fa20 con 0x7f4eb4164ec0 2024-04-25T13:42:55.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.588+0000 7f4eb8a00640 1 --2- 172.21.15.123:0/2219768709 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4e9406f430 0x7f4e94071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:55.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.588+0000 7f4eb8a00640 1 --2- 172.21.15.123:0/2219768709 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4e9406f430 0x7f4e94071940 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40ae000 tx=0x7f4ea40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:55.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.592+0000 7f4eb0c00640 1 -- 172.21.15.123:0/2219768709 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4eac022030 con 0x7f4eb4164ec0 2024-04-25T13:42:55.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.804+0000 7f4ebb400640 1 -- 172.21.15.123:0/2219768709 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f4eb415fc70 con 0x7f4eb4164ec0 2024-04-25T13:42:55.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.804+0000 7f4eb0c00640 1 -- 172.21.15.123:0/2219768709 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f4eac010040 con 0x7f4eb4164ec0 2024-04-25T13:42:55.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.808+0000 7f4ebb400640 1 -- 172.21.15.123:0/2219768709 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4e9406f430 msgr2=0x7f4e94071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:55.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.808+0000 7f4ebb400640 1 --2- 172.21.15.123:0/2219768709 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4e9406f430 0x7f4e94071940 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40ae000 tx=0x7f4ea40a7000 comp rx=0 tx=0).stop 2024-04-25T13:42:55.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.808+0000 7f4ebb400640 1 -- 172.21.15.123:0/2219768709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4eb4164ec0 msgr2=0x7f4eb4071740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:55.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.808+0000 7f4ebb400640 1 --2- 172.21.15.123:0/2219768709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4eb4164ec0 0x7f4eb4071740 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4eac009e10 tx=0x7f4eac00c490 comp rx=0 tx=0).stop 2024-04-25T13:42:55.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.808+0000 7f4ebb400640 1 -- 172.21.15.123:0/2219768709 shutdown_connections 2024-04-25T13:42:55.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.808+0000 7f4ebb400640 1 --2- 172.21.15.123:0/2219768709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4eb41643a0 0x7f4eb4071200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:55.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.808+0000 7f4ebb400640 1 --2- 172.21.15.123:0/2219768709 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4e9406f430 0x7f4e94071940 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:55.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.808+0000 7f4ebb400640 1 --2- 172.21.15.123:0/2219768709 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4eb4164ec0 0x7f4eb4071740 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:55.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.808+0000 7f4ebb400640 1 --2- 172.21.15.123:0/2219768709 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4eb406e610 0x7f4eb40b0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:55.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.808+0000 7f4ebb400640 1 -- 172.21.15.123:0/2219768709 >> 172.21.15.123:0/2219768709 conn(0x7f4eb40b51d0 msgr2=0x7f4eb409c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:55.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.808+0000 7f4ebb400640 1 -- 172.21.15.123:0/2219768709 shutdown_connections 2024-04-25T13:42:55.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.808+0000 7f4ebb400640 1 -- 172.21.15.123:0/2219768709 wait complete. 2024-04-25T13:42:55.831 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-25T13:42:55.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.976+0000 7f727c000640 1 Processor -- start 2024-04-25T13:42:55.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.976+0000 7f727c000640 1 -- start start 2024-04-25T13:42:55.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.976+0000 7f727c000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7274073fe0 0x7f72740d0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:55.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.976+0000 7f727c000640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f72740cc700 0x7f72740cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:55.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.976+0000 7f727c000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72740cbb40 con 0x7f72740d10b0 2024-04-25T13:42:55.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.976+0000 7f727c000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f72740cbe20 con 0x7f7274073fe0 2024-04-25T13:42:55.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.976+0000 7f727c000640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f72740730e0 con 0x7f72740cc700 2024-04-25T13:42:55.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.980+0000 7f7279600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7274073fe0 0x7f72740d0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:55.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.980+0000 7f7279600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f7274073fe0 0x7f72740d0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36714/0 (socket says 172.21.15.123:36714) 2024-04-25T13:42:55.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.980+0000 7f7278c00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f72740d10b0 0x7f72740cbff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56338/0 (socket says 172.21.15.123:56338) 2024-04-25T13:42:55.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.980+0000 7f7279600640 1 -- 172.21.15.123:0/1276288687 learned_addr learned my addr 172.21.15.123:0/1276288687 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:55.981 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.980+0000 7f727a000640 1 --2- 172.21.15.123:0/1276288687 >> v2:172.21.15.130:3300/0 conn(0x7f72740cc700 0x7f72740cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:55.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.980+0000 7f7279600640 1 -- 172.21.15.123:0/1276288687 >> v2:172.21.15.130:3300/0 conn(0x7f72740cc700 msgr2=0x7f72740cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:55.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.980+0000 7f7279600640 1 --2- 172.21.15.123:0/1276288687 >> v2:172.21.15.130:3300/0 conn(0x7f72740cc700 0x7f72740cadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:55.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.980+0000 7f7279600640 1 -- 172.21.15.123:0/1276288687 >> v1:172.21.15.123:6789/0 conn(0x7f72740d10b0 legacy=0x7f72740cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:55.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.980+0000 7f7279600640 1 -- 172.21.15.123:0/1276288687 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72740733c0 con 0x7f7274073fe0 2024-04-25T13:42:55.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.980+0000 7f7273e00640 1 -- 172.21.15.123:0/1276288687 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1492738229 0 0) 0x7f72740cbb40 con 0x7f72740d10b0 2024-04-25T13:42:55.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.980+0000 7f7279600640 1 --2- 172.21.15.123:0/1276288687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7274073fe0 0x7f72740d0b70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7274072b30 tx=0x7f726801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab2bc53ee0a2bca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:55.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.980+0000 7f7273e00640 1 -- 172.21.15.123:0/1276288687 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72680b1070 con 0x7f7274073fe0 2024-04-25T13:42:55.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.980+0000 7f7273e00640 1 -- 172.21.15.123:0/1276288687 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72680ac600 con 0x7f7274073fe0 2024-04-25T13:42:55.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.980+0000 7f7273e00640 1 -- 172.21.15.123:0/1276288687 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72680ac9d0 con 0x7f7274073fe0 2024-04-25T13:42:55.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.984+0000 7f727c000640 1 -- 172.21.15.123:0/1276288687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7274073fe0 msgr2=0x7f72740d0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:55.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.984+0000 7f727c000640 1 --2- 172.21.15.123:0/1276288687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7274073fe0 0x7f72740d0b70 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7274072b30 tx=0x7f726801c490 comp rx=0 tx=0).stop 2024-04-25T13:42:55.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.984+0000 7f727c000640 1 -- 172.21.15.123:0/1276288687 shutdown_connections 2024-04-25T13:42:55.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.984+0000 7f727c000640 1 --2- 172.21.15.123:0/1276288687 >> v2:172.21.15.130:3300/0 conn(0x7f72740cc700 0x7f72740cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:55.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.984+0000 7f727c000640 1 --2- 172.21.15.123:0/1276288687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7274073fe0 0x7f72740d0b70 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:55.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.984+0000 7f727c000640 1 -- 172.21.15.123:0/1276288687 >> 172.21.15.123:0/1276288687 conn(0x7f72740d19a0 msgr2=0x7f72740d1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:55.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.984+0000 7f727c000640 1 -- 172.21.15.123:0/1276288687 shutdown_connections 2024-04-25T13:42:55.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.984+0000 7f727c000640 1 -- 172.21.15.123:0/1276288687 wait complete. 2024-04-25T13:42:55.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.984+0000 7f727c000640 1 Processor -- start 2024-04-25T13:42:55.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.984+0000 7f727c000640 1 -- start start 2024-04-25T13:42:55.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.988+0000 7f727c000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72740cc700 0x7f727415d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:55.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.988+0000 7f727c000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72740d10b0 0x7f727413ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:55.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.988+0000 7f727c000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72740b1ac0 0x7f7274147c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:55.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.988+0000 7f727c000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7274149920 con 0x7f72740d10b0 2024-04-25T13:42:55.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.988+0000 7f727c000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f72741497a0 con 0x7f72740cc700 2024-04-25T13:42:55.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.988+0000 7f727c000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f727416d310 con 0x7f72740b1ac0 2024-04-25T13:42:55.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.988+0000 7f7278c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72740d10b0 0x7f727413ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:55.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.988+0000 7f7278c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72740d10b0 0x7f727413ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36720/0 (socket says 172.21.15.123:36720) 2024-04-25T13:42:55.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.988+0000 7f7278c00640 1 -- 172.21.15.123:0/2240470277 learned_addr learned my addr 172.21.15.123:0/2240470277 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:55.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.988+0000 7f7279600640 1 --2- 172.21.15.123:0/2240470277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72740cc700 0x7f727415d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:55.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.988+0000 7f727a000640 1 --2- 172.21.15.123:0/2240470277 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72740b1ac0 0x7f7274147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:55.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.988+0000 7f7278c00640 1 -- 172.21.15.123:0/2240470277 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72740b1ac0 msgr2=0x7f7274147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:55.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.988+0000 7f7278c00640 1 --2- 172.21.15.123:0/2240470277 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72740b1ac0 0x7f7274147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:55.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.988+0000 7f7278c00640 1 -- 172.21.15.123:0/2240470277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72740cc700 msgr2=0x7f727415d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:55.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.988+0000 7f7278c00640 1 --2- 172.21.15.123:0/2240470277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72740cc700 0x7f727415d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:55.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.988+0000 7f7278c00640 1 -- 172.21.15.123:0/2240470277 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72740b7970 con 0x7f72740d10b0 2024-04-25T13:42:55.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.988+0000 7f7279600640 1 --2- 172.21.15.123:0/2240470277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72740cc700 0x7f727415d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:55.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.988+0000 7f7278c00640 1 --2- 172.21.15.123:0/2240470277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72740d10b0 0x7f727413ab00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f726000c4b0 tx=0x7f726000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:55.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.988+0000 7f7271600640 1 -- 172.21.15.123:0/2240470277 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260018070 con 0x7f72740d10b0 2024-04-25T13:42:55.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.988+0000 7f7271600640 1 -- 172.21.15.123:0/2240470277 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7260007500 con 0x7f72740d10b0 2024-04-25T13:42:55.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.988+0000 7f7271600640 1 -- 172.21.15.123:0/2240470277 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260004a30 con 0x7f72740d10b0 2024-04-25T13:42:55.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.988+0000 7f727c000640 1 -- 172.21.15.123:0/2240470277 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f727415d9d0 con 0x7f72740d10b0 2024-04-25T13:42:55.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.988+0000 7f727c000640 1 -- 172.21.15.123:0/2240470277 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7274160be0 con 0x7f72740d10b0 2024-04-25T13:42:55.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.988+0000 7f727c000640 1 -- 172.21.15.123:0/2240470277 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7274050750 con 0x7f72740d10b0 2024-04-25T13:42:55.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.992+0000 7f7271600640 1 -- 172.21.15.123:0/2240470277 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7260004bd0 con 0x7f72740d10b0 2024-04-25T13:42:55.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.992+0000 7f7271600640 1 --2- 172.21.15.123:0/2240470277 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f725406f430 0x7f7254071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:55.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.992+0000 7f7271600640 1 -- 172.21.15.123:0/2240470277 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f726008e1c0 con 0x7f72740d10b0 2024-04-25T13:42:55.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.992+0000 7f7279600640 1 --2- 172.21.15.123:0/2240470277 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f725406f430 0x7f7254071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:55.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.992+0000 7f7279600640 1 --2- 172.21.15.123:0/2240470277 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f725406f430 0x7f7254071940 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f72680ae000 tx=0x7f72680a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:55.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:55.996+0000 7f7271600640 1 -- 172.21.15.123:0/2240470277 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f726005b360 con 0x7f72740d10b0 2024-04-25T13:42:56.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.212+0000 7f727c000640 1 -- 172.21.15.123:0/2240470277 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f727415d720 con 0x7f72740d10b0 2024-04-25T13:42:56.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.216+0000 7f7271600640 1 -- 172.21.15.123:0/2240470277 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f726005ac60 con 0x7f72740d10b0 2024-04-25T13:42:56.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.216+0000 7f727c000640 1 -- 172.21.15.123:0/2240470277 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f725406f430 msgr2=0x7f7254071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:56.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.216+0000 7f727c000640 1 --2- 172.21.15.123:0/2240470277 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f725406f430 0x7f7254071940 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f72680ae000 tx=0x7f72680a7000 comp rx=0 tx=0).stop 2024-04-25T13:42:56.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.216+0000 7f727c000640 1 -- 172.21.15.123:0/2240470277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72740d10b0 msgr2=0x7f727413ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:56.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.216+0000 7f727c000640 1 --2- 172.21.15.123:0/2240470277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72740d10b0 0x7f727413ab00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f726000c4b0 tx=0x7f726000c970 comp rx=0 tx=0).stop 2024-04-25T13:42:56.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.216+0000 7f727c000640 1 -- 172.21.15.123:0/2240470277 shutdown_connections 2024-04-25T13:42:56.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.216+0000 7f727c000640 1 --2- 172.21.15.123:0/2240470277 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f725406f430 0x7f7254071940 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:56.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.216+0000 7f727c000640 1 --2- 172.21.15.123:0/2240470277 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72740b1ac0 0x7f7274147c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:56.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.216+0000 7f727c000640 1 --2- 172.21.15.123:0/2240470277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72740d10b0 0x7f727413ab00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:56.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.216+0000 7f727c000640 1 --2- 172.21.15.123:0/2240470277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72740cc700 0x7f727415d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:56.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.216+0000 7f727c000640 1 -- 172.21.15.123:0/2240470277 >> 172.21.15.123:0/2240470277 conn(0x7f72740d19a0 msgr2=0x7f727406f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:56.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.216+0000 7f727c000640 1 -- 172.21.15.123:0/2240470277 shutdown_connections 2024-04-25T13:42:56.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.216+0000 7f727c000640 1 -- 172.21.15.123:0/2240470277 wait complete. 2024-04-25T13:42:56.239 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-25T13:42:56.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.384+0000 7f8bf4e00640 1 Processor -- start 2024-04-25T13:42:56.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.384+0000 7f8bf4e00640 1 -- start start 2024-04-25T13:42:56.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8bf4e00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8bf00b3870 0x7f8bf00b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:56.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8bf4e00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bf00b41c0 con 0x7f8bf00ceac0 2024-04-25T13:42:56.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8bf4e00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bf00c6810 con 0x7f8bf015de80 2024-04-25T13:42:56.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8bf4e00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f8bf00c7140 con 0x7f8bf00b3870 2024-04-25T13:42:56.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8bede00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8bf00ceac0 0x7f8bf00c75d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56350/0 (socket says 172.21.15.123:56350) 2024-04-25T13:42:56.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8bede00640 1 -- 172.21.15.123:0/3326425955 learned_addr learned my addr 172.21.15.123:0/3326425955 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:56.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8be5400640 1 --2- 172.21.15.123:0/3326425955 >> v2:172.21.15.130:3300/0 conn(0x7f8bf00b3870 0x7f8bf00b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:56.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8bed400640 1 -- 172.21.15.123:0/3326425955 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1365396455 0 0) 0x7f8be00014a0 con 0x7f8bf00ceac0 2024-04-25T13:42:56.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8bed400640 1 -- 172.21.15.123:0/3326425955 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bd4003530 con 0x7f8bf00ceac0 2024-04-25T13:42:56.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8bed400640 1 -- 172.21.15.123:0/3326425955 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 624756844 0 0) 0x7f8bd4003530 con 0x7f8bf00ceac0 2024-04-25T13:42:56.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8bed400640 1 -- 172.21.15.123:0/3326425955 >> v2:172.21.15.130:3300/0 conn(0x7f8bf00b3870 msgr2=0x7f8bf00b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:56.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8bed400640 1 --2- 172.21.15.123:0/3326425955 >> v2:172.21.15.130:3300/0 conn(0x7f8bf00b3870 0x7f8bf00b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:56.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8bed400640 1 -- 172.21.15.123:0/3326425955 >> v1:172.21.15.130:6789/0 conn(0x7f8bf015de80 legacy=0x7f8bf015e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:56.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8bed400640 1 -- 172.21.15.123:0/3326425955 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf00c6af0 con 0x7f8bf00ceac0 2024-04-25T13:42:56.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8bed400640 1 -- 172.21.15.123:0/3326425955 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7f8be0001bd0 con 0x7f8bf00ceac0 2024-04-25T13:42:56.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8bed400640 1 -- 172.21.15.123:0/3326425955 >> v1:172.21.15.123:6789/0 conn(0x7f8bf00ceac0 legacy=0x7f8bf00c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:56.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8bed400640 1 --2- 172.21.15.123:0/3326425955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8bd4003aa0 0x7f8bd4003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:56.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8bed400640 1 --2- 172.21.15.123:0/3326425955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bd4004810 0x7f8bd4004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:56.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8bed400640 1 --2- 172.21.15.123:0/3326425955 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bd4005360 0x7f8bd400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:56.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8bed400640 1 -- 172.21.15.123:0/3326425955 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf00c7140 con 0x7f8bd4004810 2024-04-25T13:42:56.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8bed400640 1 -- 172.21.15.123:0/3326425955 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd400c2f0 con 0x7f8bd4003aa0 2024-04-25T13:42:56.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8bed400640 1 -- 172.21.15.123:0/3326425955 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8bd400c4f0 con 0x7f8bd4005360 2024-04-25T13:42:56.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8be5400640 1 --2- 172.21.15.123:0/3326425955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bd4004810 0x7f8bd4004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:56.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8bede00640 1 --2- 172.21.15.123:0/3326425955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8bd4003aa0 0x7f8bd4003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:56.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8bee800640 1 --2- 172.21.15.123:0/3326425955 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bd4005360 0x7f8bd400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:56.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8be5400640 1 -- 172.21.15.123:0/3326425955 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bd4005360 msgr2=0x7f8bd400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:56.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8be5400640 1 --2- 172.21.15.123:0/3326425955 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bd4005360 0x7f8bd400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:56.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8be5400640 1 -- 172.21.15.123:0/3326425955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8bd4003aa0 msgr2=0x7f8bd4003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:56.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8be5400640 1 --2- 172.21.15.123:0/3326425955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8bd4003aa0 0x7f8bd4003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:56.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8be5400640 1 -- 172.21.15.123:0/3326425955 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd4003530 con 0x7f8bd4004810 2024-04-25T13:42:56.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.388+0000 7f8bee800640 1 -- 172.21.15.123:0/3326425955 reap_dead start 2024-04-25T13:42:56.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.392+0000 7f8be5400640 1 --2- 172.21.15.123:0/3326425955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bd4004810 0x7f8bd4004c20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8009ae0 tx=0x7f8bd801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4547ba45bb4b7cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:56.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.392+0000 7f8bed400640 1 -- 172.21.15.123:0/3326425955 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd80096b0 con 0x7f8bd4004810 2024-04-25T13:42:56.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.392+0000 7f8bed400640 1 -- 172.21.15.123:0/3326425955 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bd80a6450 con 0x7f8bd4004810 2024-04-25T13:42:56.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.392+0000 7f8bed400640 1 -- 172.21.15.123:0/3326425955 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd80a6840 con 0x7f8bd4004810 2024-04-25T13:42:56.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.392+0000 7f8bf4e00640 1 -- 172.21.15.123:0/3326425955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bd4004810 msgr2=0x7f8bd4004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:56.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.392+0000 7f8bf4e00640 1 --2- 172.21.15.123:0/3326425955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bd4004810 0x7f8bd4004c20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8009ae0 tx=0x7f8bd801ca70 comp rx=0 tx=0).stop 2024-04-25T13:42:56.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.392+0000 7f8bf4e00640 1 -- 172.21.15.123:0/3326425955 shutdown_connections 2024-04-25T13:42:56.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.392+0000 7f8bf4e00640 1 --2- 172.21.15.123:0/3326425955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bd4004810 0x7f8bd4004c20 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:56.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.392+0000 7f8bf4e00640 1 -- 172.21.15.123:0/3326425955 >> 172.21.15.123:0/3326425955 conn(0x7f8bf006ca70 msgr2=0x7f8bf006ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:56.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.392+0000 7f8bf4e00640 1 -- 172.21.15.123:0/3326425955 shutdown_connections 2024-04-25T13:42:56.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.392+0000 7f8bf4e00640 1 -- 172.21.15.123:0/3326425955 wait complete. 2024-04-25T13:42:56.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.396+0000 7f8bf4e00640 1 Processor -- start 2024-04-25T13:42:56.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.396+0000 7f8bf4e00640 1 -- start start 2024-04-25T13:42:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.396+0000 7f8bf4e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bd4004810 0x7f8bf0156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.396+0000 7f8bf4e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bf0146d80 0x7f8bf0147190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.396+0000 7f8bf4e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8bf01ea690 0x7f8bf01eaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.396+0000 7f8bf4e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf015ec20 con 0x7f8bd4004810 2024-04-25T13:42:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.396+0000 7f8bf4e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf015eaa0 con 0x7f8bf01ea690 2024-04-25T13:42:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.396+0000 7f8bf4e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8bf015eda0 con 0x7f8bf0146d80 2024-04-25T13:42:56.399 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.396+0000 7f8bede00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bd4004810 0x7f8bf0156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.396+0000 7f8bede00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bd4004810 0x7f8bf0156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36740/0 (socket says 172.21.15.123:36740) 2024-04-25T13:42:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.396+0000 7f8bede00640 1 -- 172.21.15.123:0/2569375804 learned_addr learned my addr 172.21.15.123:0/2569375804 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.396+0000 7f8bede00640 1 -- 172.21.15.123:0/2569375804 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bf0146d80 msgr2=0x7f8bf0147190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.396+0000 7f8bede00640 1 --2- 172.21.15.123:0/2569375804 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bf0146d80 0x7f8bf0147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.396+0000 7f8bede00640 1 -- 172.21.15.123:0/2569375804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8bf01ea690 msgr2=0x7f8bf01eaaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.396+0000 7f8bede00640 1 --2- 172.21.15.123:0/2569375804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8bf01ea690 0x7f8bf01eaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:56.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.396+0000 7f8bede00640 1 -- 172.21.15.123:0/2569375804 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf01476d0 con 0x7f8bd4004810 2024-04-25T13:42:56.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.396+0000 7f8bede00640 1 --2- 172.21.15.123:0/2569375804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bd4004810 0x7f8bf0156a10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8be000ab50 tx=0x7f8be0007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:56.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.396+0000 7f8be6a00640 1 -- 172.21.15.123:0/2569375804 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be0017020 con 0x7f8bd4004810 2024-04-25T13:42:56.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.396+0000 7f8be6a00640 1 -- 172.21.15.123:0/2569375804 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8be000ae50 con 0x7f8bd4004810 2024-04-25T13:42:56.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.396+0000 7f8bf4e00640 1 -- 172.21.15.123:0/2569375804 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf01eafe0 con 0x7f8bd4004810 2024-04-25T13:42:56.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.396+0000 7f8be6a00640 1 -- 172.21.15.123:0/2569375804 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be0013630 con 0x7f8bd4004810 2024-04-25T13:42:56.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.396+0000 7f8bf4e00640 1 -- 172.21.15.123:0/2569375804 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf01548e0 con 0x7f8bd4004810 2024-04-25T13:42:56.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.400+0000 7f8bf4e00640 1 -- 172.21.15.123:0/2569375804 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bf006d600 con 0x7f8bd4004810 2024-04-25T13:42:56.402 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.400+0000 7f8be6a00640 1 -- 172.21.15.123:0/2569375804 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8be001a020 con 0x7f8bd4004810 2024-04-25T13:42:56.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.400+0000 7f8be6a00640 1 --2- 172.21.15.123:0/2569375804 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8bcc06f400 0x7f8bcc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:56.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.400+0000 7f8be6a00640 1 -- 172.21.15.123:0/2569375804 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f8be008f970 con 0x7f8bd4004810 2024-04-25T13:42:56.403 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.400+0000 7f8be5400640 1 --2- 172.21.15.123:0/2569375804 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8bcc06f400 0x7f8bcc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:56.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.400+0000 7f8be5400640 1 --2- 172.21.15.123:0/2569375804 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8bcc06f400 0x7f8bcc071910 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80ad000 tx=0x7f8bd80a9040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:56.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.404+0000 7f8be6a00640 1 -- 172.21.15.123:0/2569375804 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8be0021020 con 0x7f8bd4004810 2024-04-25T13:42:56.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.616+0000 7f8bf4e00640 1 -- 172.21.15.123:0/2569375804 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f8bf0050750 con 0x7f8bd4004810 2024-04-25T13:42:56.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.624+0000 7f8be6a00640 1 -- 172.21.15.123:0/2569375804 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) ==== 90+0+0 (secure 0 0 0) 0x7f8bf01eafe0 con 0x7f8bd4004810 2024-04-25T13:42:56.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.624+0000 7f8bf4e00640 1 -- 172.21.15.123:0/2569375804 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8bcc06f400 msgr2=0x7f8bcc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:56.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.624+0000 7f8bf4e00640 1 --2- 172.21.15.123:0/2569375804 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8bcc06f400 0x7f8bcc071910 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8bd80ad000 tx=0x7f8bd80a9040 comp rx=0 tx=0).stop 2024-04-25T13:42:56.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.624+0000 7f8bf4e00640 1 -- 172.21.15.123:0/2569375804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bd4004810 msgr2=0x7f8bf0156a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:56.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.624+0000 7f8bf4e00640 1 --2- 172.21.15.123:0/2569375804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bd4004810 0x7f8bf0156a10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8be000ab50 tx=0x7f8be0007430 comp rx=0 tx=0).stop 2024-04-25T13:42:56.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.624+0000 7f8bf4e00640 1 -- 172.21.15.123:0/2569375804 shutdown_connections 2024-04-25T13:42:56.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.624+0000 7f8bf4e00640 1 --2- 172.21.15.123:0/2569375804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8bf01ea690 0x7f8bf01eaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:56.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.624+0000 7f8bf4e00640 1 --2- 172.21.15.123:0/2569375804 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8bcc06f400 0x7f8bcc071910 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:56.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.624+0000 7f8bf4e00640 1 --2- 172.21.15.123:0/2569375804 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8bf0146d80 0x7f8bf0147190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:56.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.624+0000 7f8bf4e00640 1 --2- 172.21.15.123:0/2569375804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8bd4004810 0x7f8bf0156a10 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:56.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.624+0000 7f8bf4e00640 1 -- 172.21.15.123:0/2569375804 >> 172.21.15.123:0/2569375804 conn(0x7f8bf006ca70 msgr2=0x7f8bf00cdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:56.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.624+0000 7f8bf4e00640 1 -- 172.21.15.123:0/2569375804 shutdown_connections 2024-04-25T13:42:56.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.624+0000 7f8bf4e00640 1 -- 172.21.15.123:0/2569375804 wait complete. 2024-04-25T13:42:56.646 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-25T13:42:56.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.792+0000 7ff299c00640 1 Processor -- start 2024-04-25T13:42:56.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.792+0000 7ff299c00640 1 -- start start 2024-04-25T13:42:56.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.792+0000 7ff299c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff2941651b0 0x7ff2941675d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:56.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.792+0000 7ff299c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2940b5780 con 0x7ff2940cdeb0 2024-04-25T13:42:56.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.792+0000 7ff299c00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2941538f0 con 0x7ff2941534e0 2024-04-25T13:42:56.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.792+0000 7ff299c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff294074a50 con 0x7ff2941651b0 2024-04-25T13:42:56.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.792+0000 7ff28a000640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff2940cdeb0 0x7ff2940ce2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56366/0 (socket says 172.21.15.123:56366) 2024-04-25T13:42:56.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.792+0000 7ff28a000640 1 -- 172.21.15.123:0/1166597806 learned_addr learned my addr 172.21.15.123:0/1166597806 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:56.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.792+0000 7ff293400640 1 --2- 172.21.15.123:0/1166597806 >> v2:172.21.15.123:3300/0 conn(0x7ff2941651b0 0x7ff2941675d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:56.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.792+0000 7ff292000640 1 -- 172.21.15.123:0/1166597806 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3767927919 0 0) 0x7ff27c001120 con 0x7ff2940cdeb0 2024-04-25T13:42:56.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.792+0000 7ff292000640 1 -- 172.21.15.123:0/1166597806 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff278003530 con 0x7ff2940cdeb0 2024-04-25T13:42:56.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.792+0000 7ff293400640 1 -- 172.21.15.123:0/1166597806 >> v1:172.21.15.130:6789/0 conn(0x7ff2941534e0 legacy=0x7ff294074240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:56.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.792+0000 7ff293400640 1 -- 172.21.15.123:0/1166597806 >> v1:172.21.15.123:6789/0 conn(0x7ff2940cdeb0 legacy=0x7ff2940ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:56.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.792+0000 7ff293400640 1 -- 172.21.15.123:0/1166597806 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff29415cde0 con 0x7ff2941651b0 2024-04-25T13:42:56.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.796+0000 7ff293400640 1 --2- 172.21.15.123:0/1166597806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2941651b0 0x7ff2941675d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00a960 tx=0x7ff28c01d7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0762a9919f7f122 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:56.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.796+0000 7ff292000640 1 -- 172.21.15.123:0/1166597806 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c00b040 con 0x7ff2941651b0 2024-04-25T13:42:56.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.796+0000 7ff292000640 1 -- 172.21.15.123:0/1166597806 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff28c0a7710 con 0x7ff2941651b0 2024-04-25T13:42:56.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.796+0000 7ff292000640 1 -- 172.21.15.123:0/1166597806 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c0a7ae0 con 0x7ff2941651b0 2024-04-25T13:42:56.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.796+0000 7ff299c00640 1 -- 172.21.15.123:0/1166597806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2941651b0 msgr2=0x7ff2941675d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:56.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.796+0000 7ff299c00640 1 --2- 172.21.15.123:0/1166597806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2941651b0 0x7ff2941675d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00a960 tx=0x7ff28c01d7e0 comp rx=0 tx=0).stop 2024-04-25T13:42:56.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.796+0000 7ff299c00640 1 -- 172.21.15.123:0/1166597806 shutdown_connections 2024-04-25T13:42:56.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.796+0000 7ff299c00640 1 --2- 172.21.15.123:0/1166597806 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2941651b0 0x7ff2941675d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:56.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.796+0000 7ff299c00640 1 -- 172.21.15.123:0/1166597806 >> 172.21.15.123:0/1166597806 conn(0x7ff29406ca70 msgr2=0x7ff29406ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:56.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.796+0000 7ff299c00640 1 -- 172.21.15.123:0/1166597806 shutdown_connections 2024-04-25T13:42:56.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.796+0000 7ff299c00640 1 -- 172.21.15.123:0/1166597806 wait complete. 2024-04-25T13:42:56.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.800+0000 7ff299c00640 1 Processor -- start 2024-04-25T13:42:56.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.800+0000 7ff299c00640 1 -- start start 2024-04-25T13:42:56.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.800+0000 7ff299c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2940cdeb0 0x7ff29414cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:56.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.800+0000 7ff299c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2941534e0 0x7ff29415f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:56.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.800+0000 7ff299c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2941651b0 0x7ff2940b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:56.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.800+0000 7ff299c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff29415cbc0 con 0x7ff2940cdeb0 2024-04-25T13:42:56.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.800+0000 7ff299c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff29415ca40 con 0x7ff2941534e0 2024-04-25T13:42:56.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.800+0000 7ff299c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff294169b20 con 0x7ff2941651b0 2024-04-25T13:42:56.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.800+0000 7ff292a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2940cdeb0 0x7ff29414cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:56.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.800+0000 7ff292a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2940cdeb0 0x7ff29414cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36770/0 (socket says 172.21.15.123:36770) 2024-04-25T13:42:56.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.800+0000 7ff292a00640 1 -- 172.21.15.123:0/1750148520 learned_addr learned my addr 172.21.15.123:0/1750148520 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:56.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.800+0000 7ff28a000640 1 --2- 172.21.15.123:0/1750148520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2941534e0 0x7ff29415f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:56.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.800+0000 7ff293400640 1 --2- 172.21.15.123:0/1750148520 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2941651b0 0x7ff2940b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:56.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.800+0000 7ff292a00640 1 -- 172.21.15.123:0/1750148520 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2941651b0 msgr2=0x7ff2940b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:56.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.800+0000 7ff292a00640 1 --2- 172.21.15.123:0/1750148520 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2941651b0 0x7ff2940b59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:56.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.800+0000 7ff292a00640 1 -- 172.21.15.123:0/1750148520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2941534e0 msgr2=0x7ff29415f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:56.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.800+0000 7ff292a00640 1 --2- 172.21.15.123:0/1750148520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2941534e0 0x7ff29415f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:56.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.800+0000 7ff292a00640 1 -- 172.21.15.123:0/1750148520 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff29415fa30 con 0x7ff2940cdeb0 2024-04-25T13:42:56.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.800+0000 7ff293400640 1 --2- 172.21.15.123:0/1750148520 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2941651b0 0x7ff2940b59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:56.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.804+0000 7ff292a00640 1 --2- 172.21.15.123:0/1750148520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2940cdeb0 0x7ff29414cf50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff28400c760 tx=0x7ff28400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:56.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.804+0000 7ff28b400640 1 -- 172.21.15.123:0/1750148520 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff284016020 con 0x7ff2940cdeb0 2024-04-25T13:42:56.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.804+0000 7ff28b400640 1 -- 172.21.15.123:0/1750148520 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff284006d80 con 0x7ff2940cdeb0 2024-04-25T13:42:56.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.804+0000 7ff299c00640 1 -- 172.21.15.123:0/1750148520 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff294165cc0 con 0x7ff2940cdeb0 2024-04-25T13:42:56.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.804+0000 7ff28b400640 1 -- 172.21.15.123:0/1750148520 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff284003bc0 con 0x7ff2940cdeb0 2024-04-25T13:42:56.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.804+0000 7ff299c00640 1 -- 172.21.15.123:0/1750148520 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff294166280 con 0x7ff2940cdeb0 2024-04-25T13:42:56.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.804+0000 7ff299c00640 1 -- 172.21.15.123:0/1750148520 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff294050750 con 0x7ff2940cdeb0 2024-04-25T13:42:56.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.804+0000 7ff28b400640 1 -- 172.21.15.123:0/1750148520 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff28400a7f0 con 0x7ff2940cdeb0 2024-04-25T13:42:56.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.808+0000 7ff28b400640 1 --2- 172.21.15.123:0/1750148520 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff27006f430 0x7ff270071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:56.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.808+0000 7ff28b400640 1 -- 172.21.15.123:0/1750148520 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7ff28408eac0 con 0x7ff2940cdeb0 2024-04-25T13:42:56.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.808+0000 7ff28a000640 1 --2- 172.21.15.123:0/1750148520 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff27006f430 0x7ff270071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:56.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.808+0000 7ff28a000640 1 --2- 172.21.15.123:0/1750148520 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff27006f430 0x7ff270071940 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff294068ba0 tx=0x7ff27c007b80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:56.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:56.812+0000 7ff28b400640 1 -- 172.21.15.123:0/1750148520 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff284020020 con 0x7ff2940cdeb0 2024-04-25T13:42:57.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.024+0000 7ff299c00640 1 -- 172.21.15.123:0/1750148520 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7ff2940d01e0 con 0x7ff2940cdeb0 2024-04-25T13:42:57.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.028+0000 7ff28b400640 1 -- 172.21.15.123:0/1750148520 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7ff28405bd80 con 0x7ff2940cdeb0 2024-04-25T13:42:57.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.028+0000 7ff299c00640 1 -- 172.21.15.123:0/1750148520 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff27006f430 msgr2=0x7ff270071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:57.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.028+0000 7ff299c00640 1 --2- 172.21.15.123:0/1750148520 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff27006f430 0x7ff270071940 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff294068ba0 tx=0x7ff27c007b80 comp rx=0 tx=0).stop 2024-04-25T13:42:57.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.028+0000 7ff299c00640 1 -- 172.21.15.123:0/1750148520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2940cdeb0 msgr2=0x7ff29414cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:57.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.028+0000 7ff299c00640 1 --2- 172.21.15.123:0/1750148520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2940cdeb0 0x7ff29414cf50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff28400c760 tx=0x7ff28400cc20 comp rx=0 tx=0).stop 2024-04-25T13:42:57.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.028+0000 7ff299c00640 1 -- 172.21.15.123:0/1750148520 shutdown_connections 2024-04-25T13:42:57.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.028+0000 7ff299c00640 1 --2- 172.21.15.123:0/1750148520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff2941534e0 0x7ff29415f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:57.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.028+0000 7ff299c00640 1 --2- 172.21.15.123:0/1750148520 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff27006f430 0x7ff270071940 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:57.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.028+0000 7ff299c00640 1 --2- 172.21.15.123:0/1750148520 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff2941651b0 0x7ff2940b59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:57.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.028+0000 7ff299c00640 1 --2- 172.21.15.123:0/1750148520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2940cdeb0 0x7ff29414cf50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:57.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.028+0000 7ff299c00640 1 -- 172.21.15.123:0/1750148520 >> 172.21.15.123:0/1750148520 conn(0x7ff29406ca70 msgr2=0x7ff2940b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:57.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.028+0000 7ff299c00640 1 -- 172.21.15.123:0/1750148520 shutdown_connections 2024-04-25T13:42:57.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.028+0000 7ff299c00640 1 -- 172.21.15.123:0/1750148520 wait complete. 2024-04-25T13:42:57.052 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-25T13:42:57.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.196+0000 7f82cd800640 1 Processor -- start 2024-04-25T13:42:57.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.196+0000 7f82cd800640 1 -- start start 2024-04-25T13:42:57.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.196+0000 7f82cd800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82c8149b00 0x7f82c806fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:57.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.196+0000 7f82cd800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f82c80b5550 0x7f82c80b5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:57.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.196+0000 7f82cd800640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82c80b5ea0 con 0x7f82c8163a20 2024-04-25T13:42:57.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.196+0000 7f82cd800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f82c8070410 con 0x7f82c80b5550 2024-04-25T13:42:57.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.196+0000 7f82cd800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f82c80706f0 con 0x7f82c8149b00 2024-04-25T13:42:57.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.200+0000 7f82c6000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f82c80b5550 0x7f82c80b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:57.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.200+0000 7f82c6000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f82c80b5550 0x7f82c80b5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36782/0 (socket says 172.21.15.123:36782) 2024-04-25T13:42:57.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.200+0000 7f82c6000640 1 -- 172.21.15.123:0/4166145878 learned_addr learned my addr 172.21.15.123:0/4166145878 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:57.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.200+0000 7f82c6a00640 1 --2- 172.21.15.123:0/4166145878 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82c8149b00 0x7f82c806fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:57.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.200+0000 7f82c6000640 1 -- 172.21.15.123:0/4166145878 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82c8149b00 msgr2=0x7f82c806fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:57.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.200+0000 7f82c6000640 1 --2- 172.21.15.123:0/4166145878 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82c8149b00 0x7f82c806fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:57.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.200+0000 7f82c6000640 1 -- 172.21.15.123:0/4166145878 >> v1:172.21.15.130:6789/0 conn(0x7f82c8163a20 legacy=0x7f82c8163e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:57.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.200+0000 7f82c6000640 1 -- 172.21.15.123:0/4166145878 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c80709d0 con 0x7f82c80b5550 2024-04-25T13:42:57.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.200+0000 7f82c5600640 1 -- 172.21.15.123:0/4166145878 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4254603727 0 0) 0x7f82c00014a0 con 0x7f82c8163a20 2024-04-25T13:42:57.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.200+0000 7f82c6000640 1 --2- 172.21.15.123:0/4166145878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82c80b5550 0x7f82c80b5960 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009870 tx=0x7f82b401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3b3c54a515ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:57.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.204+0000 7f82c5600640 1 -- 172.21.15.123:0/4166145878 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b40a95f0 con 0x7f82c80b5550 2024-04-25T13:42:57.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.204+0000 7f82c5600640 1 -- 172.21.15.123:0/4166145878 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82b40a9790 con 0x7f82c80b5550 2024-04-25T13:42:57.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.204+0000 7f82c5600640 1 -- 172.21.15.123:0/4166145878 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b40a9b60 con 0x7f82c80b5550 2024-04-25T13:42:57.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.204+0000 7f82cd800640 1 -- 172.21.15.123:0/4166145878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82c80b5550 msgr2=0x7f82c80b5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:57.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.204+0000 7f82cd800640 1 --2- 172.21.15.123:0/4166145878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82c80b5550 0x7f82c80b5960 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009870 tx=0x7f82b401c530 comp rx=0 tx=0).stop 2024-04-25T13:42:57.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.204+0000 7f82cd800640 1 -- 172.21.15.123:0/4166145878 shutdown_connections 2024-04-25T13:42:57.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.204+0000 7f82cd800640 1 --2- 172.21.15.123:0/4166145878 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82c80b5550 0x7f82c80b5960 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:57.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.204+0000 7f82cd800640 1 --2- 172.21.15.123:0/4166145878 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82c8149b00 0x7f82c806fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:57.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.204+0000 7f82cd800640 1 -- 172.21.15.123:0/4166145878 >> 172.21.15.123:0/4166145878 conn(0x7f82c80d2180 msgr2=0x7f82c80d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:57.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.204+0000 7f82cd800640 1 -- 172.21.15.123:0/4166145878 shutdown_connections 2024-04-25T13:42:57.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.204+0000 7f82cd800640 1 -- 172.21.15.123:0/4166145878 wait complete. 2024-04-25T13:42:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.204+0000 7f82cd800640 1 Processor -- start 2024-04-25T13:42:57.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.204+0000 7f82cd800640 1 -- start start 2024-04-25T13:42:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.208+0000 7f82cd800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82c80b5550 0x7f82c813f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.208+0000 7f82cd800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82c8149b00 0x7f82c8147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.208+0000 7f82cd800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82c8163a20 0x7f82c815c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.208+0000 7f82cd800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f82c816d750 con 0x7f82c8149b00 2024-04-25T13:42:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.208+0000 7f82cd800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f82c816d5d0 con 0x7f82c80b5550 2024-04-25T13:42:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.208+0000 7f82cd800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f82c816d8d0 con 0x7f82c8163a20 2024-04-25T13:42:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.208+0000 7f82c6000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82c8149b00 0x7f82c8147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.208+0000 7f82c6000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82c8149b00 0x7f82c8147ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36784/0 (socket says 172.21.15.123:36784) 2024-04-25T13:42:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.208+0000 7f82c6000640 1 -- 172.21.15.123:0/886603687 learned_addr learned my addr 172.21.15.123:0/886603687 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.208+0000 7f82c6a00640 1 --2- 172.21.15.123:0/886603687 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82c80b5550 0x7f82c813f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.208+0000 7f82c7400640 1 --2- 172.21.15.123:0/886603687 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82c8163a20 0x7f82c815c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:57.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.208+0000 7f82c6000640 1 -- 172.21.15.123:0/886603687 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82c8163a20 msgr2=0x7f82c815c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:57.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.208+0000 7f82c6000640 1 --2- 172.21.15.123:0/886603687 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82c8163a20 0x7f82c815c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:57.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.208+0000 7f82c6000640 1 -- 172.21.15.123:0/886603687 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82c80b5550 msgr2=0x7f82c813f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:57.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.208+0000 7f82c6000640 1 --2- 172.21.15.123:0/886603687 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82c80b5550 0x7f82c813f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:57.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.208+0000 7f82c6000640 1 -- 172.21.15.123:0/886603687 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c8148660 con 0x7f82c8149b00 2024-04-25T13:42:57.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.208+0000 7f82c6a00640 1 --2- 172.21.15.123:0/886603687 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82c80b5550 0x7f82c813f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:57.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.208+0000 7f82c6000640 1 --2- 172.21.15.123:0/886603687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82c8149b00 0x7f82c8147ba0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f82b401ca10 tx=0x7f82b40192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:57.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.208+0000 7f82bea00640 1 -- 172.21.15.123:0/886603687 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b4004220 con 0x7f82c8149b00 2024-04-25T13:42:57.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.208+0000 7f82bea00640 1 -- 172.21.15.123:0/886603687 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82b40043c0 con 0x7f82c8149b00 2024-04-25T13:42:57.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.208+0000 7f82cd800640 1 -- 172.21.15.123:0/886603687 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82c8148940 con 0x7f82c8149b00 2024-04-25T13:42:57.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.208+0000 7f82bea00640 1 -- 172.21.15.123:0/886603687 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b4003820 con 0x7f82c8149b00 2024-04-25T13:42:57.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.208+0000 7f82cd800640 1 -- 172.21.15.123:0/886603687 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82c815e460 con 0x7f82c8149b00 2024-04-25T13:42:57.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.208+0000 7f82cd800640 1 -- 172.21.15.123:0/886603687 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82c81483d0 con 0x7f82c8149b00 2024-04-25T13:42:57.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.212+0000 7f82bea00640 1 -- 172.21.15.123:0/886603687 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f82b40039c0 con 0x7f82c8149b00 2024-04-25T13:42:57.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.212+0000 7f82bea00640 1 --2- 172.21.15.123:0/886603687 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f82a806f400 0x7f82a8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:57.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.212+0000 7f82bea00640 1 -- 172.21.15.123:0/886603687 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f82b4129190 con 0x7f82c8149b00 2024-04-25T13:42:57.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.212+0000 7f82c6a00640 1 --2- 172.21.15.123:0/886603687 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f82a806f400 0x7f82a8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:57.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.212+0000 7f82c6a00640 1 --2- 172.21.15.123:0/886603687 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f82a806f400 0x7f82a8071910 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f82b8009eb0 tx=0x7f82b8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:57.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.216+0000 7f82bea00640 1 -- 172.21.15.123:0/886603687 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f82b40ad020 con 0x7f82c8149b00 2024-04-25T13:42:57.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.428+0000 7f82cd800640 1 -- 172.21.15.123:0/886603687 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f82c8050750 con 0x7f82c8149b00 2024-04-25T13:42:57.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.432+0000 7f82bea00640 1 -- 172.21.15.123:0/886603687 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) ==== 97+0+0 (secure 0 0 0) 0x7f82b4016150 con 0x7f82c8149b00 2024-04-25T13:42:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.436+0000 7f82cd800640 1 -- 172.21.15.123:0/886603687 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f82a806f400 msgr2=0x7f82a8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.436+0000 7f82cd800640 1 --2- 172.21.15.123:0/886603687 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f82a806f400 0x7f82a8071910 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f82b8009eb0 tx=0x7f82b8009190 comp rx=0 tx=0).stop 2024-04-25T13:42:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.436+0000 7f82cd800640 1 -- 172.21.15.123:0/886603687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82c8149b00 msgr2=0x7f82c8147ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.436+0000 7f82cd800640 1 --2- 172.21.15.123:0/886603687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82c8149b00 0x7f82c8147ba0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f82b401ca10 tx=0x7f82b40192d0 comp rx=0 tx=0).stop 2024-04-25T13:42:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.436+0000 7f82cd800640 1 -- 172.21.15.123:0/886603687 shutdown_connections 2024-04-25T13:42:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.436+0000 7f82cd800640 1 --2- 172.21.15.123:0/886603687 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f82a806f400 0x7f82a8071910 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.436+0000 7f82cd800640 1 --2- 172.21.15.123:0/886603687 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82c8163a20 0x7f82c815c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.436+0000 7f82cd800640 1 --2- 172.21.15.123:0/886603687 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82c8149b00 0x7f82c8147ba0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.436+0000 7f82cd800640 1 --2- 172.21.15.123:0/886603687 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82c80b5550 0x7f82c813f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:57.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.436+0000 7f82cd800640 1 -- 172.21.15.123:0/886603687 >> 172.21.15.123:0/886603687 conn(0x7f82c80d2180 msgr2=0x7f82c806c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:57.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.436+0000 7f82cd800640 1 -- 172.21.15.123:0/886603687 shutdown_connections 2024-04-25T13:42:57.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.436+0000 7f82cd800640 1 -- 172.21.15.123:0/886603687 wait complete. 2024-04-25T13:42:57.458 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-25T13:42:57.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.604+0000 7f27cc200640 1 Processor -- start 2024-04-25T13:42:57.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.604+0000 7f27cc200640 1 -- start start 2024-04-25T13:42:57.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.604+0000 7f27cc200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27c40b38d0 0x7f27c40d34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:57.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.604+0000 7f27cc200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f27c40b3ce0 0x7f27c40d39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:57.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.604+0000 7f27cc200640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f27c40cff50 0x7f27c40d0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:57.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.604+0000 7f27cc200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f27c40b9260 con 0x7f27c40b3ce0 2024-04-25T13:42:57.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.604+0000 7f27cc200640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f27c40d0ba0 con 0x7f27c40cff50 2024-04-25T13:42:57.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.604+0000 7f27cc200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f27c40d0e80 con 0x7f27c40b38d0 2024-04-25T13:42:57.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.604+0000 7f27c8e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f27c40b3ce0 0x7f27c40d39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:57.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.604+0000 7f27c8e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f27c40b3ce0 0x7f27c40d39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36798/0 (socket says 172.21.15.123:36798) 2024-04-25T13:42:57.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.604+0000 7f27c8e00640 1 -- 172.21.15.123:0/1733567124 learned_addr learned my addr 172.21.15.123:0/1733567124 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:57.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.608+0000 7f27ca200640 1 --2- 172.21.15.123:0/1733567124 >> v2:172.21.15.130:3300/0 conn(0x7f27c40cff50 0x7f27c40d0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:57.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.608+0000 7f27c9800640 1 --2- 172.21.15.123:0/1733567124 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27c40b38d0 0x7f27c40d34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:57.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.608+0000 7f27c8e00640 1 -- 172.21.15.123:0/1733567124 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27c40b38d0 msgr2=0x7f27c40d34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:57.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.608+0000 7f27c8e00640 1 --2- 172.21.15.123:0/1733567124 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27c40b38d0 0x7f27c40d34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:57.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.608+0000 7f27c8e00640 1 -- 172.21.15.123:0/1733567124 >> v2:172.21.15.130:3300/0 conn(0x7f27c40cff50 msgr2=0x7f27c40d0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:57.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.608+0000 7f27c8e00640 1 --2- 172.21.15.123:0/1733567124 >> v2:172.21.15.130:3300/0 conn(0x7f27c40cff50 0x7f27c40d0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:57.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.608+0000 7f27c8e00640 1 -- 172.21.15.123:0/1733567124 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c40d1f20 con 0x7f27c40b3ce0 2024-04-25T13:42:57.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.608+0000 7f27ca200640 1 --2- 172.21.15.123:0/1733567124 >> v2:172.21.15.130:3300/0 conn(0x7f27c40cff50 0x7f27c40d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:57.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.608+0000 7f27c9800640 1 --2- 172.21.15.123:0/1733567124 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27c40b38d0 0x7f27c40d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:42:57.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.608+0000 7f27c8e00640 1 --2- 172.21.15.123:0/1733567124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27c40b3ce0 0x7f27c40d39f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f27c40d1160 tx=0x7f27b001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c4b1bde5d2f853 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:57.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.608+0000 7f27c3e00640 1 -- 172.21.15.123:0/1733567124 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b00aa430 con 0x7f27c40b3ce0 2024-04-25T13:42:57.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.608+0000 7f27c3e00640 1 -- 172.21.15.123:0/1733567124 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b00af070 con 0x7f27c40b3ce0 2024-04-25T13:42:57.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.608+0000 7f27c3e00640 1 -- 172.21.15.123:0/1733567124 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b00aa7f0 con 0x7f27c40b3ce0 2024-04-25T13:42:57.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.612+0000 7f27cc200640 1 -- 172.21.15.123:0/1733567124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27c40b3ce0 msgr2=0x7f27c40d39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:57.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.612+0000 7f27cc200640 1 --2- 172.21.15.123:0/1733567124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27c40b3ce0 0x7f27c40d39f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f27c40d1160 tx=0x7f27b001c4f0 comp rx=0 tx=0).stop 2024-04-25T13:42:57.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.612+0000 7f27cc200640 1 -- 172.21.15.123:0/1733567124 shutdown_connections 2024-04-25T13:42:57.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.612+0000 7f27cc200640 1 --2- 172.21.15.123:0/1733567124 >> v2:172.21.15.130:3300/0 conn(0x7f27c40cff50 0x7f27c40d0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:57.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.612+0000 7f27cc200640 1 --2- 172.21.15.123:0/1733567124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27c40b3ce0 0x7f27c40d39f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:57.613 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.612+0000 7f27cc200640 1 --2- 172.21.15.123:0/1733567124 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27c40b38d0 0x7f27c40d34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:57.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.612+0000 7f27cc200640 1 -- 172.21.15.123:0/1733567124 >> 172.21.15.123:0/1733567124 conn(0x7f27c408cf90 msgr2=0x7f27c408d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:57.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.612+0000 7f27cc200640 1 -- 172.21.15.123:0/1733567124 shutdown_connections 2024-04-25T13:42:57.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.612+0000 7f27cc200640 1 -- 172.21.15.123:0/1733567124 wait complete. 2024-04-25T13:42:57.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.612+0000 7f27cc200640 1 Processor -- start 2024-04-25T13:42:57.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.612+0000 7f27cc200640 1 -- start start 2024-04-25T13:42:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.616+0000 7f27cc200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27c40b38d0 0x7f27c4157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.616+0000 7f27cc200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27c40b3ce0 0x7f27c415b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.616+0000 7f27cc200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27c40cff50 0x7f27c415bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.616+0000 7f27cc200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f27c406dfd0 con 0x7f27c40b3ce0 2024-04-25T13:42:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.616+0000 7f27cc200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f27c406de50 con 0x7f27c40b38d0 2024-04-25T13:42:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.616+0000 7f27cc200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f27c406e150 con 0x7f27c40cff50 2024-04-25T13:42:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.616+0000 7f27c8e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27c40b3ce0 0x7f27c415b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:57.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.616+0000 7f27c8e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27c40b3ce0 0x7f27c415b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36812/0 (socket says 172.21.15.123:36812) 2024-04-25T13:42:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.616+0000 7f27c8e00640 1 -- 172.21.15.123:0/3286789954 learned_addr learned my addr 172.21.15.123:0/3286789954 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.616+0000 7f27c9800640 1 --2- 172.21.15.123:0/3286789954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27c40b38d0 0x7f27c4157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.616+0000 7f27ca200640 1 --2- 172.21.15.123:0/3286789954 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27c40cff50 0x7f27c415bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.616+0000 7f27c8e00640 1 -- 172.21.15.123:0/3286789954 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27c40cff50 msgr2=0x7f27c415bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.616+0000 7f27c8e00640 1 --2- 172.21.15.123:0/3286789954 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27c40cff50 0x7f27c415bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.616+0000 7f27c8e00640 1 -- 172.21.15.123:0/3286789954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27c40b38d0 msgr2=0x7f27c4157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.616+0000 7f27c8e00640 1 --2- 172.21.15.123:0/3286789954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27c40b38d0 0x7f27c4157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.616+0000 7f27c8e00640 1 -- 172.21.15.123:0/3286789954 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c40b0c60 con 0x7f27c40b3ce0 2024-04-25T13:42:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.616+0000 7f27ca200640 1 --2- 172.21.15.123:0/3286789954 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27c40cff50 0x7f27c415bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.616+0000 7f27c8e00640 1 --2- 172.21.15.123:0/3286789954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27c40b3ce0 0x7f27c415b6b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f27b001aba0 tx=0x7f27b001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.616+0000 7f27c1600640 1 -- 172.21.15.123:0/3286789954 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b00bd5f0 con 0x7f27c40b3ce0 2024-04-25T13:42:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.616+0000 7f27c1600640 1 -- 172.21.15.123:0/3286789954 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b00bd7b0 con 0x7f27c40b3ce0 2024-04-25T13:42:57.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.616+0000 7f27c1600640 1 -- 172.21.15.123:0/3286789954 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b00bdba0 con 0x7f27c40b3ce0 2024-04-25T13:42:57.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.616+0000 7f27cc200640 1 -- 172.21.15.123:0/3286789954 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27c40b0f00 con 0x7f27c40b3ce0 2024-04-25T13:42:57.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.616+0000 7f27cc200640 1 -- 172.21.15.123:0/3286789954 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27c40b14c0 con 0x7f27c40b3ce0 2024-04-25T13:42:57.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.616+0000 7f27cc200640 1 -- 172.21.15.123:0/3286789954 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27c4050750 con 0x7f27c40b3ce0 2024-04-25T13:42:57.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.616+0000 7f27c1600640 1 -- 172.21.15.123:0/3286789954 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f27b00b33f0 con 0x7f27c40b3ce0 2024-04-25T13:42:57.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.620+0000 7f27c1600640 1 --2- 172.21.15.123:0/3286789954 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f27a406f400 0x7f27a4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:57.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.620+0000 7f27c1600640 1 -- 172.21.15.123:0/3286789954 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f27b0129ae0 con 0x7f27c40b3ce0 2024-04-25T13:42:57.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.620+0000 7f27c9800640 1 --2- 172.21.15.123:0/3286789954 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f27a406f400 0x7f27a4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:57.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.620+0000 7f27c9800640 1 --2- 172.21.15.123:0/3286789954 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f27a406f400 0x7f27a4071910 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f27b8006fd0 tx=0x7f27b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:57.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.624+0000 7f27c1600640 1 -- 172.21.15.123:0/3286789954 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f27b00c3060 con 0x7f27c40b3ce0 2024-04-25T13:42:57.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.836+0000 7f27cc200640 1 -- 172.21.15.123:0/3286789954 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f27c40b7c60 con 0x7f27c40b3ce0 2024-04-25T13:42:57.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.840+0000 7f27c1600640 1 -- 172.21.15.123:0/3286789954 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) ==== 90+0+0 (secure 0 0 0) 0x7f27c40b0c60 con 0x7f27c40b3ce0 2024-04-25T13:42:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.844+0000 7f27cc200640 1 -- 172.21.15.123:0/3286789954 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f27a406f400 msgr2=0x7f27a4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.844+0000 7f27cc200640 1 --2- 172.21.15.123:0/3286789954 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f27a406f400 0x7f27a4071910 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f27b8006fd0 tx=0x7f27b8008040 comp rx=0 tx=0).stop 2024-04-25T13:42:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.844+0000 7f27cc200640 1 -- 172.21.15.123:0/3286789954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27c40b3ce0 msgr2=0x7f27c415b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.844+0000 7f27cc200640 1 --2- 172.21.15.123:0/3286789954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27c40b3ce0 0x7f27c415b6b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f27b001aba0 tx=0x7f27b001ad30 comp rx=0 tx=0).stop 2024-04-25T13:42:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.844+0000 7f27cc200640 1 -- 172.21.15.123:0/3286789954 shutdown_connections 2024-04-25T13:42:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.844+0000 7f27cc200640 1 --2- 172.21.15.123:0/3286789954 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f27a406f400 0x7f27a4071910 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.844+0000 7f27cc200640 1 --2- 172.21.15.123:0/3286789954 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f27c40cff50 0x7f27c415bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.844+0000 7f27cc200640 1 --2- 172.21.15.123:0/3286789954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f27c40b3ce0 0x7f27c415b6b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:57.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.844+0000 7f27cc200640 1 --2- 172.21.15.123:0/3286789954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27c40b38d0 0x7f27c4157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:57.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.844+0000 7f27cc200640 1 -- 172.21.15.123:0/3286789954 >> 172.21.15.123:0/3286789954 conn(0x7f27c408cf90 msgr2=0x7f27c40ced10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:57.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.844+0000 7f27cc200640 1 -- 172.21.15.123:0/3286789954 shutdown_connections 2024-04-25T13:42:57.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:57.844+0000 7f27cc200640 1 -- 172.21.15.123:0/3286789954 wait complete. 2024-04-25T13:42:57.865 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:42:58.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.008+0000 7fb657400640 1 Processor -- start 2024-04-25T13:42:58.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.008+0000 7fb657400640 1 -- start start 2024-04-25T13:42:58.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.012+0000 7fb657400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb6501474f0 0x7fb65015eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:58.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.012+0000 7fb657400640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb6500cd8e0 0x7fb6500cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:58.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.012+0000 7fb657400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb65015f0d0 con 0x7fb6500b6970 2024-04-25T13:42:58.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.012+0000 7fb657400640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fb6500d0d10 con 0x7fb6500cd8e0 2024-04-25T13:42:58.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.012+0000 7fb657400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb650073400 con 0x7fb6501474f0 2024-04-25T13:42:58.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.012+0000 7fb64fe00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fb6500b6970 0x7fb6500b6d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56372/0 (socket says 172.21.15.123:56372) 2024-04-25T13:42:58.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.012+0000 7fb64fe00640 1 -- 172.21.15.123:0/834114056 learned_addr learned my addr 172.21.15.123:0/834114056 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:58.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.012+0000 7fb655400640 1 --2- 172.21.15.123:0/834114056 >> v2:172.21.15.130:3300/0 conn(0x7fb6500cd8e0 0x7fb6500cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:58.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.012+0000 7fb654a00640 1 --2- 172.21.15.123:0/834114056 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb6501474f0 0x7fb65015eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:58.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.012+0000 7fb64f400640 1 -- 172.21.15.123:0/834114056 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 104548970 0 0) 0x7fb63c001120 con 0x7fb6500b6970 2024-04-25T13:42:58.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.012+0000 7fb64f400640 1 -- 172.21.15.123:0/834114056 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb638003530 con 0x7fb6500b6970 2024-04-25T13:42:58.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.012+0000 7fb655400640 1 -- 172.21.15.123:0/834114056 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb6501474f0 msgr2=0x7fb65015eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:58.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.012+0000 7fb655400640 1 --2- 172.21.15.123:0/834114056 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb6501474f0 0x7fb65015eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.012+0000 7fb655400640 1 -- 172.21.15.123:0/834114056 >> v1:172.21.15.123:6789/0 conn(0x7fb6500b6970 legacy=0x7fb6500b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:58.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.012+0000 7fb655400640 1 -- 172.21.15.123:0/834114056 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6500736e0 con 0x7fb6500cd8e0 2024-04-25T13:42:58.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.012+0000 7fb654a00640 1 --2- 172.21.15.123:0/834114056 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb6501474f0 0x7fb65015eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:42:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.016+0000 7fb655400640 1 --2- 172.21.15.123:0/834114056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6500cd8e0 0x7fb6500cdcf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb648009d90 tx=0x7fb64801c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96c8b15648c4ecb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.016+0000 7fb64f400640 1 -- 172.21.15.123:0/834114056 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6480b2070 con 0x7fb6500cd8e0 2024-04-25T13:42:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.016+0000 7fb64f400640 1 -- 172.21.15.123:0/834114056 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6480a59a0 con 0x7fb6500cd8e0 2024-04-25T13:42:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.016+0000 7fb64f400640 1 -- 172.21.15.123:0/834114056 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6480a5d70 con 0x7fb6500cd8e0 2024-04-25T13:42:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.016+0000 7fb657400640 1 -- 172.21.15.123:0/834114056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6500cd8e0 msgr2=0x7fb6500cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.016+0000 7fb657400640 1 --2- 172.21.15.123:0/834114056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6500cd8e0 0x7fb6500cdcf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb648009d90 tx=0x7fb64801c8e0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.016+0000 7fb657400640 1 -- 172.21.15.123:0/834114056 shutdown_connections 2024-04-25T13:42:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.016+0000 7fb657400640 1 --2- 172.21.15.123:0/834114056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6500cd8e0 0x7fb6500cdcf0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.016+0000 7fb657400640 1 --2- 172.21.15.123:0/834114056 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb6501474f0 0x7fb65015eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.016+0000 7fb657400640 1 -- 172.21.15.123:0/834114056 >> 172.21.15.123:0/834114056 conn(0x7fb65006d210 msgr2=0x7fb65006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.016+0000 7fb657400640 1 -- 172.21.15.123:0/834114056 shutdown_connections 2024-04-25T13:42:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.016+0000 7fb657400640 1 -- 172.21.15.123:0/834114056 wait complete. 2024-04-25T13:42:58.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.020+0000 7fb657400640 1 Processor -- start 2024-04-25T13:42:58.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.020+0000 7fb657400640 1 -- start start 2024-04-25T13:42:58.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.020+0000 7fb657400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6500b6970 0x7fb65015adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:58.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.020+0000 7fb657400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb6500cd8e0 0x7fb6500af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:58.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.020+0000 7fb657400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6501474f0 0x7fb6501402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:58.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.020+0000 7fb657400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb65016a750 con 0x7fb6500b6970 2024-04-25T13:42:58.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.020+0000 7fb657400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb6500744a0 con 0x7fb6501474f0 2024-04-25T13:42:58.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.020+0000 7fb657400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb65016a8d0 con 0x7fb6500cd8e0 2024-04-25T13:42:58.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.020+0000 7fb654a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6500b6970 0x7fb65015adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:58.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.020+0000 7fb654a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6500b6970 0x7fb65015adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36824/0 (socket says 172.21.15.123:36824) 2024-04-25T13:42:58.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.020+0000 7fb654a00640 1 -- 172.21.15.123:0/1497238828 learned_addr learned my addr 172.21.15.123:0/1497238828 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:58.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.024+0000 7fb64fe00640 1 --2- 172.21.15.123:0/1497238828 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb6500cd8e0 0x7fb6500af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:58.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.024+0000 7fb655400640 1 --2- 172.21.15.123:0/1497238828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6501474f0 0x7fb6501402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:58.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.024+0000 7fb654a00640 1 -- 172.21.15.123:0/1497238828 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb6500cd8e0 msgr2=0x7fb6500af310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:58.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.024+0000 7fb654a00640 1 --2- 172.21.15.123:0/1497238828 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb6500cd8e0 0x7fb6500af310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.024+0000 7fb654a00640 1 -- 172.21.15.123:0/1497238828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6501474f0 msgr2=0x7fb6501402c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:58.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.024+0000 7fb654a00640 1 --2- 172.21.15.123:0/1497238828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6501474f0 0x7fb6501402c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.024+0000 7fb654a00640 1 -- 172.21.15.123:0/1497238828 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6501425a0 con 0x7fb6500b6970 2024-04-25T13:42:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.024+0000 7fb654a00640 1 --2- 172.21.15.123:0/1497238828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6500b6970 0x7fb65015adf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb64400e9b0 tx=0x7fb64400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.024+0000 7fb64cc00640 1 -- 172.21.15.123:0/1497238828 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644017070 con 0x7fb6500b6970 2024-04-25T13:42:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.024+0000 7fb64cc00640 1 -- 172.21.15.123:0/1497238828 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb64400ca00 con 0x7fb6500b6970 2024-04-25T13:42:58.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.024+0000 7fb64cc00640 1 -- 172.21.15.123:0/1497238828 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64400cdd0 con 0x7fb6500b6970 2024-04-25T13:42:58.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.024+0000 7fb657400640 1 -- 172.21.15.123:0/1497238828 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb650142880 con 0x7fb6500b6970 2024-04-25T13:42:58.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.024+0000 7fb657400640 1 -- 172.21.15.123:0/1497238828 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb650142e40 con 0x7fb6500b6970 2024-04-25T13:42:58.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.024+0000 7fb657400640 1 -- 172.21.15.123:0/1497238828 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6500507c0 con 0x7fb6500b6970 2024-04-25T13:42:58.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.024+0000 7fb64cc00640 1 -- 172.21.15.123:0/1497238828 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb64401a070 con 0x7fb6500b6970 2024-04-25T13:42:58.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.028+0000 7fb64cc00640 1 --2- 172.21.15.123:0/1497238828 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb63006f400 0x7fb630071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:58.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.028+0000 7fb64cc00640 1 -- 172.21.15.123:0/1497238828 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fb64408f250 con 0x7fb6500b6970 2024-04-25T13:42:58.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.028+0000 7fb64fe00640 1 --2- 172.21.15.123:0/1497238828 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb63006f400 0x7fb630071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:58.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.028+0000 7fb64fe00640 1 --2- 172.21.15.123:0/1497238828 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb63006f400 0x7fb630071910 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb65006f810 tx=0x7fb63c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:58.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.032+0000 7fb64cc00640 1 -- 172.21.15.123:0/1497238828 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb64405c480 con 0x7fb6500b6970 2024-04-25T13:42:58.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.188+0000 7fb657400640 1 -- 172.21.15.123:0/1497238828 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb65013f900 con 0x7fb6500b6970 2024-04-25T13:42:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.188+0000 7fb64cc00640 1 -- 172.21.15.123:0/1497238828 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) ==== 74+0+12915 (secure 0 0 0) 0x7fb64405bd80 con 0x7fb6500b6970 2024-04-25T13:42:58.192 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:58.192 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":30,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:42:55.007591+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:42:58.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.192+0000 7fb657400640 1 -- 172.21.15.123:0/1497238828 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb63006f400 msgr2=0x7fb630071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.192+0000 7fb657400640 1 --2- 172.21.15.123:0/1497238828 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb63006f400 0x7fb630071910 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb65006f810 tx=0x7fb63c009040 comp rx=0 tx=0).stop 2024-04-25T13:42:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.192+0000 7fb657400640 1 -- 172.21.15.123:0/1497238828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6500b6970 msgr2=0x7fb65015adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.192+0000 7fb657400640 1 --2- 172.21.15.123:0/1497238828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6500b6970 0x7fb65015adf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb64400e9b0 tx=0x7fb64400ee70 comp rx=0 tx=0).stop 2024-04-25T13:42:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.192+0000 7fb657400640 1 -- 172.21.15.123:0/1497238828 shutdown_connections 2024-04-25T13:42:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.192+0000 7fb657400640 1 --2- 172.21.15.123:0/1497238828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb6501474f0 0x7fb6501402c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.192+0000 7fb657400640 1 --2- 172.21.15.123:0/1497238828 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb63006f400 0x7fb630071910 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.192+0000 7fb657400640 1 --2- 172.21.15.123:0/1497238828 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb6500cd8e0 0x7fb6500af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.192+0000 7fb657400640 1 --2- 172.21.15.123:0/1497238828 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb6500b6970 0x7fb65015adf0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.192+0000 7fb657400640 1 -- 172.21.15.123:0/1497238828 >> 172.21.15.123:0/1497238828 conn(0x7fb65006d210 msgr2=0x7fb650146430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.192+0000 7fb657400640 1 -- 172.21.15.123:0/1497238828 shutdown_connections 2024-04-25T13:42:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.192+0000 7fb657400640 1 -- 172.21.15.123:0/1497238828 wait complete. 2024-04-25T13:42:58.214 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:41:53.602480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:42:58.215 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:42:58.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.360+0000 7f60b8600640 1 Processor -- start 2024-04-25T13:42:58.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.360+0000 7f60b8600640 1 -- start start 2024-04-25T13:42:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.364+0000 7f60b8600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60b00b3870 0x7f60b00b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.364+0000 7f60b8600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f60b0072af0 0x7f60b0072f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.364+0000 7f60b8600640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60b00b41c0 con 0x7f60b01571b0 2024-04-25T13:42:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.364+0000 7f60b8600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f60b00cdee0 con 0x7f60b0072af0 2024-04-25T13:42:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.364+0000 7f60b8600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f60b015d570 con 0x7f60b00b3870 2024-04-25T13:42:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.364+0000 7f60b6600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f60b0072af0 0x7f60b0072f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.364+0000 7f60b6600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f60b0072af0 0x7f60b0072f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36826/0 (socket says 172.21.15.123:36826) 2024-04-25T13:42:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.364+0000 7f60b6600640 1 -- 172.21.15.123:0/3881878599 learned_addr learned my addr 172.21.15.123:0/3881878599 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.364+0000 7f60b5200640 1 --2- 172.21.15.123:0/3881878599 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60b00b3870 0x7f60b00b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.364+0000 7f60b6600640 1 -- 172.21.15.123:0/3881878599 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60b00b3870 msgr2=0x7f60b00b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:58.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.364+0000 7f60b6600640 1 --2- 172.21.15.123:0/3881878599 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60b00b3870 0x7f60b00b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.364+0000 7f60b6600640 1 -- 172.21.15.123:0/3881878599 >> v1:172.21.15.130:6789/0 conn(0x7f60b01571b0 legacy=0x7f60b00cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.364+0000 7f60b6600640 1 -- 172.21.15.123:0/3881878599 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b015d850 con 0x7f60b0072af0 2024-04-25T13:42:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.364+0000 7f60afe00640 1 -- 172.21.15.123:0/3881878599 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3054420028 0 0) 0x7f60a4001120 con 0x7f60b01571b0 2024-04-25T13:42:58.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.368+0000 7f60b6600640 1 --2- 172.21.15.123:0/3881878599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60b0072af0 0x7f60b0072f00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f60a8009e50 tx=0x7f60a801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66696505092a73bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:58.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.368+0000 7f60afe00640 1 -- 172.21.15.123:0/3881878599 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a80a58f0 con 0x7f60b0072af0 2024-04-25T13:42:58.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.368+0000 7f60afe00640 1 -- 172.21.15.123:0/3881878599 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60a80a5a90 con 0x7f60b0072af0 2024-04-25T13:42:58.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.368+0000 7f60afe00640 1 -- 172.21.15.123:0/3881878599 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a80a5e60 con 0x7f60b0072af0 2024-04-25T13:42:58.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.368+0000 7f60b8600640 1 -- 172.21.15.123:0/3881878599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60b0072af0 msgr2=0x7f60b0072f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:58.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.368+0000 7f60b8600640 1 --2- 172.21.15.123:0/3881878599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60b0072af0 0x7f60b0072f00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f60a8009e50 tx=0x7f60a801ca00 comp rx=0 tx=0).stop 2024-04-25T13:42:58.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.368+0000 7f60b8600640 1 -- 172.21.15.123:0/3881878599 shutdown_connections 2024-04-25T13:42:58.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.368+0000 7f60b8600640 1 --2- 172.21.15.123:0/3881878599 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60b0072af0 0x7f60b0072f00 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.368+0000 7f60b8600640 1 --2- 172.21.15.123:0/3881878599 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60b00b3870 0x7f60b00b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.368+0000 7f60b8600640 1 -- 172.21.15.123:0/3881878599 >> 172.21.15.123:0/3881878599 conn(0x7f60b006ca70 msgr2=0x7f60b006ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:58.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.368+0000 7f60b8600640 1 -- 172.21.15.123:0/3881878599 shutdown_connections 2024-04-25T13:42:58.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.368+0000 7f60b8600640 1 -- 172.21.15.123:0/3881878599 wait complete. 2024-04-25T13:42:58.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.372+0000 7f60b8600640 1 Processor -- start 2024-04-25T13:42:58.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.372+0000 7f60b8600640 1 -- start start 2024-04-25T13:42:58.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.372+0000 7f60b8600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60b0072af0 0x7f60b00c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:58.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.372+0000 7f60b8600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60b00b3870 0x7f60b0152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:58.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.372+0000 7f60b8600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60b01571b0 0x7f60b01525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:58.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.372+0000 7f60b8600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f60b0157740 con 0x7f60b0072af0 2024-04-25T13:42:58.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.372+0000 7f60b8600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f60b01575c0 con 0x7f60b01571b0 2024-04-25T13:42:58.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.372+0000 7f60b8600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f60b0073850 con 0x7f60b00b3870 2024-04-25T13:42:58.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.372+0000 7f60b5c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60b0072af0 0x7f60b00c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:58.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.372+0000 7f60b5c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60b0072af0 0x7f60b00c96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36834/0 (socket says 172.21.15.123:36834) 2024-04-25T13:42:58.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.372+0000 7f60b5c00640 1 -- 172.21.15.123:0/3509795829 learned_addr learned my addr 172.21.15.123:0/3509795829 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:58.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.372+0000 7f60b6600640 1 --2- 172.21.15.123:0/3509795829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60b01571b0 0x7f60b01525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:58.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.372+0000 7f60b5200640 1 --2- 172.21.15.123:0/3509795829 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60b00b3870 0x7f60b0152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:58.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.372+0000 7f60b5c00640 1 -- 172.21.15.123:0/3509795829 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60b00b3870 msgr2=0x7f60b0152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:58.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.372+0000 7f60b5c00640 1 --2- 172.21.15.123:0/3509795829 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60b00b3870 0x7f60b0152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.372+0000 7f60b5c00640 1 -- 172.21.15.123:0/3509795829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60b01571b0 msgr2=0x7f60b01525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:58.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.372+0000 7f60b5c00640 1 --2- 172.21.15.123:0/3509795829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60b01571b0 0x7f60b01525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.372+0000 7f60b5c00640 1 -- 172.21.15.123:0/3509795829 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b01f78b0 con 0x7f60b0072af0 2024-04-25T13:42:58.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.372+0000 7f60b5c00640 1 --2- 172.21.15.123:0/3509795829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60b0072af0 0x7f60b00c96e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f60a400c420 tx=0x7f60a400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:58.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.372+0000 7f60ad600640 1 -- 172.21.15.123:0/3509795829 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a4017070 con 0x7f60b0072af0 2024-04-25T13:42:58.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.372+0000 7f60ad600640 1 -- 172.21.15.123:0/3509795829 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60a4003600 con 0x7f60b0072af0 2024-04-25T13:42:58.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.372+0000 7f60ad600640 1 -- 172.21.15.123:0/3509795829 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a40039f0 con 0x7f60b0072af0 2024-04-25T13:42:58.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.372+0000 7f60b8600640 1 -- 172.21.15.123:0/3509795829 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60b01f7b90 con 0x7f60b0072af0 2024-04-25T13:42:58.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.372+0000 7f60b8600640 1 -- 172.21.15.123:0/3509795829 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60b01f8150 con 0x7f60b0072af0 2024-04-25T13:42:58.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.376+0000 7f60b8600640 1 -- 172.21.15.123:0/3509795829 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60b0050750 con 0x7f60b0072af0 2024-04-25T13:42:58.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.376+0000 7f60ad600640 1 -- 172.21.15.123:0/3509795829 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f60a401a070 con 0x7f60b0072af0 2024-04-25T13:42:58.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.376+0000 7f60ad600640 1 --2- 172.21.15.123:0/3509795829 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f609006f430 0x7f6090071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:58.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.376+0000 7f60ad600640 1 -- 172.21.15.123:0/3509795829 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f60a408e250 con 0x7f60b0072af0 2024-04-25T13:42:58.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.376+0000 7f60b5200640 1 --2- 172.21.15.123:0/3509795829 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f609006f430 0x7f6090071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:58.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.376+0000 7f60b5200640 1 --2- 172.21.15.123:0/3509795829 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f609006f430 0x7f6090071940 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f60b00c9600 tx=0x7f609c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:58.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.380+0000 7f60ad600640 1 -- 172.21.15.123:0/3509795829 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f60b00b41c0 con 0x7f60b0072af0 2024-04-25T13:42:58.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.540+0000 7f60b8600640 1 -- 172.21.15.123:0/3509795829 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f60b00ca100 con 0x7f60b0072af0 2024-04-25T13:42:58.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.540+0000 7f60ad600640 1 -- 172.21.15.123:0/3509795829 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) ==== 93+0+10 (secure 0 0 0) 0x7f60a405ae30 con 0x7f60b0072af0 2024-04-25T13:42:58.542 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-04-25T13:42:58.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.540+0000 7f60b8600640 1 -- 172.21.15.123:0/3509795829 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f609006f430 msgr2=0x7f6090071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:58.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.540+0000 7f60b8600640 1 --2- 172.21.15.123:0/3509795829 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f609006f430 0x7f6090071940 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f60b00c9600 tx=0x7f609c009190 comp rx=0 tx=0).stop 2024-04-25T13:42:58.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.540+0000 7f60b8600640 1 -- 172.21.15.123:0/3509795829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60b0072af0 msgr2=0x7f60b00c96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:58.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.540+0000 7f60b8600640 1 --2- 172.21.15.123:0/3509795829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60b0072af0 0x7f60b00c96e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f60a400c420 tx=0x7f60a400c8e0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.540+0000 7f60b8600640 1 -- 172.21.15.123:0/3509795829 shutdown_connections 2024-04-25T13:42:58.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.540+0000 7f60b8600640 1 --2- 172.21.15.123:0/3509795829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60b01571b0 0x7f60b01525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.540+0000 7f60b8600640 1 --2- 172.21.15.123:0/3509795829 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f609006f430 0x7f6090071940 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.540+0000 7f60b8600640 1 --2- 172.21.15.123:0/3509795829 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60b00b3870 0x7f60b0152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.540+0000 7f60b8600640 1 --2- 172.21.15.123:0/3509795829 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60b0072af0 0x7f60b00c96e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.540+0000 7f60b8600640 1 -- 172.21.15.123:0/3509795829 >> 172.21.15.123:0/3509795829 conn(0x7f60b006ca70 msgr2=0x7f60b00ce1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:58.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.540+0000 7f60b8600640 1 -- 172.21.15.123:0/3509795829 shutdown_connections 2024-04-25T13:42:58.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.540+0000 7f60b8600640 1 -- 172.21.15.123:0/3509795829 wait complete. 2024-04-25T13:42:58.564 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T13:42:58.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.708+0000 7f824de00640 1 Processor -- start 2024-04-25T13:42:58.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.708+0000 7f824de00640 1 -- start start 2024-04-25T13:42:58.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.712+0000 7f824de00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f82481474f0 0x7f824815eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:58.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.712+0000 7f824de00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f82480cd8e0 0x7f82480cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:58.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.712+0000 7f824de00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f824815f0d0 con 0x7f82480b6970 2024-04-25T13:42:58.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.712+0000 7f824de00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f82480d0d10 con 0x7f82480cd8e0 2024-04-25T13:42:58.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.712+0000 7f824de00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f8248073400 con 0x7f82481474f0 2024-04-25T13:42:58.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.712+0000 7f8247400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f82480cd8e0 0x7f82480cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:58.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.712+0000 7f8247400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f82480cd8e0 0x7f82480cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36836/0 (socket says 172.21.15.123:36836) 2024-04-25T13:42:58.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.712+0000 7f8247400640 1 -- 172.21.15.123:0/135748506 learned_addr learned my addr 172.21.15.123:0/135748506 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:58.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.712+0000 7f8246a00640 1 --2- 172.21.15.123:0/135748506 >> v2:172.21.15.130:3300/0 conn(0x7f82481474f0 0x7f824815eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:58.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.712+0000 7f8247400640 1 -- 172.21.15.123:0/135748506 >> v2:172.21.15.130:3300/0 conn(0x7f82481474f0 msgr2=0x7f824815eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:58.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.712+0000 7f8247400640 1 --2- 172.21.15.123:0/135748506 >> v2:172.21.15.130:3300/0 conn(0x7f82481474f0 0x7f824815eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.712+0000 7f8247400640 1 -- 172.21.15.123:0/135748506 >> v1:172.21.15.130:6789/0 conn(0x7f82480b6970 legacy=0x7f82480b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:58.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.712+0000 7f8247400640 1 -- 172.21.15.123:0/135748506 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82480736e0 con 0x7f82480cd8e0 2024-04-25T13:42:58.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.712+0000 7f8246a00640 1 --2- 172.21.15.123:0/135748506 >> v2:172.21.15.130:3300/0 conn(0x7f82481474f0 0x7f824815eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:58.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.716+0000 7f8247400640 1 --2- 172.21.15.123:0/135748506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82480cd8e0 0x7f82480cdcf0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f824806fa20 tx=0x7f824001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943ab99ae5f65b65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:58.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.716+0000 7f8245600640 1 -- 172.21.15.123:0/135748506 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82400a5820 con 0x7f82480cd8e0 2024-04-25T13:42:58.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.716+0000 7f8245600640 1 -- 172.21.15.123:0/135748506 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82400a59c0 con 0x7f82480cd8e0 2024-04-25T13:42:58.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.716+0000 7f8245600640 1 -- 172.21.15.123:0/135748506 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82400a5d90 con 0x7f82480cd8e0 2024-04-25T13:42:58.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.716+0000 7f824de00640 1 -- 172.21.15.123:0/135748506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82480cd8e0 msgr2=0x7f82480cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:58.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.716+0000 7f824de00640 1 --2- 172.21.15.123:0/135748506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82480cd8e0 0x7f82480cdcf0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f824806fa20 tx=0x7f824001c960 comp rx=0 tx=0).stop 2024-04-25T13:42:58.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.716+0000 7f824de00640 1 -- 172.21.15.123:0/135748506 shutdown_connections 2024-04-25T13:42:58.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.716+0000 7f824de00640 1 --2- 172.21.15.123:0/135748506 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82480cd8e0 0x7f82480cdcf0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.716+0000 7f824de00640 1 --2- 172.21.15.123:0/135748506 >> v2:172.21.15.130:3300/0 conn(0x7f82481474f0 0x7f824815eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.716+0000 7f824de00640 1 -- 172.21.15.123:0/135748506 >> 172.21.15.123:0/135748506 conn(0x7f824806d210 msgr2=0x7f824806ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:58.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.716+0000 7f824de00640 1 -- 172.21.15.123:0/135748506 shutdown_connections 2024-04-25T13:42:58.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.716+0000 7f824de00640 1 -- 172.21.15.123:0/135748506 wait complete. 2024-04-25T13:42:58.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.716+0000 7f824de00640 1 Processor -- start 2024-04-25T13:42:58.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.716+0000 7f824de00640 1 -- start start 2024-04-25T13:42:58.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.720+0000 7f824de00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82480b6970 0x7f824814bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:58.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.720+0000 7f824de00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82480cd8e0 0x7f824815b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:58.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.720+0000 7f824de00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82481474f0 0x7f824815d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:58.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.720+0000 7f824de00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f824816a750 con 0x7f82481474f0 2024-04-25T13:42:58.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.720+0000 7f824de00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f82480744a0 con 0x7f82480b6970 2024-04-25T13:42:58.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.720+0000 7f824de00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f824816a8d0 con 0x7f82480cd8e0 2024-04-25T13:42:58.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.720+0000 7f8247400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82481474f0 0x7f824815d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:58.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.720+0000 7f8247400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82481474f0 0x7f824815d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36846/0 (socket says 172.21.15.123:36846) 2024-04-25T13:42:58.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.720+0000 7f8247400640 1 -- 172.21.15.123:0/75483817 learned_addr learned my addr 172.21.15.123:0/75483817 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:58.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.720+0000 7f8246a00640 1 --2- 172.21.15.123:0/75483817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82480b6970 0x7f824814bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:58.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.720+0000 7f8246000640 1 --2- 172.21.15.123:0/75483817 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82480cd8e0 0x7f824815b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:58.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.720+0000 7f8247400640 1 -- 172.21.15.123:0/75483817 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82480cd8e0 msgr2=0x7f824815b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:58.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.720+0000 7f8247400640 1 --2- 172.21.15.123:0/75483817 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82480cd8e0 0x7f824815b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.720+0000 7f8247400640 1 -- 172.21.15.123:0/75483817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82480b6970 msgr2=0x7f824814bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:58.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.720+0000 7f8247400640 1 --2- 172.21.15.123:0/75483817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82480b6970 0x7f824814bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.720+0000 7f8247400640 1 -- 172.21.15.123:0/75483817 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f824814c1d0 con 0x7f82481474f0 2024-04-25T13:42:58.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.720+0000 7f8246a00640 1 --2- 172.21.15.123:0/75483817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82480b6970 0x7f824814bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:42:58.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.720+0000 7f8247400640 1 --2- 172.21.15.123:0/75483817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82481474f0 0x7f824815d0c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f82400af040 tx=0x7f8240019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:58.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.720+0000 7f823f400640 1 -- 172.21.15.123:0/75483817 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82400b8670 con 0x7f82481474f0 2024-04-25T13:42:58.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.720+0000 7f823f400640 1 -- 172.21.15.123:0/75483817 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82400be070 con 0x7f82481474f0 2024-04-25T13:42:58.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.720+0000 7f823f400640 1 -- 172.21.15.123:0/75483817 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82400b8a50 con 0x7f82481474f0 2024-04-25T13:42:58.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.720+0000 7f824de00640 1 -- 172.21.15.123:0/75483817 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f824814cc10 con 0x7f82481474f0 2024-04-25T13:42:58.724 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.720+0000 7f824de00640 1 -- 172.21.15.123:0/75483817 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f824814c930 con 0x7f82481474f0 2024-04-25T13:42:58.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.720+0000 7f824de00640 1 -- 172.21.15.123:0/75483817 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f824814c3a0 con 0x7f82481474f0 2024-04-25T13:42:58.725 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.724+0000 7f823f400640 1 -- 172.21.15.123:0/75483817 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f82400b8bf0 con 0x7f82481474f0 2024-04-25T13:42:58.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.724+0000 7f823f400640 1 --2- 172.21.15.123:0/75483817 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f822806f430 0x7f8228071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:58.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.724+0000 7f823f400640 1 -- 172.21.15.123:0/75483817 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f8240129de0 con 0x7f82481474f0 2024-04-25T13:42:58.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.724+0000 7f8246a00640 1 --2- 172.21.15.123:0/75483817 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f822806f430 0x7f8228071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:58.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.724+0000 7f8246a00640 1 --2- 172.21.15.123:0/75483817 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f822806f430 0x7f8228071940 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f82380079d0 tx=0x7f8238008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:58.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.728+0000 7f823f400640 1 -- 172.21.15.123:0/75483817 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f82400165e0 con 0x7f82481474f0 2024-04-25T13:42:58.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.884+0000 7f824de00640 1 -- 172.21.15.123:0/75483817 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f824813e7b0 con 0x7f82481474f0 2024-04-25T13:42:58.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.884+0000 7f823f400640 1 -- 172.21.15.123:0/75483817 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) ==== 84+0+65 (secure 0 0 0) 0x7f82400f6f90 con 0x7f82481474f0 2024-04-25T13:42:58.888 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:42:58.888 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-04-25T13:42:58.888 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:42:58.888 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2024-04-25T13:42:58.888 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2024-04-25T13:42:58.888 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:42:58.888 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-04-25T13:42:58.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.888+0000 7f824de00640 1 -- 172.21.15.123:0/75483817 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f822806f430 msgr2=0x7f8228071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:58.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.888+0000 7f824de00640 1 --2- 172.21.15.123:0/75483817 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f822806f430 0x7f8228071940 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f82380079d0 tx=0x7f8238008040 comp rx=0 tx=0).stop 2024-04-25T13:42:58.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.888+0000 7f824de00640 1 -- 172.21.15.123:0/75483817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82481474f0 msgr2=0x7f824815d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:58.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.888+0000 7f824de00640 1 --2- 172.21.15.123:0/75483817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82481474f0 0x7f824815d0c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f82400af040 tx=0x7f8240019760 comp rx=0 tx=0).stop 2024-04-25T13:42:58.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.888+0000 7f824de00640 1 -- 172.21.15.123:0/75483817 shutdown_connections 2024-04-25T13:42:58.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.888+0000 7f824de00640 1 --2- 172.21.15.123:0/75483817 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f822806f430 0x7f8228071940 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.888+0000 7f824de00640 1 --2- 172.21.15.123:0/75483817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f82481474f0 0x7f824815d0c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.888+0000 7f824de00640 1 --2- 172.21.15.123:0/75483817 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82480cd8e0 0x7f824815b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.888+0000 7f824de00640 1 --2- 172.21.15.123:0/75483817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82480b6970 0x7f824814bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:58.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.888+0000 7f824de00640 1 -- 172.21.15.123:0/75483817 >> 172.21.15.123:0/75483817 conn(0x7f824806d210 msgr2=0x7f82480b06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:58.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.888+0000 7f824de00640 1 -- 172.21.15.123:0/75483817 shutdown_connections 2024-04-25T13:42:58.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:58.888+0000 7f824de00640 1 -- 172.21.15.123:0/75483817 wait complete. 2024-04-25T13:42:58.909 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T13:42:58.909 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T13:42:59.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.060+0000 7f05e8c00640 1 Processor -- start 2024-04-25T13:42:59.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.060+0000 7f05e8c00640 1 -- start start 2024-04-25T13:42:59.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.060+0000 7f05e8c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f05e40d1430 0x7f05e40d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.060+0000 7f05e8c00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f05e4162580 0x7f05e40ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.060+0000 7f05e8c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05e40d0ef0 con 0x7f05e40d1840 2024-04-25T13:42:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.060+0000 7f05e8c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f05e40d11d0 con 0x7f05e40d1430 2024-04-25T13:42:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.060+0000 7f05e8c00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f05e40b8d50 con 0x7f05e4162580 2024-04-25T13:42:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.060+0000 7f05e1e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f05e40d1430 0x7f05e40d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.060+0000 7f05d9400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f05e40d1840 0x7f05e4161e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:56376/0 (socket says 172.21.15.123:56376) 2024-04-25T13:42:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.060+0000 7f05e1e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f05e40d1430 0x7f05e40d1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36848/0 (socket says 172.21.15.123:36848) 2024-04-25T13:42:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.060+0000 7f05d9400640 1 -- 172.21.15.123:0/3158018695 learned_addr learned my addr 172.21.15.123:0/3158018695 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:42:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.060+0000 7f05e2800640 1 --2- 172.21.15.123:0/3158018695 >> v2:172.21.15.130:3300/0 conn(0x7f05e4162580 0x7f05e40ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.064+0000 7f05e1e00640 1 -- 172.21.15.123:0/3158018695 >> v2:172.21.15.130:3300/0 conn(0x7f05e4162580 msgr2=0x7f05e40ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:42:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.064+0000 7f05e1e00640 1 --2- 172.21.15.123:0/3158018695 >> v2:172.21.15.130:3300/0 conn(0x7f05e4162580 0x7f05e40ce3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.064+0000 7f05e1e00640 1 -- 172.21.15.123:0/3158018695 >> v1:172.21.15.123:6789/0 conn(0x7f05e40d1840 legacy=0x7f05e4161e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:59.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.064+0000 7f05e1e00640 1 -- 172.21.15.123:0/3158018695 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e40b9030 con 0x7f05e40d1430 2024-04-25T13:42:59.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.064+0000 7f05e1400640 1 -- 172.21.15.123:0/3158018695 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1703546270 0 0) 0x7f05e40d0ef0 con 0x7f05e40d1840 2024-04-25T13:42:59.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.064+0000 7f05e1e00640 1 --2- 172.21.15.123:0/3158018695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05e40d1430 0x7f05e40d1f40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f05e40b94c0 tx=0x7f05d401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea5921d75a4b97c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:59.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.064+0000 7f05e1400640 1 -- 172.21.15.123:0/3158018695 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d40b0070 con 0x7f05e40d1430 2024-04-25T13:42:59.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.064+0000 7f05e1400640 1 -- 172.21.15.123:0/3158018695 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d40ab600 con 0x7f05e40d1430 2024-04-25T13:42:59.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.064+0000 7f05e1400640 1 -- 172.21.15.123:0/3158018695 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d40ab9d0 con 0x7f05e40d1430 2024-04-25T13:42:59.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.064+0000 7f05e8c00640 1 -- 172.21.15.123:0/3158018695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05e40d1430 msgr2=0x7f05e40d1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:59.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.064+0000 7f05e8c00640 1 --2- 172.21.15.123:0/3158018695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05e40d1430 0x7f05e40d1f40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f05e40b94c0 tx=0x7f05d401c3f0 comp rx=0 tx=0).stop 2024-04-25T13:42:59.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.064+0000 7f05e8c00640 1 -- 172.21.15.123:0/3158018695 shutdown_connections 2024-04-25T13:42:59.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.064+0000 7f05e8c00640 1 --2- 172.21.15.123:0/3158018695 >> v2:172.21.15.130:3300/0 conn(0x7f05e4162580 0x7f05e40ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:59.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.064+0000 7f05e8c00640 1 --2- 172.21.15.123:0/3158018695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05e40d1430 0x7f05e40d1f40 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:59.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.064+0000 7f05e8c00640 1 -- 172.21.15.123:0/3158018695 >> 172.21.15.123:0/3158018695 conn(0x7f05e40d0250 msgr2=0x7f05e40d0660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:42:59.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.068+0000 7f05e8c00640 1 -- 172.21.15.123:0/3158018695 shutdown_connections 2024-04-25T13:42:59.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.068+0000 7f05e8c00640 1 -- 172.21.15.123:0/3158018695 wait complete. 2024-04-25T13:42:59.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.068+0000 7f05e8c00640 1 Processor -- start 2024-04-25T13:42:59.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.068+0000 7f05e8c00640 1 -- start start 2024-04-25T13:42:59.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.068+0000 7f05e8c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05e40d1430 0x7f05e4156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:59.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.068+0000 7f05e8c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05e40d1840 0x7f05e4159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:59.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.068+0000 7f05e8c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05e4162580 0x7f05e415a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:59.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.068+0000 7f05e8c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f05e416b350 con 0x7f05e40d1840 2024-04-25T13:42:59.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.068+0000 7f05e8c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f05e409cec0 con 0x7f05e4162580 2024-04-25T13:42:59.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.068+0000 7f05e8c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f05e416b4d0 con 0x7f05e40d1430 2024-04-25T13:42:59.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.068+0000 7f05d9400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05e40d1840 0x7f05e4159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:59.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.072+0000 7f05d9400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05e40d1840 0x7f05e4159be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36854/0 (socket says 172.21.15.123:36854) 2024-04-25T13:42:59.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.072+0000 7f05d9400640 1 -- 172.21.15.123:0/4294497932 learned_addr learned my addr 172.21.15.123:0/4294497932 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:42:59.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.072+0000 7f05e2800640 1 --2- 172.21.15.123:0/4294497932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05e4162580 0x7f05e415a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:59.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.072+0000 7f05e1e00640 1 --2- 172.21.15.123:0/4294497932 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05e40d1430 0x7f05e4156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:59.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.072+0000 7f05d9400640 1 -- 172.21.15.123:0/4294497932 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05e40d1430 msgr2=0x7f05e4156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:59.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.072+0000 7f05d9400640 1 --2- 172.21.15.123:0/4294497932 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05e40d1430 0x7f05e4156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:59.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.072+0000 7f05d9400640 1 -- 172.21.15.123:0/4294497932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05e4162580 msgr2=0x7f05e415a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:42:59.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.072+0000 7f05d9400640 1 --2- 172.21.15.123:0/4294497932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05e4162580 0x7f05e415a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:42:59.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.072+0000 7f05d9400640 1 -- 172.21.15.123:0/4294497932 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e4160ce0 con 0x7f05e40d1840 2024-04-25T13:42:59.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.072+0000 7f05d9400640 1 --2- 172.21.15.123:0/4294497932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05e40d1840 0x7f05e4159be0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f05cc00c480 tx=0x7f05cc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:59.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.072+0000 7f05daa00640 1 -- 172.21.15.123:0/4294497932 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05cc018070 con 0x7f05e40d1840 2024-04-25T13:42:59.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.072+0000 7f05daa00640 1 -- 172.21.15.123:0/4294497932 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05cc0074e0 con 0x7f05e40d1840 2024-04-25T13:42:59.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.072+0000 7f05daa00640 1 -- 172.21.15.123:0/4294497932 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05cc0049f0 con 0x7f05e40d1840 2024-04-25T13:42:59.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.072+0000 7f05e8c00640 1 -- 172.21.15.123:0/4294497932 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e4160fc0 con 0x7f05e40d1840 2024-04-25T13:42:59.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.072+0000 7f05e8c00640 1 -- 172.21.15.123:0/4294497932 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e4161580 con 0x7f05e40d1840 2024-04-25T13:42:59.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.072+0000 7f05e8c00640 1 -- 172.21.15.123:0/4294497932 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05e406a210 con 0x7f05e40d1840 2024-04-25T13:42:59.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.072+0000 7f05daa00640 1 -- 172.21.15.123:0/4294497932 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f05cc01b070 con 0x7f05e40d1840 2024-04-25T13:42:59.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.076+0000 7f05daa00640 1 --2- 172.21.15.123:0/4294497932 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f05c006f430 0x7f05c0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:42:59.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.076+0000 7f05daa00640 1 -- 172.21.15.123:0/4294497932 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f05cc08e360 con 0x7f05e40d1840 2024-04-25T13:42:59.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.076+0000 7f05e1e00640 1 --2- 172.21.15.123:0/4294497932 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f05c006f430 0x7f05c0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:42:59.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.076+0000 7f05e1e00640 1 --2- 172.21.15.123:0/4294497932 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f05c006f430 0x7f05c0071940 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f05d40ad000 tx=0x7f05d40a4f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:42:59.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.080+0000 7f05daa00640 1 -- 172.21.15.123:0/4294497932 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f05cc05b590 con 0x7f05e40d1840 2024-04-25T13:42:59.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:42:59.236+0000 7f05e8c00640 1 -- 172.21.15.123:0/4294497932 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f05e40d0790 con 0x7f05e40d1840 2024-04-25T13:43:00.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.016+0000 7f05daa00640 1 -- 172.21.15.123:0/4294497932 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) ==== 138+0+0 (secure 0 0 0) 0x7f05cc05ae90 con 0x7f05e40d1840 2024-04-25T13:43:00.020 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2024-04-25T13:43:00.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.020+0000 7f05e8c00640 1 -- 172.21.15.123:0/4294497932 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f05c006f430 msgr2=0x7f05c0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:00.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.020+0000 7f05e8c00640 1 --2- 172.21.15.123:0/4294497932 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f05c006f430 0x7f05c0071940 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f05d40ad000 tx=0x7f05d40a4f90 comp rx=0 tx=0).stop 2024-04-25T13:43:00.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.020+0000 7f05e8c00640 1 -- 172.21.15.123:0/4294497932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05e40d1840 msgr2=0x7f05e4159be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:00.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.020+0000 7f05e8c00640 1 --2- 172.21.15.123:0/4294497932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05e40d1840 0x7f05e4159be0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f05cc00c480 tx=0x7f05cc00c940 comp rx=0 tx=0).stop 2024-04-25T13:43:00.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.020+0000 7f05e8c00640 1 -- 172.21.15.123:0/4294497932 shutdown_connections 2024-04-25T13:43:00.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.020+0000 7f05e8c00640 1 --2- 172.21.15.123:0/4294497932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05e4162580 0x7f05e415a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:00.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.020+0000 7f05e8c00640 1 --2- 172.21.15.123:0/4294497932 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f05c006f430 0x7f05c0071940 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:00.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.020+0000 7f05e8c00640 1 --2- 172.21.15.123:0/4294497932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f05e40d1840 0x7f05e4159be0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:00.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.020+0000 7f05e8c00640 1 --2- 172.21.15.123:0/4294497932 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05e40d1430 0x7f05e4156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:00.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.020+0000 7f05e8c00640 1 -- 172.21.15.123:0/4294497932 >> 172.21.15.123:0/4294497932 conn(0x7f05e40d0250 msgr2=0x7f05e41575c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:00.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.020+0000 7f05e8c00640 1 -- 172.21.15.123:0/4294497932 shutdown_connections 2024-04-25T13:43:00.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.020+0000 7f05e8c00640 1 -- 172.21.15.123:0/4294497932 wait complete. 2024-04-25T13:43:00.051 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T13:43:00.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.204+0000 7fec57400640 1 Processor -- start 2024-04-25T13:43:00.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.204+0000 7fec57400640 1 -- start start 2024-04-25T13:43:00.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.204+0000 7fec57400640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fec500d1cb0 0x7fec500d20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:00.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.204+0000 7fec57400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec500b8bd0 con 0x7fec500b6f00 2024-04-25T13:43:00.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.204+0000 7fec57400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec500b7a20 con 0x7fec500ce4e0 2024-04-25T13:43:00.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.204+0000 7fec57400640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fec500d27b0 con 0x7fec500d1cb0 2024-04-25T13:43:00.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.204+0000 7fec4fe00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fec500b6f00 0x7fec500b7310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36518/0 (socket says 172.21.15.123:36518) 2024-04-25T13:43:00.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.204+0000 7fec4fe00640 1 -- 172.21.15.123:0/3137600190 learned_addr learned my addr 172.21.15.123:0/3137600190 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:00.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.204+0000 7fec54a00640 1 --2- 172.21.15.123:0/3137600190 >> v2:172.21.15.130:3300/0 conn(0x7fec500d1cb0 0x7fec500d20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:00.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.208+0000 7fec4f400640 1 -- 172.21.15.123:0/3137600190 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2113459419 0 0) 0x7fec500b8bd0 con 0x7fec500b6f00 2024-04-25T13:43:00.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.208+0000 7fec4f400640 1 -- 172.21.15.123:0/3137600190 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec38003530 con 0x7fec500b6f00 2024-04-25T13:43:00.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.208+0000 7fec4f400640 1 -- 172.21.15.123:0/3137600190 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1385876050 0 0) 0x7fec500b7a20 con 0x7fec500ce4e0 2024-04-25T13:43:00.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.208+0000 7fec4f400640 1 -- 172.21.15.123:0/3137600190 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec500b8bd0 con 0x7fec500ce4e0 2024-04-25T13:43:00.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.208+0000 7fec4f400640 1 -- 172.21.15.123:0/3137600190 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3765853350 0 0) 0x7fec38003530 con 0x7fec500b6f00 2024-04-25T13:43:00.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.208+0000 7fec4f400640 1 -- 172.21.15.123:0/3137600190 >> v2:172.21.15.130:3300/0 conn(0x7fec500d1cb0 msgr2=0x7fec500d20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:00.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.208+0000 7fec4f400640 1 --2- 172.21.15.123:0/3137600190 >> v2:172.21.15.130:3300/0 conn(0x7fec500d1cb0 0x7fec500d20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:00.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.208+0000 7fec4f400640 1 -- 172.21.15.123:0/3137600190 >> v1:172.21.15.130:6789/0 conn(0x7fec500ce4e0 legacy=0x7fec500ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:00.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.208+0000 7fec4f400640 1 -- 172.21.15.123:0/3137600190 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5009cab0 con 0x7fec500b6f00 2024-04-25T13:43:00.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.208+0000 7fec4f400640 1 -- 172.21.15.123:0/3137600190 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7fec3c001680 con 0x7fec500b6f00 2024-04-25T13:43:00.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.208+0000 7fec54a00640 1 --2- 172.21.15.123:0/3137600190 >> v2:172.21.15.130:3300/0 conn(0x7fec500d1cb0 0x7fec500d20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:43:00.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.208+0000 7fec4f400640 1 -- 172.21.15.123:0/3137600190 >> v1:172.21.15.123:6789/0 conn(0x7fec500b6f00 legacy=0x7fec500b7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:00.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.208+0000 7fec4f400640 1 --2- 172.21.15.123:0/3137600190 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec38003bc0 0x7fec38004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:00.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.208+0000 7fec4f400640 1 --2- 172.21.15.123:0/3137600190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec38004810 0x7fec38004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:00.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.208+0000 7fec4f400640 1 --2- 172.21.15.123:0/3137600190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec38005350 0x7fec3800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:00.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.208+0000 7fec4f400640 1 -- 172.21.15.123:0/3137600190 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fec500d27b0 con 0x7fec38005350 2024-04-25T13:43:00.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.208+0000 7fec4f400640 1 -- 172.21.15.123:0/3137600190 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fec3800c2f0 con 0x7fec38004810 2024-04-25T13:43:00.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.208+0000 7fec4f400640 1 -- 172.21.15.123:0/3137600190 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fec3800c4f0 con 0x7fec38003bc0 2024-04-25T13:43:00.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.208+0000 7fec55400640 1 --2- 172.21.15.123:0/3137600190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec38005350 0x7fec3800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:00.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.208+0000 7fec4fe00640 1 --2- 172.21.15.123:0/3137600190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec38004810 0x7fec38004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:00.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.208+0000 7fec54a00640 1 --2- 172.21.15.123:0/3137600190 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec38003bc0 0x7fec38004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:00.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.208+0000 7fec55400640 1 -- 172.21.15.123:0/3137600190 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec38003bc0 msgr2=0x7fec38004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:00.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.208+0000 7fec55400640 1 --2- 172.21.15.123:0/3137600190 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec38003bc0 0x7fec38004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:00.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.208+0000 7fec55400640 1 -- 172.21.15.123:0/3137600190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec38004810 msgr2=0x7fec38004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:00.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.208+0000 7fec55400640 1 --2- 172.21.15.123:0/3137600190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec38004810 0x7fec38004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:00.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.208+0000 7fec55400640 1 -- 172.21.15.123:0/3137600190 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec38003530 con 0x7fec38005350 2024-04-25T13:43:00.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.208+0000 7fec54a00640 1 --2- 172.21.15.123:0/3137600190 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec38003bc0 0x7fec38004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:00.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.212+0000 7fec55400640 1 -- 172.21.15.123:0/3137600190 reap_dead start 2024-04-25T13:43:00.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.212+0000 7fec55400640 1 --2- 172.21.15.123:0/3137600190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec38005350 0x7fec3800ba10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fec48001fd0 tx=0x7fec4801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbabc103e36e48f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:00.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.212+0000 7fec4f400640 1 -- 172.21.15.123:0/3137600190 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec48001c20 con 0x7fec38005350 2024-04-25T13:43:00.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.212+0000 7fec4f400640 1 -- 172.21.15.123:0/3137600190 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec48003b80 con 0x7fec38005350 2024-04-25T13:43:00.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.212+0000 7fec4f400640 1 -- 172.21.15.123:0/3137600190 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec480050d0 con 0x7fec38005350 2024-04-25T13:43:00.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.212+0000 7fec57400640 1 -- 172.21.15.123:0/3137600190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec38005350 msgr2=0x7fec3800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:00.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.212+0000 7fec57400640 1 --2- 172.21.15.123:0/3137600190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec38005350 0x7fec3800ba10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fec48001fd0 tx=0x7fec4801c900 comp rx=0 tx=0).stop 2024-04-25T13:43:00.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.212+0000 7fec57400640 1 -- 172.21.15.123:0/3137600190 shutdown_connections 2024-04-25T13:43:00.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.212+0000 7fec57400640 1 --2- 172.21.15.123:0/3137600190 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec38005350 0x7fec3800ba10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:00.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.212+0000 7fec57400640 1 -- 172.21.15.123:0/3137600190 >> 172.21.15.123:0/3137600190 conn(0x7fec500d0120 msgr2=0x7fec500d0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:00.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.212+0000 7fec57400640 1 -- 172.21.15.123:0/3137600190 shutdown_connections 2024-04-25T13:43:00.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.212+0000 7fec57400640 1 -- 172.21.15.123:0/3137600190 wait complete. 2024-04-25T13:43:00.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.212+0000 7fec57400640 1 Processor -- start 2024-04-25T13:43:00.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.212+0000 7fec57400640 1 -- start start 2024-04-25T13:43:00.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.216+0000 7fec57400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec38005350 0x7fec5006f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:00.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.216+0000 7fec57400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec50157a90 0x7fec501489d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:00.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.216+0000 7fec57400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec501636d0 0x7fec50163ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:00.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.216+0000 7fec57400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fec500d3360 con 0x7fec38005350 2024-04-25T13:43:00.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.216+0000 7fec57400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fec500cf410 con 0x7fec501636d0 2024-04-25T13:43:00.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.216+0000 7fec57400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fec5009f560 con 0x7fec50157a90 2024-04-25T13:43:00.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.216+0000 7fec54a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec38005350 0x7fec5006f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:00.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.216+0000 7fec54a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec38005350 0x7fec5006f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47376/0 (socket says 172.21.15.123:47376) 2024-04-25T13:43:00.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.216+0000 7fec54a00640 1 -- 172.21.15.123:0/2566050154 learned_addr learned my addr 172.21.15.123:0/2566050154 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:00.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.216+0000 7fec55400640 1 --2- 172.21.15.123:0/2566050154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec501636d0 0x7fec50163ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:00.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.216+0000 7fec4fe00640 1 --2- 172.21.15.123:0/2566050154 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec50157a90 0x7fec501489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:00.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.216+0000 7fec54a00640 1 -- 172.21.15.123:0/2566050154 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec50157a90 msgr2=0x7fec501489d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:00.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.216+0000 7fec54a00640 1 --2- 172.21.15.123:0/2566050154 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec50157a90 0x7fec501489d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:00.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.216+0000 7fec54a00640 1 -- 172.21.15.123:0/2566050154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec501636d0 msgr2=0x7fec50163ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:00.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.216+0000 7fec54a00640 1 --2- 172.21.15.123:0/2566050154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec501636d0 0x7fec50163ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:00.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.216+0000 7fec54a00640 1 -- 172.21.15.123:0/2566050154 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec50148f10 con 0x7fec38005350 2024-04-25T13:43:00.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.216+0000 7fec54a00640 1 --2- 172.21.15.123:0/2566050154 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec38005350 0x7fec5006f000 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fec440116a0 tx=0x7fec44011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:00.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.216+0000 7fec4cc00640 1 -- 172.21.15.123:0/2566050154 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec44004220 con 0x7fec38005350 2024-04-25T13:43:00.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.216+0000 7fec4cc00640 1 -- 172.21.15.123:0/2566050154 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec440043c0 con 0x7fec38005350 2024-04-25T13:43:00.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.216+0000 7fec57400640 1 -- 172.21.15.123:0/2566050154 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec50164020 con 0x7fec38005350 2024-04-25T13:43:00.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.216+0000 7fec4cc00640 1 -- 172.21.15.123:0/2566050154 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec44005be0 con 0x7fec38005350 2024-04-25T13:43:00.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.216+0000 7fec57400640 1 -- 172.21.15.123:0/2566050154 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec50156e50 con 0x7fec38005350 2024-04-25T13:43:00.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.220+0000 7fec57400640 1 -- 172.21.15.123:0/2566050154 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec500507c0 con 0x7fec38005350 2024-04-25T13:43:00.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.220+0000 7fec4cc00640 1 -- 172.21.15.123:0/2566050154 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fec4400f6f0 con 0x7fec38005350 2024-04-25T13:43:00.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.220+0000 7fec4cc00640 1 --2- 172.21.15.123:0/2566050154 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fec3006f400 0x7fec30071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:00.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.220+0000 7fec4cc00640 1 -- 172.21.15.123:0/2566050154 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5227+0+0 (secure 0 0 0) 0x7fec4408fc70 con 0x7fec38005350 2024-04-25T13:43:00.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.220+0000 7fec4fe00640 1 --2- 172.21.15.123:0/2566050154 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fec3006f400 0x7fec30071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:00.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.224+0000 7fec4fe00640 1 --2- 172.21.15.123:0/2566050154 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fec3006f400 0x7fec30071910 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fec50149180 tx=0x7fec3c001e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:00.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.224+0000 7fec4cc00640 1 -- 172.21.15.123:0/2566050154 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fec50164020 con 0x7fec38005350 2024-04-25T13:43:00.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:00.384+0000 7fec57400640 1 -- 172.21.15.123:0/2566050154 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fec5006df60 con 0x7fec38005350 2024-04-25T13:43:01.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.024+0000 7fec4cc00640 1 -- 172.21.15.123:0/2566050154 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) ==== 170+0+0 (secure 0 0 0) 0x7fec50148f10 con 0x7fec38005350 2024-04-25T13:43:01.027 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2024-04-25T13:43:01.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.028+0000 7fec57400640 1 -- 172.21.15.123:0/2566050154 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fec3006f400 msgr2=0x7fec30071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:01.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.028+0000 7fec57400640 1 --2- 172.21.15.123:0/2566050154 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fec3006f400 0x7fec30071910 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fec50149180 tx=0x7fec3c001e40 comp rx=0 tx=0).stop 2024-04-25T13:43:01.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.028+0000 7fec57400640 1 -- 172.21.15.123:0/2566050154 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec38005350 msgr2=0x7fec5006f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:01.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.028+0000 7fec57400640 1 --2- 172.21.15.123:0/2566050154 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec38005350 0x7fec5006f000 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fec440116a0 tx=0x7fec44011aa0 comp rx=0 tx=0).stop 2024-04-25T13:43:01.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.028+0000 7fec57400640 1 -- 172.21.15.123:0/2566050154 shutdown_connections 2024-04-25T13:43:01.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.028+0000 7fec57400640 1 --2- 172.21.15.123:0/2566050154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec501636d0 0x7fec50163ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:01.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.028+0000 7fec57400640 1 --2- 172.21.15.123:0/2566050154 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fec3006f400 0x7fec30071910 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:01.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.028+0000 7fec57400640 1 --2- 172.21.15.123:0/2566050154 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec50157a90 0x7fec501489d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:01.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.028+0000 7fec57400640 1 --2- 172.21.15.123:0/2566050154 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fec38005350 0x7fec5006f000 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:01.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.028+0000 7fec57400640 1 -- 172.21.15.123:0/2566050154 >> 172.21.15.123:0/2566050154 conn(0x7fec500d0120 msgr2=0x7fec5009d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:01.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.028+0000 7fec57400640 1 -- 172.21.15.123:0/2566050154 shutdown_connections 2024-04-25T13:43:01.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.028+0000 7fec57400640 1 -- 172.21.15.123:0/2566050154 wait complete. 2024-04-25T13:43:01.069 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T13:43:01.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.216+0000 7fed3d000640 1 Processor -- start 2024-04-25T13:43:01.219 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.216+0000 7fed3d000640 1 -- start start 2024-04-25T13:43:01.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.220+0000 7fed3d000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fed380b3870 0x7fed380b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:01.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.220+0000 7fed3d000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed380b41c0 con 0x7fed3815de80 2024-04-25T13:43:01.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.220+0000 7fed3d000640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed380c6810 con 0x7fed380ceac0 2024-04-25T13:43:01.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.220+0000 7fed3d000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fed380c7140 con 0x7fed380b3870 2024-04-25T13:43:01.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.220+0000 7fed35400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fed380b3870 0x7fed380b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:01.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.220+0000 7fed35400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fed380b3870 0x7fed380b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47382/0 (socket says 172.21.15.123:47382) 2024-04-25T13:43:01.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.220+0000 7fed35400640 1 -- 172.21.15.123:0/394085465 learned_addr learned my addr 172.21.15.123:0/394085465 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:01.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.220+0000 7fed35400640 1 -- 172.21.15.123:0/394085465 >> v1:172.21.15.130:6789/0 conn(0x7fed380ceac0 legacy=0x7fed380c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:01.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.220+0000 7fed35400640 1 -- 172.21.15.123:0/394085465 >> v1:172.21.15.123:6789/0 conn(0x7fed3815de80 legacy=0x7fed3815e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:01.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.220+0000 7fed35400640 1 -- 172.21.15.123:0/394085465 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed380c6af0 con 0x7fed380b3870 2024-04-25T13:43:01.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.220+0000 7fed35400640 1 --2- 172.21.15.123:0/394085465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed380b3870 0x7fed380b3c80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fed380c72c0 tx=0x7fed2801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1c763266b86cbf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:01.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.220+0000 7fed34a00640 1 -- 172.21.15.123:0/394085465 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed280b2070 con 0x7fed380b3870 2024-04-25T13:43:01.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.220+0000 7fed34a00640 1 -- 172.21.15.123:0/394085465 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed280ad680 con 0x7fed380b3870 2024-04-25T13:43:01.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.220+0000 7fed34a00640 1 -- 172.21.15.123:0/394085465 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed280ada50 con 0x7fed380b3870 2024-04-25T13:43:01.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.224+0000 7fed3d000640 1 -- 172.21.15.123:0/394085465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed380b3870 msgr2=0x7fed380b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:01.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.224+0000 7fed3d000640 1 --2- 172.21.15.123:0/394085465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed380b3870 0x7fed380b3c80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fed380c72c0 tx=0x7fed2801c470 comp rx=0 tx=0).stop 2024-04-25T13:43:01.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.224+0000 7fed3d000640 1 -- 172.21.15.123:0/394085465 shutdown_connections 2024-04-25T13:43:01.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.224+0000 7fed3d000640 1 --2- 172.21.15.123:0/394085465 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed380b3870 0x7fed380b3c80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:01.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.224+0000 7fed3d000640 1 -- 172.21.15.123:0/394085465 >> 172.21.15.123:0/394085465 conn(0x7fed3806ca70 msgr2=0x7fed3806ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:01.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.224+0000 7fed3d000640 1 -- 172.21.15.123:0/394085465 shutdown_connections 2024-04-25T13:43:01.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.224+0000 7fed3d000640 1 -- 172.21.15.123:0/394085465 wait complete. 2024-04-25T13:43:01.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.224+0000 7fed3d000640 1 Processor -- start 2024-04-25T13:43:01.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.224+0000 7fed3d000640 1 -- start start 2024-04-25T13:43:01.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.228+0000 7fed3d000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed380b3870 0x7fed380734d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:01.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.228+0000 7fed3d000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed380ceac0 0x7fed380cd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:01.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.228+0000 7fed3d000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed3815de80 0x7fed38142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:01.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.228+0000 7fed3d000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fed3816c710 con 0x7fed380b3870 2024-04-25T13:43:01.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.228+0000 7fed3d000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fed3816c590 con 0x7fed380ceac0 2024-04-25T13:43:01.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.228+0000 7fed3d000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fed3816c890 con 0x7fed3815de80 2024-04-25T13:43:01.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.228+0000 7fed35e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed380b3870 0x7fed380734d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:01.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.228+0000 7fed35e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed380b3870 0x7fed380734d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47392/0 (socket says 172.21.15.123:47392) 2024-04-25T13:43:01.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.228+0000 7fed35e00640 1 -- 172.21.15.123:0/1998953602 learned_addr learned my addr 172.21.15.123:0/1998953602 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:01.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.228+0000 7fed35400640 1 --2- 172.21.15.123:0/1998953602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed380ceac0 0x7fed380cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:01.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.228+0000 7fed36800640 1 --2- 172.21.15.123:0/1998953602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed3815de80 0x7fed38142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:01.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.228+0000 7fed35e00640 1 -- 172.21.15.123:0/1998953602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed3815de80 msgr2=0x7fed38142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:01.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.228+0000 7fed35e00640 1 --2- 172.21.15.123:0/1998953602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed3815de80 0x7fed38142ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:01.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.228+0000 7fed35e00640 1 -- 172.21.15.123:0/1998953602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed380ceac0 msgr2=0x7fed380cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:01.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.228+0000 7fed35e00640 1 --2- 172.21.15.123:0/1998953602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed380ceac0 0x7fed380cd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:01.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.228+0000 7fed35e00640 1 -- 172.21.15.123:0/1998953602 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed381555b0 con 0x7fed380b3870 2024-04-25T13:43:01.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.228+0000 7fed35400640 1 --2- 172.21.15.123:0/1998953602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed380ceac0 0x7fed380cd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:01.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.228+0000 7fed35e00640 1 --2- 172.21.15.123:0/1998953602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed380b3870 0x7fed380734d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fed2000b440 tx=0x7fed2000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:01.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.228+0000 7fed2e000640 1 -- 172.21.15.123:0/1998953602 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed20015020 con 0x7fed380b3870 2024-04-25T13:43:01.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.228+0000 7fed2e000640 1 -- 172.21.15.123:0/1998953602 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed20011890 con 0x7fed380b3870 2024-04-25T13:43:01.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.228+0000 7fed3d000640 1 -- 172.21.15.123:0/1998953602 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed38155890 con 0x7fed380b3870 2024-04-25T13:43:01.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.228+0000 7fed2e000640 1 -- 172.21.15.123:0/1998953602 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed20011c80 con 0x7fed380b3870 2024-04-25T13:43:01.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.228+0000 7fed3d000640 1 -- 172.21.15.123:0/1998953602 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed38155e50 con 0x7fed380b3870 2024-04-25T13:43:01.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.228+0000 7fed3d000640 1 -- 172.21.15.123:0/1998953602 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed3806d600 con 0x7fed380b3870 2024-04-25T13:43:01.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.232+0000 7fed2e000640 1 -- 172.21.15.123:0/1998953602 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fed20018020 con 0x7fed380b3870 2024-04-25T13:43:01.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.232+0000 7fed2e000640 1 --2- 172.21.15.123:0/1998953602 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fed1406f430 0x7fed14071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:01.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.232+0000 7fed2e000640 1 -- 172.21.15.123:0/1998953602 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5609+0+0 (secure 0 0 0) 0x7fed2008f520 con 0x7fed380b3870 2024-04-25T13:43:01.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.232+0000 7fed35400640 1 --2- 172.21.15.123:0/1998953602 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fed1406f430 0x7fed14071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:01.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.232+0000 7fed35400640 1 --2- 172.21.15.123:0/1998953602 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fed1406f430 0x7fed14071940 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fed280af000 tx=0x7fed280a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:01.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.236+0000 7fed2e000640 1 -- 172.21.15.123:0/1998953602 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fed2001f030 con 0x7fed380b3870 2024-04-25T13:43:01.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:01.428+0000 7fed3d000640 1 -- 172.21.15.123:0/1998953602 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fed38050750 con 0x7fed380b3870 2024-04-25T13:43:02.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.040+0000 7fed2e000640 1 -- 172.21.15.123:0/1998953602 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7fed2000d040 con 0x7fed380b3870 2024-04-25T13:43:02.052 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 4 and data pool 5 2024-04-25T13:43:02.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.056+0000 7fed3d000640 1 -- 172.21.15.123:0/1998953602 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fed1406f430 msgr2=0x7fed14071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:02.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.056+0000 7fed3d000640 1 --2- 172.21.15.123:0/1998953602 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fed1406f430 0x7fed14071940 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fed280af000 tx=0x7fed280a7000 comp rx=0 tx=0).stop 2024-04-25T13:43:02.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.056+0000 7fed3d000640 1 -- 172.21.15.123:0/1998953602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed380b3870 msgr2=0x7fed380734d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:02.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.056+0000 7fed3d000640 1 --2- 172.21.15.123:0/1998953602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed380b3870 0x7fed380734d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fed2000b440 tx=0x7fed2000b900 comp rx=0 tx=0).stop 2024-04-25T13:43:02.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.060+0000 7fed3d000640 1 -- 172.21.15.123:0/1998953602 shutdown_connections 2024-04-25T13:43:02.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.060+0000 7fed3d000640 1 --2- 172.21.15.123:0/1998953602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed380ceac0 0x7fed380cd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.060+0000 7fed3d000640 1 --2- 172.21.15.123:0/1998953602 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fed1406f430 0x7fed14071940 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.060+0000 7fed3d000640 1 --2- 172.21.15.123:0/1998953602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed3815de80 0x7fed38142ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.060+0000 7fed3d000640 1 --2- 172.21.15.123:0/1998953602 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fed380b3870 0x7fed380734d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.060+0000 7fed3d000640 1 -- 172.21.15.123:0/1998953602 >> 172.21.15.123:0/1998953602 conn(0x7fed3806ca70 msgr2=0x7fed3815f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:02.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.064+0000 7fed3d000640 1 -- 172.21.15.123:0/1998953602 shutdown_connections 2024-04-25T13:43:02.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.064+0000 7fed3d000640 1 -- 172.21.15.123:0/1998953602 wait complete. 2024-04-25T13:43:02.096 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:43:02.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.240+0000 7fc008800640 1 Processor -- start 2024-04-25T13:43:02.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.240+0000 7fc008800640 1 -- start start 2024-04-25T13:43:02.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.244+0000 7fc008800640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc0000747a0 0x7fc00015fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:02.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.244+0000 7fc008800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc0000b5670 0x7fc0000731e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:02.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.244+0000 7fc008800640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc000145d70 con 0x7fc0001602e0 2024-04-25T13:43:02.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.244+0000 7fc008800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc000074290 con 0x7fc0000b5670 2024-04-25T13:43:02.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.244+0000 7fc008800640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fc0001606f0 con 0x7fc0000747a0 2024-04-25T13:43:02.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.244+0000 7fc006800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc0000b5670 0x7fc0000731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:02.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.244+0000 7fc006800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc0000b5670 0x7fc0000731e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47406/0 (socket says 172.21.15.123:47406) 2024-04-25T13:43:02.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.244+0000 7fc006800640 1 -- 172.21.15.123:0/332503003 learned_addr learned my addr 172.21.15.123:0/332503003 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:02.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.244+0000 7fc005e00640 1 --2- 172.21.15.123:0/332503003 >> v2:172.21.15.130:3300/0 conn(0x7fc0000747a0 0x7fc00015fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:02.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.244+0000 7fc006800640 1 -- 172.21.15.123:0/332503003 >> v2:172.21.15.130:3300/0 conn(0x7fc0000747a0 msgr2=0x7fc00015fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:02.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.244+0000 7fc006800640 1 --2- 172.21.15.123:0/332503003 >> v2:172.21.15.130:3300/0 conn(0x7fc0000747a0 0x7fc00015fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.244+0000 7fc004a00640 1 -- 172.21.15.123:0/332503003 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 494917128 0 0) 0x7fbff0001120 con 0x7fc0001602e0 2024-04-25T13:43:02.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.244+0000 7fc006800640 1 -- 172.21.15.123:0/332503003 >> v1:172.21.15.130:6789/0 conn(0x7fc0001602e0 legacy=0x7fc000072ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:02.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.244+0000 7fc006800640 1 -- 172.21.15.123:0/332503003 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc000073c80 con 0x7fc0000b5670 2024-04-25T13:43:02.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.248+0000 7fc006800640 1 --2- 172.21.15.123:0/332503003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0000b5670 0x7fc0000731e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc000070e80 tx=0x7fbffc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2923181359775bfc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:02.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.248+0000 7fc004a00640 1 -- 172.21.15.123:0/332503003 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbffc0a5720 con 0x7fc0000b5670 2024-04-25T13:43:02.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.248+0000 7fc004a00640 1 -- 172.21.15.123:0/332503003 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbffc0a58c0 con 0x7fc0000b5670 2024-04-25T13:43:02.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.248+0000 7fc004a00640 1 -- 172.21.15.123:0/332503003 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbffc0a5c90 con 0x7fc0000b5670 2024-04-25T13:43:02.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.248+0000 7fc008800640 1 -- 172.21.15.123:0/332503003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0000b5670 msgr2=0x7fc0000731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:02.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.248+0000 7fc008800640 1 --2- 172.21.15.123:0/332503003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0000b5670 0x7fc0000731e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc000070e80 tx=0x7fbffc01c9f0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.248+0000 7fc008800640 1 -- 172.21.15.123:0/332503003 shutdown_connections 2024-04-25T13:43:02.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.248+0000 7fc008800640 1 --2- 172.21.15.123:0/332503003 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0000b5670 0x7fc0000731e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.248+0000 7fc008800640 1 --2- 172.21.15.123:0/332503003 >> v2:172.21.15.130:3300/0 conn(0x7fc0000747a0 0x7fc00015fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.248+0000 7fc008800640 1 -- 172.21.15.123:0/332503003 >> 172.21.15.123:0/332503003 conn(0x7fc00006d210 msgr2=0x7fc00006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:02.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.248+0000 7fc008800640 1 -- 172.21.15.123:0/332503003 shutdown_connections 2024-04-25T13:43:02.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.248+0000 7fc008800640 1 -- 172.21.15.123:0/332503003 wait complete. 2024-04-25T13:43:02.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.252+0000 7fc008800640 1 Processor -- start 2024-04-25T13:43:02.253 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.252+0000 7fc008800640 1 -- start start 2024-04-25T13:43:02.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.252+0000 7fc008800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc0000747a0 0x7fc000143520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:02.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.252+0000 7fc008800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0000b5670 0x7fc000157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:02.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.252+0000 7fc008800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0001602e0 0x7fc00013d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:02.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.252+0000 7fc008800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc0000b6380 con 0x7fc0000b5670 2024-04-25T13:43:02.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.252+0000 7fc008800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc000074bb0 con 0x7fc0001602e0 2024-04-25T13:43:02.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.252+0000 7fc008800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc0000b6500 con 0x7fc0000747a0 2024-04-25T13:43:02.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.252+0000 7fc005400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0000b5670 0x7fc000157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:02.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.252+0000 7fc005400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0000b5670 0x7fc000157640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47412/0 (socket says 172.21.15.123:47412) 2024-04-25T13:43:02.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.252+0000 7fc005400640 1 -- 172.21.15.123:0/4106382156 learned_addr learned my addr 172.21.15.123:0/4106382156 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:02.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.252+0000 7fc005e00640 1 --2- 172.21.15.123:0/4106382156 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc0000747a0 0x7fc000143520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:02.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.252+0000 7fc006800640 1 --2- 172.21.15.123:0/4106382156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0001602e0 0x7fc00013d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:02.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.252+0000 7fc005400640 1 -- 172.21.15.123:0/4106382156 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc0000747a0 msgr2=0x7fc000143520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:02.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.252+0000 7fc005400640 1 --2- 172.21.15.123:0/4106382156 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc0000747a0 0x7fc000143520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.252+0000 7fc005400640 1 -- 172.21.15.123:0/4106382156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0001602e0 msgr2=0x7fc00013d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:02.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.252+0000 7fc005400640 1 --2- 172.21.15.123:0/4106382156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0001602e0 0x7fc00013d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.252+0000 7fc005400640 1 -- 172.21.15.123:0/4106382156 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc000141c00 con 0x7fc0000b5670 2024-04-25T13:43:02.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.252+0000 7fc005e00640 1 --2- 172.21.15.123:0/4106382156 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc0000747a0 0x7fc000143520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:02.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.252+0000 7fc005400640 1 --2- 172.21.15.123:0/4106382156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0000b5670 0x7fc000157640 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbff0001ec0 tx=0x7fbff000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:02.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.252+0000 7fbffa000640 1 -- 172.21.15.123:0/4106382156 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff0017070 con 0x7fc0000b5670 2024-04-25T13:43:02.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.252+0000 7fbffa000640 1 -- 172.21.15.123:0/4106382156 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff0003600 con 0x7fc0000b5670 2024-04-25T13:43:02.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.252+0000 7fc008800640 1 -- 172.21.15.123:0/4106382156 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc000141ee0 con 0x7fc0000b5670 2024-04-25T13:43:02.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.252+0000 7fbffa000640 1 -- 172.21.15.123:0/4106382156 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff00039f0 con 0x7fc0000b5670 2024-04-25T13:43:02.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.252+0000 7fc008800640 1 -- 172.21.15.123:0/4106382156 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0000aeb50 con 0x7fc0000b5670 2024-04-25T13:43:02.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.256+0000 7fc008800640 1 -- 172.21.15.123:0/4106382156 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0000507c0 con 0x7fc0000b5670 2024-04-25T13:43:02.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.256+0000 7fbffa000640 1 -- 172.21.15.123:0/4106382156 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbff001a070 con 0x7fc0000b5670 2024-04-25T13:43:02.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.256+0000 7fbffa000640 1 --2- 172.21.15.123:0/4106382156 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fbfe406f430 0x7fbfe4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:02.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.256+0000 7fbffa000640 1 -- 172.21.15.123:0/4106382156 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fbff008e640 con 0x7fc0000b5670 2024-04-25T13:43:02.259 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.256+0000 7fc005e00640 1 --2- 172.21.15.123:0/4106382156 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fbfe406f430 0x7fbfe4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:02.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.256+0000 7fc005e00640 1 --2- 172.21.15.123:0/4106382156 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fbfe406f430 0x7fbfe4071940 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbff4009b10 tx=0x7fbff4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:02.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.260+0000 7fbffa000640 1 -- 172.21.15.123:0/4106382156 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc000145d70 con 0x7fc0000b5670 2024-04-25T13:43:02.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.420+0000 7fc008800640 1 -- 172.21.15.123:0/4106382156 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc0000b6780 con 0x7fc0000b5670 2024-04-25T13:43:02.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.420+0000 7fbffa000640 1 -- 172.21.15.123:0/4106382156 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16706 (secure 0 0 0) 0x7fbff005ae40 con 0x7fc0000b5670 2024-04-25T13:43:02.424 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:02.424 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":33,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:43:01.431335+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:59.250248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T13:43:00.396458+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:43:02.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.424+0000 7fc008800640 1 -- 172.21.15.123:0/4106382156 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fbfe406f430 msgr2=0x7fbfe4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:02.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.424+0000 7fc008800640 1 --2- 172.21.15.123:0/4106382156 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fbfe406f430 0x7fbfe4071940 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbff4009b10 tx=0x7fbff4008040 comp rx=0 tx=0).stop 2024-04-25T13:43:02.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.424+0000 7fc008800640 1 -- 172.21.15.123:0/4106382156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0000b5670 msgr2=0x7fc000157640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:02.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.424+0000 7fc008800640 1 --2- 172.21.15.123:0/4106382156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0000b5670 0x7fc000157640 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbff0001ec0 tx=0x7fbff000c8e0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.424+0000 7fc008800640 1 -- 172.21.15.123:0/4106382156 shutdown_connections 2024-04-25T13:43:02.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.424+0000 7fc008800640 1 --2- 172.21.15.123:0/4106382156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc0001602e0 0x7fc00013d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.424+0000 7fc008800640 1 --2- 172.21.15.123:0/4106382156 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fbfe406f430 0x7fbfe4071940 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.424+0000 7fc008800640 1 --2- 172.21.15.123:0/4106382156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc0000b5670 0x7fc000157640 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.424+0000 7fc008800640 1 --2- 172.21.15.123:0/4106382156 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc0000747a0 0x7fc000143520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.424+0000 7fc008800640 1 -- 172.21.15.123:0/4106382156 >> 172.21.15.123:0/4106382156 conn(0x7fc00006d210 msgr2=0x7fc00015b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:02.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.424+0000 7fc008800640 1 -- 172.21.15.123:0/4106382156 shutdown_connections 2024-04-25T13:43:02.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.424+0000 7fc008800640 1 -- 172.21.15.123:0/4106382156 wait complete. 2024-04-25T13:43:02.446 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:43:02.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.636+0000 7f0451400640 1 Processor -- start 2024-04-25T13:43:02.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.636+0000 7f0451400640 1 -- start start 2024-04-25T13:43:02.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.640+0000 7f0451400640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f044c0b4d70 0x7f044c0b5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:02.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.640+0000 7f0451400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f044c145d70 con 0x7f044c0747a0 2024-04-25T13:43:02.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.640+0000 7f0451400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f044c073c80 con 0x7f044c1604b0 2024-04-25T13:43:02.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.640+0000 7f0451400640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f044c074290 con 0x7f044c0b4d70 2024-04-25T13:43:02.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.640+0000 7f044a800640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f044c0747a0 0x7f044c15fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36544/0 (socket says 172.21.15.123:36544) 2024-04-25T13:43:02.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.640+0000 7f044a800640 1 -- 172.21.15.123:0/468217558 learned_addr learned my addr 172.21.15.123:0/468217558 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:02.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.640+0000 7f044b200640 1 --2- 172.21.15.123:0/468217558 >> v2:172.21.15.130:3300/0 conn(0x7f044c0b4d70 0x7f044c0b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:02.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.640+0000 7f0449400640 1 -- 172.21.15.123:0/468217558 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1084243355 0 0) 0x7f043c0014a0 con 0x7f044c0747a0 2024-04-25T13:43:02.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.640+0000 7f0449400640 1 -- 172.21.15.123:0/468217558 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0430005740 con 0x7f044c0747a0 2024-04-25T13:43:02.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.640+0000 7f0449400640 1 -- 172.21.15.123:0/468217558 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1718509640 0 0) 0x7f044c073c80 con 0x7f044c1604b0 2024-04-25T13:43:02.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.640+0000 7f0449400640 1 -- 172.21.15.123:0/468217558 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f043c0014a0 con 0x7f044c1604b0 2024-04-25T13:43:02.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.640+0000 7f044b200640 1 -- 172.21.15.123:0/468217558 >> v1:172.21.15.130:6789/0 conn(0x7f044c1604b0 legacy=0x7f044c0b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:02.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.640+0000 7f044b200640 1 -- 172.21.15.123:0/468217558 >> v1:172.21.15.123:6789/0 conn(0x7f044c0747a0 legacy=0x7f044c15fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:02.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.640+0000 7f0449400640 1 -- 172.21.15.123:0/468217558 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4230640700 0 0) 0x7f0430005740 con 0x7f044c0747a0 2024-04-25T13:43:02.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.640+0000 7f044b200640 1 -- 172.21.15.123:0/468217558 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044c0ce030 con 0x7f044c0b4d70 2024-04-25T13:43:02.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.644+0000 7f044b200640 1 --2- 172.21.15.123:0/468217558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f044c0b4d70 0x7f044c0b5180 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f04440097c0 tx=0x7f044401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8168af93fa4a2a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:02.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.644+0000 7f0449400640 1 -- 172.21.15.123:0/468217558 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04440b0070 con 0x7f044c0b4d70 2024-04-25T13:43:02.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.644+0000 7f0449400640 1 -- 172.21.15.123:0/468217558 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04440ab400 con 0x7f044c0b4d70 2024-04-25T13:43:02.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.644+0000 7f0449400640 1 -- 172.21.15.123:0/468217558 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c001bd0 con 0x7f044c0b4d70 2024-04-25T13:43:02.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.644+0000 7f0451400640 1 -- 172.21.15.123:0/468217558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f044c0b4d70 msgr2=0x7f044c0b5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:02.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.644+0000 7f0451400640 1 --2- 172.21.15.123:0/468217558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f044c0b4d70 0x7f044c0b5180 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f04440097c0 tx=0x7f044401c3c0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.644+0000 7f0451400640 1 -- 172.21.15.123:0/468217558 shutdown_connections 2024-04-25T13:43:02.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.644+0000 7f0451400640 1 --2- 172.21.15.123:0/468217558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f044c0b4d70 0x7f044c0b5180 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.644+0000 7f0451400640 1 -- 172.21.15.123:0/468217558 >> 172.21.15.123:0/468217558 conn(0x7f044c06d210 msgr2=0x7f044c06ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:02.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.644+0000 7f0451400640 1 -- 172.21.15.123:0/468217558 shutdown_connections 2024-04-25T13:43:02.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.644+0000 7f0451400640 1 -- 172.21.15.123:0/468217558 wait complete. 2024-04-25T13:43:02.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.648+0000 7f0451400640 1 Processor -- start 2024-04-25T13:43:02.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.648+0000 7f0451400640 1 -- start start 2024-04-25T13:43:02.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.648+0000 7f0451400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f044c0747a0 0x7f044c15bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:02.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.648+0000 7f0451400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f044c0b4d70 0x7f044c0aa740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:02.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.648+0000 7f0451400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f044c140440 0x7f044c140850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:02.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.648+0000 7f0451400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f044c0b6500 con 0x7f044c0b4d70 2024-04-25T13:43:02.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.648+0000 7f0451400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f044c0b6380 con 0x7f044c0747a0 2024-04-25T13:43:02.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.648+0000 7f0451400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f044c16a150 con 0x7f044c140440 2024-04-25T13:43:02.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.648+0000 7f0449e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f044c0b4d70 0x7f044c0aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:02.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.648+0000 7f0449e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f044c0b4d70 0x7f044c0aa740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47418/0 (socket says 172.21.15.123:47418) 2024-04-25T13:43:02.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.648+0000 7f0449e00640 1 -- 172.21.15.123:0/3227980804 learned_addr learned my addr 172.21.15.123:0/3227980804 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:02.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.648+0000 7f044a800640 1 --2- 172.21.15.123:0/3227980804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f044c0747a0 0x7f044c15bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:02.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.648+0000 7f044b200640 1 --2- 172.21.15.123:0/3227980804 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f044c140440 0x7f044c140850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:02.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.648+0000 7f0449e00640 1 -- 172.21.15.123:0/3227980804 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f044c140440 msgr2=0x7f044c140850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:02.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.648+0000 7f0449e00640 1 --2- 172.21.15.123:0/3227980804 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f044c140440 0x7f044c140850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.648+0000 7f0449e00640 1 -- 172.21.15.123:0/3227980804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f044c0747a0 msgr2=0x7f044c15bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:02.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.648+0000 7f0449e00640 1 --2- 172.21.15.123:0/3227980804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f044c0747a0 0x7f044c15bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.648+0000 7f0449e00640 1 -- 172.21.15.123:0/3227980804 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044c13f3a0 con 0x7f044c0b4d70 2024-04-25T13:43:02.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.648+0000 7f0449e00640 1 --2- 172.21.15.123:0/3227980804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f044c0b4d70 0x7f044c0aa740 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f043800c460 tx=0x7f043800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:02.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.648+0000 7f0442a00640 1 -- 172.21.15.123:0/3227980804 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0438017070 con 0x7f044c0b4d70 2024-04-25T13:43:02.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.648+0000 7f0442a00640 1 -- 172.21.15.123:0/3227980804 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04380052f0 con 0x7f044c0b4d70 2024-04-25T13:43:02.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.648+0000 7f0451400640 1 -- 172.21.15.123:0/3227980804 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f044c13f680 con 0x7f044c0b4d70 2024-04-25T13:43:02.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.648+0000 7f0442a00640 1 -- 172.21.15.123:0/3227980804 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0438003840 con 0x7f044c0b4d70 2024-04-25T13:43:02.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.652+0000 7f0451400640 1 -- 172.21.15.123:0/3227980804 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f044c13fc40 con 0x7f044c0b4d70 2024-04-25T13:43:02.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.652+0000 7f0451400640 1 -- 172.21.15.123:0/3227980804 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f044c13f110 con 0x7f044c0b4d70 2024-04-25T13:43:02.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.652+0000 7f0442a00640 1 -- 172.21.15.123:0/3227980804 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f043801a070 con 0x7f044c0b4d70 2024-04-25T13:43:02.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.652+0000 7f0442a00640 1 --2- 172.21.15.123:0/3227980804 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f042c06f430 0x7f042c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:02.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.652+0000 7f0442a00640 1 -- 172.21.15.123:0/3227980804 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f043808e690 con 0x7f044c0b4d70 2024-04-25T13:43:02.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.652+0000 7f044a800640 1 --2- 172.21.15.123:0/3227980804 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f042c06f430 0x7f042c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:02.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.652+0000 7f044a800640 1 --2- 172.21.15.123:0/3227980804 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f042c06f430 0x7f042c071940 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f043c001740 tx=0x7f043c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:02.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.656+0000 7f0442a00640 1 -- 172.21.15.123:0/3227980804 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f043805b570 con 0x7f044c0b4d70 2024-04-25T13:43:02.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.812+0000 7f0451400640 1 -- 172.21.15.123:0/3227980804 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f044c0507c0 con 0x7f044c0b4d70 2024-04-25T13:43:02.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.816+0000 7f0442a00640 1 -- 172.21.15.123:0/3227980804 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16706 (secure 0 0 0) 0x7f043805ae70 con 0x7f044c0b4d70 2024-04-25T13:43:02.817 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:02.818 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":33,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:43:01.431335+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:59.250248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T13:43:00.396458+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:43:02.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.816+0000 7f0451400640 1 -- 172.21.15.123:0/3227980804 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f042c06f430 msgr2=0x7f042c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:02.819 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.816+0000 7f0451400640 1 --2- 172.21.15.123:0/3227980804 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f042c06f430 0x7f042c071940 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f043c001740 tx=0x7f043c009040 comp rx=0 tx=0).stop 2024-04-25T13:43:02.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.816+0000 7f0451400640 1 -- 172.21.15.123:0/3227980804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f044c0b4d70 msgr2=0x7f044c0aa740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:02.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.816+0000 7f0451400640 1 --2- 172.21.15.123:0/3227980804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f044c0b4d70 0x7f044c0aa740 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f043800c460 tx=0x7f043800c920 comp rx=0 tx=0).stop 2024-04-25T13:43:02.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.816+0000 7f0451400640 1 -- 172.21.15.123:0/3227980804 shutdown_connections 2024-04-25T13:43:02.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.816+0000 7f0451400640 1 --2- 172.21.15.123:0/3227980804 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f042c06f430 0x7f042c071940 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.816+0000 7f0451400640 1 --2- 172.21.15.123:0/3227980804 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f044c140440 0x7f044c140850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.816+0000 7f0451400640 1 --2- 172.21.15.123:0/3227980804 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f044c0b4d70 0x7f044c0aa740 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.816+0000 7f0451400640 1 --2- 172.21.15.123:0/3227980804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f044c0747a0 0x7f044c15bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.816+0000 7f0451400640 1 -- 172.21.15.123:0/3227980804 >> 172.21.15.123:0/3227980804 conn(0x7f044c06d210 msgr2=0x7f044c15e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:02.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.816+0000 7f0451400640 1 -- 172.21.15.123:0/3227980804 shutdown_connections 2024-04-25T13:43:02.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.816+0000 7f0451400640 1 -- 172.21.15.123:0/3227980804 wait complete. 2024-04-25T13:43:02.839 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T13:43:02.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.984+0000 7f54e1600640 1 Processor -- start 2024-04-25T13:43:02.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.984+0000 7f54e1600640 1 -- start start 2024-04-25T13:43:02.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.988+0000 7f54e1600640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f54dc1571b0 0x7f54dc0cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:02.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.988+0000 7f54e1600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54dc0cdee0 con 0x7f54dc072af0 2024-04-25T13:43:02.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.988+0000 7f54e1600640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54dc15d570 con 0x7f54dc0b3870 2024-04-25T13:43:02.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.988+0000 7f54e1600640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f54dc15d850 con 0x7f54dc1571b0 2024-04-25T13:43:02.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.988+0000 7f54db400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f54dc072af0 0x7f54dc072f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36558/0 (socket says 172.21.15.123:36558) 2024-04-25T13:43:02.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.988+0000 7f54db400640 1 -- 172.21.15.123:0/1616424665 learned_addr learned my addr 172.21.15.123:0/1616424665 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:02.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.988+0000 7f54daa00640 1 --2- 172.21.15.123:0/1616424665 >> v2:172.21.15.130:3300/0 conn(0x7f54dc1571b0 0x7f54dc0cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:02.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.988+0000 7f54d9600640 1 -- 172.21.15.123:0/1616424665 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 312473441 0 0) 0x7f54dc0cdee0 con 0x7f54dc072af0 2024-04-25T13:43:02.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.988+0000 7f54d9600640 1 -- 172.21.15.123:0/1616424665 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54c0005740 con 0x7f54dc072af0 2024-04-25T13:43:02.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.988+0000 7f54daa00640 1 -- 172.21.15.123:0/1616424665 >> v1:172.21.15.130:6789/0 conn(0x7f54dc0b3870 legacy=0x7f54dc0b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:02.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.988+0000 7f54daa00640 1 -- 172.21.15.123:0/1616424665 >> v1:172.21.15.123:6789/0 conn(0x7f54dc072af0 legacy=0x7f54dc072f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:02.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.988+0000 7f54daa00640 1 -- 172.21.15.123:0/1616424665 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54dc15db30 con 0x7f54dc1571b0 2024-04-25T13:43:02.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.992+0000 7f54daa00640 1 --2- 172.21.15.123:0/1616424665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54dc1571b0 0x7f54dc0cd6b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f54cc009d90 tx=0x7f54cc01c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c912ad54ae263a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:02.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.992+0000 7f54d9600640 1 -- 172.21.15.123:0/1616424665 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54cc0b2070 con 0x7f54dc1571b0 2024-04-25T13:43:02.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.992+0000 7f54d9600640 1 -- 172.21.15.123:0/1616424665 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54cc0a58c0 con 0x7f54dc1571b0 2024-04-25T13:43:02.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.992+0000 7f54d9600640 1 -- 172.21.15.123:0/1616424665 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54cc0a5c90 con 0x7f54dc1571b0 2024-04-25T13:43:02.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.992+0000 7f54e1600640 1 -- 172.21.15.123:0/1616424665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54dc1571b0 msgr2=0x7f54dc0cd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:02.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.992+0000 7f54e1600640 1 --2- 172.21.15.123:0/1616424665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54dc1571b0 0x7f54dc0cd6b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f54cc009d90 tx=0x7f54cc01c8a0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.992+0000 7f54e1600640 1 -- 172.21.15.123:0/1616424665 shutdown_connections 2024-04-25T13:43:02.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.992+0000 7f54e1600640 1 --2- 172.21.15.123:0/1616424665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54dc1571b0 0x7f54dc0cd6b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:02.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.992+0000 7f54e1600640 1 -- 172.21.15.123:0/1616424665 >> 172.21.15.123:0/1616424665 conn(0x7f54dc06ca70 msgr2=0x7f54dc06ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:02.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.992+0000 7f54e1600640 1 -- 172.21.15.123:0/1616424665 shutdown_connections 2024-04-25T13:43:02.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.992+0000 7f54e1600640 1 -- 172.21.15.123:0/1616424665 wait complete. 2024-04-25T13:43:02.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.996+0000 7f54e1600640 1 Processor -- start 2024-04-25T13:43:02.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.996+0000 7f54e1600640 1 -- start start 2024-04-25T13:43:02.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.996+0000 7f54e1600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54dc072af0 0x7f54dc141220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:02.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.996+0000 7f54e1600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f54dc0b3870 0x7f54dc143ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:02.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.996+0000 7f54e1600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54dc1571b0 0x7f54dc141e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:02.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.996+0000 7f54e1600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f54dc15e050 con 0x7f54dc072af0 2024-04-25T13:43:02.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.996+0000 7f54e1600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f54dc1575c0 con 0x7f54dc1571b0 2024-04-25T13:43:02.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.996+0000 7f54e1600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f54dc147560 con 0x7f54dc0b3870 2024-04-25T13:43:02.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.996+0000 7f54daa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54dc072af0 0x7f54dc141220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:02.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.996+0000 7f54daa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54dc072af0 0x7f54dc141220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47426/0 (socket says 172.21.15.123:47426) 2024-04-25T13:43:02.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.996+0000 7f54daa00640 1 -- 172.21.15.123:0/526714236 learned_addr learned my addr 172.21.15.123:0/526714236 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:03.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.996+0000 7f54db400640 1 --2- 172.21.15.123:0/526714236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54dc1571b0 0x7f54dc141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:03.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.996+0000 7f54da000640 1 --2- 172.21.15.123:0/526714236 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f54dc0b3870 0x7f54dc143ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:03.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.996+0000 7f54daa00640 1 -- 172.21.15.123:0/526714236 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f54dc0b3870 msgr2=0x7f54dc143ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:03.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.996+0000 7f54daa00640 1 --2- 172.21.15.123:0/526714236 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f54dc0b3870 0x7f54dc143ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:03.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.996+0000 7f54daa00640 1 -- 172.21.15.123:0/526714236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54dc1571b0 msgr2=0x7f54dc141e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:03.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.996+0000 7f54daa00640 1 --2- 172.21.15.123:0/526714236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54dc1571b0 0x7f54dc141e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:03.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.996+0000 7f54daa00640 1 -- 172.21.15.123:0/526714236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54dc0b50f0 con 0x7f54dc072af0 2024-04-25T13:43:03.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.996+0000 7f54db400640 1 --2- 172.21.15.123:0/526714236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54dc1571b0 0x7f54dc141e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:03.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.996+0000 7f54da000640 1 --2- 172.21.15.123:0/526714236 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f54dc0b3870 0x7f54dc143ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:03.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.996+0000 7f54daa00640 1 --2- 172.21.15.123:0/526714236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54dc072af0 0x7f54dc141220 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f54cc0b0040 tx=0x7f54cc019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:03.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.996+0000 7f54d2a00640 1 -- 172.21.15.123:0/526714236 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54cc0b2040 con 0x7f54dc072af0 2024-04-25T13:43:03.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.996+0000 7f54d2a00640 1 -- 172.21.15.123:0/526714236 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54cc0bf070 con 0x7f54dc072af0 2024-04-25T13:43:03.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.996+0000 7f54e1600640 1 -- 172.21.15.123:0/526714236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54dc0b53d0 con 0x7f54dc072af0 2024-04-25T13:43:03.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.996+0000 7f54d2a00640 1 -- 172.21.15.123:0/526714236 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54cc0ada30 con 0x7f54dc072af0 2024-04-25T13:43:03.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:02.996+0000 7f54e1600640 1 -- 172.21.15.123:0/526714236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54dc0b5990 con 0x7f54dc072af0 2024-04-25T13:43:03.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:03.000+0000 7f54e1600640 1 -- 172.21.15.123:0/526714236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54dc0b5b90 con 0x7f54dc072af0 2024-04-25T13:43:03.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:03.000+0000 7f54d2a00640 1 -- 172.21.15.123:0/526714236 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f54cc0adbd0 con 0x7f54dc072af0 2024-04-25T13:43:03.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:03.000+0000 7f54d2a00640 1 --2- 172.21.15.123:0/526714236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f54bc06f430 0x7f54bc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:03.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:03.000+0000 7f54d2a00640 1 -- 172.21.15.123:0/526714236 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f54cc12a590 con 0x7f54dc072af0 2024-04-25T13:43:03.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:03.000+0000 7f54da000640 1 --2- 172.21.15.123:0/526714236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f54bc06f430 0x7f54bc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:03.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:03.000+0000 7f54da000640 1 --2- 172.21.15.123:0/526714236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f54bc06f430 0x7f54bc071940 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f54dc14ce70 tx=0x7f54c8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:03.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:03.004+0000 7f54d2a00640 1 -- 172.21.15.123:0/526714236 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f54cc016520 con 0x7f54dc072af0 2024-04-25T13:43:03.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:03.204+0000 7f54e1600640 1 -- 172.21.15.123:0/526714236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f54dc050750 con 0x7f54dc072af0 2024-04-25T13:43:03.625 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:43:03.628 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:43:04.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.055+0000 7f54d2a00640 1 -- 172.21.15.123:0/526714236 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f54cc0f73e0 con 0x7f54dc072af0 2024-04-25T13:43:04.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.055+0000 7f54e1600640 1 -- 172.21.15.123:0/526714236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f54bc06f430 msgr2=0x7f54bc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:04.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.055+0000 7f54e1600640 1 --2- 172.21.15.123:0/526714236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f54bc06f430 0x7f54bc071940 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f54dc14ce70 tx=0x7f54c8009040 comp rx=0 tx=0).stop 2024-04-25T13:43:04.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.055+0000 7f54e1600640 1 -- 172.21.15.123:0/526714236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54dc072af0 msgr2=0x7f54dc141220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:04.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.055+0000 7f54e1600640 1 --2- 172.21.15.123:0/526714236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54dc072af0 0x7f54dc141220 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f54cc0b0040 tx=0x7f54cc019640 comp rx=0 tx=0).stop 2024-04-25T13:43:04.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.055+0000 7f54e1600640 1 -- 172.21.15.123:0/526714236 shutdown_connections 2024-04-25T13:43:04.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.055+0000 7f54e1600640 1 --2- 172.21.15.123:0/526714236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54dc1571b0 0x7f54dc141e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:04.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.055+0000 7f54e1600640 1 --2- 172.21.15.123:0/526714236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f54bc06f430 0x7f54bc071940 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:04.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.055+0000 7f54e1600640 1 --2- 172.21.15.123:0/526714236 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f54dc0b3870 0x7f54dc143ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:04.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.055+0000 7f54e1600640 1 --2- 172.21.15.123:0/526714236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f54dc072af0 0x7f54dc141220 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:04.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.055+0000 7f54e1600640 1 -- 172.21.15.123:0/526714236 >> 172.21.15.123:0/526714236 conn(0x7f54dc06ca70 msgr2=0x7f54dc15e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:04.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.055+0000 7f54e1600640 1 -- 172.21.15.123:0/526714236 shutdown_connections 2024-04-25T13:43:04.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.055+0000 7f54e1600640 1 -- 172.21.15.123:0/526714236 wait complete. 2024-04-25T13:43:04.082 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T13:43:04.082 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T13:43:04.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.227+0000 7f84b4000640 1 Processor -- start 2024-04-25T13:43:04.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.227+0000 7f84b4000640 1 -- start start 2024-04-25T13:43:04.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.231+0000 7f84b4000640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f84ac1571b0 0x7f84ac0cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:04.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.231+0000 7f84b4000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f84ac0b3870 0x7f84ac0b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:04.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.231+0000 7f84b4000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f84ac0b4770 0x7f84ac0b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:04.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.231+0000 7f84b4000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f84ac0b41c0 con 0x7f84ac0b3870 2024-04-25T13:43:04.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.231+0000 7f84b4000640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f84ac0cdee0 con 0x7f84ac1571b0 2024-04-25T13:43:04.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.231+0000 7f84b4000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f84ac15d570 con 0x7f84ac0b4770 2024-04-25T13:43:04.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.231+0000 7f84b0c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f84ac0b3870 0x7f84ac0b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:04.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.231+0000 7f84b0c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f84ac0b3870 0x7f84ac0b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47428/0 (socket says 172.21.15.123:47428) 2024-04-25T13:43:04.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.231+0000 7f84b0c00640 1 -- 172.21.15.123:0/3099649017 learned_addr learned my addr 172.21.15.123:0/3099649017 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:04.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.231+0000 7f84b2000640 1 --2- 172.21.15.123:0/3099649017 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f84ac0b4770 0x7f84ac0b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:04.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.231+0000 7f84b1600640 1 --2- 172.21.15.123:0/3099649017 >> v2:172.21.15.130:3300/0 conn(0x7f84ac1571b0 0x7f84ac0cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:04.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.231+0000 7f84b0c00640 1 -- 172.21.15.123:0/3099649017 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f84ac0b4770 msgr2=0x7f84ac0b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:04.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.231+0000 7f84b0c00640 1 --2- 172.21.15.123:0/3099649017 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f84ac0b4770 0x7f84ac0b4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:04.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.231+0000 7f84b0c00640 1 -- 172.21.15.123:0/3099649017 >> v2:172.21.15.130:3300/0 conn(0x7f84ac1571b0 msgr2=0x7f84ac0cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:04.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.231+0000 7f84b0c00640 1 --2- 172.21.15.123:0/3099649017 >> v2:172.21.15.130:3300/0 conn(0x7f84ac1571b0 0x7f84ac0cd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:04.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.231+0000 7f84b0c00640 1 -- 172.21.15.123:0/3099649017 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84ac15d850 con 0x7f84ac0b3870 2024-04-25T13:43:04.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.235+0000 7f84b0c00640 1 --2- 172.21.15.123:0/3099649017 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84ac0b3870 0x7f84ac0b3c80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0722c0 tx=0x7f849801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c1c79f152d79a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:04.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.235+0000 7f84abe00640 1 -- 172.21.15.123:0/3099649017 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84980b0070 con 0x7f84ac0b3870 2024-04-25T13:43:04.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.235+0000 7f84abe00640 1 -- 172.21.15.123:0/3099649017 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84980ab600 con 0x7f84ac0b3870 2024-04-25T13:43:04.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.235+0000 7f84abe00640 1 -- 172.21.15.123:0/3099649017 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84980ab9d0 con 0x7f84ac0b3870 2024-04-25T13:43:04.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.235+0000 7f84b4000640 1 -- 172.21.15.123:0/3099649017 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84ac0b3870 msgr2=0x7f84ac0b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:04.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.235+0000 7f84b4000640 1 --2- 172.21.15.123:0/3099649017 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84ac0b3870 0x7f84ac0b3c80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0722c0 tx=0x7f849801c460 comp rx=0 tx=0).stop 2024-04-25T13:43:04.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.235+0000 7f84b4000640 1 -- 172.21.15.123:0/3099649017 shutdown_connections 2024-04-25T13:43:04.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.235+0000 7f84b4000640 1 --2- 172.21.15.123:0/3099649017 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f84ac0b4770 0x7f84ac0b4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:04.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.235+0000 7f84b4000640 1 --2- 172.21.15.123:0/3099649017 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84ac0b3870 0x7f84ac0b3c80 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:04.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.235+0000 7f84b4000640 1 --2- 172.21.15.123:0/3099649017 >> v2:172.21.15.130:3300/0 conn(0x7f84ac1571b0 0x7f84ac0cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:04.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.235+0000 7f84b4000640 1 -- 172.21.15.123:0/3099649017 >> 172.21.15.123:0/3099649017 conn(0x7f84ac06ca70 msgr2=0x7f84ac06ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:04.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.235+0000 7f84b4000640 1 -- 172.21.15.123:0/3099649017 shutdown_connections 2024-04-25T13:43:04.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.235+0000 7f84b4000640 1 -- 172.21.15.123:0/3099649017 wait complete. 2024-04-25T13:43:04.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.239+0000 7f84b4000640 1 Processor -- start 2024-04-25T13:43:04.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.239+0000 7f84b4000640 1 -- start start 2024-04-25T13:43:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.239+0000 7f84b4000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84ac0b3870 0x7f84ac14e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.239+0000 7f84b4000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84ac0b4770 0x7f84ac15bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.239+0000 7f84b4000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f84ac1571b0 0x7f84ac15c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.239+0000 7f84b4000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f84ac15e050 con 0x7f84ac0b3870 2024-04-25T13:43:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.239+0000 7f84b4000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f84ac0b54d0 con 0x7f84ac0b4770 2024-04-25T13:43:04.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.239+0000 7f84b4000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f84ac14ed30 con 0x7f84ac1571b0 2024-04-25T13:43:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.239+0000 7f84b1600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84ac0b3870 0x7f84ac14e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.239+0000 7f84b1600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84ac0b3870 0x7f84ac14e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47434/0 (socket says 172.21.15.123:47434) 2024-04-25T13:43:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.239+0000 7f84b1600640 1 -- 172.21.15.123:0/1916770395 learned_addr learned my addr 172.21.15.123:0/1916770395 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.239+0000 7f84b0c00640 1 --2- 172.21.15.123:0/1916770395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84ac0b4770 0x7f84ac15bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.239+0000 7f84b2000640 1 --2- 172.21.15.123:0/1916770395 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f84ac1571b0 0x7f84ac15c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.239+0000 7f84b1600640 1 -- 172.21.15.123:0/1916770395 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f84ac1571b0 msgr2=0x7f84ac15c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.239+0000 7f84b1600640 1 --2- 172.21.15.123:0/1916770395 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f84ac1571b0 0x7f84ac15c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.239+0000 7f84b1600640 1 -- 172.21.15.123:0/1916770395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84ac0b4770 msgr2=0x7f84ac15bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.239+0000 7f84b1600640 1 --2- 172.21.15.123:0/1916770395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84ac0b4770 0x7f84ac15bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.239+0000 7f84b1600640 1 -- 172.21.15.123:0/1916770395 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84ac1f94d0 con 0x7f84ac0b3870 2024-04-25T13:43:04.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.239+0000 7f84b1600640 1 --2- 172.21.15.123:0/1916770395 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84ac0b3870 0x7f84ac14e7f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f84a000e840 tx=0x7f84a000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:04.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.239+0000 7f84a9600640 1 -- 172.21.15.123:0/1916770395 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a0017070 con 0x7f84ac0b3870 2024-04-25T13:43:04.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.239+0000 7f84a9600640 1 -- 172.21.15.123:0/1916770395 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a000ee90 con 0x7f84ac0b3870 2024-04-25T13:43:04.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.239+0000 7f84a9600640 1 -- 172.21.15.123:0/1916770395 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a000cb60 con 0x7f84ac0b3870 2024-04-25T13:43:04.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.239+0000 7f84b4000640 1 -- 172.21.15.123:0/1916770395 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84ac1f9790 con 0x7f84ac0b3870 2024-04-25T13:43:04.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.239+0000 7f84b4000640 1 -- 172.21.15.123:0/1916770395 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84ac1f9d50 con 0x7f84ac0b3870 2024-04-25T13:43:04.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.243+0000 7f84b4000640 1 -- 172.21.15.123:0/1916770395 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84ac050750 con 0x7f84ac0b3870 2024-04-25T13:43:04.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.243+0000 7f84a9600640 1 -- 172.21.15.123:0/1916770395 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f84a001a070 con 0x7f84ac0b3870 2024-04-25T13:43:04.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.243+0000 7f84a9600640 1 --2- 172.21.15.123:0/1916770395 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f848c06f400 0x7f848c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:04.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.243+0000 7f84a9600640 1 -- 172.21.15.123:0/1916770395 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f84a008f210 con 0x7f84ac0b3870 2024-04-25T13:43:04.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.243+0000 7f84b0c00640 1 --2- 172.21.15.123:0/1916770395 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f848c06f400 0x7f848c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:04.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.243+0000 7f84b0c00640 1 --2- 172.21.15.123:0/1916770395 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f848c06f400 0x7f848c071910 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f84980ad000 tx=0x7f8498008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:04.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.247+0000 7f84a9600640 1 -- 172.21.15.123:0/1916770395 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f84a005c060 con 0x7f84ac0b3870 2024-04-25T13:43:04.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:04.435+0000 7f84b4000640 1 -- 172.21.15.123:0/1916770395 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f84ac074cc0 con 0x7f84ac0b3870 2024-04-25T13:43:04.999 INFO:tasks.ceph.mds.c.smithi123.stderr:2024-04-25T13:43:04.995+0000 7f4422400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T13:43:05.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.055+0000 7f84a9600640 1 -- 172.21.15.123:0/1916770395 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7f84a005b960 con 0x7f84ac0b3870 2024-04-25T13:43:05.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.059+0000 7f84b4000640 1 -- 172.21.15.123:0/1916770395 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f848c06f400 msgr2=0x7f848c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:05.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.059+0000 7f84b4000640 1 --2- 172.21.15.123:0/1916770395 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f848c06f400 0x7f848c071910 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f84980ad000 tx=0x7f8498008040 comp rx=0 tx=0).stop 2024-04-25T13:43:05.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.059+0000 7f84b4000640 1 -- 172.21.15.123:0/1916770395 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84ac0b3870 msgr2=0x7f84ac14e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:05.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.059+0000 7f84b4000640 1 --2- 172.21.15.123:0/1916770395 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84ac0b3870 0x7f84ac14e7f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f84a000e840 tx=0x7f84a000ec40 comp rx=0 tx=0).stop 2024-04-25T13:43:05.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.059+0000 7f84b4000640 1 -- 172.21.15.123:0/1916770395 shutdown_connections 2024-04-25T13:43:05.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.059+0000 7f84b4000640 1 --2- 172.21.15.123:0/1916770395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f84ac0b4770 0x7f84ac15bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:05.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.059+0000 7f84b4000640 1 --2- 172.21.15.123:0/1916770395 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f848c06f400 0x7f848c071910 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:05.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.059+0000 7f84b4000640 1 --2- 172.21.15.123:0/1916770395 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f84ac1571b0 0x7f84ac15c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:05.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.059+0000 7f84b4000640 1 --2- 172.21.15.123:0/1916770395 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84ac0b3870 0x7f84ac14e7f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:05.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.059+0000 7f84b4000640 1 -- 172.21.15.123:0/1916770395 >> 172.21.15.123:0/1916770395 conn(0x7f84ac06ca70 msgr2=0x7f84ac0d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:05.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.059+0000 7f84b4000640 1 -- 172.21.15.123:0/1916770395 shutdown_connections 2024-04-25T13:43:05.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.059+0000 7f84b4000640 1 -- 172.21.15.123:0/1916770395 wait complete. 2024-04-25T13:43:05.084 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T13:43:05.084 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:43:05.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.227+0000 7f69e9400640 1 Processor -- start 2024-04-25T13:43:05.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.227+0000 7f69e9400640 1 -- start start 2024-04-25T13:43:05.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.231+0000 7f69e9400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69e41604b0 0x7f69e40b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:05.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.231+0000 7f69e9400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f69e40b4ba0 0x7f69e40b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:05.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.231+0000 7f69e9400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69e4145d70 con 0x7f69e40747a0 2024-04-25T13:43:05.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.231+0000 7f69e9400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f69e4074290 con 0x7f69e40b4ba0 2024-04-25T13:43:05.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.231+0000 7f69e9400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f69e4073c80 con 0x7f69e41604b0 2024-04-25T13:43:05.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.231+0000 7f69e3200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f69e40b4ba0 0x7f69e40b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:05.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.231+0000 7f69e3200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f69e40b4ba0 0x7f69e40b4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47436/0 (socket says 172.21.15.123:47436) 2024-04-25T13:43:05.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.231+0000 7f69e3200640 1 -- 172.21.15.123:0/3526602277 learned_addr learned my addr 172.21.15.123:0/3526602277 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:05.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.231+0000 7f69e1e00640 1 --2- 172.21.15.123:0/3526602277 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69e41604b0 0x7f69e40b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:05.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.231+0000 7f69e3200640 1 -- 172.21.15.123:0/3526602277 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69e41604b0 msgr2=0x7f69e40b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:05.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.231+0000 7f69e3200640 1 --2- 172.21.15.123:0/3526602277 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69e41604b0 0x7f69e40b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:05.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.231+0000 7f69e3200640 1 -- 172.21.15.123:0/3526602277 >> v1:172.21.15.130:6789/0 conn(0x7f69e40747a0 legacy=0x7f69e415fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:05.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.231+0000 7f69e3200640 1 -- 172.21.15.123:0/3526602277 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e40ce030 con 0x7f69e40b4ba0 2024-04-25T13:43:05.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.235+0000 7f69e3200640 1 --2- 172.21.15.123:0/3526602277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e40b4ba0 0x7f69e40b4fb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009e50 tx=0x7f69dc01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11984a4c043898c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:05.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.235+0000 7f69e1400640 1 -- 172.21.15.123:0/3526602277 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc0a5770 con 0x7f69e40b4ba0 2024-04-25T13:43:05.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.235+0000 7f69e1400640 1 -- 172.21.15.123:0/3526602277 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69dc0a5910 con 0x7f69e40b4ba0 2024-04-25T13:43:05.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.235+0000 7f69e1400640 1 -- 172.21.15.123:0/3526602277 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc0a5ce0 con 0x7f69e40b4ba0 2024-04-25T13:43:05.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.235+0000 7f69e9400640 1 -- 172.21.15.123:0/3526602277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e40b4ba0 msgr2=0x7f69e40b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:05.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.235+0000 7f69e9400640 1 --2- 172.21.15.123:0/3526602277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e40b4ba0 0x7f69e40b4fb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009e50 tx=0x7f69dc01ca30 comp rx=0 tx=0).stop 2024-04-25T13:43:05.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.235+0000 7f69e9400640 1 -- 172.21.15.123:0/3526602277 shutdown_connections 2024-04-25T13:43:05.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.235+0000 7f69e9400640 1 --2- 172.21.15.123:0/3526602277 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e40b4ba0 0x7f69e40b4fb0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:05.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.235+0000 7f69e9400640 1 --2- 172.21.15.123:0/3526602277 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69e41604b0 0x7f69e40b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:05.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.235+0000 7f69e9400640 1 -- 172.21.15.123:0/3526602277 >> 172.21.15.123:0/3526602277 conn(0x7f69e406d210 msgr2=0x7f69e406ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:05.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.235+0000 7f69e9400640 1 -- 172.21.15.123:0/3526602277 shutdown_connections 2024-04-25T13:43:05.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.235+0000 7f69e9400640 1 -- 172.21.15.123:0/3526602277 wait complete. 2024-04-25T13:43:05.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.239+0000 7f69e9400640 1 Processor -- start 2024-04-25T13:43:05.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.239+0000 7f69e9400640 1 -- start start 2024-04-25T13:43:05.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.239+0000 7f69e9400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e40747a0 0x7f69e415e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:05.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.239+0000 7f69e9400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69e40b4ba0 0x7f69e4158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:05.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.239+0000 7f69e9400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69e4159080 0x7f69e415fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:05.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.239+0000 7f69e9400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f69e40b6380 con 0x7f69e40747a0 2024-04-25T13:43:05.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.239+0000 7f69e9400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f69e4074bb0 con 0x7f69e40b4ba0 2024-04-25T13:43:05.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.239+0000 7f69e9400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f69e40b6500 con 0x7f69e4159080 2024-04-25T13:43:05.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.239+0000 7f69e2800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e40747a0 0x7f69e415e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:05.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.239+0000 7f69e2800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e40747a0 0x7f69e415e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47440/0 (socket says 172.21.15.123:47440) 2024-04-25T13:43:05.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.239+0000 7f69e2800640 1 -- 172.21.15.123:0/3123867740 learned_addr learned my addr 172.21.15.123:0/3123867740 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:05.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.239+0000 7f69e1e00640 1 --2- 172.21.15.123:0/3123867740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69e40b4ba0 0x7f69e4158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:05.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.239+0000 7f69e3200640 1 --2- 172.21.15.123:0/3123867740 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69e4159080 0x7f69e415fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:05.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.239+0000 7f69e2800640 1 -- 172.21.15.123:0/3123867740 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69e4159080 msgr2=0x7f69e415fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:05.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.239+0000 7f69e2800640 1 --2- 172.21.15.123:0/3123867740 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69e4159080 0x7f69e415fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:05.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.239+0000 7f69e2800640 1 -- 172.21.15.123:0/3123867740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69e40b4ba0 msgr2=0x7f69e4158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:05.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.239+0000 7f69e2800640 1 --2- 172.21.15.123:0/3123867740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69e40b4ba0 0x7f69e4158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:05.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.239+0000 7f69e2800640 1 -- 172.21.15.123:0/3123867740 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e4159790 con 0x7f69e40747a0 2024-04-25T13:43:05.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.239+0000 7f69e3200640 1 --2- 172.21.15.123:0/3123867740 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69e4159080 0x7f69e415fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:05.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.239+0000 7f69e2800640 1 --2- 172.21.15.123:0/3123867740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e40747a0 0x7f69e415e020 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f69d400c3a0 tx=0x7f69d400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:05.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.239+0000 7f69daa00640 1 -- 172.21.15.123:0/3123867740 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d40052d0 con 0x7f69e40747a0 2024-04-25T13:43:05.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.239+0000 7f69daa00640 1 -- 172.21.15.123:0/3123867740 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d4005470 con 0x7f69e40747a0 2024-04-25T13:43:05.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.239+0000 7f69daa00640 1 -- 172.21.15.123:0/3123867740 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d4007260 con 0x7f69e40747a0 2024-04-25T13:43:05.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.239+0000 7f69e9400640 1 -- 172.21.15.123:0/3123867740 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69e4159a70 con 0x7f69e40747a0 2024-04-25T13:43:05.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.239+0000 7f69e9400640 1 -- 172.21.15.123:0/3123867740 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69e415a030 con 0x7f69e40747a0 2024-04-25T13:43:05.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.239+0000 7f69e9400640 1 -- 172.21.15.123:0/3123867740 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69e40507c0 con 0x7f69e40747a0 2024-04-25T13:43:05.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.243+0000 7f69daa00640 1 -- 172.21.15.123:0/3123867740 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f69d4007400 con 0x7f69e40747a0 2024-04-25T13:43:05.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.243+0000 7f69daa00640 1 --2- 172.21.15.123:0/3123867740 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f69c406f400 0x7f69c4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:05.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.243+0000 7f69daa00640 1 -- 172.21.15.123:0/3123867740 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f69d408e780 con 0x7f69e40747a0 2024-04-25T13:43:05.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.243+0000 7f69e1e00640 1 --2- 172.21.15.123:0/3123867740 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f69c406f400 0x7f69c4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:05.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.243+0000 7f69e1e00640 1 --2- 172.21.15.123:0/3123867740 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f69c406f400 0x7f69c4071910 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f69e4145050 tx=0x7f69d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:05.251 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.247+0000 7f69daa00640 1 -- 172.21.15.123:0/3123867740 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f69e4145d70 con 0x7f69e40747a0 2024-04-25T13:43:05.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.439+0000 7f69e9400640 1 -- 172.21.15.123:0/3123867740 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69e406f1d0 con 0x7f69e40747a0 2024-04-25T13:43:05.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.439+0000 7f69daa00640 1 -- 172.21.15.123:0/3123867740 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5187 (secure 0 0 0) 0x7f69d405b660 con 0x7f69e40747a0 2024-04-25T13:43:05.443 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:05.443 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3582988979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":3582988979},{"type":"v1","addr":"172.21.15.130:6835","nonce":3582988979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4978,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/173287078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":173287078},{"type":"v1","addr":"172.21.15.123:6837","nonce":173287078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4987,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/4025543653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4025543653},{"type":"v1","addr":"172.21.15.130:6834","nonce":4025543653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:43:01.431292+0000","modified":"2024-04-25T13:43:04.442129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6836/499623122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":499623122},{"type":"v1","addr":"172.21.15.123:6836","nonce":499623122}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5046,"qdb_cluster":[5046]},"id":2}]} 2024-04-25T13:43:05.443 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 17 2024-04-25T13:43:05.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.443+0000 7f69e9400640 1 -- 172.21.15.123:0/3123867740 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f69c406f400 msgr2=0x7f69c4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:05.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.443+0000 7f69e9400640 1 --2- 172.21.15.123:0/3123867740 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f69c406f400 0x7f69c4071910 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f69e4145050 tx=0x7f69d0008040 comp rx=0 tx=0).stop 2024-04-25T13:43:05.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.443+0000 7f69e9400640 1 -- 172.21.15.123:0/3123867740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e40747a0 msgr2=0x7f69e415e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:05.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.443+0000 7f69e9400640 1 --2- 172.21.15.123:0/3123867740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e40747a0 0x7f69e415e020 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f69d400c3a0 tx=0x7f69d400c860 comp rx=0 tx=0).stop 2024-04-25T13:43:05.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.443+0000 7f69e9400640 1 -- 172.21.15.123:0/3123867740 shutdown_connections 2024-04-25T13:43:05.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.443+0000 7f69e9400640 1 --2- 172.21.15.123:0/3123867740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69e40b4ba0 0x7f69e4158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:05.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.443+0000 7f69e9400640 1 --2- 172.21.15.123:0/3123867740 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f69c406f400 0x7f69c4071910 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:05.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.443+0000 7f69e9400640 1 --2- 172.21.15.123:0/3123867740 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69e4159080 0x7f69e415fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:05.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.443+0000 7f69e9400640 1 --2- 172.21.15.123:0/3123867740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f69e40747a0 0x7f69e415e020 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:05.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.443+0000 7f69e9400640 1 -- 172.21.15.123:0/3123867740 >> 172.21.15.123:0/3123867740 conn(0x7f69e406d210 msgr2=0x7f69e4140a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:05.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.443+0000 7f69e9400640 1 -- 172.21.15.123:0/3123867740 shutdown_connections 2024-04-25T13:43:05.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.443+0000 7f69e9400640 1 -- 172.21.15.123:0/3123867740 wait complete. 2024-04-25T13:43:05.465 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:43:05.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.607+0000 7f3fdc200640 1 Processor -- start 2024-04-25T13:43:05.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.607+0000 7f3fdc200640 1 -- start start 2024-04-25T13:43:05.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.611+0000 7f3fdc200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3fd40747a0 0x7f3fd415fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:05.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.611+0000 7f3fdc200640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3fd41602e0 0x7f3fd4072ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:05.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.611+0000 7f3fdc200640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fd4145d70 con 0x7f3fd4073010 2024-04-25T13:43:05.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.611+0000 7f3fdc200640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f3fd4074290 con 0x7f3fd41602e0 2024-04-25T13:43:05.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.611+0000 7f3fdc200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3fd41606f0 con 0x7f3fd40747a0 2024-04-25T13:43:05.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.611+0000 7f3fd8e00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3fd41602e0 0x7f3fd4072ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:05.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.611+0000 7f3fd9800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3fd40747a0 0x7f3fd415fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:05.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.611+0000 7f3fd8e00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3fd41602e0 0x7f3fd4072ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:35128/0 (socket says 172.21.15.123:35128) 2024-04-25T13:43:05.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.611+0000 7f3fd8e00640 1 -- 172.21.15.123:0/3572506445 learned_addr learned my addr 172.21.15.123:0/3572506445 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:05.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.611+0000 7f3fda200640 1 --1- 172.21.15.123:0/3572506445 >> v1:172.21.15.130:6789/0 conn(0x7f3fd4073010 0x7f3fd4073420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.123:55326/0 (socket says 172.21.15.123:55326) 2024-04-25T13:43:05.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.611+0000 7f3fd9800640 1 -- 172.21.15.123:0/3572506445 >> v2:172.21.15.130:3300/0 conn(0x7f3fd41602e0 msgr2=0x7f3fd4072ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:05.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.611+0000 7f3fd9800640 1 --2- 172.21.15.123:0/3572506445 >> v2:172.21.15.130:3300/0 conn(0x7f3fd41602e0 0x7f3fd4072ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:05.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.611+0000 7f3fd9800640 1 -- 172.21.15.123:0/3572506445 >> v1:172.21.15.130:6789/0 conn(0x7f3fd4073010 legacy=0x7f3fd4073420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:05.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.611+0000 7f3fd9800640 1 -- 172.21.15.123:0/3572506445 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd4073c80 con 0x7f3fd40747a0 2024-04-25T13:43:05.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.611+0000 7f3fd8e00640 1 --2- 172.21.15.123:0/3572506445 >> v2:172.21.15.130:3300/0 conn(0x7f3fd41602e0 0x7f3fd4072ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:43:05.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.615+0000 7f3fd9800640 1 --2- 172.21.15.123:0/3572506445 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3fd40747a0 0x7f3fd415fda0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3fc80097c0 tx=0x7f3fc801e6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c468b3c1da435463 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:05.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.615+0000 7f3fd3e00640 1 -- 172.21.15.123:0/3572506445 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc80ab5f0 con 0x7f3fd40747a0 2024-04-25T13:43:05.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.615+0000 7f3fd3e00640 1 -- 172.21.15.123:0/3572506445 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fc80ab790 con 0x7f3fd40747a0 2024-04-25T13:43:05.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.615+0000 7f3fd3e00640 1 -- 172.21.15.123:0/3572506445 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc80abb60 con 0x7f3fd40747a0 2024-04-25T13:43:05.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.615+0000 7f3fdc200640 1 -- 172.21.15.123:0/3572506445 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3fd40747a0 msgr2=0x7f3fd415fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:05.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.615+0000 7f3fdc200640 1 --2- 172.21.15.123:0/3572506445 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3fd40747a0 0x7f3fd415fda0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3fc80097c0 tx=0x7f3fc801e6b0 comp rx=0 tx=0).stop 2024-04-25T13:43:05.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.615+0000 7f3fdc200640 1 -- 172.21.15.123:0/3572506445 shutdown_connections 2024-04-25T13:43:05.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.615+0000 7f3fdc200640 1 --2- 172.21.15.123:0/3572506445 >> v2:172.21.15.130:3300/0 conn(0x7f3fd41602e0 0x7f3fd4072ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:05.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.615+0000 7f3fdc200640 1 --2- 172.21.15.123:0/3572506445 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3fd40747a0 0x7f3fd415fda0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:05.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.615+0000 7f3fdc200640 1 -- 172.21.15.123:0/3572506445 >> 172.21.15.123:0/3572506445 conn(0x7f3fd406d210 msgr2=0x7f3fd406ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:05.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.615+0000 7f3fdc200640 1 -- 172.21.15.123:0/3572506445 shutdown_connections 2024-04-25T13:43:05.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.615+0000 7f3fdc200640 1 -- 172.21.15.123:0/3572506445 wait complete. 2024-04-25T13:43:05.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.619+0000 7f3fdc200640 1 Processor -- start 2024-04-25T13:43:05.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.619+0000 7f3fdc200640 1 -- start start 2024-04-25T13:43:05.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.619+0000 7f3fdc200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fd4073010 0x7f3fd41460a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:05.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.619+0000 7f3fdc200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3fd40747a0 0x7f3fd4159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:05.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.619+0000 7f3fdc200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3fd41602e0 0x7f3fd413cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:05.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.619+0000 7f3fdc200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd40b6380 con 0x7f3fd4073010 2024-04-25T13:43:05.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.619+0000 7f3fdc200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd4074bb0 con 0x7f3fd40747a0 2024-04-25T13:43:05.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.619+0000 7f3fdc200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3fd40b6500 con 0x7f3fd41602e0 2024-04-25T13:43:05.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.619+0000 7f3fd9800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fd4073010 0x7f3fd41460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:05.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.619+0000 7f3fd9800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fd4073010 0x7f3fd41460a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47456/0 (socket says 172.21.15.123:47456) 2024-04-25T13:43:05.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.619+0000 7f3fd9800640 1 -- 172.21.15.123:0/276639909 learned_addr learned my addr 172.21.15.123:0/276639909 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:05.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.619+0000 7f3fda200640 1 --2- 172.21.15.123:0/276639909 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3fd41602e0 0x7f3fd413cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:05.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.619+0000 7f3fd8e00640 1 --2- 172.21.15.123:0/276639909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3fd40747a0 0x7f3fd4159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:05.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.619+0000 7f3fd9800640 1 -- 172.21.15.123:0/276639909 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3fd41602e0 msgr2=0x7f3fd413cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:05.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.619+0000 7f3fd9800640 1 --2- 172.21.15.123:0/276639909 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3fd41602e0 0x7f3fd413cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:05.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.619+0000 7f3fd9800640 1 -- 172.21.15.123:0/276639909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3fd40747a0 msgr2=0x7f3fd4159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:05.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.619+0000 7f3fd9800640 1 --2- 172.21.15.123:0/276639909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3fd40747a0 0x7f3fd4159660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:05.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.619+0000 7f3fd9800640 1 -- 172.21.15.123:0/276639909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd413bd40 con 0x7f3fd4073010 2024-04-25T13:43:05.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.619+0000 7f3fd9800640 1 --2- 172.21.15.123:0/276639909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fd4073010 0x7f3fd41460a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3fc801ef50 tx=0x7f3fc801cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:05.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.623+0000 7f3fd1600640 1 -- 172.21.15.123:0/276639909 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc80c1070 con 0x7f3fd4073010 2024-04-25T13:43:05.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.623+0000 7f3fd1600640 1 -- 172.21.15.123:0/276639909 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fc80b38c0 con 0x7f3fd4073010 2024-04-25T13:43:05.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.623+0000 7f3fd1600640 1 -- 172.21.15.123:0/276639909 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fc80b3cb0 con 0x7f3fd4073010 2024-04-25T13:43:05.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.623+0000 7f3fdc200640 1 -- 172.21.15.123:0/276639909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fd413c020 con 0x7f3fd4073010 2024-04-25T13:43:05.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.623+0000 7f3fdc200640 1 -- 172.21.15.123:0/276639909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fd413c5e0 con 0x7f3fd4073010 2024-04-25T13:43:05.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.623+0000 7f3fdc200640 1 -- 172.21.15.123:0/276639909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fd40507c0 con 0x7f3fd4073010 2024-04-25T13:43:05.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.623+0000 7f3fd1600640 1 -- 172.21.15.123:0/276639909 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3fc80c4070 con 0x7f3fd4073010 2024-04-25T13:43:05.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.623+0000 7f3fd1600640 1 --2- 172.21.15.123:0/276639909 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3fb406f400 0x7f3fb4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:05.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.623+0000 7f3fd1600640 1 -- 172.21.15.123:0/276639909 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3fc812b990 con 0x7f3fd4073010 2024-04-25T13:43:05.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.623+0000 7f3fd8e00640 1 --2- 172.21.15.123:0/276639909 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3fb406f400 0x7f3fb4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:05.629 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.627+0000 7f3fd8e00640 1 --2- 172.21.15.123:0/276639909 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3fb406f400 0x7f3fb4071910 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4160250 tx=0x7f3fc0009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:05.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.631+0000 7f3fd1600640 1 -- 172.21.15.123:0/276639909 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3fc80af020 con 0x7f3fd4073010 2024-04-25T13:43:05.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.787+0000 7f3fdc200640 1 -- 172.21.15.123:0/276639909 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3fd413eba0 con 0x7f3fd4073010 2024-04-25T13:43:05.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.787+0000 7f3fd1600640 1 -- 172.21.15.123:0/276639909 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16693 (secure 0 0 0) 0x7f3fc80182a0 con 0x7f3fd4073010 2024-04-25T13:43:05.792 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:05.792 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":34,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:43:03.039428+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:59.250248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T13:43:00.396458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:43:05.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.791+0000 7f3fdc200640 1 -- 172.21.15.123:0/276639909 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3fb406f400 msgr2=0x7f3fb4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:05.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.791+0000 7f3fdc200640 1 --2- 172.21.15.123:0/276639909 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3fb406f400 0x7f3fb4071910 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4160250 tx=0x7f3fc0009240 comp rx=0 tx=0).stop 2024-04-25T13:43:05.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.791+0000 7f3fdc200640 1 -- 172.21.15.123:0/276639909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fd4073010 msgr2=0x7f3fd41460a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:05.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.791+0000 7f3fdc200640 1 --2- 172.21.15.123:0/276639909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fd4073010 0x7f3fd41460a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3fc801ef50 tx=0x7f3fc801cef0 comp rx=0 tx=0).stop 2024-04-25T13:43:05.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.791+0000 7f3fdc200640 1 -- 172.21.15.123:0/276639909 shutdown_connections 2024-04-25T13:43:05.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.791+0000 7f3fdc200640 1 --2- 172.21.15.123:0/276639909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3fd40747a0 0x7f3fd4159660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:05.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.791+0000 7f3fdc200640 1 --2- 172.21.15.123:0/276639909 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3fb406f400 0x7f3fb4071910 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:05.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.791+0000 7f3fdc200640 1 --2- 172.21.15.123:0/276639909 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3fd41602e0 0x7f3fd413cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:05.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.791+0000 7f3fdc200640 1 --2- 172.21.15.123:0/276639909 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3fd4073010 0x7f3fd41460a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:05.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.791+0000 7f3fdc200640 1 -- 172.21.15.123:0/276639909 >> 172.21.15.123:0/276639909 conn(0x7f3fd406d210 msgr2=0x7f3fd406ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:05.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.791+0000 7f3fdc200640 1 -- 172.21.15.123:0/276639909 shutdown_connections 2024-04-25T13:43:05.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.791+0000 7f3fdc200640 1 -- 172.21.15.123:0/276639909 wait complete. 2024-04-25T13:43:05.813 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T13:43:05.814 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:43:05.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.955+0000 7f3a98600640 1 Processor -- start 2024-04-25T13:43:05.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.955+0000 7f3a98600640 1 -- start start 2024-04-25T13:43:05.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.959+0000 7f3a98600640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3a90166730 0x7f3a90168b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:05.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.959+0000 7f3a98600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a90073400 con 0x7f3a900b6970 2024-04-25T13:43:05.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.959+0000 7f3a98600640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a900736e0 con 0x7f3a901474f0 2024-04-25T13:43:05.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.959+0000 7f3a98600640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f3a900d0d10 con 0x7f3a90166730 2024-04-25T13:43:05.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.959+0000 7f3a95200640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3a900b6970 0x7f3a900b6d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36568/0 (socket says 172.21.15.123:36568) 2024-04-25T13:43:05.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.959+0000 7f3a95200640 1 -- 172.21.15.123:0/1974191154 learned_addr learned my addr 172.21.15.123:0/1974191154 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:05.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.959+0000 7f3a96600640 1 --2- 172.21.15.123:0/1974191154 >> v2:172.21.15.130:3300/0 conn(0x7f3a90166730 0x7f3a90168b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:05.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.959+0000 7f3a8fe00640 1 -- 172.21.15.123:0/1974191154 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2074075370 0 0) 0x7f3a90073400 con 0x7f3a900b6970 2024-04-25T13:43:05.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.959+0000 7f3a8fe00640 1 -- 172.21.15.123:0/1974191154 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a78003530 con 0x7f3a900b6970 2024-04-25T13:43:05.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.959+0000 7f3a8fe00640 1 -- 172.21.15.123:0/1974191154 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3311311463 0 0) 0x7f3a900736e0 con 0x7f3a901474f0 2024-04-25T13:43:05.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.959+0000 7f3a8fe00640 1 -- 172.21.15.123:0/1974191154 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a90073400 con 0x7f3a901474f0 2024-04-25T13:43:05.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.959+0000 7f3a96600640 1 -- 172.21.15.123:0/1974191154 >> v1:172.21.15.130:6789/0 conn(0x7f3a901474f0 legacy=0x7f3a9015eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:05.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.959+0000 7f3a96600640 1 -- 172.21.15.123:0/1974191154 >> v1:172.21.15.123:6789/0 conn(0x7f3a900b6970 legacy=0x7f3a900b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:05.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.959+0000 7f3a96600640 1 -- 172.21.15.123:0/1974191154 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a900739c0 con 0x7f3a90166730 2024-04-25T13:43:05.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.963+0000 7f3a96600640 1 --2- 172.21.15.123:0/1974191154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a90166730 0x7f3a90168b50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3a88009d90 tx=0x7f3a8801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39782e419c69e354 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:05.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.963+0000 7f3a8fe00640 1 -- 172.21.15.123:0/1974191154 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a880b2070 con 0x7f3a90166730 2024-04-25T13:43:05.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.963+0000 7f3a8fe00640 1 -- 172.21.15.123:0/1974191154 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a880a5920 con 0x7f3a90166730 2024-04-25T13:43:05.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.963+0000 7f3a8fe00640 1 -- 172.21.15.123:0/1974191154 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a880a5cf0 con 0x7f3a90166730 2024-04-25T13:43:05.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.963+0000 7f3a98600640 1 -- 172.21.15.123:0/1974191154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a90166730 msgr2=0x7f3a90168b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:05.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.963+0000 7f3a98600640 1 --2- 172.21.15.123:0/1974191154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a90166730 0x7f3a90168b50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3a88009d90 tx=0x7f3a8801c970 comp rx=0 tx=0).stop 2024-04-25T13:43:05.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.963+0000 7f3a98600640 1 -- 172.21.15.123:0/1974191154 shutdown_connections 2024-04-25T13:43:05.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.963+0000 7f3a98600640 1 --2- 172.21.15.123:0/1974191154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a90166730 0x7f3a90168b50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:05.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.963+0000 7f3a98600640 1 -- 172.21.15.123:0/1974191154 >> 172.21.15.123:0/1974191154 conn(0x7f3a9006d210 msgr2=0x7f3a9006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:05.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.963+0000 7f3a98600640 1 -- 172.21.15.123:0/1974191154 shutdown_connections 2024-04-25T13:43:05.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.963+0000 7f3a98600640 1 -- 172.21.15.123:0/1974191154 wait complete. 2024-04-25T13:43:05.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.967+0000 7f3a98600640 1 Processor -- start 2024-04-25T13:43:05.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.967+0000 7f3a98600640 1 -- start start 2024-04-25T13:43:05.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.967+0000 7f3a98600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a900b6970 0x7f3a900b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:05.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.967+0000 7f3a98600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a901474f0 0x7f3a900b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:05.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.967+0000 7f3a98600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a90166730 0x7f3a900b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:05.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.967+0000 7f3a98600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9016ba30 con 0x7f3a90166730 2024-04-25T13:43:05.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.967+0000 7f3a98600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9016b8b0 con 0x7f3a901474f0 2024-04-25T13:43:05.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.967+0000 7f3a98600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3a9016bbb0 con 0x7f3a900b6970 2024-04-25T13:43:05.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.967+0000 7f3a96600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a90166730 0x7f3a900b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:05.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.967+0000 7f3a96600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a90166730 0x7f3a900b1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47472/0 (socket says 172.21.15.123:47472) 2024-04-25T13:43:05.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.967+0000 7f3a96600640 1 -- 172.21.15.123:0/1414493001 learned_addr learned my addr 172.21.15.123:0/1414493001 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:05.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.967+0000 7f3a95c00640 1 --2- 172.21.15.123:0/1414493001 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a900b6970 0x7f3a900b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:05.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.967+0000 7f3a96600640 1 -- 172.21.15.123:0/1414493001 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a900b6970 msgr2=0x7f3a900b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:05.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.967+0000 7f3a95200640 1 --2- 172.21.15.123:0/1414493001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a901474f0 0x7f3a900b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:05.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.967+0000 7f3a96600640 1 --2- 172.21.15.123:0/1414493001 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a900b6970 0x7f3a900b3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:05.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.967+0000 7f3a96600640 1 -- 172.21.15.123:0/1414493001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a901474f0 msgr2=0x7f3a900b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:05.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.967+0000 7f3a96600640 1 --2- 172.21.15.123:0/1414493001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a901474f0 0x7f3a900b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:05.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.967+0000 7f3a96600640 1 -- 172.21.15.123:0/1414493001 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a900b29e0 con 0x7f3a90166730 2024-04-25T13:43:05.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.967+0000 7f3a95c00640 1 --2- 172.21.15.123:0/1414493001 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a900b6970 0x7f3a900b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:05.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.967+0000 7f3a95200640 1 --2- 172.21.15.123:0/1414493001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a901474f0 0x7f3a900b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:05.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.967+0000 7f3a96600640 1 --2- 172.21.15.123:0/1414493001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a90166730 0x7f3a900b1f60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3a8801a5a0 tx=0x7f3a88019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:05.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.967+0000 7f3a8d600640 1 -- 172.21.15.123:0/1414493001 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a880b2050 con 0x7f3a90166730 2024-04-25T13:43:05.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.967+0000 7f3a8d600640 1 -- 172.21.15.123:0/1414493001 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a880be070 con 0x7f3a90166730 2024-04-25T13:43:05.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.967+0000 7f3a98600640 1 -- 172.21.15.123:0/1414493001 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a900b2cc0 con 0x7f3a90166730 2024-04-25T13:43:05.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.967+0000 7f3a8d600640 1 -- 172.21.15.123:0/1414493001 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a880ad850 con 0x7f3a90166730 2024-04-25T13:43:05.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.967+0000 7f3a98600640 1 -- 172.21.15.123:0/1414493001 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a901f9320 con 0x7f3a90166730 2024-04-25T13:43:05.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.971+0000 7f3a98600640 1 -- 172.21.15.123:0/1414493001 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a900507c0 con 0x7f3a90166730 2024-04-25T13:43:05.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.971+0000 7f3a8d600640 1 -- 172.21.15.123:0/1414493001 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3a880ad9f0 con 0x7f3a90166730 2024-04-25T13:43:05.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.971+0000 7f3a8d600640 1 --2- 172.21.15.123:0/1414493001 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3a7006f400 0x7f3a70071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:05.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.971+0000 7f3a8d600640 1 -- 172.21.15.123:0/1414493001 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3a8812a370 con 0x7f3a90166730 2024-04-25T13:43:05.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.971+0000 7f3a95c00640 1 --2- 172.21.15.123:0/1414493001 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3a7006f400 0x7f3a70071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:05.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.971+0000 7f3a95c00640 1 --2- 172.21.15.123:0/1414493001 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3a7006f400 0x7f3a70071910 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3a84001640 tx=0x7f3a84009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:05.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:05.975+0000 7f3a8d600640 1 -- 172.21.15.123:0/1414493001 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3a88016560 con 0x7f3a90166730 2024-04-25T13:43:06.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.135+0000 7f3a98600640 1 -- 172.21.15.123:0/1414493001 --> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3a900b2770 con 0x7f3a7006f400 2024-04-25T13:43:06.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.143+0000 7f3a8d600640 1 -- 172.21.15.123:0/1414493001 <== mgr.4107 v2:172.21.15.123:6832/715752891 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251936 (secure 0 0 0) 0x7f3a900b2770 con 0x7f3a7006f400 2024-04-25T13:43:06.148 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:06.150 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-04-25T13:43:06.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.147+0000 7f3a98600640 1 -- 172.21.15.123:0/1414493001 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3a7006f400 msgr2=0x7f3a70071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:06.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.147+0000 7f3a98600640 1 --2- 172.21.15.123:0/1414493001 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3a7006f400 0x7f3a70071910 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3a84001640 tx=0x7f3a84009040 comp rx=0 tx=0).stop 2024-04-25T13:43:06.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.147+0000 7f3a98600640 1 -- 172.21.15.123:0/1414493001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a90166730 msgr2=0x7f3a900b1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:06.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.147+0000 7f3a98600640 1 --2- 172.21.15.123:0/1414493001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a90166730 0x7f3a900b1f60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3a8801a5a0 tx=0x7f3a88019710 comp rx=0 tx=0).stop 2024-04-25T13:43:06.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.147+0000 7f3a98600640 1 -- 172.21.15.123:0/1414493001 shutdown_connections 2024-04-25T13:43:06.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.147+0000 7f3a98600640 1 --2- 172.21.15.123:0/1414493001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a901474f0 0x7f3a900b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:06.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.147+0000 7f3a98600640 1 --2- 172.21.15.123:0/1414493001 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3a7006f400 0x7f3a70071910 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:06.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.147+0000 7f3a98600640 1 --2- 172.21.15.123:0/1414493001 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a90166730 0x7f3a900b1f60 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:06.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.147+0000 7f3a98600640 1 --2- 172.21.15.123:0/1414493001 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a900b6970 0x7f3a900b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:06.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.147+0000 7f3a98600640 1 -- 172.21.15.123:0/1414493001 >> 172.21.15.123:0/1414493001 conn(0x7f3a9006d210 msgr2=0x7f3a901673e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:06.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.147+0000 7f3a98600640 1 -- 172.21.15.123:0/1414493001 shutdown_connections 2024-04-25T13:43:06.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.147+0000 7f3a98600640 1 -- 172.21.15.123:0/1414493001 wait complete. 2024-04-25T13:43:06.169 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-04-25T13:43:05.588689+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220348,"kb_used_data":4148,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754372,"statfs":{"total":773094113280,"available":772868476928,"internally_reserved":0,"allocated":4247552,"data_stored":2354776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.564730"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560586+0000","last_change":"2024-04-25T13:43:02.051869+0000","last_active":"2024-04-25T13:43:03.560586+0000","last_peered":"2024-04-25T13:43:03.560586+0000","last_clean":"2024-04-25T13:43:03.560586+0000","last_became_active":"2024-04-25T13:43:02.051514+0000","last_became_peered":"2024-04-25T13:43:02.051514+0000","last_unstale":"2024-04-25T13:43:03.560586+0000","last_undegraded":"2024-04-25T13:43:03.560586+0000","last_fullsized":"2024-04-25T13:43:03.560586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:20.261942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045488+0000","last_change":"2024-04-25T13:43:02.051638+0000","last_active":"2024-04-25T13:43:03.045488+0000","last_peered":"2024-04-25T13:43:03.045488+0000","last_clean":"2024-04-25T13:43:03.045488+0000","last_became_active":"2024-04-25T13:43:02.051264+0000","last_became_peered":"2024-04-25T13:43:02.051264+0000","last_unstale":"2024-04-25T13:43:03.045488+0000","last_undegraded":"2024-04-25T13:43:03.045488+0000","last_fullsized":"2024-04-25T13:43:03.045488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:20.753160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047702+0000","last_change":"2024-04-25T13:43:02.063675+0000","last_active":"2024-04-25T13:43:03.047702+0000","last_peered":"2024-04-25T13:43:03.047702+0000","last_clean":"2024-04-25T13:43:03.047702+0000","last_became_active":"2024-04-25T13:43:02.063035+0000","last_became_peered":"2024-04-25T13:43:02.063035+0000","last_unstale":"2024-04-25T13:43:03.047702+0000","last_undegraded":"2024-04-25T13:43:03.047702+0000","last_fullsized":"2024-04-25T13:43:03.047702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:28.696619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.058360+0000","last_change":"2024-04-25T13:43:02.080374+0000","last_active":"2024-04-25T13:43:03.058360+0000","last_peered":"2024-04-25T13:43:03.058360+0000","last_clean":"2024-04-25T13:43:03.058360+0000","last_became_active":"2024-04-25T13:43:02.079157+0000","last_became_peered":"2024-04-25T13:43:02.079157+0000","last_unstale":"2024-04-25T13:43:03.058360+0000","last_undegraded":"2024-04-25T13:43:03.058360+0000","last_fullsized":"2024-04-25T13:43:03.058360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:35:09.207923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.558630+0000","last_change":"2024-04-25T13:43:02.053811+0000","last_active":"2024-04-25T13:43:03.558630+0000","last_peered":"2024-04-25T13:43:03.558630+0000","last_clean":"2024-04-25T13:43:03.558630+0000","last_became_active":"2024-04-25T13:43:02.053451+0000","last_became_peered":"2024-04-25T13:43:02.053451+0000","last_unstale":"2024-04-25T13:43:03.558630+0000","last_undegraded":"2024-04-25T13:43:03.558630+0000","last_fullsized":"2024-04-25T13:43:03.558630+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:08.711087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045347+0000","last_change":"2024-04-25T13:43:02.056305+0000","last_active":"2024-04-25T13:43:03.045347+0000","last_peered":"2024-04-25T13:43:03.045347+0000","last_clean":"2024-04-25T13:43:03.045347+0000","last_became_active":"2024-04-25T13:43:02.055991+0000","last_became_peered":"2024-04-25T13:43:02.055991+0000","last_unstale":"2024-04-25T13:43:03.045347+0000","last_undegraded":"2024-04-25T13:43:03.045347+0000","last_fullsized":"2024-04-25T13:43:03.045347+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:09.182621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047031+0000","last_change":"2024-04-25T13:43:02.061040+0000","last_active":"2024-04-25T13:43:03.047031+0000","last_peered":"2024-04-25T13:43:03.047031+0000","last_clean":"2024-04-25T13:43:03.047031+0000","last_became_active":"2024-04-25T13:43:02.059462+0000","last_became_peered":"2024-04-25T13:43:02.059462+0000","last_unstale":"2024-04-25T13:43:03.047031+0000","last_undegraded":"2024-04-25T13:43:03.047031+0000","last_fullsized":"2024-04-25T13:43:03.047031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:08.832240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.046797+0000","last_change":"2024-04-25T13:43:02.053566+0000","last_active":"2024-04-25T13:43:03.046797+0000","last_peered":"2024-04-25T13:43:03.046797+0000","last_clean":"2024-04-25T13:43:03.046797+0000","last_became_active":"2024-04-25T13:43:02.053275+0000","last_became_peered":"2024-04-25T13:43:02.053275+0000","last_unstale":"2024-04-25T13:43:03.046797+0000","last_undegraded":"2024-04-25T13:43:03.046797+0000","last_fullsized":"2024-04-25T13:43:03.046797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:20.753160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560279+0000","last_change":"2024-04-25T13:43:02.066220+0000","last_active":"2024-04-25T13:43:03.560279+0000","last_peered":"2024-04-25T13:43:03.560279+0000","last_clean":"2024-04-25T13:43:03.560279+0000","last_became_active":"2024-04-25T13:43:02.065796+0000","last_became_peered":"2024-04-25T13:43:02.065796+0000","last_unstale":"2024-04-25T13:43:03.560279+0000","last_undegraded":"2024-04-25T13:43:03.560279+0000","last_fullsized":"2024-04-25T13:43:03.560279+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:32.812037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.058844+0000","last_change":"2024-04-25T13:43:02.071704+0000","last_active":"2024-04-25T13:43:03.058844+0000","last_peered":"2024-04-25T13:43:03.058844+0000","last_clean":"2024-04-25T13:43:03.058844+0000","last_became_active":"2024-04-25T13:43:02.069348+0000","last_became_peered":"2024-04-25T13:43:02.069348+0000","last_unstale":"2024-04-25T13:43:03.058844+0000","last_undegraded":"2024-04-25T13:43:03.058844+0000","last_fullsized":"2024-04-25T13:43:03.058844+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:09.905281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047698+0000","last_change":"2024-04-25T13:43:02.065416+0000","last_active":"2024-04-25T13:43:03.047698+0000","last_peered":"2024-04-25T13:43:03.047698+0000","last_clean":"2024-04-25T13:43:03.047698+0000","last_became_active":"2024-04-25T13:43:02.064993+0000","last_became_peered":"2024-04-25T13:43:02.064993+0000","last_unstale":"2024-04-25T13:43:03.047698+0000","last_undegraded":"2024-04-25T13:43:03.047698+0000","last_fullsized":"2024-04-25T13:43:03.047698+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:01.861396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.046959+0000","last_change":"2024-04-25T13:43:02.057735+0000","last_active":"2024-04-25T13:43:03.046959+0000","last_peered":"2024-04-25T13:43:03.046959+0000","last_clean":"2024-04-25T13:43:03.046959+0000","last_became_active":"2024-04-25T13:43:02.057413+0000","last_became_peered":"2024-04-25T13:43:02.057413+0000","last_unstale":"2024-04-25T13:43:03.046959+0000","last_undegraded":"2024-04-25T13:43:03.046959+0000","last_fullsized":"2024-04-25T13:43:03.046959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:23:07.440759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.558567+0000","last_change":"2024-04-25T13:43:02.065192+0000","last_active":"2024-04-25T13:43:03.558567+0000","last_peered":"2024-04-25T13:43:03.558567+0000","last_clean":"2024-04-25T13:43:03.558567+0000","last_became_active":"2024-04-25T13:43:02.064869+0000","last_became_peered":"2024-04-25T13:43:02.064869+0000","last_unstale":"2024-04-25T13:43:03.558567+0000","last_undegraded":"2024-04-25T13:43:03.558567+0000","last_fullsized":"2024-04-25T13:43:03.558567+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:00.670986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045121+0000","last_change":"2024-04-25T13:43:02.052791+0000","last_active":"2024-04-25T13:43:03.045121+0000","last_peered":"2024-04-25T13:43:03.045121+0000","last_clean":"2024-04-25T13:43:03.045121+0000","last_became_active":"2024-04-25T13:43:02.052412+0000","last_became_peered":"2024-04-25T13:43:02.052412+0000","last_unstale":"2024-04-25T13:43:03.045121+0000","last_undegraded":"2024-04-25T13:43:03.045121+0000","last_fullsized":"2024-04-25T13:43:03.045121+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:23:07.440759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047643+0000","last_change":"2024-04-25T13:43:02.060557+0000","last_active":"2024-04-25T13:43:03.047643+0000","last_peered":"2024-04-25T13:43:03.047643+0000","last_clean":"2024-04-25T13:43:03.047643+0000","last_became_active":"2024-04-25T13:43:02.060258+0000","last_became_peered":"2024-04-25T13:43:02.060258+0000","last_unstale":"2024-04-25T13:43:03.047643+0000","last_undegraded":"2024-04-25T13:43:03.047643+0000","last_fullsized":"2024-04-25T13:43:03.047643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:08.832240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.048064+0000","last_change":"2024-04-25T13:43:02.057624+0000","last_active":"2024-04-25T13:43:03.048064+0000","last_peered":"2024-04-25T13:43:03.048064+0000","last_clean":"2024-04-25T13:43:03.048064+0000","last_became_active":"2024-04-25T13:43:02.057292+0000","last_became_peered":"2024-04-25T13:43:02.057292+0000","last_unstale":"2024-04-25T13:43:03.048064+0000","last_undegraded":"2024-04-25T13:43:03.048064+0000","last_fullsized":"2024-04-25T13:43:03.048064+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:04.232103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.046745+0000","last_change":"2024-04-25T13:43:02.055942+0000","last_active":"2024-04-25T13:43:03.046745+0000","last_peered":"2024-04-25T13:43:03.046745+0000","last_clean":"2024-04-25T13:43:03.046745+0000","last_became_active":"2024-04-25T13:43:02.055594+0000","last_became_peered":"2024-04-25T13:43:02.055594+0000","last_unstale":"2024-04-25T13:43:03.046745+0000","last_undegraded":"2024-04-25T13:43:03.046745+0000","last_fullsized":"2024-04-25T13:43:03.046745+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:09.182621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045693+0000","last_change":"2024-04-25T13:43:02.066985+0000","last_active":"2024-04-25T13:43:03.045693+0000","last_peered":"2024-04-25T13:43:03.045693+0000","last_clean":"2024-04-25T13:43:03.045693+0000","last_became_active":"2024-04-25T13:43:02.066649+0000","last_became_peered":"2024-04-25T13:43:02.066649+0000","last_unstale":"2024-04-25T13:43:03.045693+0000","last_undegraded":"2024-04-25T13:43:03.045693+0000","last_fullsized":"2024-04-25T13:43:03.045693+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:28.696619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045218+0000","last_change":"2024-04-25T13:43:02.066056+0000","last_active":"2024-04-25T13:43:03.045218+0000","last_peered":"2024-04-25T13:43:03.045218+0000","last_clean":"2024-04-25T13:43:03.045218+0000","last_became_active":"2024-04-25T13:43:02.064152+0000","last_became_peered":"2024-04-25T13:43:02.064152+0000","last_unstale":"2024-04-25T13:43:03.045218+0000","last_undegraded":"2024-04-25T13:43:03.045218+0000","last_fullsized":"2024-04-25T13:43:03.045218+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:38.962784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.558749+0000","last_change":"2024-04-25T13:43:02.066624+0000","last_active":"2024-04-25T13:43:03.558749+0000","last_peered":"2024-04-25T13:43:03.558749+0000","last_clean":"2024-04-25T13:43:03.558749+0000","last_became_active":"2024-04-25T13:43:02.066264+0000","last_became_peered":"2024-04-25T13:43:02.066264+0000","last_unstale":"2024-04-25T13:43:03.558749+0000","last_undegraded":"2024-04-25T13:43:03.558749+0000","last_fullsized":"2024-04-25T13:43:03.558749+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:36.556870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.559868+0000","last_change":"2024-04-25T13:43:02.052444+0000","last_active":"2024-04-25T13:43:03.559868+0000","last_peered":"2024-04-25T13:43:03.559868+0000","last_clean":"2024-04-25T13:43:03.559868+0000","last_became_active":"2024-04-25T13:43:02.051977+0000","last_became_peered":"2024-04-25T13:43:02.051977+0000","last_unstale":"2024-04-25T13:43:03.559868+0000","last_undegraded":"2024-04-25T13:43:03.559868+0000","last_fullsized":"2024-04-25T13:43:03.559868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:07.905899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.559783+0000","last_change":"2024-04-25T13:43:02.053466+0000","last_active":"2024-04-25T13:43:03.559783+0000","last_peered":"2024-04-25T13:43:03.559783+0000","last_clean":"2024-04-25T13:43:03.559783+0000","last_became_active":"2024-04-25T13:43:02.053136+0000","last_became_peered":"2024-04-25T13:43:02.053136+0000","last_unstale":"2024-04-25T13:43:03.559783+0000","last_undegraded":"2024-04-25T13:43:03.559783+0000","last_fullsized":"2024-04-25T13:43:03.559783+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:48.423743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.055669+0000","last_change":"2024-04-25T13:43:02.059399+0000","last_active":"2024-04-25T13:43:03.055669+0000","last_peered":"2024-04-25T13:43:03.055669+0000","last_clean":"2024-04-25T13:43:03.055669+0000","last_became_active":"2024-04-25T13:43:02.056232+0000","last_became_peered":"2024-04-25T13:43:02.056232+0000","last_unstale":"2024-04-25T13:43:03.055669+0000","last_undegraded":"2024-04-25T13:43:03.055669+0000","last_fullsized":"2024-04-25T13:43:03.055669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:23:32.253286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047758+0000","last_change":"2024-04-25T13:43:02.044735+0000","last_active":"2024-04-25T13:43:03.047758+0000","last_peered":"2024-04-25T13:43:03.047758+0000","last_clean":"2024-04-25T13:43:03.047758+0000","last_became_active":"2024-04-25T13:43:02.044482+0000","last_became_peered":"2024-04-25T13:43:02.044482+0000","last_unstale":"2024-04-25T13:43:03.047758+0000","last_undegraded":"2024-04-25T13:43:03.047758+0000","last_fullsized":"2024-04-25T13:43:03.047758+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:30:31.687953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.059028+0000","last_change":"2024-04-25T13:43:02.064046+0000","last_active":"2024-04-25T13:43:03.059028+0000","last_peered":"2024-04-25T13:43:03.059028+0000","last_clean":"2024-04-25T13:43:03.059028+0000","last_became_active":"2024-04-25T13:43:02.063603+0000","last_became_peered":"2024-04-25T13:43:02.063603+0000","last_unstale":"2024-04-25T13:43:03.059028+0000","last_undegraded":"2024-04-25T13:43:03.059028+0000","last_fullsized":"2024-04-25T13:43:03.059028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:23:07.440759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045686+0000","last_change":"2024-04-25T13:43:02.065311+0000","last_active":"2024-04-25T13:43:03.045686+0000","last_peered":"2024-04-25T13:43:03.045686+0000","last_clean":"2024-04-25T13:43:03.045686+0000","last_became_active":"2024-04-25T13:43:02.060068+0000","last_became_peered":"2024-04-25T13:43:02.060068+0000","last_unstale":"2024-04-25T13:43:03.045686+0000","last_undegraded":"2024-04-25T13:43:03.045686+0000","last_fullsized":"2024-04-25T13:43:03.045686+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:08.832240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.058913+0000","last_change":"2024-04-25T13:43:02.076015+0000","last_active":"2024-04-25T13:43:03.058913+0000","last_peered":"2024-04-25T13:43:03.058913+0000","last_clean":"2024-04-25T13:43:03.058913+0000","last_became_active":"2024-04-25T13:43:02.075624+0000","last_became_peered":"2024-04-25T13:43:02.075624+0000","last_unstale":"2024-04-25T13:43:03.058913+0000","last_undegraded":"2024-04-25T13:43:03.058913+0000","last_fullsized":"2024-04-25T13:43:03.058913+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:34:26.744118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047146+0000","last_change":"2024-04-25T13:43:02.050373+0000","last_active":"2024-04-25T13:43:03.047146+0000","last_peered":"2024-04-25T13:43:03.047146+0000","last_clean":"2024-04-25T13:43:03.047146+0000","last_became_active":"2024-04-25T13:43:02.050071+0000","last_became_peered":"2024-04-25T13:43:02.050071+0000","last_unstale":"2024-04-25T13:43:03.047146+0000","last_undegraded":"2024-04-25T13:43:03.047146+0000","last_fullsized":"2024-04-25T13:43:03.047146+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:38.962784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560625+0000","last_change":"2024-04-25T13:43:02.052220+0000","last_active":"2024-04-25T13:43:03.560625+0000","last_peered":"2024-04-25T13:43:03.560625+0000","last_clean":"2024-04-25T13:43:03.560625+0000","last_became_active":"2024-04-25T13:43:02.051631+0000","last_became_peered":"2024-04-25T13:43:02.051631+0000","last_unstale":"2024-04-25T13:43:03.560625+0000","last_undegraded":"2024-04-25T13:43:03.560625+0000","last_fullsized":"2024-04-25T13:43:03.560625+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:58.157888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.046524+0000","last_change":"2024-04-25T13:43:02.059639+0000","last_active":"2024-04-25T13:43:03.046524+0000","last_peered":"2024-04-25T13:43:03.046524+0000","last_clean":"2024-04-25T13:43:03.046524+0000","last_became_active":"2024-04-25T13:43:02.059142+0000","last_became_peered":"2024-04-25T13:43:02.059142+0000","last_unstale":"2024-04-25T13:43:03.046524+0000","last_undegraded":"2024-04-25T13:43:03.046524+0000","last_fullsized":"2024-04-25T13:43:03.046524+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:34:26.744118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560376+0000","last_change":"2024-04-25T13:43:02.053187+0000","last_active":"2024-04-25T13:43:03.560376+0000","last_peered":"2024-04-25T13:43:03.560376+0000","last_clean":"2024-04-25T13:43:03.560376+0000","last_became_active":"2024-04-25T13:43:02.052854+0000","last_became_peered":"2024-04-25T13:43:02.052854+0000","last_unstale":"2024-04-25T13:43:03.560376+0000","last_undegraded":"2024-04-25T13:43:03.560376+0000","last_fullsized":"2024-04-25T13:43:03.560376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:14:16.082236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.046581+0000","last_change":"2024-04-25T13:43:02.052600+0000","last_active":"2024-04-25T13:43:03.046581+0000","last_peered":"2024-04-25T13:43:03.046581+0000","last_clean":"2024-04-25T13:43:03.046581+0000","last_became_active":"2024-04-25T13:43:02.051127+0000","last_became_peered":"2024-04-25T13:43:02.051127+0000","last_unstale":"2024-04-25T13:43:03.046581+0000","last_undegraded":"2024-04-25T13:43:03.046581+0000","last_fullsized":"2024-04-25T13:43:03.046581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:38.962784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.055796+0000","last_change":"2024-04-25T13:43:02.049860+0000","last_active":"2024-04-25T13:43:03.055796+0000","last_peered":"2024-04-25T13:43:03.055796+0000","last_clean":"2024-04-25T13:43:03.055796+0000","last_became_active":"2024-04-25T13:43:02.049068+0000","last_became_peered":"2024-04-25T13:43:02.049068+0000","last_unstale":"2024-04-25T13:43:03.055796+0000","last_undegraded":"2024-04-25T13:43:03.055796+0000","last_fullsized":"2024-04-25T13:43:03.055796+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:21.042238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560807+0000","last_change":"2024-04-25T13:43:01.059124+0000","last_active":"2024-04-25T13:43:03.560807+0000","last_peered":"2024-04-25T13:43:03.560807+0000","last_clean":"2024-04-25T13:43:03.560807+0000","last_became_active":"2024-04-25T13:43:01.058781+0000","last_became_peered":"2024-04-25T13:43:01.058781+0000","last_unstale":"2024-04-25T13:43:03.560807+0000","last_undegraded":"2024-04-25T13:43:03.560807+0000","last_fullsized":"2024-04-25T13:43:03.560807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:59.665263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560736+0000","last_change":"2024-04-25T13:43:02.068282+0000","last_active":"2024-04-25T13:43:03.560736+0000","last_peered":"2024-04-25T13:43:03.560736+0000","last_clean":"2024-04-25T13:43:03.560736+0000","last_became_active":"2024-04-25T13:43:02.067963+0000","last_became_peered":"2024-04-25T13:43:02.067963+0000","last_unstale":"2024-04-25T13:43:03.560736+0000","last_undegraded":"2024-04-25T13:43:03.560736+0000","last_fullsized":"2024-04-25T13:43:03.560736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:23:32.253286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.055867+0000","last_change":"2024-04-25T13:43:01.054989+0000","last_active":"2024-04-25T13:43:03.055867+0000","last_peered":"2024-04-25T13:43:03.055867+0000","last_clean":"2024-04-25T13:43:03.055867+0000","last_became_active":"2024-04-25T13:43:01.054486+0000","last_became_peered":"2024-04-25T13:43:01.054486+0000","last_unstale":"2024-04-25T13:43:03.055867+0000","last_undegraded":"2024-04-25T13:43:03.055867+0000","last_fullsized":"2024-04-25T13:43:03.055867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:22.871357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560130+0000","last_change":"2024-04-25T13:43:02.064177+0000","last_active":"2024-04-25T13:43:03.560130+0000","last_peered":"2024-04-25T13:43:03.560130+0000","last_clean":"2024-04-25T13:43:03.560130+0000","last_became_active":"2024-04-25T13:43:02.063821+0000","last_became_peered":"2024-04-25T13:43:02.063821+0000","last_unstale":"2024-04-25T13:43:03.560130+0000","last_undegraded":"2024-04-25T13:43:03.560130+0000","last_fullsized":"2024-04-25T13:43:03.560130+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:44:46.062558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045459+0000","last_change":"2024-04-25T13:43:01.054928+0000","last_active":"2024-04-25T13:43:03.045459+0000","last_peered":"2024-04-25T13:43:03.045459+0000","last_clean":"2024-04-25T13:43:03.045459+0000","last_became_active":"2024-04-25T13:43:01.054633+0000","last_became_peered":"2024-04-25T13:43:01.054633+0000","last_unstale":"2024-04-25T13:43:03.045459+0000","last_undegraded":"2024-04-25T13:43:03.045459+0000","last_fullsized":"2024-04-25T13:43:03.045459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:20.036515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.058905+0000","last_change":"2024-04-25T13:43:02.075951+0000","last_active":"2024-04-25T13:43:03.058905+0000","last_peered":"2024-04-25T13:43:03.058905+0000","last_clean":"2024-04-25T13:43:03.058905+0000","last_became_active":"2024-04-25T13:43:02.075469+0000","last_became_peered":"2024-04-25T13:43:02.075469+0000","last_unstale":"2024-04-25T13:43:03.058905+0000","last_undegraded":"2024-04-25T13:43:03.058905+0000","last_fullsized":"2024-04-25T13:43:03.058905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:06.767611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.558684+0000","last_change":"2024-04-25T13:43:01.055674+0000","last_active":"2024-04-25T13:43:03.558684+0000","last_peered":"2024-04-25T13:43:03.558684+0000","last_clean":"2024-04-25T13:43:03.558684+0000","last_became_active":"2024-04-25T13:43:01.055357+0000","last_became_peered":"2024-04-25T13:43:01.055357+0000","last_unstale":"2024-04-25T13:43:03.558684+0000","last_undegraded":"2024-04-25T13:43:03.558684+0000","last_fullsized":"2024-04-25T13:43:03.558684+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:50.267632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047347+0000","last_change":"2024-04-25T13:43:02.056764+0000","last_active":"2024-04-25T13:43:03.047347+0000","last_peered":"2024-04-25T13:43:03.047347+0000","last_clean":"2024-04-25T13:43:03.047347+0000","last_became_active":"2024-04-25T13:43:02.056399+0000","last_became_peered":"2024-04-25T13:43:02.056399+0000","last_unstale":"2024-04-25T13:43:03.047347+0000","last_undegraded":"2024-04-25T13:43:03.047347+0000","last_fullsized":"2024-04-25T13:43:03.047347+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:28.696619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560303+0000","last_change":"2024-04-25T13:43:01.046596+0000","last_active":"2024-04-25T13:43:03.560303+0000","last_peered":"2024-04-25T13:43:03.560303+0000","last_clean":"2024-04-25T13:43:03.560303+0000","last_became_active":"2024-04-25T13:43:01.046199+0000","last_became_peered":"2024-04-25T13:43:01.046199+0000","last_unstale":"2024-04-25T13:43:03.560303+0000","last_undegraded":"2024-04-25T13:43:03.560303+0000","last_fullsized":"2024-04-25T13:43:03.560303+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:35.551147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.046897+0000","last_change":"2024-04-25T13:43:02.047735+0000","last_active":"2024-04-25T13:43:03.046897+0000","last_peered":"2024-04-25T13:43:03.046897+0000","last_clean":"2024-04-25T13:43:03.046897+0000","last_became_active":"2024-04-25T13:43:02.047328+0000","last_became_peered":"2024-04-25T13:43:02.047328+0000","last_unstale":"2024-04-25T13:43:03.046897+0000","last_undegraded":"2024-04-25T13:43:03.046897+0000","last_fullsized":"2024-04-25T13:43:03.046897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:34:26.744118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.559845+0000","last_change":"2024-04-25T13:43:01.045268+0000","last_active":"2024-04-25T13:43:03.559845+0000","last_peered":"2024-04-25T13:43:03.559845+0000","last_clean":"2024-04-25T13:43:03.559845+0000","last_became_active":"2024-04-25T13:43:01.044900+0000","last_became_peered":"2024-04-25T13:43:01.044900+0000","last_unstale":"2024-04-25T13:43:03.559845+0000","last_undegraded":"2024-04-25T13:43:03.559845+0000","last_fullsized":"2024-04-25T13:43:03.559845+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:41.806040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.559744+0000","last_change":"2024-04-25T13:43:02.057846+0000","last_active":"2024-04-25T13:43:03.559744+0000","last_peered":"2024-04-25T13:43:03.559744+0000","last_clean":"2024-04-25T13:43:03.559744+0000","last_became_active":"2024-04-25T13:43:02.057547+0000","last_became_peered":"2024-04-25T13:43:02.057547+0000","last_unstale":"2024-04-25T13:43:03.559744+0000","last_undegraded":"2024-04-25T13:43:03.559744+0000","last_fullsized":"2024-04-25T13:43:03.559744+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:05.648828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045102+0000","last_change":"2024-04-25T13:43:01.050120+0000","last_active":"2024-04-25T13:43:03.045102+0000","last_peered":"2024-04-25T13:43:03.045102+0000","last_clean":"2024-04-25T13:43:03.045102+0000","last_became_active":"2024-04-25T13:43:01.049801+0000","last_became_peered":"2024-04-25T13:43:01.049801+0000","last_unstale":"2024-04-25T13:43:03.045102+0000","last_undegraded":"2024-04-25T13:43:03.045102+0000","last_fullsized":"2024-04-25T13:43:03.045102+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:14:15.076513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.058260+0000","last_change":"2024-04-25T13:43:02.052750+0000","last_active":"2024-04-25T13:43:03.058260+0000","last_peered":"2024-04-25T13:43:03.058260+0000","last_clean":"2024-04-25T13:43:03.058260+0000","last_became_active":"2024-04-25T13:43:02.052409+0000","last_became_peered":"2024-04-25T13:43:02.052409+0000","last_unstale":"2024-04-25T13:43:03.058260+0000","last_undegraded":"2024-04-25T13:43:03.058260+0000","last_fullsized":"2024-04-25T13:43:03.058260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:32.812037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560117+0000","last_change":"2024-04-25T13:43:01.047582+0000","last_active":"2024-04-25T13:43:03.560117+0000","last_peered":"2024-04-25T13:43:03.560117+0000","last_clean":"2024-04-25T13:43:03.560117+0000","last_became_active":"2024-04-25T13:43:01.047309+0000","last_became_peered":"2024-04-25T13:43:01.047309+0000","last_unstale":"2024-04-25T13:43:03.560117+0000","last_undegraded":"2024-04-25T13:43:03.560117+0000","last_fullsized":"2024-04-25T13:43:03.560117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:07.705363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047716+0000","last_change":"2024-04-25T13:43:02.061334+0000","last_active":"2024-04-25T13:43:03.047716+0000","last_peered":"2024-04-25T13:43:03.047716+0000","last_clean":"2024-04-25T13:43:03.047716+0000","last_became_active":"2024-04-25T13:43:02.061037+0000","last_became_peered":"2024-04-25T13:43:02.061037+0000","last_unstale":"2024-04-25T13:43:03.047716+0000","last_undegraded":"2024-04-25T13:43:03.047716+0000","last_fullsized":"2024-04-25T13:43:03.047716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:01.861396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045783+0000","last_change":"2024-04-25T13:43:01.053326+0000","last_active":"2024-04-25T13:43:03.045783+0000","last_peered":"2024-04-25T13:43:03.045783+0000","last_clean":"2024-04-25T13:43:03.045783+0000","last_became_active":"2024-04-25T13:43:01.050687+0000","last_became_peered":"2024-04-25T13:43:01.050687+0000","last_unstale":"2024-04-25T13:43:03.045783+0000","last_undegraded":"2024-04-25T13:43:03.045783+0000","last_fullsized":"2024-04-25T13:43:03.045783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:04.643105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045757+0000","last_change":"2024-04-25T13:43:02.066148+0000","last_active":"2024-04-25T13:43:03.045757+0000","last_peered":"2024-04-25T13:43:03.045757+0000","last_clean":"2024-04-25T13:43:03.045757+0000","last_became_active":"2024-04-25T13:43:02.065862+0000","last_became_peered":"2024-04-25T13:43:02.065862+0000","last_unstale":"2024-04-25T13:43:03.045757+0000","last_undegraded":"2024-04-25T13:43:03.045757+0000","last_fullsized":"2024-04-25T13:43:03.045757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:01.861396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.055896+0000","last_change":"2024-04-25T13:43:01.054530+0000","last_active":"2024-04-25T13:43:03.055896+0000","last_peered":"2024-04-25T13:43:03.055896+0000","last_clean":"2024-04-25T13:43:03.055896+0000","last_became_active":"2024-04-25T13:43:01.053775+0000","last_became_peered":"2024-04-25T13:43:01.053775+0000","last_unstale":"2024-04-25T13:43:03.055896+0000","last_undegraded":"2024-04-25T13:43:03.055896+0000","last_fullsized":"2024-04-25T13:43:03.055896+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:23:42.245443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045856+0000","last_change":"2024-04-25T13:43:02.055473+0000","last_active":"2024-04-25T13:43:03.045856+0000","last_peered":"2024-04-25T13:43:03.045856+0000","last_clean":"2024-04-25T13:43:03.045856+0000","last_became_active":"2024-04-25T13:43:02.050454+0000","last_became_peered":"2024-04-25T13:43:02.050454+0000","last_unstale":"2024-04-25T13:43:03.045856+0000","last_undegraded":"2024-04-25T13:43:03.045856+0000","last_fullsized":"2024-04-25T13:43:03.045856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:30:31.687953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047677+0000","last_change":"2024-04-25T13:43:01.053183+0000","last_active":"2024-04-25T13:43:03.047677+0000","last_peered":"2024-04-25T13:43:03.047677+0000","last_clean":"2024-04-25T13:43:03.047677+0000","last_became_active":"2024-04-25T13:43:01.052868+0000","last_became_peered":"2024-04-25T13:43:01.052868+0000","last_unstale":"2024-04-25T13:43:03.047677+0000","last_undegraded":"2024-04-25T13:43:03.047677+0000","last_fullsized":"2024-04-25T13:43:03.047677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:15.253634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047541+0000","last_change":"2024-04-25T13:43:02.065620+0000","last_active":"2024-04-25T13:43:03.047541+0000","last_peered":"2024-04-25T13:43:03.047541+0000","last_clean":"2024-04-25T13:43:03.047541+0000","last_became_active":"2024-04-25T13:43:02.063428+0000","last_became_peered":"2024-04-25T13:43:02.063428+0000","last_unstale":"2024-04-25T13:43:03.047541+0000","last_undegraded":"2024-04-25T13:43:03.047541+0000","last_fullsized":"2024-04-25T13:43:03.047541+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:20.753160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045412+0000","last_change":"2024-04-25T13:43:01.055574+0000","last_active":"2024-04-25T13:43:03.045412+0000","last_peered":"2024-04-25T13:43:03.045412+0000","last_clean":"2024-04-25T13:43:03.045412+0000","last_became_active":"2024-04-25T13:43:01.055291+0000","last_became_peered":"2024-04-25T13:43:01.055291+0000","last_unstale":"2024-04-25T13:43:03.045412+0000","last_undegraded":"2024-04-25T13:43:03.045412+0000","last_fullsized":"2024-04-25T13:43:03.045412+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:15.253634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.058286+0000","last_change":"2024-04-25T13:43:02.058150+0000","last_active":"2024-04-25T13:43:03.058286+0000","last_peered":"2024-04-25T13:43:03.058286+0000","last_clean":"2024-04-25T13:43:03.058286+0000","last_became_active":"2024-04-25T13:43:02.057841+0000","last_became_peered":"2024-04-25T13:43:02.057841+0000","last_unstale":"2024-04-25T13:43:03.058286+0000","last_undegraded":"2024-04-25T13:43:03.058286+0000","last_fullsized":"2024-04-25T13:43:03.058286+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:58.157888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560436+0000","last_change":"2024-04-25T13:43:01.047523+0000","last_active":"2024-04-25T13:43:03.560436+0000","last_peered":"2024-04-25T13:43:03.560436+0000","last_clean":"2024-04-25T13:43:03.560436+0000","last_became_active":"2024-04-25T13:43:01.047235+0000","last_became_peered":"2024-04-25T13:43:01.047235+0000","last_unstale":"2024-04-25T13:43:03.560436+0000","last_undegraded":"2024-04-25T13:43:03.560436+0000","last_fullsized":"2024-04-25T13:43:03.560436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:23:42.245443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045346+0000","last_change":"2024-04-25T13:43:02.049588+0000","last_active":"2024-04-25T13:43:03.045346+0000","last_peered":"2024-04-25T13:43:03.045346+0000","last_clean":"2024-04-25T13:43:03.045346+0000","last_became_active":"2024-04-25T13:43:02.049210+0000","last_became_peered":"2024-04-25T13:43:02.049210+0000","last_unstale":"2024-04-25T13:43:03.045346+0000","last_undegraded":"2024-04-25T13:43:03.045346+0000","last_fullsized":"2024-04-25T13:43:03.045346+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:21.006899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.058418+0000","last_change":"2024-04-25T13:43:01.061145+0000","last_active":"2024-04-25T13:43:03.058418+0000","last_peered":"2024-04-25T13:43:03.058418+0000","last_clean":"2024-04-25T13:43:03.058418+0000","last_became_active":"2024-04-25T13:43:01.060386+0000","last_became_peered":"2024-04-25T13:43:01.060386+0000","last_unstale":"2024-04-25T13:43:03.058418+0000","last_undegraded":"2024-04-25T13:43:03.058418+0000","last_fullsized":"2024-04-25T13:43:03.058418+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:24.624016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.046794+0000","last_change":"2024-04-25T13:43:02.056912+0000","last_active":"2024-04-25T13:43:03.046794+0000","last_peered":"2024-04-25T13:43:03.046794+0000","last_clean":"2024-04-25T13:43:03.046794+0000","last_became_active":"2024-04-25T13:43:02.056448+0000","last_became_peered":"2024-04-25T13:43:02.056448+0000","last_unstale":"2024-04-25T13:43:03.046794+0000","last_undegraded":"2024-04-25T13:43:03.046794+0000","last_fullsized":"2024-04-25T13:43:03.046794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:21.006899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045139+0000","last_change":"2024-04-25T13:43:01.048740+0000","last_active":"2024-04-25T13:43:03.045139+0000","last_peered":"2024-04-25T13:43:03.045139+0000","last_clean":"2024-04-25T13:43:03.045139+0000","last_became_active":"2024-04-25T13:43:01.048301+0000","last_became_peered":"2024-04-25T13:43:01.048301+0000","last_unstale":"2024-04-25T13:43:03.045139+0000","last_undegraded":"2024-04-25T13:43:03.045139+0000","last_fullsized":"2024-04-25T13:43:03.045139+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:23:31.247563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560597+0000","last_change":"2024-04-25T13:43:02.058770+0000","last_active":"2024-04-25T13:43:03.560597+0000","last_peered":"2024-04-25T13:43:03.560597+0000","last_clean":"2024-04-25T13:43:03.560597+0000","last_became_active":"2024-04-25T13:43:02.058406+0000","last_became_peered":"2024-04-25T13:43:02.058406+0000","last_unstale":"2024-04-25T13:43:03.560597+0000","last_undegraded":"2024-04-25T13:43:03.560597+0000","last_fullsized":"2024-04-25T13:43:03.560597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:40.818979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045068+0000","last_change":"2024-04-25T13:43:01.055163+0000","last_active":"2024-04-25T13:43:03.045068+0000","last_peered":"2024-04-25T13:43:03.045068+0000","last_clean":"2024-04-25T13:43:03.045068+0000","last_became_active":"2024-04-25T13:43:01.054848+0000","last_became_peered":"2024-04-25T13:43:01.054848+0000","last_unstale":"2024-04-25T13:43:03.045068+0000","last_undegraded":"2024-04-25T13:43:03.045068+0000","last_fullsized":"2024-04-25T13:43:03.045068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:39.813256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560969+0000","last_change":"2024-04-25T13:43:02.050680+0000","last_active":"2024-04-25T13:43:03.560969+0000","last_peered":"2024-04-25T13:43:03.560969+0000","last_clean":"2024-04-25T13:43:03.560969+0000","last_became_active":"2024-04-25T13:43:02.050292+0000","last_became_peered":"2024-04-25T13:43:02.050292+0000","last_unstale":"2024-04-25T13:43:03.560969+0000","last_undegraded":"2024-04-25T13:43:03.560969+0000","last_fullsized":"2024-04-25T13:43:03.560969+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:35:09.207923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.059215+0000","last_change":"2024-04-25T13:43:01.058233+0000","last_active":"2024-04-25T13:43:03.059215+0000","last_peered":"2024-04-25T13:43:03.059215+0000","last_clean":"2024-04-25T13:43:03.059215+0000","last_became_active":"2024-04-25T13:43:01.057838+0000","last_became_peered":"2024-04-25T13:43:01.057838+0000","last_unstale":"2024-04-25T13:43:03.059215+0000","last_undegraded":"2024-04-25T13:43:03.059215+0000","last_fullsized":"2024-04-25T13:43:03.059215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:20.036515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047411+0000","last_change":"2024-04-25T13:43:02.048953+0000","last_active":"2024-04-25T13:43:03.047411+0000","last_peered":"2024-04-25T13:43:03.047411+0000","last_clean":"2024-04-25T13:43:03.047411+0000","last_became_active":"2024-04-25T13:43:02.048690+0000","last_became_peered":"2024-04-25T13:43:02.048690+0000","last_unstale":"2024-04-25T13:43:03.047411+0000","last_undegraded":"2024-04-25T13:43:03.047411+0000","last_fullsized":"2024-04-25T13:43:03.047411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:09.182621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.561005+0000","last_change":"2024-04-25T13:43:01.047243+0000","last_active":"2024-04-25T13:43:03.561005+0000","last_peered":"2024-04-25T13:43:03.561005+0000","last_clean":"2024-04-25T13:43:03.561005+0000","last_became_active":"2024-04-25T13:43:01.045745+0000","last_became_peered":"2024-04-25T13:43:01.045745+0000","last_unstale":"2024-04-25T13:43:03.561005+0000","last_undegraded":"2024-04-25T13:43:03.561005+0000","last_fullsized":"2024-04-25T13:43:03.561005+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:41.123880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.058535+0000","last_change":"2024-04-25T13:43:02.080537+0000","last_active":"2024-04-25T13:43:03.058535+0000","last_peered":"2024-04-25T13:43:03.058535+0000","last_clean":"2024-04-25T13:43:03.058535+0000","last_became_active":"2024-04-25T13:43:02.079575+0000","last_became_peered":"2024-04-25T13:43:02.079575+0000","last_unstale":"2024-04-25T13:43:03.058535+0000","last_undegraded":"2024-04-25T13:43:03.058535+0000","last_fullsized":"2024-04-25T13:43:03.058535+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:22.883374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560406+0000","last_change":"2024-04-25T13:43:01.046288+0000","last_active":"2024-04-25T13:43:03.560406+0000","last_peered":"2024-04-25T13:43:03.560406+0000","last_clean":"2024-04-25T13:43:03.560406+0000","last_became_active":"2024-04-25T13:43:01.045408+0000","last_became_peered":"2024-04-25T13:43:01.045408+0000","last_unstale":"2024-04-25T13:43:03.560406+0000","last_undegraded":"2024-04-25T13:43:03.560406+0000","last_fullsized":"2024-04-25T13:43:03.560406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:42.454166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.558808+0000","last_change":"2024-04-25T13:43:02.053991+0000","last_active":"2024-04-25T13:43:03.558808+0000","last_peered":"2024-04-25T13:43:03.558808+0000","last_clean":"2024-04-25T13:43:03.558808+0000","last_became_active":"2024-04-25T13:43:02.053643+0000","last_became_peered":"2024-04-25T13:43:02.053643+0000","last_unstale":"2024-04-25T13:43:03.558808+0000","last_undegraded":"2024-04-25T13:43:03.558808+0000","last_fullsized":"2024-04-25T13:43:03.558808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:03.130328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560040+0000","last_change":"2024-04-25T13:43:01.044957+0000","last_active":"2024-04-25T13:43:03.560040+0000","last_peered":"2024-04-25T13:43:03.560040+0000","last_clean":"2024-04-25T13:43:03.560040+0000","last_became_active":"2024-04-25T13:43:01.044434+0000","last_became_peered":"2024-04-25T13:43:01.044434+0000","last_unstale":"2024-04-25T13:43:03.560040+0000","last_undegraded":"2024-04-25T13:43:03.560040+0000","last_fullsized":"2024-04-25T13:43:03.560040+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:22.871357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.558650+0000","last_change":"2024-04-25T13:43:02.052992+0000","last_active":"2024-04-25T13:43:03.558650+0000","last_peered":"2024-04-25T13:43:03.558650+0000","last_clean":"2024-04-25T13:43:03.558650+0000","last_became_active":"2024-04-25T13:43:02.052625+0000","last_became_peered":"2024-04-25T13:43:02.052625+0000","last_unstale":"2024-04-25T13:43:03.558650+0000","last_undegraded":"2024-04-25T13:43:03.558650+0000","last_fullsized":"2024-04-25T13:43:03.558650+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:42.129603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.056000+0000","last_change":"2024-04-25T13:43:01.054327+0000","last_active":"2024-04-25T13:43:03.056000+0000","last_peered":"2024-04-25T13:43:03.056000+0000","last_clean":"2024-04-25T13:43:03.056000+0000","last_became_active":"2024-04-25T13:43:01.053997+0000","last_became_peered":"2024-04-25T13:43:01.053997+0000","last_unstale":"2024-04-25T13:43:03.056000+0000","last_undegraded":"2024-04-25T13:43:03.056000+0000","last_fullsized":"2024-04-25T13:43:03.056000+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:41.123880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.558782+0000","last_change":"2024-04-25T13:43:02.051196+0000","last_active":"2024-04-25T13:43:03.558782+0000","last_peered":"2024-04-25T13:43:03.558782+0000","last_clean":"2024-04-25T13:43:03.558782+0000","last_became_active":"2024-04-25T13:43:02.050898+0000","last_became_peered":"2024-04-25T13:43:02.050898+0000","last_unstale":"2024-04-25T13:43:03.558782+0000","last_undegraded":"2024-04-25T13:43:03.558782+0000","last_fullsized":"2024-04-25T13:43:03.558782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:23:43.251166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560886+0000","last_change":"2024-04-25T13:43:01.062512+0000","last_active":"2024-04-25T13:43:03.560886+0000","last_peered":"2024-04-25T13:43:03.560886+0000","last_clean":"2024-04-25T13:43:03.560886+0000","last_became_active":"2024-04-25T13:43:01.062296+0000","last_became_peered":"2024-04-25T13:43:01.062296+0000","last_unstale":"2024-04-25T13:43:03.560886+0000","last_undegraded":"2024-04-25T13:43:03.560886+0000","last_fullsized":"2024-04-25T13:43:03.560886+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:41.123880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.558447+0000","last_change":"2024-04-25T13:43:02.063282+0000","last_active":"2024-04-25T13:43:03.558447+0000","last_peered":"2024-04-25T13:43:03.558447+0000","last_clean":"2024-04-25T13:43:03.558447+0000","last_became_active":"2024-04-25T13:43:02.062150+0000","last_became_peered":"2024-04-25T13:43:02.062150+0000","last_unstale":"2024-04-25T13:43:03.558447+0000","last_undegraded":"2024-04-25T13:43:03.558447+0000","last_fullsized":"2024-04-25T13:43:03.558447+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:42.811763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.559934+0000","last_change":"2024-04-25T13:43:01.055323+0000","last_active":"2024-04-25T13:43:03.559934+0000","last_peered":"2024-04-25T13:43:03.559934+0000","last_clean":"2024-04-25T13:43:03.559934+0000","last_became_active":"2024-04-25T13:43:01.054980+0000","last_became_peered":"2024-04-25T13:43:01.054980+0000","last_unstale":"2024-04-25T13:43:03.559934+0000","last_undegraded":"2024-04-25T13:43:03.559934+0000","last_fullsized":"2024-04-25T13:43:03.559934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:13.581805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047972+0000","last_change":"2024-04-25T13:43:02.061410+0000","last_active":"2024-04-25T13:43:03.047972+0000","last_peered":"2024-04-25T13:43:03.047972+0000","last_clean":"2024-04-25T13:43:03.047972+0000","last_became_active":"2024-04-25T13:43:02.061111+0000","last_became_peered":"2024-04-25T13:43:02.061111+0000","last_unstale":"2024-04-25T13:43:03.047972+0000","last_undegraded":"2024-04-25T13:43:03.047972+0000","last_fullsized":"2024-04-25T13:43:03.047972+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:30:31.687953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.046321+0000","last_change":"2024-04-25T13:43:01.053595+0000","last_active":"2024-04-25T13:43:03.046321+0000","last_peered":"2024-04-25T13:43:03.046321+0000","last_clean":"2024-04-25T13:43:03.046321+0000","last_became_active":"2024-04-25T13:43:01.053168+0000","last_became_peered":"2024-04-25T13:43:01.053168+0000","last_unstale":"2024-04-25T13:43:03.046321+0000","last_undegraded":"2024-04-25T13:43:03.046321+0000","last_fullsized":"2024-04-25T13:43:03.046321+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:04.643105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.558743+0000","last_change":"2024-04-25T13:43:02.065593+0000","last_active":"2024-04-25T13:43:03.558743+0000","last_peered":"2024-04-25T13:43:03.558743+0000","last_clean":"2024-04-25T13:43:03.558743+0000","last_became_active":"2024-04-25T13:43:02.065301+0000","last_became_peered":"2024-04-25T13:43:02.065301+0000","last_unstale":"2024-04-25T13:43:03.558743+0000","last_undegraded":"2024-04-25T13:43:03.558743+0000","last_fullsized":"2024-04-25T13:43:03.558743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:23.877080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.059289+0000","last_change":"2024-04-25T13:43:01.058201+0000","last_active":"2024-04-25T13:43:03.059289+0000","last_peered":"2024-04-25T13:43:03.059289+0000","last_clean":"2024-04-25T13:43:03.059289+0000","last_became_active":"2024-04-25T13:43:01.057363+0000","last_became_peered":"2024-04-25T13:43:01.057363+0000","last_unstale":"2024-04-25T13:43:03.059289+0000","last_undegraded":"2024-04-25T13:43:03.059289+0000","last_fullsized":"2024-04-25T13:43:03.059289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:15.253634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047478+0000","last_change":"2024-04-25T13:43:02.078099+0000","last_active":"2024-04-25T13:43:03.047478+0000","last_peered":"2024-04-25T13:43:03.047478+0000","last_clean":"2024-04-25T13:43:03.047478+0000","last_became_active":"2024-04-25T13:43:02.077720+0000","last_became_peered":"2024-04-25T13:43:02.077720+0000","last_unstale":"2024-04-25T13:43:03.047478+0000","last_undegraded":"2024-04-25T13:43:03.047478+0000","last_fullsized":"2024-04-25T13:43:03.047478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:21.006899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.057670+0000","last_change":"2024-04-25T13:43:01.054773+0000","last_active":"2024-04-25T13:43:03.057670+0000","last_peered":"2024-04-25T13:43:03.057670+0000","last_clean":"2024-04-25T13:43:03.057670+0000","last_became_active":"2024-04-25T13:43:01.054213+0000","last_became_peered":"2024-04-25T13:43:01.054213+0000","last_unstale":"2024-04-25T13:43:03.057670+0000","last_undegraded":"2024-04-25T13:43:03.057670+0000","last_fullsized":"2024-04-25T13:43:03.057670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:02.124605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.055931+0000","last_change":"2024-04-25T13:43:02.059576+0000","last_active":"2024-04-25T13:43:03.055931+0000","last_peered":"2024-04-25T13:43:03.055931+0000","last_clean":"2024-04-25T13:43:03.055931+0000","last_became_active":"2024-04-25T13:43:02.059245+0000","last_became_peered":"2024-04-25T13:43:02.059245+0000","last_unstale":"2024-04-25T13:43:03.055931+0000","last_undegraded":"2024-04-25T13:43:03.055931+0000","last_fullsized":"2024-04-25T13:43:03.055931+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:05.648828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.058739+0000","last_change":"2024-04-25T13:43:01.057645+0000","last_active":"2024-04-25T13:43:03.058739+0000","last_peered":"2024-04-25T13:43:03.058739+0000","last_clean":"2024-04-25T13:43:03.058739+0000","last_became_active":"2024-04-25T13:43:01.057058+0000","last_became_peered":"2024-04-25T13:43:01.057058+0000","last_unstale":"2024-04-25T13:43:03.058739+0000","last_undegraded":"2024-04-25T13:43:03.058739+0000","last_fullsized":"2024-04-25T13:43:03.058739+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:19.256219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560874+0000","last_change":"2024-04-25T13:43:02.071715+0000","last_active":"2024-04-25T13:43:03.560874+0000","last_peered":"2024-04-25T13:43:03.560874+0000","last_clean":"2024-04-25T13:43:03.560874+0000","last_became_active":"2024-04-25T13:43:02.071485+0000","last_became_peered":"2024-04-25T13:43:02.071485+0000","last_unstale":"2024-04-25T13:43:03.560874+0000","last_undegraded":"2024-04-25T13:43:03.560874+0000","last_fullsized":"2024-04-25T13:43:03.560874+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:21.042238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.056061+0000","last_change":"2024-04-25T13:43:01.050555+0000","last_active":"2024-04-25T13:43:03.056061+0000","last_peered":"2024-04-25T13:43:03.056061+0000","last_clean":"2024-04-25T13:43:03.056061+0000","last_became_active":"2024-04-25T13:43:01.050263+0000","last_became_peered":"2024-04-25T13:43:01.050263+0000","last_unstale":"2024-04-25T13:43:03.056061+0000","last_undegraded":"2024-04-25T13:43:03.056061+0000","last_fullsized":"2024-04-25T13:43:03.056061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:35.551147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.055890+0000","last_change":"2024-04-25T13:43:02.057028+0000","last_active":"2024-04-25T13:43:03.055890+0000","last_peered":"2024-04-25T13:43:03.055890+0000","last_clean":"2024-04-25T13:43:03.055890+0000","last_became_active":"2024-04-25T13:43:02.050153+0000","last_became_peered":"2024-04-25T13:43:02.050153+0000","last_unstale":"2024-04-25T13:43:03.055890+0000","last_undegraded":"2024-04-25T13:43:03.055890+0000","last_fullsized":"2024-04-25T13:43:03.055890+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:16.259357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.058416+0000","last_change":"2024-04-25T13:43:01.059102+0000","last_active":"2024-04-25T13:43:03.058416+0000","last_peered":"2024-04-25T13:43:03.058416+0000","last_clean":"2024-04-25T13:43:03.058416+0000","last_became_active":"2024-04-25T13:43:01.058822+0000","last_became_peered":"2024-04-25T13:43:01.058822+0000","last_unstale":"2024-04-25T13:43:03.058416+0000","last_undegraded":"2024-04-25T13:43:03.058416+0000","last_fullsized":"2024-04-25T13:43:03.058416+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:14:15.076513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.044974+0000","last_change":"2024-04-25T13:43:02.063540+0000","last_active":"2024-04-25T13:43:03.044974+0000","last_peered":"2024-04-25T13:43:03.044974+0000","last_clean":"2024-04-25T13:43:03.044974+0000","last_became_active":"2024-04-25T13:43:02.063232+0000","last_became_peered":"2024-04-25T13:43:02.063232+0000","last_unstale":"2024-04-25T13:43:03.044974+0000","last_undegraded":"2024-04-25T13:43:03.044974+0000","last_fullsized":"2024-04-25T13:43:03.044974+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:34:26.744118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560622+0000","last_change":"2024-04-25T13:43:01.044355+0000","last_active":"2024-04-25T13:43:03.560622+0000","last_peered":"2024-04-25T13:43:03.560622+0000","last_clean":"2024-04-25T13:43:03.560622+0000","last_became_active":"2024-04-25T13:43:01.043978+0000","last_became_peered":"2024-04-25T13:43:01.043978+0000","last_unstale":"2024-04-25T13:43:03.560622+0000","last_undegraded":"2024-04-25T13:43:03.560622+0000","last_fullsized":"2024-04-25T13:43:03.560622+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:59.665263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.559770+0000","last_change":"2024-04-25T13:43:02.053556+0000","last_active":"2024-04-25T13:43:03.559770+0000","last_peered":"2024-04-25T13:43:03.559770+0000","last_clean":"2024-04-25T13:43:03.559770+0000","last_became_active":"2024-04-25T13:43:02.053164+0000","last_became_peered":"2024-04-25T13:43:02.053164+0000","last_unstale":"2024-04-25T13:43:03.559770+0000","last_undegraded":"2024-04-25T13:43:03.559770+0000","last_fullsized":"2024-04-25T13:43:03.559770+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:07:48.512600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045219+0000","last_change":"2024-04-25T13:43:01.057660+0000","last_active":"2024-04-25T13:43:03.045219+0000","last_peered":"2024-04-25T13:43:03.045219+0000","last_clean":"2024-04-25T13:43:03.045219+0000","last_became_active":"2024-04-25T13:43:01.056117+0000","last_became_peered":"2024-04-25T13:43:01.056117+0000","last_unstale":"2024-04-25T13:43:03.045219+0000","last_undegraded":"2024-04-25T13:43:03.045219+0000","last_fullsized":"2024-04-25T13:43:03.045219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:19.256219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.046561+0000","last_change":"2024-04-25T13:43:02.054382+0000","last_active":"2024-04-25T13:43:03.046561+0000","last_peered":"2024-04-25T13:43:03.046561+0000","last_clean":"2024-04-25T13:43:03.046561+0000","last_became_active":"2024-04-25T13:43:02.054070+0000","last_became_peered":"2024-04-25T13:43:02.054070+0000","last_unstale":"2024-04-25T13:43:03.046561+0000","last_undegraded":"2024-04-25T13:43:03.046561+0000","last_fullsized":"2024-04-25T13:43:03.046561+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:23:07.440759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560276+0000","last_change":"2024-04-25T13:43:01.059669+0000","last_active":"2024-04-25T13:43:03.560276+0000","last_peered":"2024-04-25T13:43:03.560276+0000","last_clean":"2024-04-25T13:43:03.560276+0000","last_became_active":"2024-04-25T13:43:01.058810+0000","last_became_peered":"2024-04-25T13:43:01.058810+0000","last_unstale":"2024-04-25T13:43:03.560276+0000","last_undegraded":"2024-04-25T13:43:03.560276+0000","last_fullsized":"2024-04-25T13:43:03.560276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:41.806040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":135,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047968+0000","last_change":"2024-04-25T13:41:56.890628+0000","last_active":"2024-04-25T13:43:03.047968+0000","last_peered":"2024-04-25T13:43:03.047968+0000","last_clean":"2024-04-25T13:43:03.047968+0000","last_became_active":"2024-04-25T13:41:56.889261+0000","last_became_peered":"2024-04-25T13:41:56.889261+0000","last_unstale":"2024-04-25T13:43:03.047968+0000","last_undegraded":"2024-04-25T13:43:03.047968+0000","last_fullsized":"2024-04-25T13:43:03.047968+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:53.940471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:53.940471+0000","last_clean_scrub_stamp":"2024-04-25T13:41:53.940471+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:06.164380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":970752,"data_stored":735823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":145981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":152337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":145469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":146999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":145435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":146999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":966656,"data_stored":735733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:43:06.173 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:43:06.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.355+0000 7f1c40a00640 1 Processor -- start 2024-04-25T13:43:06.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.355+0000 7f1c40a00640 1 -- start start 2024-04-25T13:43:06.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.355+0000 7f1c40a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1c3c09ca10 0x7f1c3c0ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:06.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.355+0000 7f1c40a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1c3c0b06e0 0x7f1c3c162570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:06.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.355+0000 7f1c40a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c3c0b2750 con 0x7f1c3c0b02d0 2024-04-25T13:43:06.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.355+0000 7f1c40a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f1c3c0b8f40 con 0x7f1c3c0b06e0 2024-04-25T13:43:06.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.355+0000 7f1c40a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f1c3c0b24b0 con 0x7f1c3c09ca10 2024-04-25T13:43:06.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.355+0000 7f1c3a800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f1c3c0b06e0 0x7f1c3c162570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:06.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.355+0000 7f1c39400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f1c3c0b02d0 0x7f1c3c161e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36582/0 (socket says 172.21.15.123:36582) 2024-04-25T13:43:06.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.355+0000 7f1c39400640 1 -- 172.21.15.123:0/3185972100 learned_addr learned my addr 172.21.15.123:0/3185972100 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:06.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.355+0000 7f1c39e00640 1 --2- 172.21.15.123:0/3185972100 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1c3c09ca10 0x7f1c3c0ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:06.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.355+0000 7f1c3a800640 1 -- 172.21.15.123:0/3185972100 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1c3c09ca10 msgr2=0x7f1c3c0ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:06.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.355+0000 7f1c3a800640 1 --2- 172.21.15.123:0/3185972100 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1c3c09ca10 0x7f1c3c0ce860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:06.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.355+0000 7f1c3a800640 1 -- 172.21.15.123:0/3185972100 >> v1:172.21.15.123:6789/0 conn(0x7f1c3c0b02d0 legacy=0x7f1c3c161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:06.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.355+0000 7f1c3a800640 1 -- 172.21.15.123:0/3185972100 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c3c0b2a70 con 0x7f1c3c0b06e0 2024-04-25T13:43:06.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.355+0000 7f1c38a00640 1 -- 172.21.15.123:0/3185972100 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1921099361 0 0) 0x7f1c3c0b2750 con 0x7f1c3c0b02d0 2024-04-25T13:43:06.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.359+0000 7f1c3a800640 1 --2- 172.21.15.123:0/3185972100 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c3c0b06e0 0x7f1c3c162570 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1c34009d90 tx=0x7f1c3401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a90f287fa0368de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:06.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.359+0000 7f1c38a00640 1 -- 172.21.15.123:0/3185972100 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c340b2070 con 0x7f1c3c0b06e0 2024-04-25T13:43:06.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.359+0000 7f1c38a00640 1 -- 172.21.15.123:0/3185972100 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c340a57f0 con 0x7f1c3c0b06e0 2024-04-25T13:43:06.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.359+0000 7f1c38a00640 1 -- 172.21.15.123:0/3185972100 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c340a5bc0 con 0x7f1c3c0b06e0 2024-04-25T13:43:06.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.359+0000 7f1c40a00640 1 -- 172.21.15.123:0/3185972100 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c3c0b06e0 msgr2=0x7f1c3c162570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:06.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.359+0000 7f1c40a00640 1 --2- 172.21.15.123:0/3185972100 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c3c0b06e0 0x7f1c3c162570 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1c34009d90 tx=0x7f1c3401c8e0 comp rx=0 tx=0).stop 2024-04-25T13:43:06.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.359+0000 7f1c40a00640 1 -- 172.21.15.123:0/3185972100 shutdown_connections 2024-04-25T13:43:06.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.359+0000 7f1c40a00640 1 --2- 172.21.15.123:0/3185972100 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c3c0b06e0 0x7f1c3c162570 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:06.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.359+0000 7f1c40a00640 1 --2- 172.21.15.123:0/3185972100 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1c3c09ca10 0x7f1c3c0ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:06.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.359+0000 7f1c40a00640 1 -- 172.21.15.123:0/3185972100 >> 172.21.15.123:0/3185972100 conn(0x7f1c3c0d0160 msgr2=0x7f1c3c0d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:06.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.359+0000 7f1c40a00640 1 -- 172.21.15.123:0/3185972100 shutdown_connections 2024-04-25T13:43:06.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.359+0000 7f1c40a00640 1 -- 172.21.15.123:0/3185972100 wait complete. 2024-04-25T13:43:06.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.363+0000 7f1c40a00640 1 Processor -- start 2024-04-25T13:43:06.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.363+0000 7f1c40a00640 1 -- start start 2024-04-25T13:43:06.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.363+0000 7f1c40a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1c3c09ca10 0x7f1c3c157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:06.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.363+0000 7f1c40a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c3c0b02d0 0x7f1c3c09dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:06.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.363+0000 7f1c40a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c3c0b06e0 0x7f1c3c09e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:06.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.363+0000 7f1c40a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3c09cfa0 con 0x7f1c3c0b06e0 2024-04-25T13:43:06.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.363+0000 7f1c40a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3c09ce20 con 0x7f1c3c0b02d0 2024-04-25T13:43:06.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.363+0000 7f1c40a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f1c3c0ceda0 con 0x7f1c3c09ca10 2024-04-25T13:43:06.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.363+0000 7f1c3a800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c3c0b06e0 0x7f1c3c09e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:06.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.363+0000 7f1c3a800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c3c0b06e0 0x7f1c3c09e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47488/0 (socket says 172.21.15.123:47488) 2024-04-25T13:43:06.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.363+0000 7f1c3a800640 1 -- 172.21.15.123:0/1990952372 learned_addr learned my addr 172.21.15.123:0/1990952372 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:06.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.363+0000 7f1c39e00640 1 --2- 172.21.15.123:0/1990952372 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1c3c09ca10 0x7f1c3c157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:06.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.363+0000 7f1c39400640 1 --2- 172.21.15.123:0/1990952372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c3c0b02d0 0x7f1c3c09dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:06.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.363+0000 7f1c3a800640 1 -- 172.21.15.123:0/1990952372 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1c3c09ca10 msgr2=0x7f1c3c157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:06.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.363+0000 7f1c3a800640 1 --2- 172.21.15.123:0/1990952372 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1c3c09ca10 0x7f1c3c157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:06.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.363+0000 7f1c3a800640 1 -- 172.21.15.123:0/1990952372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c3c0b02d0 msgr2=0x7f1c3c09dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:06.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.363+0000 7f1c3a800640 1 --2- 172.21.15.123:0/1990952372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c3c0b02d0 0x7f1c3c09dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:06.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.363+0000 7f1c3a800640 1 -- 172.21.15.123:0/1990952372 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c3c159c50 con 0x7f1c3c0b06e0 2024-04-25T13:43:06.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.363+0000 7f1c39400640 1 --2- 172.21.15.123:0/1990952372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c3c0b02d0 0x7f1c3c09dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:06.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.367+0000 7f1c3a800640 1 --2- 172.21.15.123:0/1990952372 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c3c0b06e0 0x7f1c3c09e210 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1c340b0040 tx=0x7f1c34019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:06.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.367+0000 7f1c32000640 1 -- 172.21.15.123:0/1990952372 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c340b2050 con 0x7f1c3c0b06e0 2024-04-25T13:43:06.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.367+0000 7f1c32000640 1 -- 172.21.15.123:0/1990952372 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c340be070 con 0x7f1c3c0b06e0 2024-04-25T13:43:06.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.367+0000 7f1c32000640 1 -- 172.21.15.123:0/1990952372 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c340ad850 con 0x7f1c3c0b06e0 2024-04-25T13:43:06.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.367+0000 7f1c40a00640 1 -- 172.21.15.123:0/1990952372 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c3c159f30 con 0x7f1c3c0b06e0 2024-04-25T13:43:06.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.367+0000 7f1c40a00640 1 -- 172.21.15.123:0/1990952372 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c3c0a0d20 con 0x7f1c3c0b06e0 2024-04-25T13:43:06.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.367+0000 7f1c40a00640 1 -- 172.21.15.123:0/1990952372 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c3c0507c0 con 0x7f1c3c0b06e0 2024-04-25T13:43:06.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.367+0000 7f1c32000640 1 -- 172.21.15.123:0/1990952372 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1c340ad9f0 con 0x7f1c3c0b06e0 2024-04-25T13:43:06.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.367+0000 7f1c32000640 1 --2- 172.21.15.123:0/1990952372 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1c1806f400 0x7f1c18071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:06.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.367+0000 7f1c32000640 1 -- 172.21.15.123:0/1990952372 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f1c3412a2e0 con 0x7f1c3c0b06e0 2024-04-25T13:43:06.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.367+0000 7f1c39e00640 1 --2- 172.21.15.123:0/1990952372 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1c1806f400 0x7f1c18071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:06.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.371+0000 7f1c39e00640 1 --2- 172.21.15.123:0/1990952372 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1c1806f400 0x7f1c18071910 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1c240079a0 tx=0x7f1c24008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:06.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.375+0000 7f1c32000640 1 -- 172.21.15.123:0/1990952372 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1c34016560 con 0x7f1c3c0b06e0 2024-04-25T13:43:06.529 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.523+0000 7f1c40a00640 1 -- 172.21.15.123:0/1990952372 --> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1c3c158480 con 0x7f1c1806f400 2024-04-25T13:43:06.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.531+0000 7f1c32000640 1 -- 172.21.15.123:0/1990952372 <== mgr.4107 v2:172.21.15.123:6832/715752891 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251936 (secure 0 0 0) 0x7f1c3c158480 con 0x7f1c1806f400 2024-04-25T13:43:06.538 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:06.539 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-04-25T13:43:06.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.535+0000 7f1c40a00640 1 -- 172.21.15.123:0/1990952372 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1c1806f400 msgr2=0x7f1c18071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:06.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.535+0000 7f1c40a00640 1 --2- 172.21.15.123:0/1990952372 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1c1806f400 0x7f1c18071910 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1c240079a0 tx=0x7f1c24008040 comp rx=0 tx=0).stop 2024-04-25T13:43:06.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.535+0000 7f1c40a00640 1 -- 172.21.15.123:0/1990952372 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c3c0b06e0 msgr2=0x7f1c3c09e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:06.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.535+0000 7f1c40a00640 1 --2- 172.21.15.123:0/1990952372 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c3c0b06e0 0x7f1c3c09e210 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1c340b0040 tx=0x7f1c34019680 comp rx=0 tx=0).stop 2024-04-25T13:43:06.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.535+0000 7f1c40a00640 1 -- 172.21.15.123:0/1990952372 shutdown_connections 2024-04-25T13:43:06.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.535+0000 7f1c40a00640 1 --2- 172.21.15.123:0/1990952372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c3c0b02d0 0x7f1c3c09dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:06.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.535+0000 7f1c40a00640 1 --2- 172.21.15.123:0/1990952372 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f1c1806f400 0x7f1c18071910 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:06.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.535+0000 7f1c40a00640 1 --2- 172.21.15.123:0/1990952372 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c3c0b06e0 0x7f1c3c09e210 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:06.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.535+0000 7f1c40a00640 1 --2- 172.21.15.123:0/1990952372 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1c3c09ca10 0x7f1c3c157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:06.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.535+0000 7f1c40a00640 1 -- 172.21.15.123:0/1990952372 >> 172.21.15.123:0/1990952372 conn(0x7f1c3c0d0160 msgr2=0x7f1c3c15b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:06.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.535+0000 7f1c40a00640 1 -- 172.21.15.123:0/1990952372 shutdown_connections 2024-04-25T13:43:06.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.535+0000 7f1c40a00640 1 -- 172.21.15.123:0/1990952372 wait complete. 2024-04-25T13:43:06.559 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-04-25T13:43:05.588689+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220348,"kb_used_data":4148,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754372,"statfs":{"total":773094113280,"available":772868476928,"internally_reserved":0,"allocated":4247552,"data_stored":2354776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.564730"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560586+0000","last_change":"2024-04-25T13:43:02.051869+0000","last_active":"2024-04-25T13:43:03.560586+0000","last_peered":"2024-04-25T13:43:03.560586+0000","last_clean":"2024-04-25T13:43:03.560586+0000","last_became_active":"2024-04-25T13:43:02.051514+0000","last_became_peered":"2024-04-25T13:43:02.051514+0000","last_unstale":"2024-04-25T13:43:03.560586+0000","last_undegraded":"2024-04-25T13:43:03.560586+0000","last_fullsized":"2024-04-25T13:43:03.560586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:20.261942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045488+0000","last_change":"2024-04-25T13:43:02.051638+0000","last_active":"2024-04-25T13:43:03.045488+0000","last_peered":"2024-04-25T13:43:03.045488+0000","last_clean":"2024-04-25T13:43:03.045488+0000","last_became_active":"2024-04-25T13:43:02.051264+0000","last_became_peered":"2024-04-25T13:43:02.051264+0000","last_unstale":"2024-04-25T13:43:03.045488+0000","last_undegraded":"2024-04-25T13:43:03.045488+0000","last_fullsized":"2024-04-25T13:43:03.045488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:20.753160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047702+0000","last_change":"2024-04-25T13:43:02.063675+0000","last_active":"2024-04-25T13:43:03.047702+0000","last_peered":"2024-04-25T13:43:03.047702+0000","last_clean":"2024-04-25T13:43:03.047702+0000","last_became_active":"2024-04-25T13:43:02.063035+0000","last_became_peered":"2024-04-25T13:43:02.063035+0000","last_unstale":"2024-04-25T13:43:03.047702+0000","last_undegraded":"2024-04-25T13:43:03.047702+0000","last_fullsized":"2024-04-25T13:43:03.047702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:28.696619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.058360+0000","last_change":"2024-04-25T13:43:02.080374+0000","last_active":"2024-04-25T13:43:03.058360+0000","last_peered":"2024-04-25T13:43:03.058360+0000","last_clean":"2024-04-25T13:43:03.058360+0000","last_became_active":"2024-04-25T13:43:02.079157+0000","last_became_peered":"2024-04-25T13:43:02.079157+0000","last_unstale":"2024-04-25T13:43:03.058360+0000","last_undegraded":"2024-04-25T13:43:03.058360+0000","last_fullsized":"2024-04-25T13:43:03.058360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:35:09.207923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.558630+0000","last_change":"2024-04-25T13:43:02.053811+0000","last_active":"2024-04-25T13:43:03.558630+0000","last_peered":"2024-04-25T13:43:03.558630+0000","last_clean":"2024-04-25T13:43:03.558630+0000","last_became_active":"2024-04-25T13:43:02.053451+0000","last_became_peered":"2024-04-25T13:43:02.053451+0000","last_unstale":"2024-04-25T13:43:03.558630+0000","last_undegraded":"2024-04-25T13:43:03.558630+0000","last_fullsized":"2024-04-25T13:43:03.558630+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:08.711087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045347+0000","last_change":"2024-04-25T13:43:02.056305+0000","last_active":"2024-04-25T13:43:03.045347+0000","last_peered":"2024-04-25T13:43:03.045347+0000","last_clean":"2024-04-25T13:43:03.045347+0000","last_became_active":"2024-04-25T13:43:02.055991+0000","last_became_peered":"2024-04-25T13:43:02.055991+0000","last_unstale":"2024-04-25T13:43:03.045347+0000","last_undegraded":"2024-04-25T13:43:03.045347+0000","last_fullsized":"2024-04-25T13:43:03.045347+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:09.182621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047031+0000","last_change":"2024-04-25T13:43:02.061040+0000","last_active":"2024-04-25T13:43:03.047031+0000","last_peered":"2024-04-25T13:43:03.047031+0000","last_clean":"2024-04-25T13:43:03.047031+0000","last_became_active":"2024-04-25T13:43:02.059462+0000","last_became_peered":"2024-04-25T13:43:02.059462+0000","last_unstale":"2024-04-25T13:43:03.047031+0000","last_undegraded":"2024-04-25T13:43:03.047031+0000","last_fullsized":"2024-04-25T13:43:03.047031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:08.832240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.046797+0000","last_change":"2024-04-25T13:43:02.053566+0000","last_active":"2024-04-25T13:43:03.046797+0000","last_peered":"2024-04-25T13:43:03.046797+0000","last_clean":"2024-04-25T13:43:03.046797+0000","last_became_active":"2024-04-25T13:43:02.053275+0000","last_became_peered":"2024-04-25T13:43:02.053275+0000","last_unstale":"2024-04-25T13:43:03.046797+0000","last_undegraded":"2024-04-25T13:43:03.046797+0000","last_fullsized":"2024-04-25T13:43:03.046797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:20.753160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560279+0000","last_change":"2024-04-25T13:43:02.066220+0000","last_active":"2024-04-25T13:43:03.560279+0000","last_peered":"2024-04-25T13:43:03.560279+0000","last_clean":"2024-04-25T13:43:03.560279+0000","last_became_active":"2024-04-25T13:43:02.065796+0000","last_became_peered":"2024-04-25T13:43:02.065796+0000","last_unstale":"2024-04-25T13:43:03.560279+0000","last_undegraded":"2024-04-25T13:43:03.560279+0000","last_fullsized":"2024-04-25T13:43:03.560279+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:32.812037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.058844+0000","last_change":"2024-04-25T13:43:02.071704+0000","last_active":"2024-04-25T13:43:03.058844+0000","last_peered":"2024-04-25T13:43:03.058844+0000","last_clean":"2024-04-25T13:43:03.058844+0000","last_became_active":"2024-04-25T13:43:02.069348+0000","last_became_peered":"2024-04-25T13:43:02.069348+0000","last_unstale":"2024-04-25T13:43:03.058844+0000","last_undegraded":"2024-04-25T13:43:03.058844+0000","last_fullsized":"2024-04-25T13:43:03.058844+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:49:09.905281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047698+0000","last_change":"2024-04-25T13:43:02.065416+0000","last_active":"2024-04-25T13:43:03.047698+0000","last_peered":"2024-04-25T13:43:03.047698+0000","last_clean":"2024-04-25T13:43:03.047698+0000","last_became_active":"2024-04-25T13:43:02.064993+0000","last_became_peered":"2024-04-25T13:43:02.064993+0000","last_unstale":"2024-04-25T13:43:03.047698+0000","last_undegraded":"2024-04-25T13:43:03.047698+0000","last_fullsized":"2024-04-25T13:43:03.047698+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:01.861396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.046959+0000","last_change":"2024-04-25T13:43:02.057735+0000","last_active":"2024-04-25T13:43:03.046959+0000","last_peered":"2024-04-25T13:43:03.046959+0000","last_clean":"2024-04-25T13:43:03.046959+0000","last_became_active":"2024-04-25T13:43:02.057413+0000","last_became_peered":"2024-04-25T13:43:02.057413+0000","last_unstale":"2024-04-25T13:43:03.046959+0000","last_undegraded":"2024-04-25T13:43:03.046959+0000","last_fullsized":"2024-04-25T13:43:03.046959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:23:07.440759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.558567+0000","last_change":"2024-04-25T13:43:02.065192+0000","last_active":"2024-04-25T13:43:03.558567+0000","last_peered":"2024-04-25T13:43:03.558567+0000","last_clean":"2024-04-25T13:43:03.558567+0000","last_became_active":"2024-04-25T13:43:02.064869+0000","last_became_peered":"2024-04-25T13:43:02.064869+0000","last_unstale":"2024-04-25T13:43:03.558567+0000","last_undegraded":"2024-04-25T13:43:03.558567+0000","last_fullsized":"2024-04-25T13:43:03.558567+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:12:00.670986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045121+0000","last_change":"2024-04-25T13:43:02.052791+0000","last_active":"2024-04-25T13:43:03.045121+0000","last_peered":"2024-04-25T13:43:03.045121+0000","last_clean":"2024-04-25T13:43:03.045121+0000","last_became_active":"2024-04-25T13:43:02.052412+0000","last_became_peered":"2024-04-25T13:43:02.052412+0000","last_unstale":"2024-04-25T13:43:03.045121+0000","last_undegraded":"2024-04-25T13:43:03.045121+0000","last_fullsized":"2024-04-25T13:43:03.045121+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:23:07.440759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047643+0000","last_change":"2024-04-25T13:43:02.060557+0000","last_active":"2024-04-25T13:43:03.047643+0000","last_peered":"2024-04-25T13:43:03.047643+0000","last_clean":"2024-04-25T13:43:03.047643+0000","last_became_active":"2024-04-25T13:43:02.060258+0000","last_became_peered":"2024-04-25T13:43:02.060258+0000","last_unstale":"2024-04-25T13:43:03.047643+0000","last_undegraded":"2024-04-25T13:43:03.047643+0000","last_fullsized":"2024-04-25T13:43:03.047643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:08.832240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.048064+0000","last_change":"2024-04-25T13:43:02.057624+0000","last_active":"2024-04-25T13:43:03.048064+0000","last_peered":"2024-04-25T13:43:03.048064+0000","last_clean":"2024-04-25T13:43:03.048064+0000","last_became_active":"2024-04-25T13:43:02.057292+0000","last_became_peered":"2024-04-25T13:43:02.057292+0000","last_unstale":"2024-04-25T13:43:03.048064+0000","last_undegraded":"2024-04-25T13:43:03.048064+0000","last_fullsized":"2024-04-25T13:43:03.048064+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:04.232103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.046745+0000","last_change":"2024-04-25T13:43:02.055942+0000","last_active":"2024-04-25T13:43:03.046745+0000","last_peered":"2024-04-25T13:43:03.046745+0000","last_clean":"2024-04-25T13:43:03.046745+0000","last_became_active":"2024-04-25T13:43:02.055594+0000","last_became_peered":"2024-04-25T13:43:02.055594+0000","last_unstale":"2024-04-25T13:43:03.046745+0000","last_undegraded":"2024-04-25T13:43:03.046745+0000","last_fullsized":"2024-04-25T13:43:03.046745+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:09.182621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045693+0000","last_change":"2024-04-25T13:43:02.066985+0000","last_active":"2024-04-25T13:43:03.045693+0000","last_peered":"2024-04-25T13:43:03.045693+0000","last_clean":"2024-04-25T13:43:03.045693+0000","last_became_active":"2024-04-25T13:43:02.066649+0000","last_became_peered":"2024-04-25T13:43:02.066649+0000","last_unstale":"2024-04-25T13:43:03.045693+0000","last_undegraded":"2024-04-25T13:43:03.045693+0000","last_fullsized":"2024-04-25T13:43:03.045693+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:28.696619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045218+0000","last_change":"2024-04-25T13:43:02.066056+0000","last_active":"2024-04-25T13:43:03.045218+0000","last_peered":"2024-04-25T13:43:03.045218+0000","last_clean":"2024-04-25T13:43:03.045218+0000","last_became_active":"2024-04-25T13:43:02.064152+0000","last_became_peered":"2024-04-25T13:43:02.064152+0000","last_unstale":"2024-04-25T13:43:03.045218+0000","last_undegraded":"2024-04-25T13:43:03.045218+0000","last_fullsized":"2024-04-25T13:43:03.045218+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:38.962784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.558749+0000","last_change":"2024-04-25T13:43:02.066624+0000","last_active":"2024-04-25T13:43:03.558749+0000","last_peered":"2024-04-25T13:43:03.558749+0000","last_clean":"2024-04-25T13:43:03.558749+0000","last_became_active":"2024-04-25T13:43:02.066264+0000","last_became_peered":"2024-04-25T13:43:02.066264+0000","last_unstale":"2024-04-25T13:43:03.558749+0000","last_undegraded":"2024-04-25T13:43:03.558749+0000","last_fullsized":"2024-04-25T13:43:03.558749+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:36.556870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.559868+0000","last_change":"2024-04-25T13:43:02.052444+0000","last_active":"2024-04-25T13:43:03.559868+0000","last_peered":"2024-04-25T13:43:03.559868+0000","last_clean":"2024-04-25T13:43:03.559868+0000","last_became_active":"2024-04-25T13:43:02.051977+0000","last_became_peered":"2024-04-25T13:43:02.051977+0000","last_unstale":"2024-04-25T13:43:03.559868+0000","last_undegraded":"2024-04-25T13:43:03.559868+0000","last_fullsized":"2024-04-25T13:43:03.559868+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:07.905899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.559783+0000","last_change":"2024-04-25T13:43:02.053466+0000","last_active":"2024-04-25T13:43:03.559783+0000","last_peered":"2024-04-25T13:43:03.559783+0000","last_clean":"2024-04-25T13:43:03.559783+0000","last_became_active":"2024-04-25T13:43:02.053136+0000","last_became_peered":"2024-04-25T13:43:02.053136+0000","last_unstale":"2024-04-25T13:43:03.559783+0000","last_undegraded":"2024-04-25T13:43:03.559783+0000","last_fullsized":"2024-04-25T13:43:03.559783+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:47:48.423743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.055669+0000","last_change":"2024-04-25T13:43:02.059399+0000","last_active":"2024-04-25T13:43:03.055669+0000","last_peered":"2024-04-25T13:43:03.055669+0000","last_clean":"2024-04-25T13:43:03.055669+0000","last_became_active":"2024-04-25T13:43:02.056232+0000","last_became_peered":"2024-04-25T13:43:02.056232+0000","last_unstale":"2024-04-25T13:43:03.055669+0000","last_undegraded":"2024-04-25T13:43:03.055669+0000","last_fullsized":"2024-04-25T13:43:03.055669+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:23:32.253286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047758+0000","last_change":"2024-04-25T13:43:02.044735+0000","last_active":"2024-04-25T13:43:03.047758+0000","last_peered":"2024-04-25T13:43:03.047758+0000","last_clean":"2024-04-25T13:43:03.047758+0000","last_became_active":"2024-04-25T13:43:02.044482+0000","last_became_peered":"2024-04-25T13:43:02.044482+0000","last_unstale":"2024-04-25T13:43:03.047758+0000","last_undegraded":"2024-04-25T13:43:03.047758+0000","last_fullsized":"2024-04-25T13:43:03.047758+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:30:31.687953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.059028+0000","last_change":"2024-04-25T13:43:02.064046+0000","last_active":"2024-04-25T13:43:03.059028+0000","last_peered":"2024-04-25T13:43:03.059028+0000","last_clean":"2024-04-25T13:43:03.059028+0000","last_became_active":"2024-04-25T13:43:02.063603+0000","last_became_peered":"2024-04-25T13:43:02.063603+0000","last_unstale":"2024-04-25T13:43:03.059028+0000","last_undegraded":"2024-04-25T13:43:03.059028+0000","last_fullsized":"2024-04-25T13:43:03.059028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:23:07.440759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045686+0000","last_change":"2024-04-25T13:43:02.065311+0000","last_active":"2024-04-25T13:43:03.045686+0000","last_peered":"2024-04-25T13:43:03.045686+0000","last_clean":"2024-04-25T13:43:03.045686+0000","last_became_active":"2024-04-25T13:43:02.060068+0000","last_became_peered":"2024-04-25T13:43:02.060068+0000","last_unstale":"2024-04-25T13:43:03.045686+0000","last_undegraded":"2024-04-25T13:43:03.045686+0000","last_fullsized":"2024-04-25T13:43:03.045686+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:32:08.832240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.058913+0000","last_change":"2024-04-25T13:43:02.076015+0000","last_active":"2024-04-25T13:43:03.058913+0000","last_peered":"2024-04-25T13:43:03.058913+0000","last_clean":"2024-04-25T13:43:03.058913+0000","last_became_active":"2024-04-25T13:43:02.075624+0000","last_became_peered":"2024-04-25T13:43:02.075624+0000","last_unstale":"2024-04-25T13:43:03.058913+0000","last_undegraded":"2024-04-25T13:43:03.058913+0000","last_fullsized":"2024-04-25T13:43:03.058913+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:34:26.744118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047146+0000","last_change":"2024-04-25T13:43:02.050373+0000","last_active":"2024-04-25T13:43:03.047146+0000","last_peered":"2024-04-25T13:43:03.047146+0000","last_clean":"2024-04-25T13:43:03.047146+0000","last_became_active":"2024-04-25T13:43:02.050071+0000","last_became_peered":"2024-04-25T13:43:02.050071+0000","last_unstale":"2024-04-25T13:43:03.047146+0000","last_undegraded":"2024-04-25T13:43:03.047146+0000","last_fullsized":"2024-04-25T13:43:03.047146+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:38.962784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560625+0000","last_change":"2024-04-25T13:43:02.052220+0000","last_active":"2024-04-25T13:43:03.560625+0000","last_peered":"2024-04-25T13:43:03.560625+0000","last_clean":"2024-04-25T13:43:03.560625+0000","last_became_active":"2024-04-25T13:43:02.051631+0000","last_became_peered":"2024-04-25T13:43:02.051631+0000","last_unstale":"2024-04-25T13:43:03.560625+0000","last_undegraded":"2024-04-25T13:43:03.560625+0000","last_fullsized":"2024-04-25T13:43:03.560625+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:58.157888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.046524+0000","last_change":"2024-04-25T13:43:02.059639+0000","last_active":"2024-04-25T13:43:03.046524+0000","last_peered":"2024-04-25T13:43:03.046524+0000","last_clean":"2024-04-25T13:43:03.046524+0000","last_became_active":"2024-04-25T13:43:02.059142+0000","last_became_peered":"2024-04-25T13:43:02.059142+0000","last_unstale":"2024-04-25T13:43:03.046524+0000","last_undegraded":"2024-04-25T13:43:03.046524+0000","last_fullsized":"2024-04-25T13:43:03.046524+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:34:26.744118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560376+0000","last_change":"2024-04-25T13:43:02.053187+0000","last_active":"2024-04-25T13:43:03.560376+0000","last_peered":"2024-04-25T13:43:03.560376+0000","last_clean":"2024-04-25T13:43:03.560376+0000","last_became_active":"2024-04-25T13:43:02.052854+0000","last_became_peered":"2024-04-25T13:43:02.052854+0000","last_unstale":"2024-04-25T13:43:03.560376+0000","last_undegraded":"2024-04-25T13:43:03.560376+0000","last_fullsized":"2024-04-25T13:43:03.560376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:14:16.082236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.046581+0000","last_change":"2024-04-25T13:43:02.052600+0000","last_active":"2024-04-25T13:43:03.046581+0000","last_peered":"2024-04-25T13:43:03.046581+0000","last_clean":"2024-04-25T13:43:03.046581+0000","last_became_active":"2024-04-25T13:43:02.051127+0000","last_became_peered":"2024-04-25T13:43:02.051127+0000","last_unstale":"2024-04-25T13:43:03.046581+0000","last_undegraded":"2024-04-25T13:43:03.046581+0000","last_fullsized":"2024-04-25T13:43:03.046581+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:38.962784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.055796+0000","last_change":"2024-04-25T13:43:02.049860+0000","last_active":"2024-04-25T13:43:03.055796+0000","last_peered":"2024-04-25T13:43:03.055796+0000","last_clean":"2024-04-25T13:43:03.055796+0000","last_became_active":"2024-04-25T13:43:02.049068+0000","last_became_peered":"2024-04-25T13:43:02.049068+0000","last_unstale":"2024-04-25T13:43:03.055796+0000","last_undegraded":"2024-04-25T13:43:03.055796+0000","last_fullsized":"2024-04-25T13:43:03.055796+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:21.042238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560807+0000","last_change":"2024-04-25T13:43:01.059124+0000","last_active":"2024-04-25T13:43:03.560807+0000","last_peered":"2024-04-25T13:43:03.560807+0000","last_clean":"2024-04-25T13:43:03.560807+0000","last_became_active":"2024-04-25T13:43:01.058781+0000","last_became_peered":"2024-04-25T13:43:01.058781+0000","last_unstale":"2024-04-25T13:43:03.560807+0000","last_undegraded":"2024-04-25T13:43:03.560807+0000","last_fullsized":"2024-04-25T13:43:03.560807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:59.665263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560736+0000","last_change":"2024-04-25T13:43:02.068282+0000","last_active":"2024-04-25T13:43:03.560736+0000","last_peered":"2024-04-25T13:43:03.560736+0000","last_clean":"2024-04-25T13:43:03.560736+0000","last_became_active":"2024-04-25T13:43:02.067963+0000","last_became_peered":"2024-04-25T13:43:02.067963+0000","last_unstale":"2024-04-25T13:43:03.560736+0000","last_undegraded":"2024-04-25T13:43:03.560736+0000","last_fullsized":"2024-04-25T13:43:03.560736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:23:32.253286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.055867+0000","last_change":"2024-04-25T13:43:01.054989+0000","last_active":"2024-04-25T13:43:03.055867+0000","last_peered":"2024-04-25T13:43:03.055867+0000","last_clean":"2024-04-25T13:43:03.055867+0000","last_became_active":"2024-04-25T13:43:01.054486+0000","last_became_peered":"2024-04-25T13:43:01.054486+0000","last_unstale":"2024-04-25T13:43:03.055867+0000","last_undegraded":"2024-04-25T13:43:03.055867+0000","last_fullsized":"2024-04-25T13:43:03.055867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:22.871357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560130+0000","last_change":"2024-04-25T13:43:02.064177+0000","last_active":"2024-04-25T13:43:03.560130+0000","last_peered":"2024-04-25T13:43:03.560130+0000","last_clean":"2024-04-25T13:43:03.560130+0000","last_became_active":"2024-04-25T13:43:02.063821+0000","last_became_peered":"2024-04-25T13:43:02.063821+0000","last_unstale":"2024-04-25T13:43:03.560130+0000","last_undegraded":"2024-04-25T13:43:03.560130+0000","last_fullsized":"2024-04-25T13:43:03.560130+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:44:46.062558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045459+0000","last_change":"2024-04-25T13:43:01.054928+0000","last_active":"2024-04-25T13:43:03.045459+0000","last_peered":"2024-04-25T13:43:03.045459+0000","last_clean":"2024-04-25T13:43:03.045459+0000","last_became_active":"2024-04-25T13:43:01.054633+0000","last_became_peered":"2024-04-25T13:43:01.054633+0000","last_unstale":"2024-04-25T13:43:03.045459+0000","last_undegraded":"2024-04-25T13:43:03.045459+0000","last_fullsized":"2024-04-25T13:43:03.045459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:20.036515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.058905+0000","last_change":"2024-04-25T13:43:02.075951+0000","last_active":"2024-04-25T13:43:03.058905+0000","last_peered":"2024-04-25T13:43:03.058905+0000","last_clean":"2024-04-25T13:43:03.058905+0000","last_became_active":"2024-04-25T13:43:02.075469+0000","last_became_peered":"2024-04-25T13:43:02.075469+0000","last_unstale":"2024-04-25T13:43:03.058905+0000","last_undegraded":"2024-04-25T13:43:03.058905+0000","last_fullsized":"2024-04-25T13:43:03.058905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:32:06.767611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.558684+0000","last_change":"2024-04-25T13:43:01.055674+0000","last_active":"2024-04-25T13:43:03.558684+0000","last_peered":"2024-04-25T13:43:03.558684+0000","last_clean":"2024-04-25T13:43:03.558684+0000","last_became_active":"2024-04-25T13:43:01.055357+0000","last_became_peered":"2024-04-25T13:43:01.055357+0000","last_unstale":"2024-04-25T13:43:03.558684+0000","last_undegraded":"2024-04-25T13:43:03.558684+0000","last_fullsized":"2024-04-25T13:43:03.558684+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:54:50.267632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047347+0000","last_change":"2024-04-25T13:43:02.056764+0000","last_active":"2024-04-25T13:43:03.047347+0000","last_peered":"2024-04-25T13:43:03.047347+0000","last_clean":"2024-04-25T13:43:03.047347+0000","last_became_active":"2024-04-25T13:43:02.056399+0000","last_became_peered":"2024-04-25T13:43:02.056399+0000","last_unstale":"2024-04-25T13:43:03.047347+0000","last_undegraded":"2024-04-25T13:43:03.047347+0000","last_fullsized":"2024-04-25T13:43:03.047347+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:28.696619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560303+0000","last_change":"2024-04-25T13:43:01.046596+0000","last_active":"2024-04-25T13:43:03.560303+0000","last_peered":"2024-04-25T13:43:03.560303+0000","last_clean":"2024-04-25T13:43:03.560303+0000","last_became_active":"2024-04-25T13:43:01.046199+0000","last_became_peered":"2024-04-25T13:43:01.046199+0000","last_unstale":"2024-04-25T13:43:03.560303+0000","last_undegraded":"2024-04-25T13:43:03.560303+0000","last_fullsized":"2024-04-25T13:43:03.560303+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:35.551147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.046897+0000","last_change":"2024-04-25T13:43:02.047735+0000","last_active":"2024-04-25T13:43:03.046897+0000","last_peered":"2024-04-25T13:43:03.046897+0000","last_clean":"2024-04-25T13:43:03.046897+0000","last_became_active":"2024-04-25T13:43:02.047328+0000","last_became_peered":"2024-04-25T13:43:02.047328+0000","last_unstale":"2024-04-25T13:43:03.046897+0000","last_undegraded":"2024-04-25T13:43:03.046897+0000","last_fullsized":"2024-04-25T13:43:03.046897+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:34:26.744118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.559845+0000","last_change":"2024-04-25T13:43:01.045268+0000","last_active":"2024-04-25T13:43:03.559845+0000","last_peered":"2024-04-25T13:43:03.559845+0000","last_clean":"2024-04-25T13:43:03.559845+0000","last_became_active":"2024-04-25T13:43:01.044900+0000","last_became_peered":"2024-04-25T13:43:01.044900+0000","last_unstale":"2024-04-25T13:43:03.559845+0000","last_undegraded":"2024-04-25T13:43:03.559845+0000","last_fullsized":"2024-04-25T13:43:03.559845+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:41.806040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.559744+0000","last_change":"2024-04-25T13:43:02.057846+0000","last_active":"2024-04-25T13:43:03.559744+0000","last_peered":"2024-04-25T13:43:03.559744+0000","last_clean":"2024-04-25T13:43:03.559744+0000","last_became_active":"2024-04-25T13:43:02.057547+0000","last_became_peered":"2024-04-25T13:43:02.057547+0000","last_unstale":"2024-04-25T13:43:03.559744+0000","last_undegraded":"2024-04-25T13:43:03.559744+0000","last_fullsized":"2024-04-25T13:43:03.559744+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:05.648828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045102+0000","last_change":"2024-04-25T13:43:01.050120+0000","last_active":"2024-04-25T13:43:03.045102+0000","last_peered":"2024-04-25T13:43:03.045102+0000","last_clean":"2024-04-25T13:43:03.045102+0000","last_became_active":"2024-04-25T13:43:01.049801+0000","last_became_peered":"2024-04-25T13:43:01.049801+0000","last_unstale":"2024-04-25T13:43:03.045102+0000","last_undegraded":"2024-04-25T13:43:03.045102+0000","last_fullsized":"2024-04-25T13:43:03.045102+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:14:15.076513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.058260+0000","last_change":"2024-04-25T13:43:02.052750+0000","last_active":"2024-04-25T13:43:03.058260+0000","last_peered":"2024-04-25T13:43:03.058260+0000","last_clean":"2024-04-25T13:43:03.058260+0000","last_became_active":"2024-04-25T13:43:02.052409+0000","last_became_peered":"2024-04-25T13:43:02.052409+0000","last_unstale":"2024-04-25T13:43:03.058260+0000","last_undegraded":"2024-04-25T13:43:03.058260+0000","last_fullsized":"2024-04-25T13:43:03.058260+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:32.812037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560117+0000","last_change":"2024-04-25T13:43:01.047582+0000","last_active":"2024-04-25T13:43:03.560117+0000","last_peered":"2024-04-25T13:43:03.560117+0000","last_clean":"2024-04-25T13:43:03.560117+0000","last_became_active":"2024-04-25T13:43:01.047309+0000","last_became_peered":"2024-04-25T13:43:01.047309+0000","last_unstale":"2024-04-25T13:43:03.560117+0000","last_undegraded":"2024-04-25T13:43:03.560117+0000","last_fullsized":"2024-04-25T13:43:03.560117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:07.705363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047716+0000","last_change":"2024-04-25T13:43:02.061334+0000","last_active":"2024-04-25T13:43:03.047716+0000","last_peered":"2024-04-25T13:43:03.047716+0000","last_clean":"2024-04-25T13:43:03.047716+0000","last_became_active":"2024-04-25T13:43:02.061037+0000","last_became_peered":"2024-04-25T13:43:02.061037+0000","last_unstale":"2024-04-25T13:43:03.047716+0000","last_undegraded":"2024-04-25T13:43:03.047716+0000","last_fullsized":"2024-04-25T13:43:03.047716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:01.861396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045783+0000","last_change":"2024-04-25T13:43:01.053326+0000","last_active":"2024-04-25T13:43:03.045783+0000","last_peered":"2024-04-25T13:43:03.045783+0000","last_clean":"2024-04-25T13:43:03.045783+0000","last_became_active":"2024-04-25T13:43:01.050687+0000","last_became_peered":"2024-04-25T13:43:01.050687+0000","last_unstale":"2024-04-25T13:43:03.045783+0000","last_undegraded":"2024-04-25T13:43:03.045783+0000","last_fullsized":"2024-04-25T13:43:03.045783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:04.643105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045757+0000","last_change":"2024-04-25T13:43:02.066148+0000","last_active":"2024-04-25T13:43:03.045757+0000","last_peered":"2024-04-25T13:43:03.045757+0000","last_clean":"2024-04-25T13:43:03.045757+0000","last_became_active":"2024-04-25T13:43:02.065862+0000","last_became_peered":"2024-04-25T13:43:02.065862+0000","last_unstale":"2024-04-25T13:43:03.045757+0000","last_undegraded":"2024-04-25T13:43:03.045757+0000","last_fullsized":"2024-04-25T13:43:03.045757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:01.861396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.055896+0000","last_change":"2024-04-25T13:43:01.054530+0000","last_active":"2024-04-25T13:43:03.055896+0000","last_peered":"2024-04-25T13:43:03.055896+0000","last_clean":"2024-04-25T13:43:03.055896+0000","last_became_active":"2024-04-25T13:43:01.053775+0000","last_became_peered":"2024-04-25T13:43:01.053775+0000","last_unstale":"2024-04-25T13:43:03.055896+0000","last_undegraded":"2024-04-25T13:43:03.055896+0000","last_fullsized":"2024-04-25T13:43:03.055896+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:23:42.245443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045856+0000","last_change":"2024-04-25T13:43:02.055473+0000","last_active":"2024-04-25T13:43:03.045856+0000","last_peered":"2024-04-25T13:43:03.045856+0000","last_clean":"2024-04-25T13:43:03.045856+0000","last_became_active":"2024-04-25T13:43:02.050454+0000","last_became_peered":"2024-04-25T13:43:02.050454+0000","last_unstale":"2024-04-25T13:43:03.045856+0000","last_undegraded":"2024-04-25T13:43:03.045856+0000","last_fullsized":"2024-04-25T13:43:03.045856+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:30:31.687953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047677+0000","last_change":"2024-04-25T13:43:01.053183+0000","last_active":"2024-04-25T13:43:03.047677+0000","last_peered":"2024-04-25T13:43:03.047677+0000","last_clean":"2024-04-25T13:43:03.047677+0000","last_became_active":"2024-04-25T13:43:01.052868+0000","last_became_peered":"2024-04-25T13:43:01.052868+0000","last_unstale":"2024-04-25T13:43:03.047677+0000","last_undegraded":"2024-04-25T13:43:03.047677+0000","last_fullsized":"2024-04-25T13:43:03.047677+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:15.253634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047541+0000","last_change":"2024-04-25T13:43:02.065620+0000","last_active":"2024-04-25T13:43:03.047541+0000","last_peered":"2024-04-25T13:43:03.047541+0000","last_clean":"2024-04-25T13:43:03.047541+0000","last_became_active":"2024-04-25T13:43:02.063428+0000","last_became_peered":"2024-04-25T13:43:02.063428+0000","last_unstale":"2024-04-25T13:43:03.047541+0000","last_undegraded":"2024-04-25T13:43:03.047541+0000","last_fullsized":"2024-04-25T13:43:03.047541+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:20.753160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045412+0000","last_change":"2024-04-25T13:43:01.055574+0000","last_active":"2024-04-25T13:43:03.045412+0000","last_peered":"2024-04-25T13:43:03.045412+0000","last_clean":"2024-04-25T13:43:03.045412+0000","last_became_active":"2024-04-25T13:43:01.055291+0000","last_became_peered":"2024-04-25T13:43:01.055291+0000","last_unstale":"2024-04-25T13:43:03.045412+0000","last_undegraded":"2024-04-25T13:43:03.045412+0000","last_fullsized":"2024-04-25T13:43:03.045412+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:15.253634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.058286+0000","last_change":"2024-04-25T13:43:02.058150+0000","last_active":"2024-04-25T13:43:03.058286+0000","last_peered":"2024-04-25T13:43:03.058286+0000","last_clean":"2024-04-25T13:43:03.058286+0000","last_became_active":"2024-04-25T13:43:02.057841+0000","last_became_peered":"2024-04-25T13:43:02.057841+0000","last_unstale":"2024-04-25T13:43:03.058286+0000","last_undegraded":"2024-04-25T13:43:03.058286+0000","last_fullsized":"2024-04-25T13:43:03.058286+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:58.157888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560436+0000","last_change":"2024-04-25T13:43:01.047523+0000","last_active":"2024-04-25T13:43:03.560436+0000","last_peered":"2024-04-25T13:43:03.560436+0000","last_clean":"2024-04-25T13:43:03.560436+0000","last_became_active":"2024-04-25T13:43:01.047235+0000","last_became_peered":"2024-04-25T13:43:01.047235+0000","last_unstale":"2024-04-25T13:43:03.560436+0000","last_undegraded":"2024-04-25T13:43:03.560436+0000","last_fullsized":"2024-04-25T13:43:03.560436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:23:42.245443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045346+0000","last_change":"2024-04-25T13:43:02.049588+0000","last_active":"2024-04-25T13:43:03.045346+0000","last_peered":"2024-04-25T13:43:03.045346+0000","last_clean":"2024-04-25T13:43:03.045346+0000","last_became_active":"2024-04-25T13:43:02.049210+0000","last_became_peered":"2024-04-25T13:43:02.049210+0000","last_unstale":"2024-04-25T13:43:03.045346+0000","last_undegraded":"2024-04-25T13:43:03.045346+0000","last_fullsized":"2024-04-25T13:43:03.045346+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:21.006899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.058418+0000","last_change":"2024-04-25T13:43:01.061145+0000","last_active":"2024-04-25T13:43:03.058418+0000","last_peered":"2024-04-25T13:43:03.058418+0000","last_clean":"2024-04-25T13:43:03.058418+0000","last_became_active":"2024-04-25T13:43:01.060386+0000","last_became_peered":"2024-04-25T13:43:01.060386+0000","last_unstale":"2024-04-25T13:43:03.058418+0000","last_undegraded":"2024-04-25T13:43:03.058418+0000","last_fullsized":"2024-04-25T13:43:03.058418+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:24.624016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.046794+0000","last_change":"2024-04-25T13:43:02.056912+0000","last_active":"2024-04-25T13:43:03.046794+0000","last_peered":"2024-04-25T13:43:03.046794+0000","last_clean":"2024-04-25T13:43:03.046794+0000","last_became_active":"2024-04-25T13:43:02.056448+0000","last_became_peered":"2024-04-25T13:43:02.056448+0000","last_unstale":"2024-04-25T13:43:03.046794+0000","last_undegraded":"2024-04-25T13:43:03.046794+0000","last_fullsized":"2024-04-25T13:43:03.046794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:21.006899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045139+0000","last_change":"2024-04-25T13:43:01.048740+0000","last_active":"2024-04-25T13:43:03.045139+0000","last_peered":"2024-04-25T13:43:03.045139+0000","last_clean":"2024-04-25T13:43:03.045139+0000","last_became_active":"2024-04-25T13:43:01.048301+0000","last_became_peered":"2024-04-25T13:43:01.048301+0000","last_unstale":"2024-04-25T13:43:03.045139+0000","last_undegraded":"2024-04-25T13:43:03.045139+0000","last_fullsized":"2024-04-25T13:43:03.045139+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:23:31.247563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560597+0000","last_change":"2024-04-25T13:43:02.058770+0000","last_active":"2024-04-25T13:43:03.560597+0000","last_peered":"2024-04-25T13:43:03.560597+0000","last_clean":"2024-04-25T13:43:03.560597+0000","last_became_active":"2024-04-25T13:43:02.058406+0000","last_became_peered":"2024-04-25T13:43:02.058406+0000","last_unstale":"2024-04-25T13:43:03.560597+0000","last_undegraded":"2024-04-25T13:43:03.560597+0000","last_fullsized":"2024-04-25T13:43:03.560597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:40.818979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045068+0000","last_change":"2024-04-25T13:43:01.055163+0000","last_active":"2024-04-25T13:43:03.045068+0000","last_peered":"2024-04-25T13:43:03.045068+0000","last_clean":"2024-04-25T13:43:03.045068+0000","last_became_active":"2024-04-25T13:43:01.054848+0000","last_became_peered":"2024-04-25T13:43:01.054848+0000","last_unstale":"2024-04-25T13:43:03.045068+0000","last_undegraded":"2024-04-25T13:43:03.045068+0000","last_fullsized":"2024-04-25T13:43:03.045068+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:39.813256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560969+0000","last_change":"2024-04-25T13:43:02.050680+0000","last_active":"2024-04-25T13:43:03.560969+0000","last_peered":"2024-04-25T13:43:03.560969+0000","last_clean":"2024-04-25T13:43:03.560969+0000","last_became_active":"2024-04-25T13:43:02.050292+0000","last_became_peered":"2024-04-25T13:43:02.050292+0000","last_unstale":"2024-04-25T13:43:03.560969+0000","last_undegraded":"2024-04-25T13:43:03.560969+0000","last_fullsized":"2024-04-25T13:43:03.560969+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:35:09.207923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.059215+0000","last_change":"2024-04-25T13:43:01.058233+0000","last_active":"2024-04-25T13:43:03.059215+0000","last_peered":"2024-04-25T13:43:03.059215+0000","last_clean":"2024-04-25T13:43:03.059215+0000","last_became_active":"2024-04-25T13:43:01.057838+0000","last_became_peered":"2024-04-25T13:43:01.057838+0000","last_unstale":"2024-04-25T13:43:03.059215+0000","last_undegraded":"2024-04-25T13:43:03.059215+0000","last_fullsized":"2024-04-25T13:43:03.059215+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:20.036515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047411+0000","last_change":"2024-04-25T13:43:02.048953+0000","last_active":"2024-04-25T13:43:03.047411+0000","last_peered":"2024-04-25T13:43:03.047411+0000","last_clean":"2024-04-25T13:43:03.047411+0000","last_became_active":"2024-04-25T13:43:02.048690+0000","last_became_peered":"2024-04-25T13:43:02.048690+0000","last_unstale":"2024-04-25T13:43:03.047411+0000","last_undegraded":"2024-04-25T13:43:03.047411+0000","last_fullsized":"2024-04-25T13:43:03.047411+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:09.182621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.561005+0000","last_change":"2024-04-25T13:43:01.047243+0000","last_active":"2024-04-25T13:43:03.561005+0000","last_peered":"2024-04-25T13:43:03.561005+0000","last_clean":"2024-04-25T13:43:03.561005+0000","last_became_active":"2024-04-25T13:43:01.045745+0000","last_became_peered":"2024-04-25T13:43:01.045745+0000","last_unstale":"2024-04-25T13:43:03.561005+0000","last_undegraded":"2024-04-25T13:43:03.561005+0000","last_fullsized":"2024-04-25T13:43:03.561005+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:41.123880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.058535+0000","last_change":"2024-04-25T13:43:02.080537+0000","last_active":"2024-04-25T13:43:03.058535+0000","last_peered":"2024-04-25T13:43:03.058535+0000","last_clean":"2024-04-25T13:43:03.058535+0000","last_became_active":"2024-04-25T13:43:02.079575+0000","last_became_peered":"2024-04-25T13:43:02.079575+0000","last_unstale":"2024-04-25T13:43:03.058535+0000","last_undegraded":"2024-04-25T13:43:03.058535+0000","last_fullsized":"2024-04-25T13:43:03.058535+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:34:22.883374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560406+0000","last_change":"2024-04-25T13:43:01.046288+0000","last_active":"2024-04-25T13:43:03.560406+0000","last_peered":"2024-04-25T13:43:03.560406+0000","last_clean":"2024-04-25T13:43:03.560406+0000","last_became_active":"2024-04-25T13:43:01.045408+0000","last_became_peered":"2024-04-25T13:43:01.045408+0000","last_unstale":"2024-04-25T13:43:03.560406+0000","last_undegraded":"2024-04-25T13:43:03.560406+0000","last_fullsized":"2024-04-25T13:43:03.560406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:42.454166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.558808+0000","last_change":"2024-04-25T13:43:02.053991+0000","last_active":"2024-04-25T13:43:03.558808+0000","last_peered":"2024-04-25T13:43:03.558808+0000","last_clean":"2024-04-25T13:43:03.558808+0000","last_became_active":"2024-04-25T13:43:02.053643+0000","last_became_peered":"2024-04-25T13:43:02.053643+0000","last_unstale":"2024-04-25T13:43:03.558808+0000","last_undegraded":"2024-04-25T13:43:03.558808+0000","last_fullsized":"2024-04-25T13:43:03.558808+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:03.130328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560040+0000","last_change":"2024-04-25T13:43:01.044957+0000","last_active":"2024-04-25T13:43:03.560040+0000","last_peered":"2024-04-25T13:43:03.560040+0000","last_clean":"2024-04-25T13:43:03.560040+0000","last_became_active":"2024-04-25T13:43:01.044434+0000","last_became_peered":"2024-04-25T13:43:01.044434+0000","last_unstale":"2024-04-25T13:43:03.560040+0000","last_undegraded":"2024-04-25T13:43:03.560040+0000","last_fullsized":"2024-04-25T13:43:03.560040+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:22.871357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.558650+0000","last_change":"2024-04-25T13:43:02.052992+0000","last_active":"2024-04-25T13:43:03.558650+0000","last_peered":"2024-04-25T13:43:03.558650+0000","last_clean":"2024-04-25T13:43:03.558650+0000","last_became_active":"2024-04-25T13:43:02.052625+0000","last_became_peered":"2024-04-25T13:43:02.052625+0000","last_unstale":"2024-04-25T13:43:03.558650+0000","last_undegraded":"2024-04-25T13:43:03.558650+0000","last_fullsized":"2024-04-25T13:43:03.558650+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:42.129603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.056000+0000","last_change":"2024-04-25T13:43:01.054327+0000","last_active":"2024-04-25T13:43:03.056000+0000","last_peered":"2024-04-25T13:43:03.056000+0000","last_clean":"2024-04-25T13:43:03.056000+0000","last_became_active":"2024-04-25T13:43:01.053997+0000","last_became_peered":"2024-04-25T13:43:01.053997+0000","last_unstale":"2024-04-25T13:43:03.056000+0000","last_undegraded":"2024-04-25T13:43:03.056000+0000","last_fullsized":"2024-04-25T13:43:03.056000+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:41.123880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.558782+0000","last_change":"2024-04-25T13:43:02.051196+0000","last_active":"2024-04-25T13:43:03.558782+0000","last_peered":"2024-04-25T13:43:03.558782+0000","last_clean":"2024-04-25T13:43:03.558782+0000","last_became_active":"2024-04-25T13:43:02.050898+0000","last_became_peered":"2024-04-25T13:43:02.050898+0000","last_unstale":"2024-04-25T13:43:03.558782+0000","last_undegraded":"2024-04-25T13:43:03.558782+0000","last_fullsized":"2024-04-25T13:43:03.558782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:23:43.251166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560886+0000","last_change":"2024-04-25T13:43:01.062512+0000","last_active":"2024-04-25T13:43:03.560886+0000","last_peered":"2024-04-25T13:43:03.560886+0000","last_clean":"2024-04-25T13:43:03.560886+0000","last_became_active":"2024-04-25T13:43:01.062296+0000","last_became_peered":"2024-04-25T13:43:01.062296+0000","last_unstale":"2024-04-25T13:43:03.560886+0000","last_undegraded":"2024-04-25T13:43:03.560886+0000","last_fullsized":"2024-04-25T13:43:03.560886+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:41.123880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.558447+0000","last_change":"2024-04-25T13:43:02.063282+0000","last_active":"2024-04-25T13:43:03.558447+0000","last_peered":"2024-04-25T13:43:03.558447+0000","last_clean":"2024-04-25T13:43:03.558447+0000","last_became_active":"2024-04-25T13:43:02.062150+0000","last_became_peered":"2024-04-25T13:43:02.062150+0000","last_unstale":"2024-04-25T13:43:03.558447+0000","last_undegraded":"2024-04-25T13:43:03.558447+0000","last_fullsized":"2024-04-25T13:43:03.558447+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:42.811763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.559934+0000","last_change":"2024-04-25T13:43:01.055323+0000","last_active":"2024-04-25T13:43:03.559934+0000","last_peered":"2024-04-25T13:43:03.559934+0000","last_clean":"2024-04-25T13:43:03.559934+0000","last_became_active":"2024-04-25T13:43:01.054980+0000","last_became_peered":"2024-04-25T13:43:01.054980+0000","last_unstale":"2024-04-25T13:43:03.559934+0000","last_undegraded":"2024-04-25T13:43:03.559934+0000","last_fullsized":"2024-04-25T13:43:03.559934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:15:13.581805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047972+0000","last_change":"2024-04-25T13:43:02.061410+0000","last_active":"2024-04-25T13:43:03.047972+0000","last_peered":"2024-04-25T13:43:03.047972+0000","last_clean":"2024-04-25T13:43:03.047972+0000","last_became_active":"2024-04-25T13:43:02.061111+0000","last_became_peered":"2024-04-25T13:43:02.061111+0000","last_unstale":"2024-04-25T13:43:03.047972+0000","last_undegraded":"2024-04-25T13:43:03.047972+0000","last_fullsized":"2024-04-25T13:43:03.047972+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:30:31.687953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.046321+0000","last_change":"2024-04-25T13:43:01.053595+0000","last_active":"2024-04-25T13:43:03.046321+0000","last_peered":"2024-04-25T13:43:03.046321+0000","last_clean":"2024-04-25T13:43:03.046321+0000","last_became_active":"2024-04-25T13:43:01.053168+0000","last_became_peered":"2024-04-25T13:43:01.053168+0000","last_unstale":"2024-04-25T13:43:03.046321+0000","last_undegraded":"2024-04-25T13:43:03.046321+0000","last_fullsized":"2024-04-25T13:43:03.046321+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:04.643105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.558743+0000","last_change":"2024-04-25T13:43:02.065593+0000","last_active":"2024-04-25T13:43:03.558743+0000","last_peered":"2024-04-25T13:43:03.558743+0000","last_clean":"2024-04-25T13:43:03.558743+0000","last_became_active":"2024-04-25T13:43:02.065301+0000","last_became_peered":"2024-04-25T13:43:02.065301+0000","last_unstale":"2024-04-25T13:43:03.558743+0000","last_undegraded":"2024-04-25T13:43:03.558743+0000","last_fullsized":"2024-04-25T13:43:03.558743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:23.877080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.059289+0000","last_change":"2024-04-25T13:43:01.058201+0000","last_active":"2024-04-25T13:43:03.059289+0000","last_peered":"2024-04-25T13:43:03.059289+0000","last_clean":"2024-04-25T13:43:03.059289+0000","last_became_active":"2024-04-25T13:43:01.057363+0000","last_became_peered":"2024-04-25T13:43:01.057363+0000","last_unstale":"2024-04-25T13:43:03.059289+0000","last_undegraded":"2024-04-25T13:43:03.059289+0000","last_fullsized":"2024-04-25T13:43:03.059289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:15.253634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047478+0000","last_change":"2024-04-25T13:43:02.078099+0000","last_active":"2024-04-25T13:43:03.047478+0000","last_peered":"2024-04-25T13:43:03.047478+0000","last_clean":"2024-04-25T13:43:03.047478+0000","last_became_active":"2024-04-25T13:43:02.077720+0000","last_became_peered":"2024-04-25T13:43:02.077720+0000","last_unstale":"2024-04-25T13:43:03.047478+0000","last_undegraded":"2024-04-25T13:43:03.047478+0000","last_fullsized":"2024-04-25T13:43:03.047478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:21.006899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.057670+0000","last_change":"2024-04-25T13:43:01.054773+0000","last_active":"2024-04-25T13:43:03.057670+0000","last_peered":"2024-04-25T13:43:03.057670+0000","last_clean":"2024-04-25T13:43:03.057670+0000","last_became_active":"2024-04-25T13:43:01.054213+0000","last_became_peered":"2024-04-25T13:43:01.054213+0000","last_unstale":"2024-04-25T13:43:03.057670+0000","last_undegraded":"2024-04-25T13:43:03.057670+0000","last_fullsized":"2024-04-25T13:43:03.057670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:02.124605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.055931+0000","last_change":"2024-04-25T13:43:02.059576+0000","last_active":"2024-04-25T13:43:03.055931+0000","last_peered":"2024-04-25T13:43:03.055931+0000","last_clean":"2024-04-25T13:43:03.055931+0000","last_became_active":"2024-04-25T13:43:02.059245+0000","last_became_peered":"2024-04-25T13:43:02.059245+0000","last_unstale":"2024-04-25T13:43:03.055931+0000","last_undegraded":"2024-04-25T13:43:03.055931+0000","last_fullsized":"2024-04-25T13:43:03.055931+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:05.648828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.058739+0000","last_change":"2024-04-25T13:43:01.057645+0000","last_active":"2024-04-25T13:43:03.058739+0000","last_peered":"2024-04-25T13:43:03.058739+0000","last_clean":"2024-04-25T13:43:03.058739+0000","last_became_active":"2024-04-25T13:43:01.057058+0000","last_became_peered":"2024-04-25T13:43:01.057058+0000","last_unstale":"2024-04-25T13:43:03.058739+0000","last_undegraded":"2024-04-25T13:43:03.058739+0000","last_fullsized":"2024-04-25T13:43:03.058739+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:19.256219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560874+0000","last_change":"2024-04-25T13:43:02.071715+0000","last_active":"2024-04-25T13:43:03.560874+0000","last_peered":"2024-04-25T13:43:03.560874+0000","last_clean":"2024-04-25T13:43:03.560874+0000","last_became_active":"2024-04-25T13:43:02.071485+0000","last_became_peered":"2024-04-25T13:43:02.071485+0000","last_unstale":"2024-04-25T13:43:03.560874+0000","last_undegraded":"2024-04-25T13:43:03.560874+0000","last_fullsized":"2024-04-25T13:43:03.560874+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:21.042238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.056061+0000","last_change":"2024-04-25T13:43:01.050555+0000","last_active":"2024-04-25T13:43:03.056061+0000","last_peered":"2024-04-25T13:43:03.056061+0000","last_clean":"2024-04-25T13:43:03.056061+0000","last_became_active":"2024-04-25T13:43:01.050263+0000","last_became_peered":"2024-04-25T13:43:01.050263+0000","last_unstale":"2024-04-25T13:43:03.056061+0000","last_undegraded":"2024-04-25T13:43:03.056061+0000","last_fullsized":"2024-04-25T13:43:03.056061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:39:35.551147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.055890+0000","last_change":"2024-04-25T13:43:02.057028+0000","last_active":"2024-04-25T13:43:03.055890+0000","last_peered":"2024-04-25T13:43:03.055890+0000","last_clean":"2024-04-25T13:43:03.055890+0000","last_became_active":"2024-04-25T13:43:02.050153+0000","last_became_peered":"2024-04-25T13:43:02.050153+0000","last_unstale":"2024-04-25T13:43:03.055890+0000","last_undegraded":"2024-04-25T13:43:03.055890+0000","last_fullsized":"2024-04-25T13:43:03.055890+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:16.259357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.058416+0000","last_change":"2024-04-25T13:43:01.059102+0000","last_active":"2024-04-25T13:43:03.058416+0000","last_peered":"2024-04-25T13:43:03.058416+0000","last_clean":"2024-04-25T13:43:03.058416+0000","last_became_active":"2024-04-25T13:43:01.058822+0000","last_became_peered":"2024-04-25T13:43:01.058822+0000","last_unstale":"2024-04-25T13:43:03.058416+0000","last_undegraded":"2024-04-25T13:43:03.058416+0000","last_fullsized":"2024-04-25T13:43:03.058416+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:14:15.076513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.044974+0000","last_change":"2024-04-25T13:43:02.063540+0000","last_active":"2024-04-25T13:43:03.044974+0000","last_peered":"2024-04-25T13:43:03.044974+0000","last_clean":"2024-04-25T13:43:03.044974+0000","last_became_active":"2024-04-25T13:43:02.063232+0000","last_became_peered":"2024-04-25T13:43:02.063232+0000","last_unstale":"2024-04-25T13:43:03.044974+0000","last_undegraded":"2024-04-25T13:43:03.044974+0000","last_fullsized":"2024-04-25T13:43:03.044974+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:34:26.744118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560622+0000","last_change":"2024-04-25T13:43:01.044355+0000","last_active":"2024-04-25T13:43:03.560622+0000","last_peered":"2024-04-25T13:43:03.560622+0000","last_clean":"2024-04-25T13:43:03.560622+0000","last_became_active":"2024-04-25T13:43:01.043978+0000","last_became_peered":"2024-04-25T13:43:01.043978+0000","last_unstale":"2024-04-25T13:43:03.560622+0000","last_undegraded":"2024-04-25T13:43:03.560622+0000","last_fullsized":"2024-04-25T13:43:03.560622+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:11:59.665263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.559770+0000","last_change":"2024-04-25T13:43:02.053556+0000","last_active":"2024-04-25T13:43:03.559770+0000","last_peered":"2024-04-25T13:43:03.559770+0000","last_clean":"2024-04-25T13:43:03.559770+0000","last_became_active":"2024-04-25T13:43:02.053164+0000","last_became_peered":"2024-04-25T13:43:02.053164+0000","last_unstale":"2024-04-25T13:43:03.559770+0000","last_undegraded":"2024-04-25T13:43:03.559770+0000","last_fullsized":"2024-04-25T13:43:03.559770+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:07:48.512600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.045219+0000","last_change":"2024-04-25T13:43:01.057660+0000","last_active":"2024-04-25T13:43:03.045219+0000","last_peered":"2024-04-25T13:43:03.045219+0000","last_clean":"2024-04-25T13:43:03.045219+0000","last_became_active":"2024-04-25T13:43:01.056117+0000","last_became_peered":"2024-04-25T13:43:01.056117+0000","last_unstale":"2024-04-25T13:43:03.045219+0000","last_undegraded":"2024-04-25T13:43:03.045219+0000","last_fullsized":"2024-04-25T13:43:03.045219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:34:19.256219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.046561+0000","last_change":"2024-04-25T13:43:02.054382+0000","last_active":"2024-04-25T13:43:03.046561+0000","last_peered":"2024-04-25T13:43:03.046561+0000","last_clean":"2024-04-25T13:43:03.046561+0000","last_became_active":"2024-04-25T13:43:02.054070+0000","last_became_peered":"2024-04-25T13:43:02.054070+0000","last_unstale":"2024-04-25T13:43:03.046561+0000","last_undegraded":"2024-04-25T13:43:03.046561+0000","last_fullsized":"2024-04-25T13:43:03.046561+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:01.021367+0000","last_clean_scrub_stamp":"2024-04-25T13:43:01.021367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:23:07.440759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.560276+0000","last_change":"2024-04-25T13:43:01.059669+0000","last_active":"2024-04-25T13:43:03.560276+0000","last_peered":"2024-04-25T13:43:03.560276+0000","last_clean":"2024-04-25T13:43:03.560276+0000","last_became_active":"2024-04-25T13:43:01.058810+0000","last_became_peered":"2024-04-25T13:43:01.058810+0000","last_unstale":"2024-04-25T13:43:03.560276+0000","last_undegraded":"2024-04-25T13:43:03.560276+0000","last_fullsized":"2024-04-25T13:43:03.560276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:43:00.015644+0000","last_clean_scrub_stamp":"2024-04-25T13:43:00.015644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:05:41.806040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":135,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047968+0000","last_change":"2024-04-25T13:41:56.890628+0000","last_active":"2024-04-25T13:43:03.047968+0000","last_peered":"2024-04-25T13:43:03.047968+0000","last_clean":"2024-04-25T13:43:03.047968+0000","last_became_active":"2024-04-25T13:41:56.889261+0000","last_became_peered":"2024-04-25T13:41:56.889261+0000","last_unstale":"2024-04-25T13:43:03.047968+0000","last_undegraded":"2024-04-25T13:43:03.047968+0000","last_fullsized":"2024-04-25T13:43:03.047968+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:53.940471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:53.940471+0000","last_clean_scrub_stamp":"2024-04-25T13:41:53.940471+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:06.164380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":970752,"data_stored":735823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":145981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":152337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":145469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":146999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":376832,"data_stored":145435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":146999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":966656,"data_stored":735733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:43:06.563 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T13:43:06.563 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T13:43:06.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.747+0000 7fdc15e00640 1 Processor -- start 2024-04-25T13:43:06.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.747+0000 7fdc15e00640 1 -- start start 2024-04-25T13:43:06.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.751+0000 7fdc15e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc10072f30 0x7fdc10073340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:06.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.751+0000 7fdc15e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdc100b08f0 0x7fdc100b0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:06.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.751+0000 7fdc15e00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdc10163a30 0x7fdc10163e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:06.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.751+0000 7fdc15e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fdc100afdf0 con 0x7fdc100b08f0 2024-04-25T13:43:06.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.751+0000 7fdc15e00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fdc10073880 con 0x7fdc10163a30 2024-04-25T13:43:06.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.751+0000 7fdc15e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fdc100af220 con 0x7fdc10072f30 2024-04-25T13:43:06.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.751+0000 7fdc06000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdc100b08f0 0x7fdc100b0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:06.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.751+0000 7fdc06000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fdc100b08f0 0x7fdc100b0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47498/0 (socket says 172.21.15.123:47498) 2024-04-25T13:43:06.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.751+0000 7fdc06000640 1 -- 172.21.15.123:0/4271171156 learned_addr learned my addr 172.21.15.123:0/4271171156 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:06.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.751+0000 7fdc0f400640 1 --2- 172.21.15.123:0/4271171156 >> v2:172.21.15.130:3300/0 conn(0x7fdc10163a30 0x7fdc10163e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:06.755 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.751+0000 7fdc0ea00640 1 --2- 172.21.15.123:0/4271171156 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc10072f30 0x7fdc10073340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:06.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.751+0000 7fdc06000640 1 -- 172.21.15.123:0/4271171156 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc10072f30 msgr2=0x7fdc10073340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:06.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.751+0000 7fdc06000640 1 --2- 172.21.15.123:0/4271171156 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc10072f30 0x7fdc10073340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:06.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.751+0000 7fdc06000640 1 -- 172.21.15.123:0/4271171156 >> v2:172.21.15.130:3300/0 conn(0x7fdc10163a30 msgr2=0x7fdc10163e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:06.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.751+0000 7fdc06000640 1 --2- 172.21.15.123:0/4271171156 >> v2:172.21.15.130:3300/0 conn(0x7fdc10163a30 0x7fdc10163e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:06.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.751+0000 7fdc06000640 1 -- 172.21.15.123:0/4271171156 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc100af4c0 con 0x7fdc100b08f0 2024-04-25T13:43:06.756 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.751+0000 7fdc0f400640 1 --2- 172.21.15.123:0/4271171156 >> v2:172.21.15.130:3300/0 conn(0x7fdc10163a30 0x7fdc10163e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:06.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.755+0000 7fdc06000640 1 --2- 172.21.15.123:0/4271171156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc100b08f0 0x7fdc100b0d00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdc1015df80 tx=0x7fdbf801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d76017966e006ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:06.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.755+0000 7fdc0e000640 1 -- 172.21.15.123:0/4271171156 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf80b0070 con 0x7fdc100b08f0 2024-04-25T13:43:06.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.755+0000 7fdc0e000640 1 -- 172.21.15.123:0/4271171156 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbf80ab600 con 0x7fdc100b08f0 2024-04-25T13:43:06.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.755+0000 7fdc0e000640 1 -- 172.21.15.123:0/4271171156 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf80ab9d0 con 0x7fdc100b08f0 2024-04-25T13:43:06.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.755+0000 7fdc15e00640 1 -- 172.21.15.123:0/4271171156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc100b08f0 msgr2=0x7fdc100b0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:06.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.755+0000 7fdc15e00640 1 --2- 172.21.15.123:0/4271171156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc100b08f0 0x7fdc100b0d00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdc1015df80 tx=0x7fdbf801c490 comp rx=0 tx=0).stop 2024-04-25T13:43:06.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.755+0000 7fdc15e00640 1 -- 172.21.15.123:0/4271171156 shutdown_connections 2024-04-25T13:43:06.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.755+0000 7fdc15e00640 1 --2- 172.21.15.123:0/4271171156 >> v2:172.21.15.130:3300/0 conn(0x7fdc10163a30 0x7fdc10163e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:06.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.755+0000 7fdc15e00640 1 --2- 172.21.15.123:0/4271171156 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc100b08f0 0x7fdc100b0d00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:06.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.755+0000 7fdc15e00640 1 --2- 172.21.15.123:0/4271171156 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc10072f30 0x7fdc10073340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:06.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.755+0000 7fdc15e00640 1 -- 172.21.15.123:0/4271171156 >> 172.21.15.123:0/4271171156 conn(0x7fdc1006cc70 msgr2=0x7fdc100b3600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:06.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.755+0000 7fdc15e00640 1 -- 172.21.15.123:0/4271171156 shutdown_connections 2024-04-25T13:43:06.760 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.755+0000 7fdc15e00640 1 -- 172.21.15.123:0/4271171156 wait complete. 2024-04-25T13:43:06.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.759+0000 7fdc15e00640 1 Processor -- start 2024-04-25T13:43:06.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.759+0000 7fdc15e00640 1 -- start start 2024-04-25T13:43:06.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.759+0000 7fdc15e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc10072f30 0x7fdc1013e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:06.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.759+0000 7fdc15e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc100b08f0 0x7fdc1013ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:06.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.759+0000 7fdc15e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc10163a30 0x7fdc100b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:06.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.759+0000 7fdc15e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fdc100b1240 con 0x7fdc100b08f0 2024-04-25T13:43:06.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.759+0000 7fdc15e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdc101571f0 con 0x7fdc10163a30 2024-04-25T13:43:06.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.759+0000 7fdc15e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fdc100b13c0 con 0x7fdc10072f30 2024-04-25T13:43:06.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.759+0000 7fdc06000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc100b08f0 0x7fdc1013ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:06.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.759+0000 7fdc06000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc100b08f0 0x7fdc1013ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47510/0 (socket says 172.21.15.123:47510) 2024-04-25T13:43:06.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.759+0000 7fdc06000640 1 -- 172.21.15.123:0/74138351 learned_addr learned my addr 172.21.15.123:0/74138351 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:06.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.759+0000 7fdc0f400640 1 --2- 172.21.15.123:0/74138351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc10163a30 0x7fdc100b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:06.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.759+0000 7fdc0ea00640 1 --2- 172.21.15.123:0/74138351 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc10072f30 0x7fdc1013e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:06.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.759+0000 7fdc06000640 1 -- 172.21.15.123:0/74138351 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc10072f30 msgr2=0x7fdc1013e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:06.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.759+0000 7fdc06000640 1 --2- 172.21.15.123:0/74138351 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc10072f30 0x7fdc1013e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:06.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.759+0000 7fdc06000640 1 -- 172.21.15.123:0/74138351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc10163a30 msgr2=0x7fdc100b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:06.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.759+0000 7fdc06000640 1 --2- 172.21.15.123:0/74138351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc10163a30 0x7fdc100b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:06.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.759+0000 7fdc06000640 1 -- 172.21.15.123:0/74138351 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc100b27d0 con 0x7fdc100b08f0 2024-04-25T13:43:06.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.759+0000 7fdc06000640 1 --2- 172.21.15.123:0/74138351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc100b08f0 0x7fdc1013ec30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8000c10 tx=0x7fdbf8019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:06.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.759+0000 7fdc07e00640 1 -- 172.21.15.123:0/74138351 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf80b0040 con 0x7fdc100b08f0 2024-04-25T13:43:06.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.759+0000 7fdc07e00640 1 -- 172.21.15.123:0/74138351 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbf80b4400 con 0x7fdc100b08f0 2024-04-25T13:43:06.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.759+0000 7fdc07e00640 1 -- 172.21.15.123:0/74138351 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf80b47d0 con 0x7fdc100b08f0 2024-04-25T13:43:06.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.759+0000 7fdc15e00640 1 -- 172.21.15.123:0/74138351 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc100b2ab0 con 0x7fdc100b08f0 2024-04-25T13:43:06.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.759+0000 7fdc15e00640 1 -- 172.21.15.123:0/74138351 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc1013f460 con 0x7fdc100b08f0 2024-04-25T13:43:06.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.763+0000 7fdc15e00640 1 -- 172.21.15.123:0/74138351 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc100b3ff0 con 0x7fdc100b08f0 2024-04-25T13:43:06.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.763+0000 7fdc07e00640 1 -- 172.21.15.123:0/74138351 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fdbf80b4970 con 0x7fdc100b08f0 2024-04-25T13:43:06.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.763+0000 7fdc07e00640 1 --2- 172.21.15.123:0/74138351 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdbec06f430 0x7fdbec071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:06.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.763+0000 7fdc07e00640 1 -- 172.21.15.123:0/74138351 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fdbf8128c90 con 0x7fdc100b08f0 2024-04-25T13:43:06.767 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.763+0000 7fdc0ea00640 1 --2- 172.21.15.123:0/74138351 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdbec06f430 0x7fdbec071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:06.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.763+0000 7fdc0ea00640 1 --2- 172.21.15.123:0/74138351 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdbec06f430 0x7fdbec071940 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdc00003ab0 tx=0x7fdc00009830 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:06.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.767+0000 7fdc07e00640 1 -- 172.21.15.123:0/74138351 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdbf8016110 con 0x7fdc100b08f0 2024-04-25T13:43:06.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.979+0000 7fdc15e00640 1 -- 172.21.15.123:0/74138351 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fdc100507c0 con 0x7fdc100b08f0 2024-04-25T13:43:06.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.983+0000 7fdc07e00640 1 -- 172.21.15.123:0/74138351 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7fdbf80f55b0 con 0x7fdc100b08f0 2024-04-25T13:43:06.986 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2024-04-25T13:43:06.986 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQByXSpmo/9OExAA/kno6dfYddtdaT2e+prGDQ== 2024-04-25T13:43:06.986 INFO:teuthology.orchestra.run.smithi123.stdout: caps mds = "allow" 2024-04-25T13:43:06.986 INFO:teuthology.orchestra.run.smithi123.stdout: caps mon = "allow r" 2024-04-25T13:43:06.986 INFO:teuthology.orchestra.run.smithi123.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T13:43:06.986 INFO:teuthology.orchestra.run.smithi123.stderr:updated caps for client.0 2024-04-25T13:43:06.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.983+0000 7fdc15e00640 1 -- 172.21.15.123:0/74138351 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdbec06f430 msgr2=0x7fdbec071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:06.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.983+0000 7fdc15e00640 1 --2- 172.21.15.123:0/74138351 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdbec06f430 0x7fdbec071940 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdc00003ab0 tx=0x7fdc00009830 comp rx=0 tx=0).stop 2024-04-25T13:43:06.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.983+0000 7fdc15e00640 1 -- 172.21.15.123:0/74138351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc100b08f0 msgr2=0x7fdc1013ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:06.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.983+0000 7fdc15e00640 1 --2- 172.21.15.123:0/74138351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc100b08f0 0x7fdc1013ec30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8000c10 tx=0x7fdbf8019230 comp rx=0 tx=0).stop 2024-04-25T13:43:06.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.983+0000 7fdc15e00640 1 -- 172.21.15.123:0/74138351 shutdown_connections 2024-04-25T13:43:06.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.983+0000 7fdc15e00640 1 --2- 172.21.15.123:0/74138351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc10163a30 0x7fdc100b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:06.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.983+0000 7fdc15e00640 1 --2- 172.21.15.123:0/74138351 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdbec06f430 0x7fdbec071940 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:06.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.983+0000 7fdc15e00640 1 --2- 172.21.15.123:0/74138351 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fdc100b08f0 0x7fdc1013ec30 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:06.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.983+0000 7fdc15e00640 1 --2- 172.21.15.123:0/74138351 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc10072f30 0x7fdc1013e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:06.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.983+0000 7fdc15e00640 1 -- 172.21.15.123:0/74138351 >> 172.21.15.123:0/74138351 conn(0x7fdc1006cc70 msgr2=0x7fdc10161570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:06.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.987+0000 7fdc15e00640 1 -- 172.21.15.123:0/74138351 shutdown_connections 2024-04-25T13:43:06.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:06.987+0000 7fdc15e00640 1 -- 172.21.15.123:0/74138351 wait complete. 2024-04-25T13:43:07.008 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:43:07.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.151+0000 7fcb5ec00640 1 Processor -- start 2024-04-25T13:43:07.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.151+0000 7fcb5ec00640 1 -- start start 2024-04-25T13:43:07.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.155+0000 7fcb5ec00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcb580747a0 0x7fcb5815fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.155+0000 7fcb5ec00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb58145d70 con 0x7fcb580b5670 2024-04-25T13:43:07.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.155+0000 7fcb5ec00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb581606f0 con 0x7fcb581602e0 2024-04-25T13:43:07.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.155+0000 7fcb5ec00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fcb58074290 con 0x7fcb580747a0 2024-04-25T13:43:07.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.155+0000 7fcb57e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcb580747a0 0x7fcb5815fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.155+0000 7fcb5cc00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fcb580b5670 0x7fcb580731e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:36594/0 (socket says 172.21.15.123:36594) 2024-04-25T13:43:07.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.155+0000 7fcb5cc00640 1 -- 172.21.15.123:0/399026556 learned_addr learned my addr 172.21.15.123:0/399026556 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:07.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.155+0000 7fcb57e00640 1 -- 172.21.15.123:0/399026556 >> v1:172.21.15.130:6789/0 conn(0x7fcb581602e0 legacy=0x7fcb58072ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:07.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.155+0000 7fcb57e00640 1 -- 172.21.15.123:0/399026556 >> v1:172.21.15.123:6789/0 conn(0x7fcb580b5670 legacy=0x7fcb580731e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:07.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.155+0000 7fcb57e00640 1 -- 172.21.15.123:0/399026556 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb58073c80 con 0x7fcb580747a0 2024-04-25T13:43:07.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.155+0000 7fcb57400640 1 -- 172.21.15.123:0/399026556 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2963885124 0 0) 0x7fcb500014a0 con 0x7fcb580b5670 2024-04-25T13:43:07.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.159+0000 7fcb57e00640 1 --2- 172.21.15.123:0/399026556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb580747a0 0x7fcb5815fda0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800a960 tx=0x7fcb4801d870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700c85aa4c069df7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:07.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.159+0000 7fcb57400640 1 -- 172.21.15.123:0/399026556 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb480b3070 con 0x7fcb580747a0 2024-04-25T13:43:07.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.159+0000 7fcb57400640 1 -- 172.21.15.123:0/399026556 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb480a6790 con 0x7fcb580747a0 2024-04-25T13:43:07.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.159+0000 7fcb57400640 1 -- 172.21.15.123:0/399026556 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4800b040 con 0x7fcb580747a0 2024-04-25T13:43:07.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.159+0000 7fcb5ec00640 1 -- 172.21.15.123:0/399026556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb580747a0 msgr2=0x7fcb5815fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:07.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.159+0000 7fcb5ec00640 1 --2- 172.21.15.123:0/399026556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb580747a0 0x7fcb5815fda0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800a960 tx=0x7fcb4801d870 comp rx=0 tx=0).stop 2024-04-25T13:43:07.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.159+0000 7fcb5ec00640 1 -- 172.21.15.123:0/399026556 shutdown_connections 2024-04-25T13:43:07.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.159+0000 7fcb5ec00640 1 --2- 172.21.15.123:0/399026556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb580747a0 0x7fcb5815fda0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.159+0000 7fcb5ec00640 1 -- 172.21.15.123:0/399026556 >> 172.21.15.123:0/399026556 conn(0x7fcb5806d210 msgr2=0x7fcb5806ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:07.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.159+0000 7fcb5ec00640 1 -- 172.21.15.123:0/399026556 shutdown_connections 2024-04-25T13:43:07.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.159+0000 7fcb5ec00640 1 -- 172.21.15.123:0/399026556 wait complete. 2024-04-25T13:43:07.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.163+0000 7fcb5ec00640 1 Processor -- start 2024-04-25T13:43:07.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.163+0000 7fcb5ec00640 1 -- start start 2024-04-25T13:43:07.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.163+0000 7fcb5ec00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb580747a0 0x7fcb581447d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.163+0000 7fcb5ec00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb580b5670 0x7fcb5813bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.163+0000 7fcb5ec00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb581602e0 0x7fcb580af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.163+0000 7fcb5ec00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcb580738f0 con 0x7fcb580747a0 2024-04-25T13:43:07.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.163+0000 7fcb5ec00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcb58074bb0 con 0x7fcb581602e0 2024-04-25T13:43:07.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.163+0000 7fcb5ec00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fcb580b6380 con 0x7fcb580b5670 2024-04-25T13:43:07.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.163+0000 7fcb57e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb580747a0 0x7fcb581447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.163+0000 7fcb57e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb580747a0 0x7fcb581447d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47524/0 (socket says 172.21.15.123:47524) 2024-04-25T13:43:07.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.163+0000 7fcb57e00640 1 -- 172.21.15.123:0/3082650326 learned_addr learned my addr 172.21.15.123:0/3082650326 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:07.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.163+0000 7fcb57e00640 1 -- 172.21.15.123:0/3082650326 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb580b5670 msgr2=0x7fcb5813bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:07.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.163+0000 7fcb57e00640 1 --2- 172.21.15.123:0/3082650326 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb580b5670 0x7fcb5813bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.163+0000 7fcb57e00640 1 -- 172.21.15.123:0/3082650326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb581602e0 msgr2=0x7fcb580af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:07.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.163+0000 7fcb57e00640 1 --2- 172.21.15.123:0/3082650326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb581602e0 0x7fcb580af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.163+0000 7fcb57e00640 1 -- 172.21.15.123:0/3082650326 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb58157b00 con 0x7fcb580747a0 2024-04-25T13:43:07.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.163+0000 7fcb57e00640 1 --2- 172.21.15.123:0/3082650326 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb580747a0 0x7fcb581447d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800a960 tx=0x7fcb4801a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:07.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.163+0000 7fcb54c00640 1 -- 172.21.15.123:0/3082650326 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb480bc070 con 0x7fcb580747a0 2024-04-25T13:43:07.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.163+0000 7fcb54c00640 1 -- 172.21.15.123:0/3082650326 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb48004030 con 0x7fcb580747a0 2024-04-25T13:43:07.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.163+0000 7fcb54c00640 1 -- 172.21.15.123:0/3082650326 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb480b3040 con 0x7fcb580747a0 2024-04-25T13:43:07.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.163+0000 7fcb5ec00640 1 -- 172.21.15.123:0/3082650326 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb58142c40 con 0x7fcb580747a0 2024-04-25T13:43:07.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.163+0000 7fcb5ec00640 1 -- 172.21.15.123:0/3082650326 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb58143200 con 0x7fcb580747a0 2024-04-25T13:43:07.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.167+0000 7fcb5ec00640 1 -- 172.21.15.123:0/3082650326 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb580507c0 con 0x7fcb580747a0 2024-04-25T13:43:07.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.167+0000 7fcb54c00640 1 -- 172.21.15.123:0/3082650326 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fcb480ae770 con 0x7fcb580747a0 2024-04-25T13:43:07.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.167+0000 7fcb54c00640 1 --2- 172.21.15.123:0/3082650326 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fcb3406f430 0x7fcb34071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.167+0000 7fcb54c00640 1 -- 172.21.15.123:0/3082650326 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fcb48128d00 con 0x7fcb580747a0 2024-04-25T13:43:07.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.167+0000 7fcb4f400640 1 --2- 172.21.15.123:0/3082650326 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fcb3406f430 0x7fcb34071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.167+0000 7fcb4f400640 1 --2- 172.21.15.123:0/3082650326 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fcb3406f430 0x7fcb34071940 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcb40000f70 tx=0x7fcb400079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:07.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.171+0000 7fcb54c00640 1 -- 172.21.15.123:0/3082650326 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcb4800a020 con 0x7fcb580747a0 2024-04-25T13:43:07.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.359+0000 7fcb5ec00640 1 -- 172.21.15.123:0/3082650326 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb58160060 con 0x7fcb580747a0 2024-04-25T13:43:07.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.359+0000 7fcb54c00640 1 -- 172.21.15.123:0/3082650326 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5187 (secure 0 0 0) 0x7fcb48017460 con 0x7fcb580747a0 2024-04-25T13:43:07.365 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:07.365 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3582988979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":3582988979},{"type":"v1","addr":"172.21.15.130:6835","nonce":3582988979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4978,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/173287078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":173287078},{"type":"v1","addr":"172.21.15.123:6837","nonce":173287078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4987,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/4025543653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4025543653},{"type":"v1","addr":"172.21.15.130:6834","nonce":4025543653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:43:01.431292+0000","modified":"2024-04-25T13:43:04.442129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6836/499623122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":499623122},{"type":"v1","addr":"172.21.15.123:6836","nonce":499623122}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5046,"qdb_cluster":[5046]},"id":2}]} 2024-04-25T13:43:07.367 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 17 2024-04-25T13:43:07.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.363+0000 7fcb5ec00640 1 -- 172.21.15.123:0/3082650326 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fcb3406f430 msgr2=0x7fcb34071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:07.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.363+0000 7fcb5ec00640 1 --2- 172.21.15.123:0/3082650326 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fcb3406f430 0x7fcb34071940 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcb40000f70 tx=0x7fcb400079c0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.363+0000 7fcb5ec00640 1 -- 172.21.15.123:0/3082650326 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb580747a0 msgr2=0x7fcb581447d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:07.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.363+0000 7fcb5ec00640 1 --2- 172.21.15.123:0/3082650326 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb580747a0 0x7fcb581447d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800a960 tx=0x7fcb4801a610 comp rx=0 tx=0).stop 2024-04-25T13:43:07.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.363+0000 7fcb5ec00640 1 -- 172.21.15.123:0/3082650326 shutdown_connections 2024-04-25T13:43:07.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.363+0000 7fcb5ec00640 1 --2- 172.21.15.123:0/3082650326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb581602e0 0x7fcb580af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.363+0000 7fcb5ec00640 1 --2- 172.21.15.123:0/3082650326 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fcb3406f430 0x7fcb34071940 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.363+0000 7fcb5ec00640 1 --2- 172.21.15.123:0/3082650326 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb580b5670 0x7fcb5813bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.363+0000 7fcb5ec00640 1 --2- 172.21.15.123:0/3082650326 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb580747a0 0x7fcb581447d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.363+0000 7fcb5ec00640 1 -- 172.21.15.123:0/3082650326 >> 172.21.15.123:0/3082650326 conn(0x7fcb5806d210 msgr2=0x7fcb580b12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:07.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.363+0000 7fcb5ec00640 1 -- 172.21.15.123:0/3082650326 shutdown_connections 2024-04-25T13:43:07.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.363+0000 7fcb5ec00640 1 -- 172.21.15.123:0/3082650326 wait complete. 2024-04-25T13:43:07.788 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T13:43:01.431292+0000', 'modified': '2024-04-25T13:43:04.442129+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5046}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5046': {'gid': 5046, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.123:6836/499623122', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6834', 'nonce': 499623122}, {'type': 'v1', 'addr': '172.21.15.123:6836', 'nonce': 499623122}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5046, 'qdb_cluster': [5046]} 2024-04-25T13:43:07.788 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T13:43:07.789 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T13:43:07.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.931+0000 7f2407200640 1 Processor -- start 2024-04-25T13:43:07.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.931+0000 7f2407200640 1 -- start start 2024-04-25T13:43:07.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.935+0000 7f2407200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f24001571b0 0x7f24000cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.935+0000 7f2407200640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2400072af0 0x7f2400072f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.935+0000 7f2407200640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24000cdee0 con 0x7f24000b3870 2024-04-25T13:43:07.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.935+0000 7f2407200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f240015d570 con 0x7f24001571b0 2024-04-25T13:43:07.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.935+0000 7f2407200640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f240015d850 con 0x7f2400072af0 2024-04-25T13:43:07.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.935+0000 7f23ffe00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f24001571b0 0x7f24000cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.935+0000 7f23ffe00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f24001571b0 0x7f24000cd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47528/0 (socket says 172.21.15.123:47528) 2024-04-25T13:43:07.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.935+0000 7f23ffe00640 1 -- 172.21.15.123:0/905901825 learned_addr learned my addr 172.21.15.123:0/905901825 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:07.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.935+0000 7f2405200640 1 --2- 172.21.15.123:0/905901825 >> v2:172.21.15.130:3300/0 conn(0x7f2400072af0 0x7f2400072f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.935+0000 7f23ffe00640 1 -- 172.21.15.123:0/905901825 >> v2:172.21.15.130:3300/0 conn(0x7f2400072af0 msgr2=0x7f2400072f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:07.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.935+0000 7f23ffe00640 1 --2- 172.21.15.123:0/905901825 >> v2:172.21.15.130:3300/0 conn(0x7f2400072af0 0x7f2400072f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.935+0000 7f23ffe00640 1 -- 172.21.15.123:0/905901825 >> v1:172.21.15.130:6789/0 conn(0x7f24000b3870 legacy=0x7f24000b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:07.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.935+0000 7f23ffe00640 1 -- 172.21.15.123:0/905901825 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240015db30 con 0x7f24001571b0 2024-04-25T13:43:07.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.939+0000 7f23ffe00640 1 --2- 172.21.15.123:0/905901825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24001571b0 0x7f24000cd6b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f24000c7160 tx=0x7f23f001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ae5d52762aa2bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:07.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.939+0000 7f23ff400640 1 -- 172.21.15.123:0/905901825 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f00a5840 con 0x7f24001571b0 2024-04-25T13:43:07.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.939+0000 7f23ff400640 1 -- 172.21.15.123:0/905901825 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f00a59e0 con 0x7f24001571b0 2024-04-25T13:43:07.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.939+0000 7f23ff400640 1 -- 172.21.15.123:0/905901825 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f00a5db0 con 0x7f24001571b0 2024-04-25T13:43:07.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.939+0000 7f2407200640 1 -- 172.21.15.123:0/905901825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24001571b0 msgr2=0x7f24000cd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:07.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.939+0000 7f2407200640 1 --2- 172.21.15.123:0/905901825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24001571b0 0x7f24000cd6b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f24000c7160 tx=0x7f23f001c920 comp rx=0 tx=0).stop 2024-04-25T13:43:07.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.939+0000 7f2407200640 1 -- 172.21.15.123:0/905901825 shutdown_connections 2024-04-25T13:43:07.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.939+0000 7f2407200640 1 --2- 172.21.15.123:0/905901825 >> v2:172.21.15.130:3300/0 conn(0x7f2400072af0 0x7f2400072f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.939+0000 7f2407200640 1 --2- 172.21.15.123:0/905901825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f24001571b0 0x7f24000cd6b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.939+0000 7f2407200640 1 -- 172.21.15.123:0/905901825 >> 172.21.15.123:0/905901825 conn(0x7f240006ca70 msgr2=0x7f240006ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:07.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.939+0000 7f2407200640 1 -- 172.21.15.123:0/905901825 shutdown_connections 2024-04-25T13:43:07.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.939+0000 7f2407200640 1 -- 172.21.15.123:0/905901825 wait complete. 2024-04-25T13:43:07.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.939+0000 7f2407200640 1 Processor -- start 2024-04-25T13:43:07.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.943+0000 7f2407200640 1 -- start start 2024-04-25T13:43:07.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.943+0000 7f2407200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2400072af0 0x7f2400150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.943+0000 7f2407200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24000b3870 0x7f240014f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.943+0000 7f2407200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f24001571b0 0x7f2400141220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.943+0000 7f2407200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2400157740 con 0x7f2400072af0 2024-04-25T13:43:07.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.943+0000 7f2407200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f24001575c0 con 0x7f24000b3870 2024-04-25T13:43:07.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.943+0000 7f2407200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2400073850 con 0x7f24001571b0 2024-04-25T13:43:07.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.943+0000 7f23ffe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2400072af0 0x7f2400150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.943+0000 7f23ffe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2400072af0 0x7f2400150b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47544/0 (socket says 172.21.15.123:47544) 2024-04-25T13:43:07.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.943+0000 7f23ffe00640 1 -- 172.21.15.123:0/1670139050 learned_addr learned my addr 172.21.15.123:0/1670139050 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:07.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.943+0000 7f23f7400640 1 --2- 172.21.15.123:0/1670139050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24000b3870 0x7f240014f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.943+0000 7f2405200640 1 --2- 172.21.15.123:0/1670139050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f24001571b0 0x7f2400141220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.943+0000 7f23ffe00640 1 -- 172.21.15.123:0/1670139050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f24001571b0 msgr2=0x7f2400141220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:07.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.943+0000 7f23ffe00640 1 --2- 172.21.15.123:0/1670139050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f24001571b0 0x7f2400141220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.943+0000 7f23ffe00640 1 -- 172.21.15.123:0/1670139050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24000b3870 msgr2=0x7f240014f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:07.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.943+0000 7f23ffe00640 1 --2- 172.21.15.123:0/1670139050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24000b3870 0x7f240014f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.943+0000 7f23ffe00640 1 -- 172.21.15.123:0/1670139050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240014fad0 con 0x7f2400072af0 2024-04-25T13:43:07.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.943+0000 7f23ffe00640 1 --2- 172.21.15.123:0/1670139050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2400072af0 0x7f2400150b70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f23f00af040 tx=0x7f23f00196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:07.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.943+0000 7f23fcc00640 1 -- 172.21.15.123:0/1670139050 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f00b8670 con 0x7f2400072af0 2024-04-25T13:43:07.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.943+0000 7f23fcc00640 1 -- 172.21.15.123:0/1670139050 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f00be070 con 0x7f2400072af0 2024-04-25T13:43:07.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.943+0000 7f23fcc00640 1 -- 172.21.15.123:0/1670139050 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f00b8a90 con 0x7f2400072af0 2024-04-25T13:43:07.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.943+0000 7f2407200640 1 -- 172.21.15.123:0/1670139050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f240014fdb0 con 0x7f2400072af0 2024-04-25T13:43:07.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.943+0000 7f2407200640 1 -- 172.21.15.123:0/1670139050 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2400150370 con 0x7f2400072af0 2024-04-25T13:43:07.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.947+0000 7f23fcc00640 1 -- 172.21.15.123:0/1670139050 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f23f00b8c30 con 0x7f2400072af0 2024-04-25T13:43:07.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.947+0000 7f23fcc00640 1 --2- 172.21.15.123:0/1670139050 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f23dc06f400 0x7f23dc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.947+0000 7f23fcc00640 1 -- 172.21.15.123:0/1670139050 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f23f012a3d0 con 0x7f2400072af0 2024-04-25T13:43:07.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.947+0000 7f23f7400640 1 --2- 172.21.15.123:0/1670139050 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f23dc06f400 0x7f23dc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.947+0000 7f240e8ee000 1 Processor -- start 2024-04-25T13:43:07.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.947+0000 7f240e8ee000 1 -- start start 2024-04-25T13:43:07.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.947+0000 7f23f7400640 1 --2- 172.21.15.123:0/1670139050 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f23dc06f400 0x7f23dc071910 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f240014de10 tx=0x7f23e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:07.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f240e8ee000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604d3f5ac20 0x5604d40b8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f240e8ee000 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f46ea0 0x5604d40b9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f240e8ee000 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5604d3b3f280 0x5604d40b9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f240e8ee000 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5604d3f28160 con 0x5604d3f46ea0 2024-04-25T13:43:07.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f240e8ee000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5604d3ebde20 con 0x5604d3f5ac20 2024-04-25T13:43:07.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f240e8ee000 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x5604d3e76a20 con 0x5604d3b3f280 2024-04-25T13:43:07.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f23f7400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f46ea0 0x5604d40b9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f23f7400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f46ea0 0x5604d40b9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47554/0 (socket says 172.21.15.123:47554) 2024-04-25T13:43:07.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f23f7400640 1 -- 172.21.15.123:0/1343020051 learned_addr learned my addr 172.21.15.123:0/1343020051 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:07.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f2405200640 1 --2- 172.21.15.123:0/1343020051 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5604d3b3f280 0x5604d40b9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f23ffe00640 1 --2- 172.21.15.123:0/1343020051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604d3f5ac20 0x5604d40b8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f23f7400640 1 -- 172.21.15.123:0/1343020051 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5604d3b3f280 msgr2=0x5604d40b9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:07.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f23f7400640 1 --2- 172.21.15.123:0/1343020051 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5604d3b3f280 0x5604d40b9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f23f7400640 1 -- 172.21.15.123:0/1343020051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604d3f5ac20 msgr2=0x5604d40b8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:07.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f23f7400640 1 --2- 172.21.15.123:0/1343020051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604d3f5ac20 0x5604d40b8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f23f7400640 1 -- 172.21.15.123:0/1343020051 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604d3e7b100 con 0x5604d3f46ea0 2024-04-25T13:43:07.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f23f7400640 1 --2- 172.21.15.123:0/1343020051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f46ea0 0x5604d40b9420 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f23e800fae0 tx=0x7f23e8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e34b2ced2e2853 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:07.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f23f4c00640 1 -- 172.21.15.123:0/1343020051 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e8025070 con 0x5604d3f46ea0 2024-04-25T13:43:07.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f23f4c00640 1 -- 172.21.15.123:0/1343020051 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23e8015bf0 con 0x5604d3f46ea0 2024-04-25T13:43:07.956 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f23f4c00640 1 -- 172.21.15.123:0/1343020051 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e8020400 con 0x5604d3f46ea0 2024-04-25T13:43:07.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f240e8ee000 1 -- 172.21.15.123:0/1343020051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f46ea0 msgr2=0x5604d40b9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:07.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f240e8ee000 1 --2- 172.21.15.123:0/1343020051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f46ea0 0x5604d40b9420 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f23e800fae0 tx=0x7f23e8000ee0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f240e8ee000 1 -- 172.21.15.123:0/1343020051 shutdown_connections 2024-04-25T13:43:07.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f240e8ee000 1 --2- 172.21.15.123:0/1343020051 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5604d3b3f280 0x5604d40b9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f240e8ee000 1 --2- 172.21.15.123:0/1343020051 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f46ea0 0x5604d40b9420 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f240e8ee000 1 --2- 172.21.15.123:0/1343020051 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604d3f5ac20 0x5604d40b8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f240e8ee000 1 -- 172.21.15.123:0/1343020051 >> 172.21.15.123:0/1343020051 conn(0x5604d3b7eff0 msgr2=0x5604d406e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:07.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f240e8ee000 1 -- 172.21.15.123:0/1343020051 shutdown_connections 2024-04-25T13:43:07.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f240e8ee000 1 -- 172.21.15.123:0/1343020051 wait complete. 2024-04-25T13:43:07.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.951+0000 7f240e8ee000 1 -- start start 2024-04-25T13:43:07.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f240e8ee000 1 Processor -- start 2024-04-25T13:43:07.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f240e8ee000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604d3b3f280 0x5604d40c0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f240e8ee000 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5604d3f46ea0 0x5604d40c05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f240e8ee000 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f5ac20 0x5604d407b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f240e8ee000 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5604d3ecb220 con 0x5604d3f5ac20 2024-04-25T13:43:07.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f240e8ee000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5604d3e61ea0 con 0x5604d3b3f280 2024-04-25T13:43:07.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f240e8ee000 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x5604d3eb8b00 con 0x5604d3f46ea0 2024-04-25T13:43:07.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f240e8ee000 10 client.0 _ll_register_callbacks cb 0x5604d3ecadc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:43:07.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f2405200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f5ac20 0x5604d407b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f2405200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f5ac20 0x5604d407b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47566/0 (socket says 172.21.15.123:47566) 2024-04-25T13:43:07.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f2405200640 1 -- 172.21.15.123:0/2182198000 learned_addr learned my addr 172.21.15.123:0/2182198000 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:07.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f23ffe00640 1 --2- 172.21.15.123:0/2182198000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604d3b3f280 0x5604d40c0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f23f7400640 1 --2- 172.21.15.123:0/2182198000 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5604d3f46ea0 0x5604d40c05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f2405200640 1 -- 172.21.15.123:0/2182198000 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5604d3f46ea0 msgr2=0x5604d40c05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:07.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f2405200640 1 --2- 172.21.15.123:0/2182198000 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5604d3f46ea0 0x5604d40c05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f2405200640 1 -- 172.21.15.123:0/2182198000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604d3b3f280 msgr2=0x5604d40c0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:07.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f2405200640 1 --2- 172.21.15.123:0/2182198000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604d3b3f280 0x5604d40c0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f2405200640 1 -- 172.21.15.123:0/2182198000 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604d3e5d500 con 0x5604d3f5ac20 2024-04-25T13:43:07.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f2405200640 1 --2- 172.21.15.123:0/2182198000 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f5ac20 0x5604d407b0c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f23f8012550 tx=0x7f23f8012950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7bc4ee3d8df97 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:07.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f23ed600640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-04-25T13:43:07.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f23ed600640 1 -- 172.21.15.123:0/2182198000 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f8019030 con 0x5604d3f5ac20 2024-04-25T13:43:07.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f23ed600640 1 -- 172.21.15.123:0/2182198000 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f23f800f040 con 0x5604d3f5ac20 2024-04-25T13:43:07.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f240e8ee000 1 -- 172.21.15.123:0/2182198000 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23e8015bf0 con 0x5604d3f5ac20 2024-04-25T13:43:07.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f23ed600640 1 -- 172.21.15.123:0/2182198000 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f23f8025050 con 0x5604d3f5ac20 2024-04-25T13:43:07.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f240e8ee000 10 client.5232 fetch_fsmap learned FSMap version 17 2024-04-25T13:43:07.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f240e8ee000 1 -- 172.21.15.123:0/2182198000 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5604d3e43ea0 con 0x5604d3f5ac20 2024-04-25T13:43:07.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f23ed600640 1 -- 172.21.15.123:0/2182198000 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23e8015bf0 con 0x5604d3f5ac20 2024-04-25T13:43:07.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f23ed600640 1 -- 172.21.15.123:0/2182198000 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f23f8004020 con 0x5604d3f5ac20 2024-04-25T13:43:07.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f240e8ee000 10 client.5232 fetch_fsmap finished waiting for FSMap version 17 2024-04-25T13:43:07.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f240e8ee000 10 client.5232 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T13:43:07.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f240e8ee000 20 client.5232 populate_metadata read hostname 'smithi123' 2024-04-25T13:43:07.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f240e8ee000 1 --2- 172.21.15.123:0/2182198000 >> [v2:172.21.15.123:6834/499623122,v1:172.21.15.123:6836/499623122] conn(0x5604d3b637d0 0x5604d407be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f240e8ee000 4 client.5232 mds_command: new command op to 5046 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T13:43:07.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f240e8ee000 1 -- 172.21.15.123:0/2182198000 --> [v2:172.21.15.123:6834/499623122,v1:172.21.15.123:6836/499623122] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604d3e56be0 con 0x5604d3b637d0 2024-04-25T13:43:07.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.955+0000 7f23ffe00640 1 --2- 172.21.15.123:0/2182198000 >> [v2:172.21.15.123:6834/499623122,v1:172.21.15.123:6836/499623122] conn(0x5604d3b637d0 0x5604d407be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.959+0000 7f23ed600640 10 client.5232 ms_handle_connect on v2:172.21.15.123:6834/499623122 2024-04-25T13:43:07.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.959+0000 7f23ffe00640 1 --2- 172.21.15.123:0/2182198000 >> [v2:172.21.15.123:6834/499623122,v1:172.21.15.123:6836/499623122] conn(0x5604d3b637d0 0x5604d407be00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be3b8aeaf54f3940 server_cookie=d3f62fdbbfaad381 in_seq=0 out_seq=0 2024-04-25T13:43:07.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.959+0000 7f23ed600640 1 -- 172.21.15.123:0/2182198000 <== mds.0 v2:172.21.15.123:6834/499623122 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5604d3e56be0 con 0x5604d3b637d0 2024-04-25T13:43:07.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.959+0000 7f23ed600640 10 client.5232 handle_command_reply: tid=0 2024-04-25T13:43:07.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.959+0000 7f240e8ee000 1 client.5232 shutdown 2024-04-25T13:43:07.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.959+0000 7f240e8ee000 1 -- 172.21.15.123:0/2182198000 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f5ac20 msgr2=0x5604d407b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:07.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.959+0000 7f240e8ee000 1 --2- 172.21.15.123:0/2182198000 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f5ac20 0x5604d407b0c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f23f8012550 tx=0x7f23f8012950 comp rx=0 tx=0).stop 2024-04-25T13:43:07.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.959+0000 7f240e8ee000 1 -- 172.21.15.123:0/2182198000 shutdown_connections 2024-04-25T13:43:07.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.959+0000 7f240e8ee000 1 --2- 172.21.15.123:0/2182198000 >> [v2:172.21.15.123:6834/499623122,v1:172.21.15.123:6836/499623122] conn(0x5604d3b637d0 0x5604d407be00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.959+0000 7f240e8ee000 1 --2- 172.21.15.123:0/2182198000 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f5ac20 0x5604d407b0c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.959+0000 7f240e8ee000 1 --2- 172.21.15.123:0/2182198000 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5604d3f46ea0 0x5604d40c05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.959+0000 7f240e8ee000 1 --2- 172.21.15.123:0/2182198000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604d3b3f280 0x5604d40c0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.959+0000 7f240e8ee000 1 -- 172.21.15.123:0/2182198000 >> 172.21.15.123:0/2182198000 conn(0x5604d3b7eff0 msgr2=0x5604d406ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:07.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.959+0000 7f23ed600640 0 client.5232 ms_handle_reset on v2:172.21.15.123:6834/499623122 2024-04-25T13:43:07.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.959+0000 7f240e8ee000 1 -- 172.21.15.123:0/2182198000 shutdown_connections 2024-04-25T13:43:07.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.959+0000 7f240e8ee000 1 -- 172.21.15.123:0/2182198000 wait complete. 2024-04-25T13:43:07.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.959+0000 7f240e8ee000 20 client.5232 trim_cache size 0 max 16384 2024-04-25T13:43:07.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.975+0000 7f240e8ee000 1 Processor -- start 2024-04-25T13:43:07.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.975+0000 7f240e8ee000 1 -- start start 2024-04-25T13:43:07.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f240e8ee000 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5604d3b3f280 0x5604d40bf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f240e8ee000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604d3f46ea0 0x5604d40d0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f240e8ee000 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f5ac20 0x5604d40d0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f240e8ee000 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f24001439c0 con 0x5604d3f5ac20 2024-04-25T13:43:07.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f240e8ee000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2400142d20 con 0x5604d3f46ea0 2024-04-25T13:43:07.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f240e8ee000 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2400143370 con 0x5604d3b3f280 2024-04-25T13:43:07.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f2405200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f5ac20 0x5604d40d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f2405200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f5ac20 0x5604d40d0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47582/0 (socket says 172.21.15.123:47582) 2024-04-25T13:43:07.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f2405200640 1 -- 172.21.15.123:0/654730423 learned_addr learned my addr 172.21.15.123:0/654730423 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:07.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f23f7400640 1 --2- 172.21.15.123:0/654730423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604d3f46ea0 0x5604d40d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f23ffe00640 1 --2- 172.21.15.123:0/654730423 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5604d3b3f280 0x5604d40bf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f2405200640 1 -- 172.21.15.123:0/654730423 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5604d3b3f280 msgr2=0x5604d40bf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:07.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f2405200640 1 --2- 172.21.15.123:0/654730423 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5604d3b3f280 0x5604d40bf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f2405200640 1 -- 172.21.15.123:0/654730423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604d3f46ea0 msgr2=0x5604d40d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:07.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f2405200640 1 --2- 172.21.15.123:0/654730423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604d3f46ea0 0x5604d40d0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f2405200640 1 -- 172.21.15.123:0/654730423 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604d4072840 con 0x5604d3f5ac20 2024-04-25T13:43:07.984 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f2405200640 1 --2- 172.21.15.123:0/654730423 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f5ac20 0x5604d40d0750 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f23f8012f00 tx=0x7f23f8009000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47054f2e5826 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:07.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f23efe00640 1 -- 172.21.15.123:0/654730423 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f802e070 con 0x5604d3f5ac20 2024-04-25T13:43:07.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f23efe00640 1 -- 172.21.15.123:0/654730423 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f8000e50 con 0x5604d3f5ac20 2024-04-25T13:43:07.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f23efe00640 1 -- 172.21.15.123:0/654730423 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f8019070 con 0x5604d3f5ac20 2024-04-25T13:43:07.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f240e8ee000 1 -- 172.21.15.123:0/654730423 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f5ac20 msgr2=0x5604d40d0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:07.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f240e8ee000 1 --2- 172.21.15.123:0/654730423 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f5ac20 0x5604d40d0750 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f23f8012f00 tx=0x7f23f8009000 comp rx=0 tx=0).stop 2024-04-25T13:43:07.985 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f240e8ee000 1 -- 172.21.15.123:0/654730423 shutdown_connections 2024-04-25T13:43:07.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f240e8ee000 1 --2- 172.21.15.123:0/654730423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604d3f46ea0 0x5604d40d0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f240e8ee000 1 --2- 172.21.15.123:0/654730423 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f5ac20 0x5604d40d0750 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f240e8ee000 1 --2- 172.21.15.123:0/654730423 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5604d3b3f280 0x5604d40bf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f240e8ee000 1 -- 172.21.15.123:0/654730423 >> 172.21.15.123:0/654730423 conn(0x5604d3b7eff0 msgr2=0x5604d4076040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:07.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f240e8ee000 1 -- 172.21.15.123:0/654730423 shutdown_connections 2024-04-25T13:43:07.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.979+0000 7f240e8ee000 1 -- 172.21.15.123:0/654730423 wait complete. 2024-04-25T13:43:07.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.983+0000 7f240e8ee000 1 -- start start 2024-04-25T13:43:07.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.983+0000 7f240e8ee000 1 Processor -- start 2024-04-25T13:43:07.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.983+0000 7f240e8ee000 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5604d3b3f280 0x5604d412b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.983+0000 7f240e8ee000 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604d3f46ea0 0x5604d412bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.983+0000 7f240e8ee000 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f5ac20 0x5604d40c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.983+0000 7f240e8ee000 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5604d3ebd130 con 0x5604d3f5ac20 2024-04-25T13:43:07.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.983+0000 7f240e8ee000 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5604d3e537d0 con 0x5604d3f46ea0 2024-04-25T13:43:07.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.983+0000 7f240e8ee000 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x5604d3ec2450 con 0x5604d3b3f280 2024-04-25T13:43:07.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.983+0000 7f240e8ee000 10 client.0 _ll_register_callbacks cb 0x7f23f8007520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T13:43:07.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.983+0000 7f2405200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f5ac20 0x5604d40c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.983+0000 7f2405200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f5ac20 0x5604d40c3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47598/0 (socket says 172.21.15.123:47598) 2024-04-25T13:43:07.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.983+0000 7f2405200640 1 -- 172.21.15.123:0/3052341985 learned_addr learned my addr 172.21.15.123:0/3052341985 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:07.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.983+0000 7f23f7400640 1 --2- 172.21.15.123:0/3052341985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604d3f46ea0 0x5604d412bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.983+0000 7f23ffe00640 1 --2- 172.21.15.123:0/3052341985 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5604d3b3f280 0x5604d412b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.983+0000 7f2405200640 1 -- 172.21.15.123:0/3052341985 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5604d3b3f280 msgr2=0x5604d412b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:07.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.983+0000 7f2405200640 1 --2- 172.21.15.123:0/3052341985 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5604d3b3f280 0x5604d412b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.983+0000 7f2405200640 1 -- 172.21.15.123:0/3052341985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604d3f46ea0 msgr2=0x5604d412bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:07.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.983+0000 7f2405200640 1 --2- 172.21.15.123:0/3052341985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604d3f46ea0 0x5604d412bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.983+0000 7f2405200640 1 -- 172.21.15.123:0/3052341985 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604d407b430 con 0x5604d3f5ac20 2024-04-25T13:43:07.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.983+0000 7f2405200640 1 --2- 172.21.15.123:0/3052341985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f5ac20 0x5604d40c3b30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f23f8004540 tx=0x7f23f80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cfe13886571e4f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:07.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.983+0000 7f23ed600640 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-04-25T13:43:07.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.983+0000 7f23ed600640 1 -- 172.21.15.123:0/3052341985 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f802e070 con 0x5604d3f5ac20 2024-04-25T13:43:07.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.983+0000 7f23ed600640 1 -- 172.21.15.123:0/3052341985 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f23f8015450 con 0x5604d3f5ac20 2024-04-25T13:43:07.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.983+0000 7f240e8ee000 1 -- 172.21.15.123:0/3052341985 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23f8000e50 con 0x5604d3f5ac20 2024-04-25T13:43:07.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.983+0000 7f23ed600640 1 -- 172.21.15.123:0/3052341985 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f23f8040050 con 0x5604d3f5ac20 2024-04-25T13:43:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.983+0000 7f240e8ee000 10 client.5238 fetch_fsmap learned FSMap version 17 2024-04-25T13:43:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.983+0000 7f240e8ee000 1 -- 172.21.15.123:0/3052341985 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5604d3e76c70 con 0x5604d3f5ac20 2024-04-25T13:43:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f23ed600640 1 -- 172.21.15.123:0/3052341985 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f8000e50 con 0x5604d3f5ac20 2024-04-25T13:43:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f23ed600640 1 -- 172.21.15.123:0/3052341985 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f23f8043020 con 0x5604d3f5ac20 2024-04-25T13:43:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f240e8ee000 10 client.5238 fetch_fsmap finished waiting for FSMap version 17 2024-04-25T13:43:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f240e8ee000 10 client.5238 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T13:43:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f240e8ee000 20 client.5238 populate_metadata read hostname 'smithi123' 2024-04-25T13:43:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f240e8ee000 1 --2- 172.21.15.123:0/3052341985 >> [v2:172.21.15.123:6834/499623122,v1:172.21.15.123:6836/499623122] conn(0x5604d3b51830 0x5604d40c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f240e8ee000 4 client.5238 mds_command: new command op to 5046 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T13:43:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f240e8ee000 1 -- 172.21.15.123:0/3052341985 --> [v2:172.21.15.123:6834/499623122,v1:172.21.15.123:6836/499623122] -- command(tid 0: {"prefix": "status"}) -- 0x5604d3ecba30 con 0x5604d3b51830 2024-04-25T13:43:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f23ffe00640 1 --2- 172.21.15.123:0/3052341985 >> [v2:172.21.15.123:6834/499623122,v1:172.21.15.123:6836/499623122] conn(0x5604d3b51830 0x5604d40c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:07.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f23ffe00640 1 --2- 172.21.15.123:0/3052341985 >> [v2:172.21.15.123:6834/499623122,v1:172.21.15.123:6836/499623122] conn(0x5604d3b51830 0x5604d40c44f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2154708bd829567 server_cookie=dd98dd4d4774e6e in_seq=0 out_seq=0 2024-04-25T13:43:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f23ed600640 10 client.5238 ms_handle_connect on v2:172.21.15.123:6834/499623122 2024-04-25T13:43:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f23ed600640 1 -- 172.21.15.123:0/3052341985 <== mds.0 v2:172.21.15.123:6834/499623122 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5604d3ecba30 con 0x5604d3b51830 2024-04-25T13:43:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f23ed600640 10 client.5238 handle_command_reply: tid=0 2024-04-25T13:43:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f240e8ee000 1 client.5238 shutdown 2024-04-25T13:43:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f240e8ee000 1 -- 172.21.15.123:0/3052341985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f5ac20 msgr2=0x5604d40c3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f240e8ee000 1 --2- 172.21.15.123:0/3052341985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f5ac20 0x5604d40c3b30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f23f8004540 tx=0x7f23f80046d0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f240e8ee000 1 -- 172.21.15.123:0/3052341985 shutdown_connections 2024-04-25T13:43:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f240e8ee000 1 --2- 172.21.15.123:0/3052341985 >> [v2:172.21.15.123:6834/499623122,v1:172.21.15.123:6836/499623122] conn(0x5604d3b51830 0x5604d40c44f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f240e8ee000 1 --2- 172.21.15.123:0/3052341985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604d3f46ea0 0x5604d412bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f240e8ee000 1 --2- 172.21.15.123:0/3052341985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5604d3f5ac20 0x5604d40c3b30 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f240e8ee000 1 --2- 172.21.15.123:0/3052341985 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5604d3b3f280 0x5604d412b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f23ed600640 0 client.5238 ms_handle_reset on v2:172.21.15.123:6834/499623122 2024-04-25T13:43:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f240e8ee000 1 -- 172.21.15.123:0/3052341985 >> 172.21.15.123:0/3052341985 conn(0x5604d3b7eff0 msgr2=0x5604d40cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:07.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f240e8ee000 1 -- 172.21.15.123:0/3052341985 shutdown_connections 2024-04-25T13:43:07.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f240e8ee000 1 -- 172.21.15.123:0/3052341985 wait complete. 2024-04-25T13:43:07.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f240e8ee000 20 client.5238 trim_cache size 0 max 16384 2024-04-25T13:43:07.994 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-04-25T13:43:07.994 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "95274ccf-6ec8-480a-933e-b3986da91a7e", 2024-04-25T13:43:07.994 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-04-25T13:43:07.994 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 5046, 2024-04-25T13:43:07.994 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-04-25T13:43:07.994 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-04-25T13:43:07.994 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-04-25T13:43:07.994 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 5.9486352460000003, 2024-04-25T13:43:07.995 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 17, 2024-04-25T13:43:07.995 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 34, 2024-04-25T13:43:07.995 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 34, 2024-04-25T13:43:07.995 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 13.814018659 2024-04-25T13:43:07.995 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-04-25T13:43:07.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f2407200640 1 -- 172.21.15.123:0/1670139050 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f23dc06f400 msgr2=0x7f23dc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:07.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f2407200640 1 --2- 172.21.15.123:0/1670139050 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f23dc06f400 0x7f23dc071910 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f240014de10 tx=0x7f23e8009040 comp rx=0 tx=0).stop 2024-04-25T13:43:07.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f2407200640 1 -- 172.21.15.123:0/1670139050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2400072af0 msgr2=0x7f2400150b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:07.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f2407200640 1 --2- 172.21.15.123:0/1670139050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2400072af0 0x7f2400150b70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f23f00af040 tx=0x7f23f00196c0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f2407200640 1 -- 172.21.15.123:0/1670139050 shutdown_connections 2024-04-25T13:43:07.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f2407200640 1 --2- 172.21.15.123:0/1670139050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24000b3870 0x7f240014f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f2407200640 1 --2- 172.21.15.123:0/1670139050 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f23dc06f400 0x7f23dc071910 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f2407200640 1 --2- 172.21.15.123:0/1670139050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f24001571b0 0x7f2400141220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f2407200640 1 --2- 172.21.15.123:0/1670139050 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2400072af0 0x7f2400150b70 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:07.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f2407200640 1 -- 172.21.15.123:0/1670139050 >> 172.21.15.123:0/1670139050 conn(0x7f240006ca70 msgr2=0x7f240015f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:07.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f2407200640 1 -- 172.21.15.123:0/1670139050 shutdown_connections 2024-04-25T13:43:07.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:07.987+0000 7f2407200640 1 -- 172.21.15.123:0/1670139050 wait complete. 2024-04-25T13:43:08.014 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T13:43:08.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.159+0000 7fbbc4a00640 1 Processor -- start 2024-04-25T13:43:08.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.159+0000 7fbbc4a00640 1 -- start start 2024-04-25T13:43:08.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.159+0000 7fbbc4a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbbc00b6850 0x7fbbc00b6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:08.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.159+0000 7fbbc4a00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fbbc00b71a0 0x7fbbc00b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:08.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.159+0000 7fbbc4a00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbc00b7af0 con 0x7fbbc00ce5d0 2024-04-25T13:43:08.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.159+0000 7fbbc4a00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fbbc00d1420 con 0x7fbbc00b71a0 2024-04-25T13:43:08.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.159+0000 7fbbc4a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fbbc00d0df0 con 0x7fbbc00b6850 2024-04-25T13:43:08.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.159+0000 7fbbb6a00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fbbc00b71a0 0x7fbbc00b75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:08.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.159+0000 7fbbbf400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbbc00b6850 0x7fbbc00b6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:08.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.159+0000 7fbbbf400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbbc00b6850 0x7fbbc00b6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:59954/0 (socket says 172.21.15.123:59954) 2024-04-25T13:43:08.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.159+0000 7fbbb6a00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fbbc00b71a0 0x7fbbc00b75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:35248/0 (socket says 172.21.15.123:35248) 2024-04-25T13:43:08.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.159+0000 7fbbbf400640 1 -- 172.21.15.123:0/29876189 learned_addr learned my addr 172.21.15.123:0/29876189 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:08.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.159+0000 7fbbbfe00640 1 --1- 172.21.15.123:0/29876189 >> v1:172.21.15.130:6789/0 conn(0x7fbbc00ce5d0 0x7fbbc00ce9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.123:55370/0 (socket says 172.21.15.123:55370) 2024-04-25T13:43:08.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.159+0000 7fbbbf400640 1 -- 172.21.15.123:0/29876189 >> v2:172.21.15.130:3300/0 conn(0x7fbbc00b71a0 msgr2=0x7fbbc00b75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:08.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.159+0000 7fbbbf400640 1 --2- 172.21.15.123:0/29876189 >> v2:172.21.15.130:3300/0 conn(0x7fbbc00b71a0 0x7fbbc00b75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:08.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.159+0000 7fbbbf400640 1 -- 172.21.15.123:0/29876189 >> v1:172.21.15.130:6789/0 conn(0x7fbbc00ce5d0 legacy=0x7fbbc00ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:08.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.159+0000 7fbbbf400640 1 -- 172.21.15.123:0/29876189 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc00b8990 con 0x7fbbc00b6850 2024-04-25T13:43:08.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.159+0000 7fbbbea00640 1 -- 172.21.15.123:0/29876189 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3004938526 0 0) 0x7fbbc00b7af0 con 0x7fbbc00ce5d0 2024-04-25T13:43:08.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.163+0000 7fbbbf400640 1 --2- 172.21.15.123:0/29876189 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbbc00b6850 0x7fbbc00b6c60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0006fd0 tx=0x7fbbb001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=194e83017dbbfe8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:08.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.163+0000 7fbbbea00640 1 -- 172.21.15.123:0/29876189 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb00ab650 con 0x7fbbc00b6850 2024-04-25T13:43:08.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.163+0000 7fbbbea00640 1 -- 172.21.15.123:0/29876189 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbb00b0070 con 0x7fbbc00b6850 2024-04-25T13:43:08.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.163+0000 7fbbbea00640 1 -- 172.21.15.123:0/29876189 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb00aba10 con 0x7fbbc00b6850 2024-04-25T13:43:08.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.163+0000 7fbbc4a00640 1 -- 172.21.15.123:0/29876189 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbbc00b6850 msgr2=0x7fbbc00b6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:08.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.163+0000 7fbbc4a00640 1 --2- 172.21.15.123:0/29876189 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbbc00b6850 0x7fbbc00b6c60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0006fd0 tx=0x7fbbb001c540 comp rx=0 tx=0).stop 2024-04-25T13:43:08.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.163+0000 7fbbc4a00640 1 -- 172.21.15.123:0/29876189 shutdown_connections 2024-04-25T13:43:08.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.163+0000 7fbbc4a00640 1 --2- 172.21.15.123:0/29876189 >> v2:172.21.15.130:3300/0 conn(0x7fbbc00b71a0 0x7fbbc00b75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:08.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.163+0000 7fbbc4a00640 1 --2- 172.21.15.123:0/29876189 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbbc00b6850 0x7fbbc00b6c60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:08.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.163+0000 7fbbc4a00640 1 -- 172.21.15.123:0/29876189 >> 172.21.15.123:0/29876189 conn(0x7fbbc00d00c0 msgr2=0x7fbbc00d04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:08.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.163+0000 7fbbc4a00640 1 -- 172.21.15.123:0/29876189 shutdown_connections 2024-04-25T13:43:08.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.163+0000 7fbbc4a00640 1 -- 172.21.15.123:0/29876189 wait complete. 2024-04-25T13:43:08.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.167+0000 7fbbc4a00640 1 Processor -- start 2024-04-25T13:43:08.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.167+0000 7fbbc4a00640 1 -- start start 2024-04-25T13:43:08.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.167+0000 7fbbc4a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbbc00b6850 0x7fbbc00c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:08.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.167+0000 7fbbc4a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbc00b71a0 0x7fbbc006d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:08.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.167+0000 7fbbc4a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbc00ce5d0 0x7fbbc006dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:08.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.167+0000 7fbbc4a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc00cfc90 con 0x7fbbc00ce5d0 2024-04-25T13:43:08.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.167+0000 7fbbc4a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc00cfb10 con 0x7fbbc00b71a0 2024-04-25T13:43:08.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.167+0000 7fbbc4a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fbbc00d1910 con 0x7fbbc00b6850 2024-04-25T13:43:08.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.171+0000 7fbbbfe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbc00ce5d0 0x7fbbc006dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:08.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.171+0000 7fbbbfe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbc00ce5d0 0x7fbbc006dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47614/0 (socket says 172.21.15.123:47614) 2024-04-25T13:43:08.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.171+0000 7fbbbfe00640 1 -- 172.21.15.123:0/3944562817 learned_addr learned my addr 172.21.15.123:0/3944562817 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:08.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.171+0000 7fbbb6a00640 1 --2- 172.21.15.123:0/3944562817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbc00b71a0 0x7fbbc006d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:08.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.171+0000 7fbbbf400640 1 --2- 172.21.15.123:0/3944562817 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbbc00b6850 0x7fbbc00c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:08.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.171+0000 7fbbbfe00640 1 -- 172.21.15.123:0/3944562817 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbbc00b6850 msgr2=0x7fbbc00c6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:08.174 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.171+0000 7fbbbfe00640 1 --2- 172.21.15.123:0/3944562817 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbbc00b6850 0x7fbbc00c6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:08.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.171+0000 7fbbbfe00640 1 -- 172.21.15.123:0/3944562817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbc00b71a0 msgr2=0x7fbbc006d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:08.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.171+0000 7fbbbfe00640 1 --2- 172.21.15.123:0/3944562817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbc00b71a0 0x7fbbc006d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:08.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.171+0000 7fbbbfe00640 1 -- 172.21.15.123:0/3944562817 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc0162dd0 con 0x7fbbc00ce5d0 2024-04-25T13:43:08.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.171+0000 7fbbb6a00640 1 --2- 172.21.15.123:0/3944562817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbc00b71a0 0x7fbbc006d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:43:08.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.171+0000 7fbbbfe00640 1 --2- 172.21.15.123:0/3944562817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbc00ce5d0 0x7fbbc006dcc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbbb800c730 tx=0x7fbbb800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:08.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.171+0000 7fbbb7e00640 1 -- 172.21.15.123:0/3944562817 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8018070 con 0x7fbbc00ce5d0 2024-04-25T13:43:08.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.171+0000 7fbbb7e00640 1 -- 172.21.15.123:0/3944562817 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbb800ce40 con 0x7fbbc00ce5d0 2024-04-25T13:43:08.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.171+0000 7fbbb7e00640 1 -- 172.21.15.123:0/3944562817 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb800a860 con 0x7fbbc00ce5d0 2024-04-25T13:43:08.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.171+0000 7fbbc4a00640 1 -- 172.21.15.123:0/3944562817 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbc00cc550 con 0x7fbbc00ce5d0 2024-04-25T13:43:08.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.171+0000 7fbbc4a00640 1 -- 172.21.15.123:0/3944562817 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbc00cc270 con 0x7fbbc00ce5d0 2024-04-25T13:43:08.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.171+0000 7fbbc4a00640 1 -- 172.21.15.123:0/3944562817 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbc0050750 con 0x7fbbc00ce5d0 2024-04-25T13:43:08.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.171+0000 7fbbb7e00640 1 -- 172.21.15.123:0/3944562817 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbbb800aa00 con 0x7fbbc00ce5d0 2024-04-25T13:43:08.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.175+0000 7fbbb7e00640 1 --2- 172.21.15.123:0/3944562817 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fbb9c06f400 0x7fbb9c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:08.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.175+0000 7fbbb7e00640 1 -- 172.21.15.123:0/3944562817 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fbbb808e870 con 0x7fbbc00ce5d0 2024-04-25T13:43:08.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.175+0000 7fbbbf400640 1 --2- 172.21.15.123:0/3944562817 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fbb9c06f400 0x7fbb9c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:08.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.175+0000 7fbbbf400640 1 --2- 172.21.15.123:0/3944562817 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fbb9c06f400 0x7fbb9c071910 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbbb00af000 tx=0x7fbbb00a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:08.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.179+0000 7fbbb7e00640 1 -- 172.21.15.123:0/3944562817 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbbb805b090 con 0x7fbbc00ce5d0 2024-04-25T13:43:08.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.367+0000 7fbbc4a00640 1 -- 172.21.15.123:0/3944562817 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbbc0165be0 con 0x7fbbc00ce5d0 2024-04-25T13:43:08.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.367+0000 7fbbb7e00640 1 -- 172.21.15.123:0/3944562817 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7fbbb805f390 con 0x7fbbc00ce5d0 2024-04-25T13:43:08.372 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T13:43:08.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.371+0000 7fbbc4a00640 1 -- 172.21.15.123:0/3944562817 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fbb9c06f400 msgr2=0x7fbb9c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:08.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.371+0000 7fbbc4a00640 1 --2- 172.21.15.123:0/3944562817 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fbb9c06f400 0x7fbb9c071910 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbbb00af000 tx=0x7fbbb00a7000 comp rx=0 tx=0).stop 2024-04-25T13:43:08.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.371+0000 7fbbc4a00640 1 -- 172.21.15.123:0/3944562817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbc00ce5d0 msgr2=0x7fbbc006dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:08.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.371+0000 7fbbc4a00640 1 --2- 172.21.15.123:0/3944562817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbc00ce5d0 0x7fbbc006dcc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbbb800c730 tx=0x7fbbb800cbf0 comp rx=0 tx=0).stop 2024-04-25T13:43:08.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.371+0000 7fbbc4a00640 1 -- 172.21.15.123:0/3944562817 shutdown_connections 2024-04-25T13:43:08.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.371+0000 7fbbc4a00640 1 --2- 172.21.15.123:0/3944562817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbc00b71a0 0x7fbbc006d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:08.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.371+0000 7fbbc4a00640 1 --2- 172.21.15.123:0/3944562817 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fbb9c06f400 0x7fbb9c071910 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:08.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.371+0000 7fbbc4a00640 1 --2- 172.21.15.123:0/3944562817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fbbc00ce5d0 0x7fbbc006dcc0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:08.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.371+0000 7fbbc4a00640 1 --2- 172.21.15.123:0/3944562817 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fbbc00b6850 0x7fbbc00c6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:08.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.371+0000 7fbbc4a00640 1 -- 172.21.15.123:0/3944562817 >> 172.21.15.123:0/3944562817 conn(0x7fbbc00d00c0 msgr2=0x7fbbc009c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:08.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.371+0000 7fbbc4a00640 1 -- 172.21.15.123:0/3944562817 shutdown_connections 2024-04-25T13:43:08.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08.371+0000 7fbbc4a00640 1 -- 172.21.15.123:0/3944562817 wait complete. 2024-04-25T13:43:08.393 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T13:43:08.393 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T13:43:08.393 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-04-25T13:43:08.393 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T13:43:08.393 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T13:43:08.393 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T13:43:08.393 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T13:43:08.393 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T13:43:08.393 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T13:43:08.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:08.394 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-04-25T13:43:08.402 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T13:43:08.402 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T13:43:08.402 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T13:43:08.402 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:43:08.403 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-04-25T13:43:08.403 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:43:08.403 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T13:43:08.403 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-04-25T13:43:08.403 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-04-25T13:43:08.403 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T13:43:08.403 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-04-25T13:43:08.403 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-04-25T13:43:08.403 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T13:43:08.403 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:43:08.403 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T13:43:08.403 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:43:08.403 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T13:43:08.404 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42437sec preferred_lft 42437sec 2024-04-25T13:43:08.404 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link 2024-04-25T13:43:08.404 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:43:08.404 INFO:teuthology.orchestra.run.smithi123.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T13:43:08.404 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 02:42:49:08:34:c5 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:43:08.404 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T13:43:08.404 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:43:08.404 INFO:teuthology.orchestra.run.smithi123.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T13:43:08.404 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T13:43:08.404 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T13:43:08.404 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:43:08.404 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T13:43:08.404 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:43:08.405 INFO:teuthology.orchestra.run.smithi123.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T13:43:08.405 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:43:08.405 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T13:43:08.405 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:43:08.405 INFO:teuthology.orchestra.run.smithi123.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T13:43:08.405 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T13:43:08.405 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T13:43:08.405 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:43:08.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:08.406 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T13:43:08.469 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-04-25T13:43:08.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:08.472 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-04-25T13:43:08.527 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-04-25T13:43:08.528 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T13:43:08.528 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T13:43:08.528 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T13:43:08.528 INFO:teuthology.orchestra.run.smithi123.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T13:43:08.528 INFO:teuthology.orchestra.run.smithi123.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T13:43:08.528 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T13:43:08.528 INFO:teuthology.orchestra.run.smithi123.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T13:43:08.528 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T13:43:08.528 INFO:teuthology.orchestra.run.smithi123.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T13:43:08.528 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T13:43:08.528 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:43:08.529 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-04-25T13:43:08.529 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T13:43:08.529 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T13:43:08.529 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T13:43:08.529 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-04-25T13:43:08.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:43:08.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:43:08.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:08.667 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-04-25T13:43:08.717 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T13:43:08.718 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T13:43:08.718 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T13:43:08.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:08.719 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-04-25T13:43:08.780 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:43:08.780 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T13:43:08.832 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T13:43:08.833 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:43:08.833 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T13:43:08.888 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T13:43:08.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:08.888 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T13:43:08.988 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T13:43:08.988 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T13:43:08.988 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-04-25T13:43:09.006 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T13:43:09.007 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T13:43:09.007 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-04-25T13:43:09.007 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.130:3300,172.21.15.130:3301" 2024-04-25T13:43:09.007 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T13:43:09.016 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T13:43:09.016 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T13:43:09.016 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-04-25T13:43:09.016 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.130:3300,172.21.15.130:3301" 2024-04-25T13:43:09.016 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T13:43:09.016 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.130:6789,172.21.15.130:6790" 2024-04-25T13:43:09.017 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.130:6789,172.21.15.130:6790:/ 2024-04-25T13:43:09.017 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=95274ccf-6ec8-480a-933e-b3986da91a7e" will pass to kernel 2024-04-25T13:43:09.020 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T13:43:09.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:09.020 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T13:43:09.041 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T13:43:09.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T13:43:09.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:43:09.146 INFO:teuthology.orchestra.run.smithi123.stdout:client5244 2024-04-25T13:43:09.146 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:43:09.146 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:43:09.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:09.156 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir mydir) 2024-04-25T13:43:09.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:09.209 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch mydir/alpha) 2024-04-25T13:43:09.263 DEBUG:teuthology.orchestra.run.smithi123:> stdin-killer -- python3 -c ' 2024-04-25T13:43:09.264 DEBUG:teuthology.orchestra.run.smithi123:> import os 2024-04-25T13:43:09.264 DEBUG:teuthology.orchestra.run.smithi123:> import stat 2024-04-25T13:43:09.264 DEBUG:teuthology.orchestra.run.smithi123:> 2024-04-25T13:43:09.264 DEBUG:teuthology.orchestra.run.smithi123:> print(os.stat("/home/ubuntu/cephtest/mnt.0/mydir").st_ino) 2024-04-25T13:43:09.264 DEBUG:teuthology.orchestra.run.smithi123:> ' 2024-04-25T13:43:09.367 INFO:teuthology.orchestra.run.smithi123.stdout:1099511627776 2024-04-25T13:43:09.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:43:09.376 DEBUG:teuthology.orchestra.run.smithi123:> stdin-killer -- python3 -c ' 2024-04-25T13:43:09.376 DEBUG:teuthology.orchestra.run.smithi123:> import os 2024-04-25T13:43:09.376 DEBUG:teuthology.orchestra.run.smithi123:> import stat 2024-04-25T13:43:09.376 DEBUG:teuthology.orchestra.run.smithi123:> 2024-04-25T13:43:09.376 DEBUG:teuthology.orchestra.run.smithi123:> print(os.stat("/home/ubuntu/cephtest/mnt.0/mydir/alpha").st_ino) 2024-04-25T13:43:09.376 DEBUG:teuthology.orchestra.run.smithi123:> ' 2024-04-25T13:43:09.484 INFO:teuthology.orchestra.run.smithi123.stdout:1099511627777 2024-04-25T13:43:09.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:43:09.493 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:43:09.493 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:43:09.545 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:43:09.545 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:43:09.601 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:43:09.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.787+0000 7f0e22400640 1 Processor -- start 2024-04-25T13:43:09.790 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.787+0000 7f0e22400640 1 -- start start 2024-04-25T13:43:09.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.787+0000 7f0e22400640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0e1c06d050 0x7f0e1c1641d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:09.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.787+0000 7f0e22400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e1c0d18a0 0x7f0e1c0d1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:09.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.787+0000 7f0e22400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e1c0b3780 con 0x7f0e1c0b1e80 2024-04-25T13:43:09.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.787+0000 7f0e22400640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f0e1c0b3a60 con 0x7f0e1c06d050 2024-04-25T13:43:09.791 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.787+0000 7f0e22400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0e1c1639d0 con 0x7f0e1c0d18a0 2024-04-25T13:43:09.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.787+0000 7f0e21a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e1c0d18a0 0x7f0e1c0d1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:09.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.787+0000 7f0e21000640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0e1c06d050 0x7f0e1c1641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:09.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.787+0000 7f0e1be00640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f0e1c0b1e80 0x7f0e1c0b2290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.123:45768/0 (socket says 172.21.15.123:45768) 2024-04-25T13:43:09.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.787+0000 7f0e1be00640 1 -- 172.21.15.123:0/2540666671 learned_addr learned my addr 172.21.15.123:0/2540666671 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:09.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.787+0000 7f0e21000640 1 -- 172.21.15.123:0/2540666671 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e1c0d18a0 msgr2=0x7f0e1c0d1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:09.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.787+0000 7f0e21000640 1 --2- 172.21.15.123:0/2540666671 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e1c0d18a0 0x7f0e1c0d1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:09.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.787+0000 7f0e21000640 1 -- 172.21.15.123:0/2540666671 >> v1:172.21.15.130:6789/0 conn(0x7f0e1c0b1e80 legacy=0x7f0e1c0b2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:09.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.787+0000 7f0e21000640 1 -- 172.21.15.123:0/2540666671 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1c163cb0 con 0x7f0e1c06d050 2024-04-25T13:43:09.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.787+0000 7f0e1b400640 1 -- 172.21.15.123:0/2540666671 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2077475054 0 0) 0x7f0e1c0b3780 con 0x7f0e1c0b1e80 2024-04-25T13:43:09.794 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.787+0000 7f0e21a00640 1 --2- 172.21.15.123:0/2540666671 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e1c0d18a0 0x7f0e1c0d1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:43:09.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.791+0000 7f0e21000640 1 --2- 172.21.15.123:0/2540666671 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e1c06d050 0x7f0e1c1641d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0e100097a0 tx=0x7f0e1001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4440bedb5c6288e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:09.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.791+0000 7f0e1b400640 1 -- 172.21.15.123:0/2540666671 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e100aa600 con 0x7f0e1c06d050 2024-04-25T13:43:09.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.791+0000 7f0e1b400640 1 -- 172.21.15.123:0/2540666671 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e100af070 con 0x7f0e1c06d050 2024-04-25T13:43:09.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.791+0000 7f0e1b400640 1 -- 172.21.15.123:0/2540666671 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e100aa9c0 con 0x7f0e1c06d050 2024-04-25T13:43:09.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.791+0000 7f0e22400640 1 -- 172.21.15.123:0/2540666671 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e1c06d050 msgr2=0x7f0e1c1641d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:09.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.791+0000 7f0e22400640 1 --2- 172.21.15.123:0/2540666671 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e1c06d050 0x7f0e1c1641d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0e100097a0 tx=0x7f0e1001c480 comp rx=0 tx=0).stop 2024-04-25T13:43:09.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.791+0000 7f0e22400640 1 -- 172.21.15.123:0/2540666671 shutdown_connections 2024-04-25T13:43:09.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.791+0000 7f0e22400640 1 --2- 172.21.15.123:0/2540666671 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e1c0d18a0 0x7f0e1c0d1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:09.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.791+0000 7f0e22400640 1 --2- 172.21.15.123:0/2540666671 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e1c06d050 0x7f0e1c1641d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:09.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.791+0000 7f0e22400640 1 -- 172.21.15.123:0/2540666671 >> 172.21.15.123:0/2540666671 conn(0x7f0e1c0d2520 msgr2=0x7f0e1c0d2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:09.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.791+0000 7f0e22400640 1 -- 172.21.15.123:0/2540666671 shutdown_connections 2024-04-25T13:43:09.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.791+0000 7f0e22400640 1 -- 172.21.15.123:0/2540666671 wait complete. 2024-04-25T13:43:09.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.795+0000 7f0e22400640 1 Processor -- start 2024-04-25T13:43:09.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.795+0000 7f0e22400640 1 -- start start 2024-04-25T13:43:09.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.795+0000 7f0e22400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e1c06d050 0x7f0e1c159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:09.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.795+0000 7f0e22400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e1c0b1e80 0x7f0e1c162be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.795+0000 7f0e22400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e1c0d18a0 0x7f0e1c15c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.795+0000 7f0e22400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1c164890 con 0x7f0e1c0b1e80 2024-04-25T13:43:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.795+0000 7f0e22400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1c164710 con 0x7f0e1c0d18a0 2024-04-25T13:43:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.795+0000 7f0e22400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0e1c0b1a20 con 0x7f0e1c06d050 2024-04-25T13:43:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.795+0000 7f0e1be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e1c0b1e80 0x7f0e1c162be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:09.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.795+0000 7f0e1be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e1c0b1e80 0x7f0e1c162be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34856/0 (socket says 172.21.15.123:34856) 2024-04-25T13:43:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.795+0000 7f0e1be00640 1 -- 172.21.15.123:0/2142126869 learned_addr learned my addr 172.21.15.123:0/2142126869 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.795+0000 7f0e21000640 1 --2- 172.21.15.123:0/2142126869 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e1c06d050 0x7f0e1c159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.795+0000 7f0e21a00640 1 --2- 172.21.15.123:0/2142126869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e1c0d18a0 0x7f0e1c15c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.799+0000 7f0e1be00640 1 -- 172.21.15.123:0/2142126869 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e1c06d050 msgr2=0x7f0e1c159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.799+0000 7f0e1be00640 1 --2- 172.21.15.123:0/2142126869 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e1c06d050 0x7f0e1c159e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:09.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.799+0000 7f0e1be00640 1 -- 172.21.15.123:0/2142126869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e1c0d18a0 msgr2=0x7f0e1c15c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:09.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.799+0000 7f0e1be00640 1 --2- 172.21.15.123:0/2142126869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e1c0d18a0 0x7f0e1c15c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:09.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.799+0000 7f0e1be00640 1 -- 172.21.15.123:0/2142126869 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1c15fae0 con 0x7f0e1c0b1e80 2024-04-25T13:43:09.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.799+0000 7f0e21000640 1 --2- 172.21.15.123:0/2142126869 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e1c06d050 0x7f0e1c159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:09.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.799+0000 7f0e1be00640 1 --2- 172.21.15.123:0/2142126869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e1c0b1e80 0x7f0e1c162be0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0e0800c4b0 tx=0x7f0e0800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:09.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.799+0000 7f0e18c00640 1 -- 172.21.15.123:0/2142126869 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e08018070 con 0x7f0e1c0b1e80 2024-04-25T13:43:09.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.799+0000 7f0e18c00640 1 -- 172.21.15.123:0/2142126869 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e08007500 con 0x7f0e1c0b1e80 2024-04-25T13:43:09.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.799+0000 7f0e18c00640 1 -- 172.21.15.123:0/2142126869 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e08004a30 con 0x7f0e1c0b1e80 2024-04-25T13:43:09.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.799+0000 7f0e22400640 1 -- 172.21.15.123:0/2142126869 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e1c15fdc0 con 0x7f0e1c0b1e80 2024-04-25T13:43:09.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.799+0000 7f0e22400640 1 -- 172.21.15.123:0/2142126869 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e1c160380 con 0x7f0e1c0b1e80 2024-04-25T13:43:09.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.799+0000 7f0e22400640 1 -- 172.21.15.123:0/2142126869 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e1c050750 con 0x7f0e1c0b1e80 2024-04-25T13:43:09.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.799+0000 7f0e18c00640 1 -- 172.21.15.123:0/2142126869 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0e08004bd0 con 0x7f0e1c0b1e80 2024-04-25T13:43:09.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.799+0000 7f0e18c00640 1 --2- 172.21.15.123:0/2142126869 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f0dfc06f400 0x7f0dfc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:09.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.799+0000 7f0e18c00640 1 -- 172.21.15.123:0/2142126869 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0e0808e510 con 0x7f0e1c0b1e80 2024-04-25T13:43:09.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.803+0000 7f0e21000640 1 --2- 172.21.15.123:0/2142126869 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f0dfc06f400 0x7f0dfc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:09.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.803+0000 7f0e21000640 1 --2- 172.21.15.123:0/2142126869 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f0dfc06f400 0x7f0dfc071910 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0e100ae000 tx=0x7f0e100a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:09.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.807+0000 7f0e18c00640 1 -- 172.21.15.123:0/2142126869 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0e0805ad10 con 0x7f0e1c0b1e80 2024-04-25T13:43:09.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.963+0000 7f0e22400640 1 -- 172.21.15.123:0/2142126869 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e1c0b2d70 con 0x7f0e1c0b1e80 2024-04-25T13:43:09.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.963+0000 7f0e18c00640 1 -- 172.21.15.123:0/2142126869 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16693 (secure 0 0 0) 0x7f0e0805f010 con 0x7f0e1c0b1e80 2024-04-25T13:43:09.967 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:09.967 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":34,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:43:03.039428+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:59.250248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T13:43:00.396458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:43:09.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.967+0000 7f0e22400640 1 -- 172.21.15.123:0/2142126869 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f0dfc06f400 msgr2=0x7f0dfc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:09.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.967+0000 7f0e22400640 1 --2- 172.21.15.123:0/2142126869 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f0dfc06f400 0x7f0dfc071910 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0e100ae000 tx=0x7f0e100a7000 comp rx=0 tx=0).stop 2024-04-25T13:43:09.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.967+0000 7f0e22400640 1 -- 172.21.15.123:0/2142126869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e1c0b1e80 msgr2=0x7f0e1c162be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:09.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.967+0000 7f0e22400640 1 --2- 172.21.15.123:0/2142126869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e1c0b1e80 0x7f0e1c162be0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0e0800c4b0 tx=0x7f0e0800c970 comp rx=0 tx=0).stop 2024-04-25T13:43:09.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.967+0000 7f0e22400640 1 -- 172.21.15.123:0/2142126869 shutdown_connections 2024-04-25T13:43:09.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.967+0000 7f0e22400640 1 --2- 172.21.15.123:0/2142126869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0e1c0d18a0 0x7f0e1c15c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:09.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.967+0000 7f0e22400640 1 --2- 172.21.15.123:0/2142126869 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f0dfc06f400 0x7f0dfc071910 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:09.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.967+0000 7f0e22400640 1 --2- 172.21.15.123:0/2142126869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0e1c0b1e80 0x7f0e1c162be0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:09.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.967+0000 7f0e22400640 1 --2- 172.21.15.123:0/2142126869 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0e1c06d050 0x7f0e1c159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:09.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.967+0000 7f0e22400640 1 -- 172.21.15.123:0/2142126869 >> 172.21.15.123:0/2142126869 conn(0x7f0e1c0d2520 msgr2=0x7f0e1c0d2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:09.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.967+0000 7f0e22400640 1 -- 172.21.15.123:0/2142126869 shutdown_connections 2024-04-25T13:43:09.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:09.967+0000 7f0e22400640 1 -- 172.21.15.123:0/2142126869 wait complete. 2024-04-25T13:43:09.989 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:41:53.602480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:42:59.250248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:43:00.396458+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:43:09.990 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:43:10.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.139+0000 7f5195e00640 1 Processor -- start 2024-04-25T13:43:10.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.139+0000 7f5195e00640 1 -- start start 2024-04-25T13:43:10.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.143+0000 7f5195e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f51900ceac0 0x7f51900c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:10.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.143+0000 7f5195e00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51900c7b10 con 0x7f519015de80 2024-04-25T13:43:10.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.143+0000 7f5195e00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51900c6810 con 0x7f51900b3870 2024-04-25T13:43:10.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.143+0000 7f5195e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f51900c7140 con 0x7f51900ceac0 2024-04-25T13:43:10.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.143+0000 7f518ea00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f51900ceac0 0x7f51900c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:10.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.143+0000 7f518f400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f519015de80 0x7f519015e290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54856/0 (socket says 172.21.15.123:54856) 2024-04-25T13:43:10.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.143+0000 7f518f400640 1 -- 172.21.15.123:0/1922733624 learned_addr learned my addr 172.21.15.123:0/1922733624 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:10.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.143+0000 7f518ea00640 1 -- 172.21.15.123:0/1922733624 >> v1:172.21.15.130:6789/0 conn(0x7f51900b3870 legacy=0x7f51900b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:10.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.143+0000 7f518ea00640 1 -- 172.21.15.123:0/1922733624 >> v1:172.21.15.123:6789/0 conn(0x7f519015de80 legacy=0x7f519015e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:10.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.143+0000 7f518ea00640 1 -- 172.21.15.123:0/1922733624 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51900c6af0 con 0x7f51900ceac0 2024-04-25T13:43:10.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.143+0000 7f518d600640 1 -- 172.21.15.123:0/1922733624 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 211572742 0 0) 0x7f51900c7b10 con 0x7f519015de80 2024-04-25T13:43:10.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.143+0000 7f518ea00640 1 --2- 172.21.15.123:0/1922733624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51900ceac0 0x7f51900c75d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f51800097c0 tx=0x7f518001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b80f4c5f09501e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:10.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.147+0000 7f518d600640 1 -- 172.21.15.123:0/1922733624 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51800b0070 con 0x7f51900ceac0 2024-04-25T13:43:10.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.147+0000 7f518d600640 1 -- 172.21.15.123:0/1922733624 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51800ab600 con 0x7f51900ceac0 2024-04-25T13:43:10.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.147+0000 7f518d600640 1 -- 172.21.15.123:0/1922733624 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51800ab9d0 con 0x7f51900ceac0 2024-04-25T13:43:10.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.147+0000 7f5195e00640 1 -- 172.21.15.123:0/1922733624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51900ceac0 msgr2=0x7f51900c75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:10.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.147+0000 7f5195e00640 1 --2- 172.21.15.123:0/1922733624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51900ceac0 0x7f51900c75d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f51800097c0 tx=0x7f518001c3d0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.147+0000 7f5195e00640 1 -- 172.21.15.123:0/1922733624 shutdown_connections 2024-04-25T13:43:10.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.147+0000 7f5195e00640 1 --2- 172.21.15.123:0/1922733624 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51900ceac0 0x7f51900c75d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.147+0000 7f5195e00640 1 -- 172.21.15.123:0/1922733624 >> 172.21.15.123:0/1922733624 conn(0x7f519006ca70 msgr2=0x7f519006ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:10.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.147+0000 7f5195e00640 1 -- 172.21.15.123:0/1922733624 shutdown_connections 2024-04-25T13:43:10.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.147+0000 7f5195e00640 1 -- 172.21.15.123:0/1922733624 wait complete. 2024-04-25T13:43:10.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.147+0000 7f5195e00640 1 Processor -- start 2024-04-25T13:43:10.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.147+0000 7f5195e00640 1 -- start start 2024-04-25T13:43:10.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.151+0000 7f5195e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51900b3870 0x7f51901438b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:10.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.151+0000 7f5195e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51900ceac0 0x7f519014baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:10.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.151+0000 7f5195e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f519015de80 0x7f5190151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:10.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.151+0000 7f5195e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f519016c710 con 0x7f51900ceac0 2024-04-25T13:43:10.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.151+0000 7f5195e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f519016c590 con 0x7f51900b3870 2024-04-25T13:43:10.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.151+0000 7f5195e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f519016c890 con 0x7f519015de80 2024-04-25T13:43:10.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.151+0000 7f518e000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51900ceac0 0x7f519014baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:10.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.151+0000 7f518e000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51900ceac0 0x7f519014baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34880/0 (socket says 172.21.15.123:34880) 2024-04-25T13:43:10.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.151+0000 7f518e000640 1 -- 172.21.15.123:0/1643133046 learned_addr learned my addr 172.21.15.123:0/1643133046 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:10.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.151+0000 7f518f400640 1 --2- 172.21.15.123:0/1643133046 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f519015de80 0x7f5190151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:10.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.151+0000 7f518ea00640 1 --2- 172.21.15.123:0/1643133046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51900b3870 0x7f51901438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:10.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.151+0000 7f518e000640 1 -- 172.21.15.123:0/1643133046 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f519015de80 msgr2=0x7f5190151650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:10.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.151+0000 7f518e000640 1 --2- 172.21.15.123:0/1643133046 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f519015de80 0x7f5190151650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.151+0000 7f518e000640 1 -- 172.21.15.123:0/1643133046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51900b3870 msgr2=0x7f51901438b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:10.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.151+0000 7f518e000640 1 --2- 172.21.15.123:0/1643133046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51900b3870 0x7f51901438b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.151+0000 7f518e000640 1 -- 172.21.15.123:0/1643133046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51901fb330 con 0x7f51900ceac0 2024-04-25T13:43:10.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.151+0000 7f518e000640 1 --2- 172.21.15.123:0/1643133046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51900ceac0 0x7f519014baf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f517c00b440 tx=0x7f517c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:10.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.151+0000 7f5187400640 1 -- 172.21.15.123:0/1643133046 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c015020 con 0x7f51900ceac0 2024-04-25T13:43:10.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.151+0000 7f5187400640 1 -- 172.21.15.123:0/1643133046 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517c011830 con 0x7f51900ceac0 2024-04-25T13:43:10.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.151+0000 7f5195e00640 1 -- 172.21.15.123:0/1643133046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51901fb5d0 con 0x7f51900ceac0 2024-04-25T13:43:10.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.151+0000 7f5187400640 1 -- 172.21.15.123:0/1643133046 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c011c20 con 0x7f51900ceac0 2024-04-25T13:43:10.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.151+0000 7f5195e00640 1 -- 172.21.15.123:0/1643133046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51901fbb90 con 0x7f51900ceac0 2024-04-25T13:43:10.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.151+0000 7f5195e00640 1 -- 172.21.15.123:0/1643133046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f519006d600 con 0x7f51900ceac0 2024-04-25T13:43:10.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.155+0000 7f5187400640 1 -- 172.21.15.123:0/1643133046 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f517c018020 con 0x7f51900ceac0 2024-04-25T13:43:10.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.155+0000 7f5187400640 1 --2- 172.21.15.123:0/1643133046 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f517006f430 0x7f5170071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:10.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.155+0000 7f5187400640 1 -- 172.21.15.123:0/1643133046 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f517c08ee30 con 0x7f51900ceac0 2024-04-25T13:43:10.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.155+0000 7f518ea00640 1 --2- 172.21.15.123:0/1643133046 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f517006f430 0x7f5170071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:10.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.155+0000 7f518ea00640 1 --2- 172.21.15.123:0/1643133046 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f517006f430 0x7f5170071940 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f51800ad000 tx=0x7f51800a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:10.163 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.159+0000 7f5187400640 1 -- 172.21.15.123:0/1643133046 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f517c01f030 con 0x7f51900ceac0 2024-04-25T13:43:10.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.315+0000 7f5195e00640 1 -- 172.21.15.123:0/1643133046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5190050750 con 0x7f51900ceac0 2024-04-25T13:43:10.320 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.315+0000 7f5187400640 1 -- 172.21.15.123:0/1643133046 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) ==== 93+0+10 (secure 0 0 0) 0x7f517c05b630 con 0x7f51900ceac0 2024-04-25T13:43:10.321 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-04-25T13:43:10.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.319+0000 7f5195e00640 1 -- 172.21.15.123:0/1643133046 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f517006f430 msgr2=0x7f5170071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:10.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.319+0000 7f5195e00640 1 --2- 172.21.15.123:0/1643133046 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f517006f430 0x7f5170071940 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f51800ad000 tx=0x7f51800a6000 comp rx=0 tx=0).stop 2024-04-25T13:43:10.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.319+0000 7f5195e00640 1 -- 172.21.15.123:0/1643133046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51900ceac0 msgr2=0x7f519014baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:10.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.319+0000 7f5195e00640 1 --2- 172.21.15.123:0/1643133046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51900ceac0 0x7f519014baf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f517c00b440 tx=0x7f517c00b900 comp rx=0 tx=0).stop 2024-04-25T13:43:10.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.319+0000 7f5195e00640 1 -- 172.21.15.123:0/1643133046 shutdown_connections 2024-04-25T13:43:10.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.319+0000 7f5195e00640 1 --2- 172.21.15.123:0/1643133046 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f517006f430 0x7f5170071940 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.319+0000 7f5195e00640 1 --2- 172.21.15.123:0/1643133046 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f519015de80 0x7f5190151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.319+0000 7f5195e00640 1 --2- 172.21.15.123:0/1643133046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f51900ceac0 0x7f519014baf0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.319+0000 7f5195e00640 1 --2- 172.21.15.123:0/1643133046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f51900b3870 0x7f51901438b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.319+0000 7f5195e00640 1 -- 172.21.15.123:0/1643133046 >> 172.21.15.123:0/1643133046 conn(0x7f519006ca70 msgr2=0x7f51900b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:10.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.319+0000 7f5195e00640 1 -- 172.21.15.123:0/1643133046 shutdown_connections 2024-04-25T13:43:10.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.319+0000 7f5195e00640 1 -- 172.21.15.123:0/1643133046 wait complete. 2024-04-25T13:43:10.342 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:43:10.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.487+0000 7f1871c00640 1 Processor -- start 2024-04-25T13:43:10.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.487+0000 7f1871c00640 1 -- start start 2024-04-25T13:43:10.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.487+0000 7f1871c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f186c166940 0x7f186c168d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:10.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.487+0000 7f1871c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f186c0c6810 con 0x7f186c0b3870 2024-04-25T13:43:10.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.487+0000 7f1871c00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f186c0c6af0 con 0x7f186c0ceac0 2024-04-25T13:43:10.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.487+0000 7f1871c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f186c0c7140 con 0x7f186c166940 2024-04-25T13:43:10.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.491+0000 7f1862000640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f186c0b3870 0x7f186c0b3c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54868/0 (socket says 172.21.15.123:54868) 2024-04-25T13:43:10.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.491+0000 7f1862000640 1 -- 172.21.15.123:0/430465207 learned_addr learned my addr 172.21.15.123:0/430465207 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:10.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.491+0000 7f186b400640 1 --2- 172.21.15.123:0/430465207 >> v2:172.21.15.123:3300/0 conn(0x7f186c166940 0x7f186c168d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.491+0000 7f186a000640 1 -- 172.21.15.123:0/430465207 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 726018275 0 0) 0x7f186c0c6810 con 0x7f186c0b3870 2024-04-25T13:43:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.491+0000 7f186a000640 1 -- 172.21.15.123:0/430465207 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1850003530 con 0x7f186c0b3870 2024-04-25T13:43:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.491+0000 7f186b400640 1 -- 172.21.15.123:0/430465207 >> v1:172.21.15.130:6789/0 conn(0x7f186c0ceac0 legacy=0x7f186c0c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.491+0000 7f186b400640 1 -- 172.21.15.123:0/430465207 >> v1:172.21.15.123:6789/0 conn(0x7f186c0b3870 legacy=0x7f186c0b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:10.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.491+0000 7f186b400640 1 -- 172.21.15.123:0/430465207 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f186c0c6dd0 con 0x7f186c166940 2024-04-25T13:43:10.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.491+0000 7f186b400640 1 --2- 172.21.15.123:0/430465207 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c166940 0x7f186c168d60 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f186c0c72c0 tx=0x7f186401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c2d5ef2fcb47bdb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:10.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.491+0000 7f186a000640 1 -- 172.21.15.123:0/430465207 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18640b2070 con 0x7f186c166940 2024-04-25T13:43:10.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.491+0000 7f186a000640 1 -- 172.21.15.123:0/430465207 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18640a5890 con 0x7f186c166940 2024-04-25T13:43:10.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.491+0000 7f186a000640 1 -- 172.21.15.123:0/430465207 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18640a5c60 con 0x7f186c166940 2024-04-25T13:43:10.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.495+0000 7f1871c00640 1 -- 172.21.15.123:0/430465207 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c166940 msgr2=0x7f186c168d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:10.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.495+0000 7f1871c00640 1 --2- 172.21.15.123:0/430465207 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c166940 0x7f186c168d60 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f186c0c72c0 tx=0x7f186401c8c0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.495+0000 7f1871c00640 1 -- 172.21.15.123:0/430465207 shutdown_connections 2024-04-25T13:43:10.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.495+0000 7f1871c00640 1 --2- 172.21.15.123:0/430465207 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c166940 0x7f186c168d60 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.495+0000 7f1871c00640 1 -- 172.21.15.123:0/430465207 >> 172.21.15.123:0/430465207 conn(0x7f186c06ca70 msgr2=0x7f186c06ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:10.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.495+0000 7f1871c00640 1 -- 172.21.15.123:0/430465207 shutdown_connections 2024-04-25T13:43:10.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.495+0000 7f1871c00640 1 -- 172.21.15.123:0/430465207 wait complete. 2024-04-25T13:43:10.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.495+0000 7f1871c00640 1 Processor -- start 2024-04-25T13:43:10.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.495+0000 7f1871c00640 1 -- start start 2024-04-25T13:43:10.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.499+0000 7f1871c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f186c0b3870 0x7f186c147df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:10.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.499+0000 7f1871c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f186c0ceac0 0x7f186c144130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:10.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.499+0000 7f1871c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c166940 0x7f186c0cd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:10.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.499+0000 7f1871c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f186c16be50 con 0x7f186c166940 2024-04-25T13:43:10.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.499+0000 7f1871c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f186c16bcd0 con 0x7f186c0ceac0 2024-04-25T13:43:10.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.499+0000 7f1871c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f186c16bfd0 con 0x7f186c0b3870 2024-04-25T13:43:10.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.499+0000 7f186b400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c166940 0x7f186c0cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:10.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.499+0000 7f186b400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c166940 0x7f186c0cd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34896/0 (socket says 172.21.15.123:34896) 2024-04-25T13:43:10.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.499+0000 7f186b400640 1 -- 172.21.15.123:0/1446075452 learned_addr learned my addr 172.21.15.123:0/1446075452 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:10.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.499+0000 7f186aa00640 1 --2- 172.21.15.123:0/1446075452 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f186c0b3870 0x7f186c147df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:10.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.499+0000 7f1862000640 1 --2- 172.21.15.123:0/1446075452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f186c0ceac0 0x7f186c144130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:10.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.499+0000 7f186b400640 1 -- 172.21.15.123:0/1446075452 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f186c0b3870 msgr2=0x7f186c147df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:10.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.499+0000 7f186b400640 1 --2- 172.21.15.123:0/1446075452 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f186c0b3870 0x7f186c147df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.499+0000 7f186b400640 1 -- 172.21.15.123:0/1446075452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f186c0ceac0 msgr2=0x7f186c144130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:10.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.499+0000 7f186b400640 1 --2- 172.21.15.123:0/1446075452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f186c0ceac0 0x7f186c144130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.499+0000 7f186b400640 1 -- 172.21.15.123:0/1446075452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f186c1488b0 con 0x7f186c166940 2024-04-25T13:43:10.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.499+0000 7f186aa00640 1 --2- 172.21.15.123:0/1446075452 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f186c0b3870 0x7f186c147df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:10.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.499+0000 7f1862000640 1 --2- 172.21.15.123:0/1446075452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f186c0ceac0 0x7f186c144130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:10.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.499+0000 7f186b400640 1 --2- 172.21.15.123:0/1446075452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c166940 0x7f186c0cd450 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f186401a4f0 tx=0x7f1864019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:10.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.499+0000 7f1863400640 1 -- 172.21.15.123:0/1446075452 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18640b2040 con 0x7f186c166940 2024-04-25T13:43:10.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.499+0000 7f1863400640 1 -- 172.21.15.123:0/1446075452 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18640bf070 con 0x7f186c166940 2024-04-25T13:43:10.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.499+0000 7f1871c00640 1 -- 172.21.15.123:0/1446075452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f186c148b90 con 0x7f186c166940 2024-04-25T13:43:10.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.499+0000 7f1863400640 1 -- 172.21.15.123:0/1446075452 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18640b8690 con 0x7f186c166940 2024-04-25T13:43:10.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.499+0000 7f1871c00640 1 -- 172.21.15.123:0/1446075452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f186c149150 con 0x7f186c166940 2024-04-25T13:43:10.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.499+0000 7f1871c00640 1 -- 172.21.15.123:0/1446075452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f186c06d600 con 0x7f186c166940 2024-04-25T13:43:10.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.503+0000 7f1863400640 1 -- 172.21.15.123:0/1446075452 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f18640b8830 con 0x7f186c166940 2024-04-25T13:43:10.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.503+0000 7f1863400640 1 --2- 172.21.15.123:0/1446075452 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f184806f400 0x7f1848071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:10.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.503+0000 7f1863400640 1 -- 172.21.15.123:0/1446075452 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f186412acc0 con 0x7f186c166940 2024-04-25T13:43:10.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.503+0000 7f186aa00640 1 --2- 172.21.15.123:0/1446075452 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f184806f400 0x7f1848071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:10.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.503+0000 7f186aa00640 1 --2- 172.21.15.123:0/1446075452 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f184806f400 0x7f1848071910 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f185c001670 tx=0x7f185c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:10.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.507+0000 7f1863400640 1 -- 172.21.15.123:0/1446075452 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1864016540 con 0x7f186c166940 2024-04-25T13:43:10.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.663+0000 7f1871c00640 1 -- 172.21.15.123:0/1446075452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f186c050750 con 0x7f186c166940 2024-04-25T13:43:10.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.663+0000 7f1863400640 1 -- 172.21.15.123:0/1446075452 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) ==== 104+0+11 (secure 0 0 0) 0x7f18640f7c90 con 0x7f186c166940 2024-04-25T13:43:10.667 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-04-25T13:43:10.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.663+0000 7f1871c00640 1 -- 172.21.15.123:0/1446075452 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f184806f400 msgr2=0x7f1848071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:10.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.663+0000 7f1871c00640 1 --2- 172.21.15.123:0/1446075452 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f184806f400 0x7f1848071910 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f185c001670 tx=0x7f185c009040 comp rx=0 tx=0).stop 2024-04-25T13:43:10.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.663+0000 7f1871c00640 1 -- 172.21.15.123:0/1446075452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c166940 msgr2=0x7f186c0cd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:10.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.663+0000 7f1871c00640 1 --2- 172.21.15.123:0/1446075452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c166940 0x7f186c0cd450 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f186401a4f0 tx=0x7f1864019660 comp rx=0 tx=0).stop 2024-04-25T13:43:10.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.663+0000 7f1871c00640 1 -- 172.21.15.123:0/1446075452 shutdown_connections 2024-04-25T13:43:10.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.663+0000 7f1871c00640 1 --2- 172.21.15.123:0/1446075452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f186c0ceac0 0x7f186c144130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.663+0000 7f1871c00640 1 --2- 172.21.15.123:0/1446075452 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f184806f400 0x7f1848071910 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.663+0000 7f1871c00640 1 --2- 172.21.15.123:0/1446075452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f186c166940 0x7f186c0cd450 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.663+0000 7f1871c00640 1 --2- 172.21.15.123:0/1446075452 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f186c0b3870 0x7f186c147df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.663+0000 7f1871c00640 1 -- 172.21.15.123:0/1446075452 >> 172.21.15.123:0/1446075452 conn(0x7f186c06ca70 msgr2=0x7f186c06ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:10.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.663+0000 7f1871c00640 1 -- 172.21.15.123:0/1446075452 shutdown_connections 2024-04-25T13:43:10.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.663+0000 7f1871c00640 1 -- 172.21.15.123:0/1446075452 wait complete. 2024-04-25T13:43:10.688 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:43:10.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.835+0000 7f0ee6000640 1 Processor -- start 2024-04-25T13:43:10.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.835+0000 7f0ee6000640 1 -- start start 2024-04-25T13:43:10.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.835+0000 7f0ee6000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ee00ceac0 0x7f0ee00c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:10.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.835+0000 7f0ee6000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f0ee015de80 0x7f0ee015e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:10.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.835+0000 7f0ee6000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ee00c7b10 con 0x7f0ee00b3870 2024-04-25T13:43:10.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.835+0000 7f0ee6000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f0ee00c7140 con 0x7f0ee015de80 2024-04-25T13:43:10.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.835+0000 7f0ee6000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0ee00cf060 con 0x7f0ee00ceac0 2024-04-25T13:43:10.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.835+0000 7f0edea00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0ee00b3870 0x7f0ee00b3c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54880/0 (socket says 172.21.15.123:54880) 2024-04-25T13:43:10.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.835+0000 7f0edea00640 1 -- 172.21.15.123:0/2464033778 learned_addr learned my addr 172.21.15.123:0/2464033778 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:10.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.835+0000 7f0edfe00640 1 --2- 172.21.15.123:0/2464033778 >> v2:172.21.15.123:3300/0 conn(0x7f0ee015de80 0x7f0ee015e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:10.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.835+0000 7f0edf400640 1 --2- 172.21.15.123:0/2464033778 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ee00ceac0 0x7f0ee00c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:10.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.835+0000 7f0ede000640 1 -- 172.21.15.123:0/2464033778 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3984291035 0 0) 0x7f0ee00c7b10 con 0x7f0ee00b3870 2024-04-25T13:43:10.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.835+0000 7f0ede000640 1 -- 172.21.15.123:0/2464033778 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ec4003530 con 0x7f0ee00b3870 2024-04-25T13:43:10.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.835+0000 7f0edfe00640 1 -- 172.21.15.123:0/2464033778 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ee00ceac0 msgr2=0x7f0ee00c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:10.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.835+0000 7f0edfe00640 1 --2- 172.21.15.123:0/2464033778 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ee00ceac0 0x7f0ee00c75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.835+0000 7f0edfe00640 1 -- 172.21.15.123:0/2464033778 >> v1:172.21.15.123:6789/0 conn(0x7f0ee00b3870 legacy=0x7f0ee00b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:10.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.835+0000 7f0edfe00640 1 -- 172.21.15.123:0/2464033778 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee00c6810 con 0x7f0ee015de80 2024-04-25T13:43:10.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.839+0000 7f0edfe00640 1 --2- 172.21.15.123:0/2464033778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ee015de80 0x7f0ee015e290 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00c72c0 tx=0x7f0ed801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc30ca55ddcb759 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:10.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.839+0000 7f0ede000640 1 -- 172.21.15.123:0/2464033778 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed80b2070 con 0x7f0ee015de80 2024-04-25T13:43:10.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.839+0000 7f0ede000640 1 -- 172.21.15.123:0/2464033778 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ed80a5950 con 0x7f0ee015de80 2024-04-25T13:43:10.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.839+0000 7f0ede000640 1 -- 172.21.15.123:0/2464033778 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed80a5d20 con 0x7f0ee015de80 2024-04-25T13:43:10.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.839+0000 7f0ee6000640 1 -- 172.21.15.123:0/2464033778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ee015de80 msgr2=0x7f0ee015e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:10.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.839+0000 7f0ee6000640 1 --2- 172.21.15.123:0/2464033778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ee015de80 0x7f0ee015e290 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00c72c0 tx=0x7f0ed801c890 comp rx=0 tx=0).stop 2024-04-25T13:43:10.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.839+0000 7f0ee6000640 1 -- 172.21.15.123:0/2464033778 shutdown_connections 2024-04-25T13:43:10.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.839+0000 7f0ee6000640 1 --2- 172.21.15.123:0/2464033778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ee015de80 0x7f0ee015e290 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.839+0000 7f0ee6000640 1 --2- 172.21.15.123:0/2464033778 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ee00ceac0 0x7f0ee00c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.839+0000 7f0ee6000640 1 -- 172.21.15.123:0/2464033778 >> 172.21.15.123:0/2464033778 conn(0x7f0ee006ca70 msgr2=0x7f0ee006ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:10.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.839+0000 7f0ee6000640 1 -- 172.21.15.123:0/2464033778 shutdown_connections 2024-04-25T13:43:10.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.839+0000 7f0ee6000640 1 -- 172.21.15.123:0/2464033778 wait complete. 2024-04-25T13:43:10.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.843+0000 7f0ee6000640 1 Processor -- start 2024-04-25T13:43:10.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.843+0000 7f0ee6000640 1 -- start start 2024-04-25T13:43:10.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.843+0000 7f0ee6000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ee00b3870 0x7f0ee013da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:10.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.843+0000 7f0ee6000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ee00ceac0 0x7f0ee014b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:10.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.843+0000 7f0ee6000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ee015de80 0x7f0ee00cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:10.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.843+0000 7f0ee6000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee016aae0 con 0x7f0ee00ceac0 2024-04-25T13:43:10.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.843+0000 7f0ee6000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee016a960 con 0x7f0ee015de80 2024-04-25T13:43:10.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.843+0000 7f0ee6000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0ee016ac60 con 0x7f0ee00b3870 2024-04-25T13:43:10.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.843+0000 7f0edea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ee00ceac0 0x7f0ee014b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:10.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.843+0000 7f0edea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ee00ceac0 0x7f0ee014b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34906/0 (socket says 172.21.15.123:34906) 2024-04-25T13:43:10.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.843+0000 7f0edea00640 1 -- 172.21.15.123:0/3131716230 learned_addr learned my addr 172.21.15.123:0/3131716230 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:10.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.843+0000 7f0edf400640 1 --2- 172.21.15.123:0/3131716230 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ee00b3870 0x7f0ee013da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:10.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.843+0000 7f0edfe00640 1 --2- 172.21.15.123:0/3131716230 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ee015de80 0x7f0ee00cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:10.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.843+0000 7f0edea00640 1 -- 172.21.15.123:0/3131716230 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ee00b3870 msgr2=0x7f0ee013da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:10.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.843+0000 7f0edea00640 1 --2- 172.21.15.123:0/3131716230 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ee00b3870 0x7f0ee013da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.843+0000 7f0edea00640 1 -- 172.21.15.123:0/3131716230 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ee015de80 msgr2=0x7f0ee00cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:10.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.843+0000 7f0edea00640 1 --2- 172.21.15.123:0/3131716230 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ee015de80 0x7f0ee00cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:10.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.843+0000 7f0edea00640 1 -- 172.21.15.123:0/3131716230 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee00732f0 con 0x7f0ee00ceac0 2024-04-25T13:43:10.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.843+0000 7f0edea00640 1 --2- 172.21.15.123:0/3131716230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ee00ceac0 0x7f0ee014b380 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00c390 tx=0x7f0ecc001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:10.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.847+0000 7f0ed7400640 1 -- 172.21.15.123:0/3131716230 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc017070 con 0x7f0ee00ceac0 2024-04-25T13:43:10.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.847+0000 7f0ed7400640 1 -- 172.21.15.123:0/3131716230 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ecc005cf0 con 0x7f0ee00ceac0 2024-04-25T13:43:10.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.847+0000 7f0ed7400640 1 -- 172.21.15.123:0/3131716230 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc0072f0 con 0x7f0ee00ceac0 2024-04-25T13:43:10.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.847+0000 7f0ee6000640 1 -- 172.21.15.123:0/3131716230 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ee00735d0 con 0x7f0ee00ceac0 2024-04-25T13:43:10.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.847+0000 7f0ee6000640 1 -- 172.21.15.123:0/3131716230 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ee01f9b20 con 0x7f0ee00ceac0 2024-04-25T13:43:10.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.847+0000 7f0ee6000640 1 -- 172.21.15.123:0/3131716230 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ee014e490 con 0x7f0ee00ceac0 2024-04-25T13:43:10.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.847+0000 7f0ed7400640 1 -- 172.21.15.123:0/3131716230 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0ecc01a070 con 0x7f0ee00ceac0 2024-04-25T13:43:10.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.847+0000 7f0ed7400640 1 --2- 172.21.15.123:0/3131716230 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f0ec006f400 0x7f0ec0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:10.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.847+0000 7f0ed7400640 1 -- 172.21.15.123:0/3131716230 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0ecc08e490 con 0x7f0ee00ceac0 2024-04-25T13:43:10.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.847+0000 7f0edf400640 1 --2- 172.21.15.123:0/3131716230 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f0ec006f400 0x7f0ec0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:10.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.851+0000 7f0edf400640 1 --2- 172.21.15.123:0/3131716230 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f0ec006f400 0x7f0ec0071910 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0ed00079c0 tx=0x7f0ed0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:10.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:10.851+0000 7f0ed7400640 1 -- 172.21.15.123:0/3131716230 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0ecc05adb0 con 0x7f0ee00ceac0 2024-04-25T13:43:11.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.011+0000 7f0ee6000640 1 -- 172.21.15.123:0/3131716230 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0ee006d600 con 0x7f0ee00ceac0 2024-04-25T13:43:11.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.011+0000 7f0ed7400640 1 -- 172.21.15.123:0/3131716230 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) ==== 100+0+11 (secure 0 0 0) 0x7f0ecc0633f0 con 0x7f0ee00ceac0 2024-04-25T13:43:11.014 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-04-25T13:43:11.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.011+0000 7f0ee6000640 1 -- 172.21.15.123:0/3131716230 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f0ec006f400 msgr2=0x7f0ec0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.011+0000 7f0ee6000640 1 --2- 172.21.15.123:0/3131716230 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f0ec006f400 0x7f0ec0071910 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0ed00079c0 tx=0x7f0ed0008040 comp rx=0 tx=0).stop 2024-04-25T13:43:11.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.011+0000 7f0ee6000640 1 -- 172.21.15.123:0/3131716230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ee00ceac0 msgr2=0x7f0ee014b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.011+0000 7f0ee6000640 1 --2- 172.21.15.123:0/3131716230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ee00ceac0 0x7f0ee014b380 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00c390 tx=0x7f0ecc001e80 comp rx=0 tx=0).stop 2024-04-25T13:43:11.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.011+0000 7f0ee6000640 1 -- 172.21.15.123:0/3131716230 shutdown_connections 2024-04-25T13:43:11.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.011+0000 7f0ee6000640 1 --2- 172.21.15.123:0/3131716230 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ee015de80 0x7f0ee00cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.011+0000 7f0ee6000640 1 --2- 172.21.15.123:0/3131716230 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f0ec006f400 0x7f0ec0071910 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.011+0000 7f0ee6000640 1 --2- 172.21.15.123:0/3131716230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0ee00ceac0 0x7f0ee014b380 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.011+0000 7f0ee6000640 1 --2- 172.21.15.123:0/3131716230 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ee00b3870 0x7f0ee013da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.011+0000 7f0ee6000640 1 -- 172.21.15.123:0/3131716230 >> 172.21.15.123:0/3131716230 conn(0x7f0ee006ca70 msgr2=0x7f0ee015ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:11.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.011+0000 7f0ee6000640 1 -- 172.21.15.123:0/3131716230 shutdown_connections 2024-04-25T13:43:11.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.011+0000 7f0ee6000640 1 -- 172.21.15.123:0/3131716230 wait complete. 2024-04-25T13:43:11.035 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:43:11.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.179+0000 7fcb5ee00640 1 Processor -- start 2024-04-25T13:43:11.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.179+0000 7fcb5ee00640 1 -- start start 2024-04-25T13:43:11.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.179+0000 7fcb5ee00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcb581571b0 0x7fcb580cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.179+0000 7fcb5ee00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb580b3870 0x7fcb580b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.179+0000 7fcb5ee00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcb580b4770 0x7fcb580b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.179+0000 7fcb5ee00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fcb580b41c0 con 0x7fcb580b4770 2024-04-25T13:43:11.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.179+0000 7fcb5ee00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fcb580cdee0 con 0x7fcb581571b0 2024-04-25T13:43:11.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.179+0000 7fcb5ee00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fcb5815d570 con 0x7fcb580b3870 2024-04-25T13:43:11.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.179+0000 7fcb5ce00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcb580b4770 0x7fcb580b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.179+0000 7fcb5ce00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fcb580b4770 0x7fcb580b4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34910/0 (socket says 172.21.15.123:34910) 2024-04-25T13:43:11.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.179+0000 7fcb5ce00640 1 -- 172.21.15.123:0/2352822093 learned_addr learned my addr 172.21.15.123:0/2352822093 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:11.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.179+0000 7fcb57e00640 1 --2- 172.21.15.123:0/2352822093 >> v2:172.21.15.130:3300/0 conn(0x7fcb581571b0 0x7fcb580cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.179+0000 7fcb4f400640 1 --2- 172.21.15.123:0/2352822093 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb580b3870 0x7fcb580b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.179+0000 7fcb5ce00640 1 -- 172.21.15.123:0/2352822093 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb580b3870 msgr2=0x7fcb580b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:11.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.179+0000 7fcb5ce00640 1 --2- 172.21.15.123:0/2352822093 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb580b3870 0x7fcb580b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.179+0000 7fcb5ce00640 1 -- 172.21.15.123:0/2352822093 >> v2:172.21.15.130:3300/0 conn(0x7fcb581571b0 msgr2=0x7fcb580cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:11.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.179+0000 7fcb5ce00640 1 --2- 172.21.15.123:0/2352822093 >> v2:172.21.15.130:3300/0 conn(0x7fcb581571b0 0x7fcb580cd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.179+0000 7fcb5ce00640 1 -- 172.21.15.123:0/2352822093 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb5815d850 con 0x7fcb580b4770 2024-04-25T13:43:11.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.179+0000 7fcb57e00640 1 --2- 172.21.15.123:0/2352822093 >> v2:172.21.15.130:3300/0 conn(0x7fcb581571b0 0x7fcb580cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:11.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.183+0000 7fcb5ce00640 1 --2- 172.21.15.123:0/2352822093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb580b4770 0x7fcb580b4b80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcb580722c0 tx=0x7fcb5001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfcc532a9fa22f6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:11.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.183+0000 7fcb57400640 1 -- 172.21.15.123:0/2352822093 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb500a5790 con 0x7fcb580b4770 2024-04-25T13:43:11.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.183+0000 7fcb57400640 1 -- 172.21.15.123:0/2352822093 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb500a5930 con 0x7fcb580b4770 2024-04-25T13:43:11.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.183+0000 7fcb57400640 1 -- 172.21.15.123:0/2352822093 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb500a5d00 con 0x7fcb580b4770 2024-04-25T13:43:11.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.183+0000 7fcb5ee00640 1 -- 172.21.15.123:0/2352822093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb580b4770 msgr2=0x7fcb580b4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.183+0000 7fcb5ee00640 1 --2- 172.21.15.123:0/2352822093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb580b4770 0x7fcb580b4b80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcb580722c0 tx=0x7fcb5001c930 comp rx=0 tx=0).stop 2024-04-25T13:43:11.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.183+0000 7fcb5ee00640 1 -- 172.21.15.123:0/2352822093 shutdown_connections 2024-04-25T13:43:11.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.183+0000 7fcb5ee00640 1 --2- 172.21.15.123:0/2352822093 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb580b4770 0x7fcb580b4b80 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.183+0000 7fcb5ee00640 1 --2- 172.21.15.123:0/2352822093 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb580b3870 0x7fcb580b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.183+0000 7fcb5ee00640 1 --2- 172.21.15.123:0/2352822093 >> v2:172.21.15.130:3300/0 conn(0x7fcb581571b0 0x7fcb580cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.183+0000 7fcb5ee00640 1 -- 172.21.15.123:0/2352822093 >> 172.21.15.123:0/2352822093 conn(0x7fcb5806ca70 msgr2=0x7fcb5806ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:11.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.183+0000 7fcb5ee00640 1 -- 172.21.15.123:0/2352822093 shutdown_connections 2024-04-25T13:43:11.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.183+0000 7fcb5ee00640 1 -- 172.21.15.123:0/2352822093 wait complete. 2024-04-25T13:43:11.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.187+0000 7fcb5ee00640 1 Processor -- start 2024-04-25T13:43:11.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.187+0000 7fcb5ee00640 1 -- start start 2024-04-25T13:43:11.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.187+0000 7fcb5ee00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb580b3870 0x7fcb5814c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.187+0000 7fcb5ee00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb580b4770 0x7fcb580cc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.187+0000 7fcb5ee00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb581571b0 0x7fcb5814e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.187+0000 7fcb5ee00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5815e050 con 0x7fcb580b3870 2024-04-25T13:43:11.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.187+0000 7fcb5ee00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcb580b54d0 con 0x7fcb581571b0 2024-04-25T13:43:11.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.187+0000 7fcb5ee00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fcb5814cef0 con 0x7fcb580b4770 2024-04-25T13:43:11.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.187+0000 7fcb57e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb580b3870 0x7fcb5814c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.187+0000 7fcb57e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb580b3870 0x7fcb5814c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34924/0 (socket says 172.21.15.123:34924) 2024-04-25T13:43:11.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.187+0000 7fcb57e00640 1 -- 172.21.15.123:0/724129112 learned_addr learned my addr 172.21.15.123:0/724129112 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:11.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.187+0000 7fcb4f400640 1 --2- 172.21.15.123:0/724129112 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb580b4770 0x7fcb580cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.187+0000 7fcb5ce00640 1 --2- 172.21.15.123:0/724129112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb581571b0 0x7fcb5814e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.191+0000 7fcb57e00640 1 -- 172.21.15.123:0/724129112 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb580b4770 msgr2=0x7fcb580cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.191+0000 7fcb57e00640 1 --2- 172.21.15.123:0/724129112 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb580b4770 0x7fcb580cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.191+0000 7fcb57e00640 1 -- 172.21.15.123:0/724129112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb581571b0 msgr2=0x7fcb5814e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.191+0000 7fcb57e00640 1 --2- 172.21.15.123:0/724129112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb581571b0 0x7fcb5814e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.191+0000 7fcb57e00640 1 -- 172.21.15.123:0/724129112 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb580b2b50 con 0x7fcb580b3870 2024-04-25T13:43:11.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.191+0000 7fcb57e00640 1 --2- 172.21.15.123:0/724129112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb580b3870 0x7fcb5814c630 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800d800 tx=0x7fcb4800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:11.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.191+0000 7fcb54c00640 1 -- 172.21.15.123:0/724129112 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb48018020 con 0x7fcb580b3870 2024-04-25T13:43:11.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.191+0000 7fcb54c00640 1 -- 172.21.15.123:0/724129112 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb480096a0 con 0x7fcb580b3870 2024-04-25T13:43:11.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.191+0000 7fcb5ee00640 1 -- 172.21.15.123:0/724129112 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb581faef0 con 0x7fcb580b3870 2024-04-25T13:43:11.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.191+0000 7fcb54c00640 1 -- 172.21.15.123:0/724129112 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb48009a90 con 0x7fcb580b3870 2024-04-25T13:43:11.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.191+0000 7fcb5ee00640 1 -- 172.21.15.123:0/724129112 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb581fb4b0 con 0x7fcb580b3870 2024-04-25T13:43:11.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.191+0000 7fcb5ee00640 1 -- 172.21.15.123:0/724129112 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb58050750 con 0x7fcb580b3870 2024-04-25T13:43:11.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.191+0000 7fcb54c00640 1 -- 172.21.15.123:0/724129112 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fcb4801b020 con 0x7fcb580b3870 2024-04-25T13:43:11.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.191+0000 7fcb54c00640 1 --2- 172.21.15.123:0/724129112 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fcb3406f430 0x7fcb34071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.195+0000 7fcb54c00640 1 -- 172.21.15.123:0/724129112 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fcb4808f650 con 0x7fcb580b3870 2024-04-25T13:43:11.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.195+0000 7fcb4f400640 1 --2- 172.21.15.123:0/724129112 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fcb3406f430 0x7fcb34071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.195+0000 7fcb4f400640 1 --2- 172.21.15.123:0/724129112 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fcb3406f430 0x7fcb34071940 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcb580cb3b0 tx=0x7fcb40008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:11.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.199+0000 7fcb54c00640 1 -- 172.21.15.123:0/724129112 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcb48022020 con 0x7fcb580b3870 2024-04-25T13:43:11.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.363+0000 7fcb5ee00640 1 -- 172.21.15.123:0/724129112 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcb58074cc0 con 0x7fcb580b3870 2024-04-25T13:43:11.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.367+0000 7fcb54c00640 1 -- 172.21.15.123:0/724129112 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7fcb4805bee0 con 0x7fcb580b3870 2024-04-25T13:43:11.369 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-04-25T13:43:11.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.367+0000 7fcb5ee00640 1 -- 172.21.15.123:0/724129112 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fcb3406f430 msgr2=0x7fcb34071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.367+0000 7fcb5ee00640 1 --2- 172.21.15.123:0/724129112 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fcb3406f430 0x7fcb34071940 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcb580cb3b0 tx=0x7fcb40008040 comp rx=0 tx=0).stop 2024-04-25T13:43:11.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.367+0000 7fcb5ee00640 1 -- 172.21.15.123:0/724129112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb580b3870 msgr2=0x7fcb5814c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.367+0000 7fcb5ee00640 1 --2- 172.21.15.123:0/724129112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb580b3870 0x7fcb5814c630 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800d800 tx=0x7fcb4800dcc0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.367+0000 7fcb5ee00640 1 -- 172.21.15.123:0/724129112 shutdown_connections 2024-04-25T13:43:11.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.367+0000 7fcb5ee00640 1 --2- 172.21.15.123:0/724129112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb581571b0 0x7fcb5814e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.367+0000 7fcb5ee00640 1 --2- 172.21.15.123:0/724129112 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fcb3406f430 0x7fcb34071940 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.367+0000 7fcb5ee00640 1 --2- 172.21.15.123:0/724129112 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb580b4770 0x7fcb580cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.367+0000 7fcb5ee00640 1 --2- 172.21.15.123:0/724129112 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb580b3870 0x7fcb5814c630 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.367+0000 7fcb5ee00640 1 -- 172.21.15.123:0/724129112 >> 172.21.15.123:0/724129112 conn(0x7fcb5806ca70 msgr2=0x7fcb580d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:11.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.367+0000 7fcb5ee00640 1 -- 172.21.15.123:0/724129112 shutdown_connections 2024-04-25T13:43:11.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.367+0000 7fcb5ee00640 1 -- 172.21.15.123:0/724129112 wait complete. 2024-04-25T13:43:11.391 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T13:43:11.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:11.391 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T13:43:11.457 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-04-25T13:43:11.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:11.457 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T13:43:11.476 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.00000000 2024-04-25T13:43:11.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.571+0000 7ffa9de3a080 1 Processor -- start 2024-04-25T13:43:11.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.571+0000 7ffa9de3a080 1 -- start start 2024-04-25T13:43:11.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa9de3a080 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x563cd4e6a4d0 0x563cd4f21b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa9de3a080 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563cd4e6c220 0x563cd4f417c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa9de3a080 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563cd4f24e20 0x563cd4f41d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa9de3a080 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x563cd4e109a0 con 0x563cd4f24e20 2024-04-25T13:43:11.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa9de3a080 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563cd4e6b480 con 0x563cd4e6c220 2024-04-25T13:43:11.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa9de3a080 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x563cd4f2bf10 con 0x563cd4e6a4d0 2024-04-25T13:43:11.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa97a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563cd4f24e20 0x563cd4f41d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa97a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563cd4f24e20 0x563cd4f41d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34946/0 (socket says 172.21.15.123:34946) 2024-04-25T13:43:11.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa97a00640 1 -- 172.21.15.123:0/3690511787 learned_addr learned my addr 172.21.15.123:0/3690511787 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:11.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa97000640 1 --2- 172.21.15.123:0/3690511787 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x563cd4e6a4d0 0x563cd4f21b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa96600640 1 --2- 172.21.15.123:0/3690511787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563cd4e6c220 0x563cd4f417c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa97a00640 1 -- 172.21.15.123:0/3690511787 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x563cd4e6a4d0 msgr2=0x563cd4f21b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:11.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa97a00640 1 --2- 172.21.15.123:0/3690511787 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x563cd4e6a4d0 0x563cd4f21b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa97a00640 1 -- 172.21.15.123:0/3690511787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563cd4e6c220 msgr2=0x563cd4f417c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:11.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa97a00640 1 --2- 172.21.15.123:0/3690511787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563cd4e6c220 0x563cd4f417c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa97a00640 1 -- 172.21.15.123:0/3690511787 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cd4f2c1b0 con 0x563cd4f24e20 2024-04-25T13:43:11.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa97a00640 1 --2- 172.21.15.123:0/3690511787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563cd4f24e20 0x563cd4f41d00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ffa9001c060 tx=0x7ffa900033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb485d600ab6e13a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:11.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa95200640 1 -- 172.21.15.123:0/3690511787 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa900a8cd0 con 0x563cd4f24e20 2024-04-25T13:43:11.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa95200640 1 -- 172.21.15.123:0/3690511787 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa900c0070 con 0x563cd4f24e20 2024-04-25T13:43:11.580 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa95200640 1 -- 172.21.15.123:0/3690511787 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa900b0660 con 0x563cd4f24e20 2024-04-25T13:43:11.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa9de3a080 1 -- 172.21.15.123:0/3690511787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563cd4f24e20 msgr2=0x563cd4f41d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa9de3a080 1 --2- 172.21.15.123:0/3690511787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563cd4f24e20 0x563cd4f41d00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ffa9001c060 tx=0x7ffa900033b0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa9de3a080 1 -- 172.21.15.123:0/3690511787 shutdown_connections 2024-04-25T13:43:11.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa9de3a080 1 --2- 172.21.15.123:0/3690511787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563cd4e6c220 0x563cd4f417c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa9de3a080 1 --2- 172.21.15.123:0/3690511787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563cd4f24e20 0x563cd4f41d00 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa9de3a080 1 --2- 172.21.15.123:0/3690511787 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x563cd4e6a4d0 0x563cd4f21b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa9de3a080 1 -- 172.21.15.123:0/3690511787 >> 172.21.15.123:0/3690511787 conn(0x563cd4e55af0 msgr2=0x563cd4e99a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:11.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa9de3a080 1 -- 172.21.15.123:0/3690511787 shutdown_connections 2024-04-25T13:43:11.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.575+0000 7ffa9de3a080 1 -- 172.21.15.123:0/3690511787 wait complete. 2024-04-25T13:43:11.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.579+0000 7ffa9de3a080 1 Processor -- start 2024-04-25T13:43:11.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.579+0000 7ffa9de3a080 1 -- start start 2024-04-25T13:43:11.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.579+0000 7ffa9de3a080 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563cd4e6a4d0 0x563cd4f210e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.579+0000 7ffa9de3a080 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563cd4e6c220 0x563cd4f27c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.579+0000 7ffa9de3a080 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x563cd4f24e20 0x563cd4f281b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.579+0000 7ffa9de3a080 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x563cd4f2c6f0 con 0x563cd4e6a4d0 2024-04-25T13:43:11.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.579+0000 7ffa9de3a080 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563cd4f2c450 con 0x563cd4e6c220 2024-04-25T13:43:11.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.579+0000 7ffa9de3a080 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x563cd4f22040 con 0x563cd4f24e20 2024-04-25T13:43:11.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.579+0000 7ffa97000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563cd4e6a4d0 0x563cd4f210e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.579+0000 7ffa97000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563cd4e6a4d0 0x563cd4f210e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34962/0 (socket says 172.21.15.123:34962) 2024-04-25T13:43:11.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.579+0000 7ffa97000640 1 -- 172.21.15.123:0/1152336020 learned_addr learned my addr 172.21.15.123:0/1152336020 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:11.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.579+0000 7ffa96600640 1 --2- 172.21.15.123:0/1152336020 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563cd4e6c220 0x563cd4f27c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.579+0000 7ffa97a00640 1 --2- 172.21.15.123:0/1152336020 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x563cd4f24e20 0x563cd4f281b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.579+0000 7ffa97000640 1 -- 172.21.15.123:0/1152336020 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x563cd4f24e20 msgr2=0x563cd4f281b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.579+0000 7ffa97000640 1 --2- 172.21.15.123:0/1152336020 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x563cd4f24e20 0x563cd4f281b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.579+0000 7ffa97000640 1 -- 172.21.15.123:0/1152336020 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563cd4e6c220 msgr2=0x563cd4f27c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.579+0000 7ffa97000640 1 --2- 172.21.15.123:0/1152336020 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563cd4e6c220 0x563cd4f27c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.579+0000 7ffa97000640 1 -- 172.21.15.123:0/1152336020 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563cd4f291f0 con 0x563cd4e6a4d0 2024-04-25T13:43:11.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.579+0000 7ffa97000640 1 --2- 172.21.15.123:0/1152336020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563cd4e6a4d0 0x563cd4f210e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ffa880086f0 tx=0x7ffa88008bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:11.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.579+0000 7ffa8f400640 1 -- 172.21.15.123:0/1152336020 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8801b070 con 0x563cd4e6a4d0 2024-04-25T13:43:11.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.579+0000 7ffa8f400640 1 -- 172.21.15.123:0/1152336020 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa88006b10 con 0x563cd4e6a4d0 2024-04-25T13:43:11.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.579+0000 7ffa9de3a080 1 -- 172.21.15.123:0/1152336020 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563cd4ea9f50 con 0x563cd4e6a4d0 2024-04-25T13:43:11.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.579+0000 7ffa8f400640 1 -- 172.21.15.123:0/1152336020 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa88016480 con 0x563cd4e6a4d0 2024-04-25T13:43:11.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.579+0000 7ffa9de3a080 1 -- 172.21.15.123:0/1152336020 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563cd4eaa490 con 0x563cd4e6a4d0 2024-04-25T13:43:11.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.583+0000 7ffa8f400640 1 -- 172.21.15.123:0/1152336020 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ffa8801e070 con 0x563cd4e6a4d0 2024-04-25T13:43:11.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.583+0000 7ffa8f400640 1 --2- 172.21.15.123:0/1152336020 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ffa7806dde0 0x7ffa780702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.583+0000 7ffa8f400640 1 -- 172.21.15.123:0/1152336020 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ffa8808de10 con 0x563cd4e6a4d0 2024-04-25T13:43:11.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.583+0000 7ffa96600640 1 --2- 172.21.15.123:0/1152336020 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ffa7806dde0 0x7ffa780702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.583+0000 7ffa9de3a080 1 --2- 172.21.15.123:0/1152336020 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x563cd4f41540 0x563cd4eaae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.583+0000 7ffa9de3a080 1 -- 172.21.15.123:0/1152336020 --> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] -- osd_op(unknown.0.0:1 4.10 4:0cf6ad0f:::10000000000.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563cd4eab380 con 0x563cd4f41540 2024-04-25T13:43:11.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.583+0000 7ffa97a00640 1 --2- 172.21.15.123:0/1152336020 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x563cd4f41540 0x563cd4eaae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.583+0000 7ffa96600640 1 --2- 172.21.15.123:0/1152336020 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ffa7806dde0 0x7ffa780702f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffa84000f70 tx=0x7ffa84001780 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:11.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.583+0000 7ffa97a00640 1 --2- 172.21.15.123:0/1152336020 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x563cd4f41540 0x563cd4eaae40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:11.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.587+0000 7ffa97a00640 1 -- 172.21.15.123:0/1152336020 <== osd.3 v2:172.21.15.123:6816/898268961 1 ==== osd_op_reply(1 10000000000.00000000 [omap-get-keys] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7ffa900a8be0 con 0x563cd4f41540 2024-04-25T13:43:11.594 INFO:teuthology.orchestra.run.smithi123.stderr:error getting omap key set cephfs_metadata/10000000000.00000000: (2) No such file or directory 2024-04-25T13:43:11.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.587+0000 7ffa9de3a080 1 -- 172.21.15.123:0/1152336020 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x563cd4f41540 msgr2=0x563cd4eaae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.594 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.587+0000 7ffa9de3a080 1 --2- 172.21.15.123:0/1152336020 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x563cd4f41540 0x563cd4eaae40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.587+0000 7ffa9de3a080 1 -- 172.21.15.123:0/1152336020 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ffa7806dde0 msgr2=0x7ffa780702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.587+0000 7ffa9de3a080 1 --2- 172.21.15.123:0/1152336020 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ffa7806dde0 0x7ffa780702f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffa84000f70 tx=0x7ffa84001780 comp rx=0 tx=0).stop 2024-04-25T13:43:11.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.587+0000 7ffa9de3a080 1 -- 172.21.15.123:0/1152336020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563cd4e6a4d0 msgr2=0x563cd4f210e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.587+0000 7ffa9de3a080 1 --2- 172.21.15.123:0/1152336020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563cd4e6a4d0 0x563cd4f210e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ffa880086f0 tx=0x7ffa88008bb0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.587+0000 7ffa97a00640 1 -- 172.21.15.123:0/1152336020 reap_dead start 2024-04-25T13:43:11.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.587+0000 7ffa9de3a080 1 -- 172.21.15.123:0/1152336020 shutdown_connections 2024-04-25T13:43:11.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.587+0000 7ffa9de3a080 1 -- 172.21.15.123:0/1152336020 >> 172.21.15.123:0/1152336020 conn(0x563cd4e55af0 msgr2=0x563cd4e97970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:11.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.587+0000 7ffa9de3a080 1 -- 172.21.15.123:0/1152336020 shutdown_connections 2024-04-25T13:43:11.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.587+0000 7ffa9de3a080 1 -- 172.21.15.123:0/1152336020 wait complete. 2024-04-25T13:43:11.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:43:11.596 ERROR:tasks.cephfs.filesystem:Command failed on smithi123 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.00000000' 2024-04-25T13:43:11.596 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-25T13:43:11.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.651+0000 7f9bb4a4b080 1 Processor -- start 2024-04-25T13:43:11.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.651+0000 7f9bb4a4b080 1 -- start start 2024-04-25T13:43:11.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.651+0000 7f9bb4a4b080 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569ba0cd5b0 0x5569ba10ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.651+0000 7f9bb4a4b080 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569ba18a170 0x5569ba1a30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.651+0000 7f9bb4a4b080 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5569ba1a1190 0x5569ba234cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.651+0000 7f9bb4a4b080 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5569ba0cc070 con 0x5569ba0cd5b0 2024-04-25T13:43:11.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.651+0000 7f9bb4a4b080 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5569ba0739a0 con 0x5569ba18a170 2024-04-25T13:43:11.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.651+0000 7f9bb4a4b080 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x5569ba0cc1f0 con 0x5569ba1a1190 2024-04-25T13:43:11.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.651+0000 7f9bad000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569ba0cd5b0 0x5569ba10ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.651+0000 7f9bad000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569ba0cd5b0 0x5569ba10ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34980/0 (socket says 172.21.15.123:34980) 2024-04-25T13:43:11.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.651+0000 7f9bad000640 1 -- 172.21.15.123:0/1258425036 learned_addr learned my addr 172.21.15.123:0/1258425036 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:11.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.651+0000 7f9bada00640 1 --2- 172.21.15.123:0/1258425036 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5569ba1a1190 0x5569ba234cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.651+0000 7f9ba7e00640 1 --2- 172.21.15.123:0/1258425036 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569ba18a170 0x5569ba1a30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.651+0000 7f9bad000640 1 -- 172.21.15.123:0/1258425036 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5569ba1a1190 msgr2=0x5569ba234cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.651+0000 7f9bad000640 1 --2- 172.21.15.123:0/1258425036 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5569ba1a1190 0x5569ba234cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.651+0000 7f9bad000640 1 -- 172.21.15.123:0/1258425036 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569ba18a170 msgr2=0x5569ba1a30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.651+0000 7f9bad000640 1 --2- 172.21.15.123:0/1258425036 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569ba18a170 0x5569ba1a30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.651+0000 7f9bad000640 1 -- 172.21.15.123:0/1258425036 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569ba113f10 con 0x5569ba0cd5b0 2024-04-25T13:43:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.655+0000 7f9bad000640 1 --2- 172.21.15.123:0/1258425036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569ba0cd5b0 0x5569ba10ce90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9ba000b220 tx=0x7f9ba000b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4aeb432a0b8b49f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.655+0000 7f9ba6a00640 1 -- 172.21.15.123:0/1258425036 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba000a040 con 0x5569ba0cd5b0 2024-04-25T13:43:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.655+0000 7f9ba6a00640 1 -- 172.21.15.123:0/1258425036 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ba000f620 con 0x5569ba0cd5b0 2024-04-25T13:43:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.655+0000 7f9ba6a00640 1 -- 172.21.15.123:0/1258425036 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba000fa10 con 0x5569ba0cd5b0 2024-04-25T13:43:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.655+0000 7f9bb4a4b080 1 -- 172.21.15.123:0/1258425036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569ba0cd5b0 msgr2=0x5569ba10ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.655+0000 7f9bb4a4b080 1 --2- 172.21.15.123:0/1258425036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569ba0cd5b0 0x5569ba10ce90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9ba000b220 tx=0x7f9ba000b6e0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.655+0000 7f9bb4a4b080 1 -- 172.21.15.123:0/1258425036 shutdown_connections 2024-04-25T13:43:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.655+0000 7f9bb4a4b080 1 --2- 172.21.15.123:0/1258425036 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569ba18a170 0x5569ba1a30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.655+0000 7f9bb4a4b080 1 --2- 172.21.15.123:0/1258425036 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5569ba1a1190 0x5569ba234cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.655+0000 7f9bb4a4b080 1 --2- 172.21.15.123:0/1258425036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569ba0cd5b0 0x5569ba10ce90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.655+0000 7f9bb4a4b080 1 -- 172.21.15.123:0/1258425036 >> 172.21.15.123:0/1258425036 conn(0x5569ba0b8af0 msgr2=0x5569ba0fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.655+0000 7f9bb4a4b080 1 -- 172.21.15.123:0/1258425036 shutdown_connections 2024-04-25T13:43:11.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.655+0000 7f9bb4a4b080 1 -- 172.21.15.123:0/1258425036 wait complete. 2024-04-25T13:43:11.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.655+0000 7f9bb4a4b080 1 Processor -- start 2024-04-25T13:43:11.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.655+0000 7f9bb4a4b080 1 -- start start 2024-04-25T13:43:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.655+0000 7f9bb4a4b080 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569ba0cd5b0 0x5569ba185310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.655+0000 7f9bb4a4b080 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5569ba18a170 0x5569ba1133a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.655+0000 7f9bb4a4b080 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569ba1a1190 0x5569ba1118a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.655+0000 7f9bb4a4b080 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5569ba114450 con 0x5569ba0cd5b0 2024-04-25T13:43:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.655+0000 7f9bb4a4b080 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5569ba1141b0 con 0x5569ba1a1190 2024-04-25T13:43:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.655+0000 7f9bb4a4b080 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x5569ba186ec0 con 0x5569ba18a170 2024-04-25T13:43:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.659+0000 7f9bad000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569ba0cd5b0 0x5569ba185310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.659+0000 7f9bad000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569ba0cd5b0 0x5569ba185310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:34994/0 (socket says 172.21.15.123:34994) 2024-04-25T13:43:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.659+0000 7f9bad000640 1 -- 172.21.15.123:0/443673944 learned_addr learned my addr 172.21.15.123:0/443673944 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.659+0000 7f9bada00640 1 --2- 172.21.15.123:0/443673944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569ba1a1190 0x5569ba1118a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.659+0000 7f9ba7e00640 1 --2- 172.21.15.123:0/443673944 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5569ba18a170 0x5569ba1133a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.659+0000 7f9bad000640 1 -- 172.21.15.123:0/443673944 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5569ba18a170 msgr2=0x5569ba1133a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.659+0000 7f9bad000640 1 --2- 172.21.15.123:0/443673944 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5569ba18a170 0x5569ba1133a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.659+0000 7f9bad000640 1 -- 172.21.15.123:0/443673944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569ba1a1190 msgr2=0x5569ba1118a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.659+0000 7f9bad000640 1 --2- 172.21.15.123:0/443673944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569ba1a1190 0x5569ba1118a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.659+0000 7f9bad000640 1 -- 172.21.15.123:0/443673944 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569ba185a00 con 0x5569ba0cd5b0 2024-04-25T13:43:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.659+0000 7f9bad000640 1 --2- 172.21.15.123:0/443673944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569ba0cd5b0 0x5569ba185310 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x5569ba113b50 tx=0x7f9ba0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.659+0000 7f9ba5600640 1 -- 172.21.15.123:0/443673944 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba000fe10 con 0x5569ba0cd5b0 2024-04-25T13:43:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.659+0000 7f9ba5600640 1 -- 172.21.15.123:0/443673944 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ba0021020 con 0x5569ba0cd5b0 2024-04-25T13:43:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.659+0000 7f9ba5600640 1 -- 172.21.15.123:0/443673944 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ba000e9b0 con 0x5569ba0cd5b0 2024-04-25T13:43:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.659+0000 7f9bb4a4b080 1 -- 172.21.15.123:0/443673944 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5569ba185ca0 con 0x5569ba0cd5b0 2024-04-25T13:43:11.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.659+0000 7f9bb4a4b080 1 -- 172.21.15.123:0/443673944 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569ba16ffd0 con 0x5569ba0cd5b0 2024-04-25T13:43:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.659+0000 7f9ba5600640 1 -- 172.21.15.123:0/443673944 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9ba0017070 con 0x5569ba0cd5b0 2024-04-25T13:43:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.663+0000 7f9ba5600640 1 --2- 172.21.15.123:0/443673944 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9b8c06de10 0x7f9b8c070320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.663+0000 7f9ba5600640 1 -- 172.21.15.123:0/443673944 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f9ba008f820 con 0x5569ba0cd5b0 2024-04-25T13:43:11.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.663+0000 7f9ba7e00640 1 --2- 172.21.15.123:0/443673944 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9b8c06de10 0x7f9b8c070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.663+0000 7f9bb4a4b080 1 --2- 172.21.15.123:0/443673944 >> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] conn(0x5569ba170470 0x5569ba170880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.663+0000 7f9bb4a4b080 1 -- 172.21.15.123:0/443673944 --> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] -- osd_op(unknown.0.0:1 5.7 5:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5569ba170dc0 con 0x5569ba170470 2024-04-25T13:43:11.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.663+0000 7f9ba7e00640 1 --2- 172.21.15.123:0/443673944 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9b8c06de10 0x7f9b8c070320 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9b980098d0 tx=0x7f9b9800e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:11.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.663+0000 7f9bada00640 1 --2- 172.21.15.123:0/443673944 >> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] conn(0x5569ba170470 0x5569ba170880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.663+0000 7f9bada00640 1 --2- 172.21.15.123:0/443673944 >> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] conn(0x5569ba170470 0x5569ba170880 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:11.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.663+0000 7f9bada00640 1 -- 172.21.15.123:0/443673944 <== osd.5 v2:172.21.15.130:6800/2763000783 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7f9ba80a6940 con 0x5569ba170470 2024-04-25T13:43:11.668 INFO:teuthology.orchestra.run.smithi123.stderr:error getting xattr cephfs_data/10000000001.00000000/parent: (2) No such file or directory 2024-04-25T13:43:11.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.663+0000 7f9bb4a4b080 1 -- 172.21.15.123:0/443673944 >> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] conn(0x5569ba170470 msgr2=0x5569ba170880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.663+0000 7f9bb4a4b080 1 --2- 172.21.15.123:0/443673944 >> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] conn(0x5569ba170470 0x5569ba170880 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.663+0000 7f9bb4a4b080 1 -- 172.21.15.123:0/443673944 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9b8c06de10 msgr2=0x7f9b8c070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.663+0000 7f9bb4a4b080 1 --2- 172.21.15.123:0/443673944 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9b8c06de10 0x7f9b8c070320 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9b980098d0 tx=0x7f9b9800e040 comp rx=0 tx=0).stop 2024-04-25T13:43:11.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.663+0000 7f9bb4a4b080 1 -- 172.21.15.123:0/443673944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569ba0cd5b0 msgr2=0x5569ba185310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.663+0000 7f9bb4a4b080 1 --2- 172.21.15.123:0/443673944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5569ba0cd5b0 0x5569ba185310 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x5569ba113b50 tx=0x7f9ba0000bd0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.663+0000 7f9bada00640 1 -- 172.21.15.123:0/443673944 reap_dead start 2024-04-25T13:43:11.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.663+0000 7f9bb4a4b080 1 -- 172.21.15.123:0/443673944 shutdown_connections 2024-04-25T13:43:11.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.663+0000 7f9bb4a4b080 1 -- 172.21.15.123:0/443673944 >> 172.21.15.123:0/443673944 conn(0x5569ba0b8af0 msgr2=0x5569ba114630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:11.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.663+0000 7f9bb4a4b080 1 -- 172.21.15.123:0/443673944 shutdown_connections 2024-04-25T13:43:11.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.663+0000 7f9bb4a4b080 1 -- 172.21.15.123:0/443673944 wait complete. 2024-04-25T13:43:11.672 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:43:11.672 ERROR:tasks.cephfs.filesystem:Command failed on smithi123 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent' 2024-04-25T13:43:11.673 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 1.00000000 2024-04-25T13:43:11.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.723+0000 7fbbea155080 1 Processor -- start 2024-04-25T13:43:11.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.723+0000 7fbbea155080 1 -- start start 2024-04-25T13:43:11.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbea155080 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5557c881e070 0x5557c88323a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbea155080 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5557c881e480 0x5557c881a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbea155080 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5557c881ae40 0x5557c87ab980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbea155080 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5557c881f910 con 0x5557c881e480 2024-04-25T13:43:11.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbea155080 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5557c87099a0 con 0x5557c881e070 2024-04-25T13:43:11.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbea155080 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x5557c881fa90 con 0x5557c881ae40 2024-04-25T13:43:11.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbe2800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5557c881e480 0x5557c881a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbe2800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5557c881e480 0x5557c881a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35010/0 (socket says 172.21.15.123:35010) 2024-04-25T13:43:11.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbe2800640 1 -- 172.21.15.123:0/839941250 learned_addr learned my addr 172.21.15.123:0/839941250 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:11.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbe3200640 1 --2- 172.21.15.123:0/839941250 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5557c881e070 0x5557c88323a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbe3c00640 1 --2- 172.21.15.123:0/839941250 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5557c881ae40 0x5557c87ab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbe2800640 1 -- 172.21.15.123:0/839941250 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5557c881ae40 msgr2=0x5557c87ab980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:11.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbe2800640 1 --2- 172.21.15.123:0/839941250 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5557c881ae40 0x5557c87ab980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbe2800640 1 -- 172.21.15.123:0/839941250 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5557c881e070 msgr2=0x5557c88323a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:11.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbe2800640 1 --2- 172.21.15.123:0/839941250 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5557c881e070 0x5557c88323a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbe2800640 1 -- 172.21.15.123:0/839941250 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557c87614f0 con 0x5557c881e480 2024-04-25T13:43:11.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbe2800640 1 --2- 172.21.15.123:0/839941250 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5557c881e480 0x5557c881a900 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00097d0 tx=0x7fbbd0005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51a2b989de25a20 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:11.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbe1400640 1 -- 172.21.15.123:0/839941250 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0019070 con 0x5557c881e480 2024-04-25T13:43:11.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbe1400640 1 -- 172.21.15.123:0/839941250 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbd0008da0 con 0x5557c881e480 2024-04-25T13:43:11.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbe1400640 1 -- 172.21.15.123:0/839941250 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd00146a0 con 0x5557c881e480 2024-04-25T13:43:11.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbea155080 1 -- 172.21.15.123:0/839941250 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5557c881e480 msgr2=0x5557c881a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbea155080 1 --2- 172.21.15.123:0/839941250 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5557c881e480 0x5557c881a900 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbbd00097d0 tx=0x7fbbd0005a10 comp rx=0 tx=0).stop 2024-04-25T13:43:11.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbea155080 1 -- 172.21.15.123:0/839941250 shutdown_connections 2024-04-25T13:43:11.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbea155080 1 --2- 172.21.15.123:0/839941250 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5557c881ae40 0x5557c87ab980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbea155080 1 --2- 172.21.15.123:0/839941250 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5557c881e480 0x5557c881a900 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbea155080 1 --2- 172.21.15.123:0/839941250 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5557c881e070 0x5557c88323a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbea155080 1 -- 172.21.15.123:0/839941250 >> 172.21.15.123:0/839941250 conn(0x5557c874eaf0 msgr2=0x5557c88383d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:11.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbea155080 1 -- 172.21.15.123:0/839941250 shutdown_connections 2024-04-25T13:43:11.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.727+0000 7fbbea155080 1 -- 172.21.15.123:0/839941250 wait complete. 2024-04-25T13:43:11.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.731+0000 7fbbea155080 1 Processor -- start 2024-04-25T13:43:11.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.731+0000 7fbbea155080 1 -- start start 2024-04-25T13:43:11.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.731+0000 7fbbea155080 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5557c881ae40 0x5557c88314a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.731+0000 7fbbea155080 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5557c881e070 0x5557c88354e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.731+0000 7fbbea155080 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5557c881e480 0x5557c8835a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.731+0000 7fbbea155080 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5557c88392e0 con 0x5557c881e480 2024-04-25T13:43:11.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.731+0000 7fbbea155080 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5557c8761790 con 0x5557c881e070 2024-04-25T13:43:11.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.731+0000 7fbbea155080 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x5557c8839580 con 0x5557c881ae40 2024-04-25T13:43:11.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.731+0000 7fbbe3c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5557c881e480 0x5557c8835a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.731+0000 7fbbe3200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5557c881ae40 0x5557c88314a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.731+0000 7fbbe3c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5557c881e480 0x5557c8835a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35018/0 (socket says 172.21.15.123:35018) 2024-04-25T13:43:11.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.731+0000 7fbbe3c00640 1 -- 172.21.15.123:0/2690097890 learned_addr learned my addr 172.21.15.123:0/2690097890 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:11.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.731+0000 7fbbe2800640 1 --2- 172.21.15.123:0/2690097890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5557c881e070 0x5557c88354e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.731+0000 7fbbe3c00640 1 -- 172.21.15.123:0/2690097890 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5557c881ae40 msgr2=0x5557c88314a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.731+0000 7fbbe3c00640 1 --2- 172.21.15.123:0/2690097890 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5557c881ae40 0x5557c88314a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.731+0000 7fbbe3c00640 1 -- 172.21.15.123:0/2690097890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5557c881e070 msgr2=0x5557c88354e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.731+0000 7fbbe3c00640 1 --2- 172.21.15.123:0/2690097890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5557c881e070 0x5557c88354e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.731+0000 7fbbe3c00640 1 -- 172.21.15.123:0/2690097890 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557c88319e0 con 0x5557c881e480 2024-04-25T13:43:11.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.731+0000 7fbbe3c00640 1 --2- 172.21.15.123:0/2690097890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5557c881e480 0x5557c8835a20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00a4d0 tx=0x7fbbdc017dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:11.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.731+0000 7fbbdbe00640 1 -- 172.21.15.123:0/2690097890 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc0b9020 con 0x5557c881e480 2024-04-25T13:43:11.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.731+0000 7fbbdbe00640 1 -- 172.21.15.123:0/2690097890 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbdc0b5680 con 0x5557c881e480 2024-04-25T13:43:11.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.731+0000 7fbbdbe00640 1 -- 172.21.15.123:0/2690097890 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc0b0040 con 0x5557c881e480 2024-04-25T13:43:11.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.731+0000 7fbbea155080 1 -- 172.21.15.123:0/2690097890 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557c88342e0 con 0x5557c881e480 2024-04-25T13:43:11.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.731+0000 7fbbea155080 1 -- 172.21.15.123:0/2690097890 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557c8834820 con 0x5557c881e480 2024-04-25T13:43:11.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.735+0000 7fbbdbe00640 1 -- 172.21.15.123:0/2690097890 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbbdc0bc020 con 0x5557c881e480 2024-04-25T13:43:11.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.735+0000 7fbbdbe00640 1 --2- 172.21.15.123:0/2690097890 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fbbc406dde0 0x7fbbc40702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.735+0000 7fbbdbe00640 1 -- 172.21.15.123:0/2690097890 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fbbdc128880 con 0x5557c881e480 2024-04-25T13:43:11.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.735+0000 7fbbe3200640 1 --2- 172.21.15.123:0/2690097890 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fbbc406dde0 0x7fbbc40702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.735+0000 7fbbea155080 1 --2- 172.21.15.123:0/2690097890 >> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] conn(0x5557c8837a90 0x5557c8790e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.735+0000 7fbbea155080 1 -- 172.21.15.123:0/2690097890 --> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] -- osd_op(unknown.0.0:1 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5557c8763480 con 0x5557c8837a90 2024-04-25T13:43:11.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.735+0000 7fbbe3200640 1 --2- 172.21.15.123:0/2690097890 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fbbc406dde0 0x7fbbc40702f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4000c10 tx=0x7fbbd4010040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:11.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.735+0000 7fbbe2800640 1 --2- 172.21.15.123:0/2690097890 >> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] conn(0x5557c8837a90 0x5557c8790e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.739+0000 7fbbe2800640 1 --2- 172.21.15.123:0/2690097890 >> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] conn(0x5557c8837a90 0x5557c8790e80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:11.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.739+0000 7fbbe2800640 1 -- 172.21.15.123:0/2690097890 <== osd.6 v2:172.21.15.130:6801/3650490477 1 ==== osd_op_reply(1 1.00000000 [omap-get-keys out=5b] v0'0 uv2 ondisk = 0) ==== 154+0+5 (crc 0 0 0) 0x7fbbd001c040 con 0x5557c8837a90 2024-04-25T13:43:11.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.739+0000 7fbbea155080 1 -- 172.21.15.123:0/2690097890 >> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] conn(0x5557c8837a90 msgr2=0x5557c8790e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.739+0000 7fbbea155080 1 --2- 172.21.15.123:0/2690097890 >> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] conn(0x5557c8837a90 0x5557c8790e80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.739+0000 7fbbea155080 1 -- 172.21.15.123:0/2690097890 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fbbc406dde0 msgr2=0x7fbbc40702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.739+0000 7fbbea155080 1 --2- 172.21.15.123:0/2690097890 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fbbc406dde0 0x7fbbc40702f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4000c10 tx=0x7fbbd4010040 comp rx=0 tx=0).stop 2024-04-25T13:43:11.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.739+0000 7fbbea155080 1 -- 172.21.15.123:0/2690097890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5557c881e480 msgr2=0x5557c8835a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.739+0000 7fbbea155080 1 --2- 172.21.15.123:0/2690097890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5557c881e480 0x5557c8835a20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00a4d0 tx=0x7fbbdc017dc0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.739+0000 7fbbe3c00640 1 -- 172.21.15.123:0/2690097890 reap_dead start 2024-04-25T13:43:11.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.739+0000 7fbbea155080 1 -- 172.21.15.123:0/2690097890 shutdown_connections 2024-04-25T13:43:11.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.739+0000 7fbbea155080 1 -- 172.21.15.123:0/2690097890 >> 172.21.15.123:0/2690097890 conn(0x5557c874eaf0 msgr2=0x5557c881b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:11.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.739+0000 7fbbea155080 1 -- 172.21.15.123:0/2690097890 shutdown_connections 2024-04-25T13:43:11.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.739+0000 7fbbea155080 1 -- 172.21.15.123:0/2690097890 wait complete. 2024-04-25T13:43:11.747 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:43:11.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.887+0000 7f0b69200640 1 Processor -- start 2024-04-25T13:43:11.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.887+0000 7f0b69200640 1 -- start start 2024-04-25T13:43:11.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.891+0000 7f0b69200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b640b32f0 0x7f0b640b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.891+0000 7f0b69200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b640b3c40 con 0x7f0b640b5010 2024-04-25T13:43:11.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.891+0000 7f0b69200640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b6415d240 con 0x7f0b640d0f80 2024-04-25T13:43:11.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.891+0000 7f0b69200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0b6415cfe0 con 0x7f0b640b32f0 2024-04-25T13:43:11.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.891+0000 7f0b62800640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f0b640b5010 0x7f0b640b5420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54900/0 (socket says 172.21.15.123:54900) 2024-04-25T13:43:11.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.891+0000 7f0b62800640 1 -- 172.21.15.123:0/4107162189 learned_addr learned my addr 172.21.15.123:0/4107162189 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:11.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.891+0000 7f0b59400640 1 --2- 172.21.15.123:0/4107162189 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b640b32f0 0x7f0b640b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.891+0000 7f0b61400640 1 -- 172.21.15.123:0/4107162189 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2310034598 0 0) 0x7f0b5c001120 con 0x7f0b640b5010 2024-04-25T13:43:11.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.891+0000 7f0b61400640 1 -- 172.21.15.123:0/4107162189 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b48005740 con 0x7f0b640b5010 2024-04-25T13:43:11.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.891+0000 7f0b61400640 1 -- 172.21.15.123:0/4107162189 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 307784629 0 0) 0x7f0b6415d240 con 0x7f0b640d0f80 2024-04-25T13:43:11.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.891+0000 7f0b61400640 1 -- 172.21.15.123:0/4107162189 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b5c001120 con 0x7f0b640d0f80 2024-04-25T13:43:11.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.891+0000 7f0b59400640 1 -- 172.21.15.123:0/4107162189 >> v1:172.21.15.130:6789/0 conn(0x7f0b640d0f80 legacy=0x7f0b64160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.891+0000 7f0b59400640 1 -- 172.21.15.123:0/4107162189 >> v1:172.21.15.123:6789/0 conn(0x7f0b640b5010 legacy=0x7f0b640b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.891+0000 7f0b61400640 1 -- 172.21.15.123:0/4107162189 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3798684718 0 0) 0x7f0b48005740 con 0x7f0b640b5010 2024-04-25T13:43:11.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.891+0000 7f0b59400640 1 -- 172.21.15.123:0/4107162189 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b6415d520 con 0x7f0b640b32f0 2024-04-25T13:43:11.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.895+0000 7f0b59400640 1 --2- 172.21.15.123:0/4107162189 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b640b32f0 0x7f0b640b3700 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0097f0 tx=0x7f0b4c01c340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f05622598c7e066 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:11.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.895+0000 7f0b61400640 1 -- 172.21.15.123:0/4107162189 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c0b0070 con 0x7f0b640b32f0 2024-04-25T13:43:11.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.895+0000 7f0b61400640 1 -- 172.21.15.123:0/4107162189 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b4c0a4e50 con 0x7f0b640b32f0 2024-04-25T13:43:11.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.895+0000 7f0b61400640 1 -- 172.21.15.123:0/4107162189 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c001850 con 0x7f0b640b32f0 2024-04-25T13:43:11.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.895+0000 7f0b69200640 1 -- 172.21.15.123:0/4107162189 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b640b32f0 msgr2=0x7f0b640b3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.895+0000 7f0b69200640 1 --2- 172.21.15.123:0/4107162189 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b640b32f0 0x7f0b640b3700 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0097f0 tx=0x7f0b4c01c340 comp rx=0 tx=0).stop 2024-04-25T13:43:11.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.895+0000 7f0b69200640 1 -- 172.21.15.123:0/4107162189 shutdown_connections 2024-04-25T13:43:11.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.895+0000 7f0b69200640 1 --2- 172.21.15.123:0/4107162189 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b640b32f0 0x7f0b640b3700 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.895+0000 7f0b69200640 1 -- 172.21.15.123:0/4107162189 >> 172.21.15.123:0/4107162189 conn(0x7f0b6406d210 msgr2=0x7f0b6406ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:11.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.895+0000 7f0b69200640 1 -- 172.21.15.123:0/4107162189 shutdown_connections 2024-04-25T13:43:11.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.895+0000 7f0b69200640 1 -- 172.21.15.123:0/4107162189 wait complete. 2024-04-25T13:43:11.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.899+0000 7f0b69200640 1 Processor -- start 2024-04-25T13:43:11.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.899+0000 7f0b69200640 1 -- start start 2024-04-25T13:43:11.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.899+0000 7f0b69200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b640b32f0 0x7f0b6414f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.899+0000 7f0b69200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b640b5010 0x7f0b64154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.899+0000 7f0b69200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b640d0f80 0x7f0b64154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.899+0000 7f0b69200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0b640b5f40 con 0x7f0b640d0f80 2024-04-25T13:43:11.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.899+0000 7f0b69200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0b640b6470 con 0x7f0b640b5010 2024-04-25T13:43:11.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.899+0000 7f0b69200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0b640b60c0 con 0x7f0b640b32f0 2024-04-25T13:43:11.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.899+0000 7f0b62800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b640d0f80 0x7f0b64154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.899+0000 7f0b62800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b640d0f80 0x7f0b64154cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35040/0 (socket says 172.21.15.123:35040) 2024-04-25T13:43:11.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.899+0000 7f0b62800640 1 -- 172.21.15.123:0/3897563452 learned_addr learned my addr 172.21.15.123:0/3897563452 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:11.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.899+0000 7f0b59400640 1 --2- 172.21.15.123:0/3897563452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b640b5010 0x7f0b64154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.899+0000 7f0b61e00640 1 --2- 172.21.15.123:0/3897563452 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b640b32f0 0x7f0b6414f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.899+0000 7f0b62800640 1 -- 172.21.15.123:0/3897563452 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b640b32f0 msgr2=0x7f0b6414f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.899+0000 7f0b62800640 1 --2- 172.21.15.123:0/3897563452 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b640b32f0 0x7f0b6414f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.899+0000 7f0b62800640 1 -- 172.21.15.123:0/3897563452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b640b5010 msgr2=0x7f0b64154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:11.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.899+0000 7f0b62800640 1 --2- 172.21.15.123:0/3897563452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b640b5010 0x7f0b64154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:11.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.899+0000 7f0b62800640 1 -- 172.21.15.123:0/3897563452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b6415b840 con 0x7f0b640d0f80 2024-04-25T13:43:11.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.899+0000 7f0b62800640 1 --2- 172.21.15.123:0/3897563452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b640d0f80 0x7f0b64154cb0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c00c7b0 tx=0x7f0b5c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:11.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.899+0000 7f0b5aa00640 1 -- 172.21.15.123:0/3897563452 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c00ce60 con 0x7f0b640d0f80 2024-04-25T13:43:11.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.899+0000 7f0b5aa00640 1 -- 172.21.15.123:0/3897563452 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b5c005cf0 con 0x7f0b640d0f80 2024-04-25T13:43:11.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.899+0000 7f0b5aa00640 1 -- 172.21.15.123:0/3897563452 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c007270 con 0x7f0b640d0f80 2024-04-25T13:43:11.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.899+0000 7f0b69200640 1 -- 172.21.15.123:0/3897563452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b6415ae60 con 0x7f0b640d0f80 2024-04-25T13:43:11.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.899+0000 7f0b69200640 1 -- 172.21.15.123:0/3897563452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b6414fde0 con 0x7f0b640d0f80 2024-04-25T13:43:11.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.903+0000 7f0b69200640 1 -- 172.21.15.123:0/3897563452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b6415b5b0 con 0x7f0b640d0f80 2024-04-25T13:43:11.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.903+0000 7f0b5aa00640 1 -- 172.21.15.123:0/3897563452 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0b5c007410 con 0x7f0b640d0f80 2024-04-25T13:43:11.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.903+0000 7f0b5aa00640 1 --2- 172.21.15.123:0/3897563452 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f0b4006f400 0x7f0b40071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:11.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.903+0000 7f0b5aa00640 1 -- 172.21.15.123:0/3897563452 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0b5c08f0f0 con 0x7f0b640d0f80 2024-04-25T13:43:11.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.903+0000 7f0b61e00640 1 --2- 172.21.15.123:0/3897563452 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f0b4006f400 0x7f0b40071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:11.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.903+0000 7f0b61e00640 1 --2- 172.21.15.123:0/3897563452 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f0b4006f400 0x7f0b40071910 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0b54001570 tx=0x7f0b54009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:11.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:11.907+0000 7f0b5aa00640 1 -- 172.21.15.123:0/3897563452 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0b640b3c40 con 0x7f0b640d0f80 2024-04-25T13:43:12.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.099+0000 7f0b69200640 1 -- 172.21.15.123:0/3897563452 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0b6415e400 con 0x7f0b640d0f80 2024-04-25T13:43:12.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.099+0000 7f0b5aa00640 1 -- 172.21.15.123:0/3897563452 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5187 (secure 0 0 0) 0x7f0b6415e400 con 0x7f0b640d0f80 2024-04-25T13:43:12.103 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:12.104 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3582988979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":3582988979},{"type":"v1","addr":"172.21.15.130:6835","nonce":3582988979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4978,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/173287078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":173287078},{"type":"v1","addr":"172.21.15.123:6837","nonce":173287078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4987,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/4025543653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4025543653},{"type":"v1","addr":"172.21.15.130:6834","nonce":4025543653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:43:01.431292+0000","modified":"2024-04-25T13:43:04.442129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6836/499623122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":499623122},{"type":"v1","addr":"172.21.15.123:6836","nonce":499623122}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5046,"qdb_cluster":[5046]},"id":2}]} 2024-04-25T13:43:12.104 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 17 2024-04-25T13:43:12.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.103+0000 7f0b69200640 1 -- 172.21.15.123:0/3897563452 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f0b4006f400 msgr2=0x7f0b40071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.103+0000 7f0b69200640 1 --2- 172.21.15.123:0/3897563452 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f0b4006f400 0x7f0b40071910 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0b54001570 tx=0x7f0b54009040 comp rx=0 tx=0).stop 2024-04-25T13:43:12.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.103+0000 7f0b69200640 1 -- 172.21.15.123:0/3897563452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b640d0f80 msgr2=0x7f0b64154cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.103+0000 7f0b69200640 1 --2- 172.21.15.123:0/3897563452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b640d0f80 0x7f0b64154cb0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c00c7b0 tx=0x7f0b5c00cc70 comp rx=0 tx=0).stop 2024-04-25T13:43:12.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.103+0000 7f0b69200640 1 -- 172.21.15.123:0/3897563452 shutdown_connections 2024-04-25T13:43:12.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.103+0000 7f0b69200640 1 --2- 172.21.15.123:0/3897563452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b640b5010 0x7f0b64154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.103+0000 7f0b69200640 1 --2- 172.21.15.123:0/3897563452 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f0b4006f400 0x7f0b40071910 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.103+0000 7f0b69200640 1 --2- 172.21.15.123:0/3897563452 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b640d0f80 0x7f0b64154cb0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.103+0000 7f0b69200640 1 --2- 172.21.15.123:0/3897563452 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0b640b32f0 0x7f0b6414f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.103+0000 7f0b69200640 1 -- 172.21.15.123:0/3897563452 >> 172.21.15.123:0/3897563452 conn(0x7f0b6406d210 msgr2=0x7f0b640b5420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:12.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.103+0000 7f0b69200640 1 -- 172.21.15.123:0/3897563452 shutdown_connections 2024-04-25T13:43:12.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.103+0000 7f0b69200640 1 -- 172.21.15.123:0/3897563452 wait complete. 2024-04-25T13:43:12.125 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-25T13:43:12.301 INFO:teuthology.orchestra.run.smithi123.stdout:{"message":"","return_code":0} 2024-04-25T13:43:12.301 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T13:43:12.301 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.00000000 2024-04-25T13:43:12.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.355+0000 7f8963413080 1 Processor -- start 2024-04-25T13:43:12.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.355+0000 7f8963413080 1 -- start start 2024-04-25T13:43:12.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.355+0000 7f8963413080 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c1e6e5a5b0 0x55c1e6f14b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.355+0000 7f8963413080 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c1e6e5d380 0x55c1e6f15080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.355+0000 7f8963413080 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55c1e6f2e6d0 0x55c1e6ea32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.355+0000 7f8963413080 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c1e6e59070 con 0x55c1e6e5d380 2024-04-25T13:43:12.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.355+0000 7f8963413080 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c1e6e009a0 con 0x55c1e6e5a5b0 2024-04-25T13:43:12.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.355+0000 7f8963413080 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x55c1e6e591f0 con 0x55c1e6f2e6d0 2024-04-25T13:43:12.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.355+0000 7f895bc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c1e6e5d380 0x55c1e6f15080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.355+0000 7f895bc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c1e6e5d380 0x55c1e6f15080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35052/0 (socket says 172.21.15.123:35052) 2024-04-25T13:43:12.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.355+0000 7f895bc00640 1 -- 172.21.15.123:0/3129611925 learned_addr learned my addr 172.21.15.123:0/3129611925 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:12.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.355+0000 7f895d000640 1 --2- 172.21.15.123:0/3129611925 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55c1e6f2e6d0 0x55c1e6ea32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.355+0000 7f895c600640 1 --2- 172.21.15.123:0/3129611925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c1e6e5a5b0 0x55c1e6f14b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.355+0000 7f895bc00640 1 -- 172.21.15.123:0/3129611925 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55c1e6f2e6d0 msgr2=0x55c1e6ea32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:12.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.355+0000 7f895bc00640 1 --2- 172.21.15.123:0/3129611925 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55c1e6f2e6d0 0x55c1e6ea32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.355+0000 7f895bc00640 1 -- 172.21.15.123:0/3129611925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c1e6e5a5b0 msgr2=0x55c1e6f14b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:12.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.355+0000 7f895bc00640 1 --2- 172.21.15.123:0/3129611925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c1e6e5a5b0 0x55c1e6f14b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.355+0000 7f895bc00640 1 -- 172.21.15.123:0/3129611925 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1e6f15b20 con 0x55c1e6e5d380 2024-04-25T13:43:12.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.359+0000 7f895bc00640 1 --2- 172.21.15.123:0/3129611925 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c1e6e5d380 0x55c1e6f15080 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f89480097a0 tx=0x7f8948005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf979e1e97f442 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:12.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.359+0000 7f895a800640 1 -- 172.21.15.123:0/3129611925 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8948008da0 con 0x55c1e6e5d380 2024-04-25T13:43:12.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.359+0000 7f895a800640 1 -- 172.21.15.123:0/3129611925 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8948018070 con 0x55c1e6e5d380 2024-04-25T13:43:12.363 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.359+0000 7f895a800640 1 -- 172.21.15.123:0/3129611925 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8948013640 con 0x55c1e6e5d380 2024-04-25T13:43:12.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.359+0000 7f8963413080 1 -- 172.21.15.123:0/3129611925 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c1e6e5d380 msgr2=0x55c1e6f15080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.359+0000 7f8963413080 1 --2- 172.21.15.123:0/3129611925 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c1e6e5d380 0x55c1e6f15080 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f89480097a0 tx=0x7f8948005a10 comp rx=0 tx=0).stop 2024-04-25T13:43:12.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.359+0000 7f8963413080 1 -- 172.21.15.123:0/3129611925 shutdown_connections 2024-04-25T13:43:12.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.359+0000 7f8963413080 1 --2- 172.21.15.123:0/3129611925 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55c1e6f2e6d0 0x55c1e6ea32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.359+0000 7f8963413080 1 --2- 172.21.15.123:0/3129611925 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c1e6e5d380 0x55c1e6f15080 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.359+0000 7f8963413080 1 --2- 172.21.15.123:0/3129611925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c1e6e5a5b0 0x55c1e6f14b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.359+0000 7f8963413080 1 -- 172.21.15.123:0/3129611925 >> 172.21.15.123:0/3129611925 conn(0x55c1e6e45af0 msgr2=0x55c1e6ea1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:12.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.359+0000 7f8963413080 1 -- 172.21.15.123:0/3129611925 shutdown_connections 2024-04-25T13:43:12.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.359+0000 7f8963413080 1 -- 172.21.15.123:0/3129611925 wait complete. 2024-04-25T13:43:12.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.359+0000 7f8963413080 1 Processor -- start 2024-04-25T13:43:12.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.359+0000 7f8963413080 1 -- start start 2024-04-25T13:43:12.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.359+0000 7f8963413080 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c1e6e5a5b0 0x55c1e6f11b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.359+0000 7f8963413080 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c1e6e5d380 0x55c1e6f15320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.359+0000 7f8963413080 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55c1e6f2e6d0 0x55c1e6ea32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.359+0000 7f8963413080 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55c1e6f15dc0 con 0x55c1e6e5a5b0 2024-04-25T13:43:12.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.359+0000 7f8963413080 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c1e6f30b80 con 0x55c1e6e5d380 2024-04-25T13:43:12.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.363+0000 7f8963413080 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x55c1e6fc52d0 con 0x55c1e6f2e6d0 2024-04-25T13:43:12.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.363+0000 7f895c600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c1e6e5a5b0 0x55c1e6f11b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.363+0000 7f895c600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c1e6e5a5b0 0x55c1e6f11b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35056/0 (socket says 172.21.15.123:35056) 2024-04-25T13:43:12.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.363+0000 7f895c600640 1 -- 172.21.15.123:0/3438042583 learned_addr learned my addr 172.21.15.123:0/3438042583 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:12.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.363+0000 7f895d000640 1 --2- 172.21.15.123:0/3438042583 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55c1e6f2e6d0 0x55c1e6ea32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.363+0000 7f895bc00640 1 --2- 172.21.15.123:0/3438042583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c1e6e5d380 0x55c1e6f15320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.363+0000 7f895c600640 1 -- 172.21.15.123:0/3438042583 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55c1e6f2e6d0 msgr2=0x55c1e6ea32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.363+0000 7f895c600640 1 --2- 172.21.15.123:0/3438042583 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55c1e6f2e6d0 0x55c1e6ea32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.363+0000 7f895c600640 1 -- 172.21.15.123:0/3438042583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c1e6e5d380 msgr2=0x55c1e6f15320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.363+0000 7f895c600640 1 --2- 172.21.15.123:0/3438042583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c1e6e5d380 0x55c1e6f15320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.363+0000 7f895c600640 1 -- 172.21.15.123:0/3438042583 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1e6f2d490 con 0x55c1e6e5a5b0 2024-04-25T13:43:12.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.363+0000 7f895c600640 1 --2- 172.21.15.123:0/3438042583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c1e6e5a5b0 0x55c1e6f11b80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f894c0ad040 tx=0x7f894c018210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:12.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.363+0000 7f8959400640 1 -- 172.21.15.123:0/3438042583 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894c0bb070 con 0x55c1e6e5a5b0 2024-04-25T13:43:12.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.363+0000 7f8959400640 1 -- 172.21.15.123:0/3438042583 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f894c0b5660 con 0x55c1e6e5a5b0 2024-04-25T13:43:12.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.363+0000 7f8963413080 1 -- 172.21.15.123:0/3438042583 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c1e6f2d730 con 0x55c1e6e5a5b0 2024-04-25T13:43:12.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.363+0000 7f8959400640 1 -- 172.21.15.123:0/3438042583 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894c0af040 con 0x55c1e6e5a5b0 2024-04-25T13:43:12.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.363+0000 7f8963413080 1 -- 172.21.15.123:0/3438042583 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1e6f2dc70 con 0x55c1e6e5a5b0 2024-04-25T13:43:12.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.363+0000 7f8959400640 1 -- 172.21.15.123:0/3438042583 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f894c0be070 con 0x55c1e6e5a5b0 2024-04-25T13:43:12.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.367+0000 7f8959400640 1 --2- 172.21.15.123:0/3438042583 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f893c06dde0 0x7f893c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.367+0000 7f8959400640 1 -- 172.21.15.123:0/3438042583 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f894c128e20 con 0x55c1e6e5a5b0 2024-04-25T13:43:12.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.367+0000 7f895bc00640 1 --2- 172.21.15.123:0/3438042583 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f893c06dde0 0x7f893c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.367+0000 7f8963413080 1 --2- 172.21.15.123:0/3438042583 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x55c1e6f2cf50 0x55c1e6fc1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.367+0000 7f8963413080 1 -- 172.21.15.123:0/3438042583 --> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] -- osd_op(unknown.0.0:1 4.10 4:0cf6ad0f:::10000000000.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c1e6fc2500 con 0x55c1e6f2cf50 2024-04-25T13:43:12.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.367+0000 7f895d000640 1 --2- 172.21.15.123:0/3438042583 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x55c1e6f2cf50 0x55c1e6fc1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.367+0000 7f895bc00640 1 --2- 172.21.15.123:0/3438042583 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f893c06dde0 0x7f893c0702f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8948015040 tx=0x7f8948012000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:12.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.367+0000 7f895d000640 1 --2- 172.21.15.123:0/3438042583 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x55c1e6f2cf50 0x55c1e6fc1fc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:12.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.367+0000 7f895d000640 1 -- 172.21.15.123:0/3438042583 <== osd.3 v2:172.21.15.123:6816/898268961 1 ==== osd_op_reply(1 10000000000.00000000 [omap-get-keys out=19b] v0'0 uv10 ondisk = 0) ==== 164+0+19 (crc 0 0 0) 0x7f8954006020 con 0x55c1e6f2cf50 2024-04-25T13:43:12.372 INFO:teuthology.orchestra.run.smithi123.stdout:alpha_head 2024-04-25T13:43:12.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.367+0000 7f8963413080 1 -- 172.21.15.123:0/3438042583 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x55c1e6f2cf50 msgr2=0x55c1e6fc1fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.367+0000 7f8963413080 1 --2- 172.21.15.123:0/3438042583 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x55c1e6f2cf50 0x55c1e6fc1fc0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.367+0000 7f8963413080 1 -- 172.21.15.123:0/3438042583 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f893c06dde0 msgr2=0x7f893c0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.367+0000 7f8963413080 1 --2- 172.21.15.123:0/3438042583 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f893c06dde0 0x7f893c0702f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8948015040 tx=0x7f8948012000 comp rx=0 tx=0).stop 2024-04-25T13:43:12.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.367+0000 7f8963413080 1 -- 172.21.15.123:0/3438042583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c1e6e5a5b0 msgr2=0x55c1e6f11b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.367+0000 7f8963413080 1 --2- 172.21.15.123:0/3438042583 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55c1e6e5a5b0 0x55c1e6f11b80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f894c0ad040 tx=0x7f894c018210 comp rx=0 tx=0).stop 2024-04-25T13:43:12.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.367+0000 7f895d000640 1 -- 172.21.15.123:0/3438042583 reap_dead start 2024-04-25T13:43:12.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.367+0000 7f8963413080 1 -- 172.21.15.123:0/3438042583 shutdown_connections 2024-04-25T13:43:12.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.367+0000 7f8963413080 1 -- 172.21.15.123:0/3438042583 >> 172.21.15.123:0/3438042583 conn(0x55c1e6e45af0 msgr2=0x55c1e6ea17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:12.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.367+0000 7f8963413080 1 -- 172.21.15.123:0/3438042583 shutdown_connections 2024-04-25T13:43:12.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.367+0000 7f8963413080 1 -- 172.21.15.123:0/3438042583 wait complete. 2024-04-25T13:43:12.376 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 1.00000000 2024-04-25T13:43:12.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.427+0000 7fd4eee62080 1 Processor -- start 2024-04-25T13:43:12.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.427+0000 7fd4eee62080 1 -- start start 2024-04-25T13:43:12.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4eee62080 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d2c3acaf0 0x555d2c43a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4eee62080 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d2c3b00a0 0x555d2c37ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4eee62080 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555d2c43b540 0x555d2c37f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4eee62080 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x555d2c3b04b0 con 0x555d2c3b00a0 2024-04-25T13:43:12.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4eee62080 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555d2c3249a0 con 0x555d2c3acaf0 2024-04-25T13:43:12.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4eee62080 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x555d2c3afea0 con 0x555d2c43b540 2024-04-25T13:43:12.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4dfe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d2c3b00a0 0x555d2c37ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4dfe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d2c3b00a0 0x555d2c37ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35076/0 (socket says 172.21.15.123:35076) 2024-04-25T13:43:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4dfe00640 1 -- 172.21.15.123:0/4206026944 learned_addr learned my addr 172.21.15.123:0/4206026944 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4e8000640 1 --2- 172.21.15.123:0/4206026944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d2c3acaf0 0x555d2c43a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4e8a00640 1 --2- 172.21.15.123:0/4206026944 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555d2c43b540 0x555d2c37f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4dfe00640 1 -- 172.21.15.123:0/4206026944 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555d2c43b540 msgr2=0x555d2c37f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4dfe00640 1 --2- 172.21.15.123:0/4206026944 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555d2c43b540 0x555d2c37f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4dfe00640 1 -- 172.21.15.123:0/4206026944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d2c3acaf0 msgr2=0x555d2c43a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4dfe00640 1 --2- 172.21.15.123:0/4206026944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d2c3acaf0 0x555d2c43a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4dfe00640 1 -- 172.21.15.123:0/4206026944 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d2c4403d0 con 0x555d2c3b00a0 2024-04-25T13:43:12.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4dfe00640 1 --2- 172.21.15.123:0/4206026944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d2c3b00a0 0x555d2c37ef30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd4d000a470 tx=0x7fd4d000a930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4b2ffd734cf12d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:12.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4e6c00640 1 -- 172.21.15.123:0/4206026944 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d000b930 con 0x555d2c3b00a0 2024-04-25T13:43:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4e6c00640 1 -- 172.21.15.123:0/4206026944 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d000f070 con 0x555d2c3b00a0 2024-04-25T13:43:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4e6c00640 1 -- 172.21.15.123:0/4206026944 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d000bd30 con 0x555d2c3b00a0 2024-04-25T13:43:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4eee62080 1 -- 172.21.15.123:0/4206026944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d2c3b00a0 msgr2=0x555d2c37ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4eee62080 1 --2- 172.21.15.123:0/4206026944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d2c3b00a0 0x555d2c37ef30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd4d000a470 tx=0x7fd4d000a930 comp rx=0 tx=0).stop 2024-04-25T13:43:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4eee62080 1 -- 172.21.15.123:0/4206026944 shutdown_connections 2024-04-25T13:43:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4eee62080 1 --2- 172.21.15.123:0/4206026944 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555d2c43b540 0x555d2c37f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4eee62080 1 --2- 172.21.15.123:0/4206026944 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d2c3b00a0 0x555d2c37ef30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4eee62080 1 --2- 172.21.15.123:0/4206026944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d2c3acaf0 0x555d2c43a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4eee62080 1 -- 172.21.15.123:0/4206026944 >> 172.21.15.123:0/4206026944 conn(0x555d2c369af0 msgr2=0x555d2c3b1580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4eee62080 1 -- 172.21.15.123:0/4206026944 shutdown_connections 2024-04-25T13:43:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4eee62080 1 -- 172.21.15.123:0/4206026944 wait complete. 2024-04-25T13:43:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4eee62080 1 Processor -- start 2024-04-25T13:43:12.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.431+0000 7fd4eee62080 1 -- start start 2024-04-25T13:43:12.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.435+0000 7fd4eee62080 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d2c3acaf0 0x555d2c4dd590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.435+0000 7fd4eee62080 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d2c3b00a0 0x555d2c3b1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.435+0000 7fd4eee62080 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555d2c43b540 0x555d2c3b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.435+0000 7fd4eee62080 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x555d2c43e070 con 0x555d2c3acaf0 2024-04-25T13:43:12.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.435+0000 7fd4eee62080 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555d2c43ecf0 con 0x555d2c3b00a0 2024-04-25T13:43:12.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.435+0000 7fd4eee62080 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x555d2c43e310 con 0x555d2c43b540 2024-04-25T13:43:12.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.435+0000 7fd4e8000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d2c3acaf0 0x555d2c4dd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.435+0000 7fd4e8000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d2c3acaf0 0x555d2c4dd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35092/0 (socket says 172.21.15.123:35092) 2024-04-25T13:43:12.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.435+0000 7fd4e8000640 1 -- 172.21.15.123:0/2345966594 learned_addr learned my addr 172.21.15.123:0/2345966594 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:12.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.435+0000 7fd4dfe00640 1 --2- 172.21.15.123:0/2345966594 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d2c3b00a0 0x555d2c3b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.435+0000 7fd4e8a00640 1 --2- 172.21.15.123:0/2345966594 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555d2c43b540 0x555d2c3b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.435+0000 7fd4e8000640 1 -- 172.21.15.123:0/2345966594 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555d2c43b540 msgr2=0x555d2c3b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.435+0000 7fd4e8000640 1 --2- 172.21.15.123:0/2345966594 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555d2c43b540 0x555d2c3b1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.435+0000 7fd4e8000640 1 -- 172.21.15.123:0/2345966594 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d2c3b00a0 msgr2=0x555d2c3b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.435+0000 7fd4e8000640 1 --2- 172.21.15.123:0/2345966594 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555d2c3b00a0 0x555d2c3b1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.435+0000 7fd4e8000640 1 -- 172.21.15.123:0/2345966594 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d2c4ddbc0 con 0x555d2c3acaf0 2024-04-25T13:43:12.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.435+0000 7fd4e8000640 1 --2- 172.21.15.123:0/2345966594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d2c3acaf0 0x555d2c4dd590 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd4d801b830 tx=0x7fd4d801a9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:12.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.435+0000 7fd4e5800640 1 -- 172.21.15.123:0/2345966594 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d80b4040 con 0x555d2c3acaf0 2024-04-25T13:43:12.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.435+0000 7fd4e5800640 1 -- 172.21.15.123:0/2345966594 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4d80c3070 con 0x555d2c3acaf0 2024-04-25T13:43:12.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.435+0000 7fd4eee62080 1 -- 172.21.15.123:0/2345966594 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d2c4dde60 con 0x555d2c3acaf0 2024-04-25T13:43:12.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.435+0000 7fd4e5800640 1 -- 172.21.15.123:0/2345966594 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d80afbd0 con 0x555d2c3acaf0 2024-04-25T13:43:12.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.435+0000 7fd4eee62080 1 -- 172.21.15.123:0/2345966594 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d2c4de3a0 con 0x555d2c3acaf0 2024-04-25T13:43:12.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.439+0000 7fd4e5800640 1 -- 172.21.15.123:0/2345966594 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd4d80c8460 con 0x555d2c3acaf0 2024-04-25T13:43:12.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.439+0000 7fd4e5800640 1 --2- 172.21.15.123:0/2345966594 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd4c406dde0 0x7fd4c40702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.439+0000 7fd4e5800640 1 -- 172.21.15.123:0/2345966594 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd4d812c4c0 con 0x555d2c3acaf0 2024-04-25T13:43:12.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.439+0000 7fd4dfe00640 1 --2- 172.21.15.123:0/2345966594 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd4c406dde0 0x7fd4c40702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.439+0000 7fd4eee62080 1 --2- 172.21.15.123:0/2345966594 >> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] conn(0x555d2c438950 0x555d2c453110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.439+0000 7fd4eee62080 1 -- 172.21.15.123:0/2345966594 --> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] -- osd_op(unknown.0.0:1 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555d2c453650 con 0x555d2c438950 2024-04-25T13:43:12.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.439+0000 7fd4e8a00640 1 --2- 172.21.15.123:0/2345966594 >> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] conn(0x555d2c438950 0x555d2c453110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.439+0000 7fd4dfe00640 1 --2- 172.21.15.123:0/2345966594 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd4c406dde0 0x7fd4c40702f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd4d000a410 tx=0x7fd4d0002000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:12.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.439+0000 7fd4e8a00640 1 --2- 172.21.15.123:0/2345966594 >> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] conn(0x555d2c438950 0x555d2c453110 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:12.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.439+0000 7fd4e8a00640 1 -- 172.21.15.123:0/2345966594 <== osd.6 v2:172.21.15.130:6801/3650490477 1 ==== osd_op_reply(1 1.00000000 [omap-get-keys out=19b] v0'0 uv6 ondisk = 0) ==== 154+0+19 (crc 0 0 0) 0x7fd4e000da50 con 0x555d2c438950 2024-04-25T13:43:12.444 INFO:teuthology.orchestra.run.smithi123.stdout:mydir_head 2024-04-25T13:43:12.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.439+0000 7fd4eee62080 1 -- 172.21.15.123:0/2345966594 >> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] conn(0x555d2c438950 msgr2=0x555d2c453110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.439+0000 7fd4eee62080 1 --2- 172.21.15.123:0/2345966594 >> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] conn(0x555d2c438950 0x555d2c453110 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.439+0000 7fd4eee62080 1 -- 172.21.15.123:0/2345966594 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd4c406dde0 msgr2=0x7fd4c40702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.439+0000 7fd4eee62080 1 --2- 172.21.15.123:0/2345966594 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd4c406dde0 0x7fd4c40702f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd4d000a410 tx=0x7fd4d0002000 comp rx=0 tx=0).stop 2024-04-25T13:43:12.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.439+0000 7fd4eee62080 1 -- 172.21.15.123:0/2345966594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d2c3acaf0 msgr2=0x555d2c4dd590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.439+0000 7fd4eee62080 1 --2- 172.21.15.123:0/2345966594 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555d2c3acaf0 0x555d2c4dd590 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd4d801b830 tx=0x7fd4d801a9a0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.439+0000 7fd4e8a00640 1 -- 172.21.15.123:0/2345966594 reap_dead start 2024-04-25T13:43:12.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.439+0000 7fd4eee62080 1 -- 172.21.15.123:0/2345966594 shutdown_connections 2024-04-25T13:43:12.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.439+0000 7fd4eee62080 1 -- 172.21.15.123:0/2345966594 >> 172.21.15.123:0/2345966594 conn(0x555d2c369af0 msgr2=0x555d2c457d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:12.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.443+0000 7fd4eee62080 1 -- 172.21.15.123:0/2345966594 shutdown_connections 2024-04-25T13:43:12.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.443+0000 7fd4eee62080 1 -- 172.21.15.123:0/2345966594 wait complete. 2024-04-25T13:43:12.449 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-25T13:43:12.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.503+0000 7f657ab9e080 1 Processor -- start 2024-04-25T13:43:12.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.503+0000 7f657ab9e080 1 -- start start 2024-04-25T13:43:12.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.503+0000 7f657ab9e080 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56471ea074d0 0x56471eade600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.503+0000 7f657ab9e080 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56471ea09220 0x56471ea4b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.503+0000 7f657ab9e080 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56471eac1e20 0x56471eaddd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.503+0000 7f657ab9e080 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56471e9ad9a0 con 0x56471ea074d0 2024-04-25T13:43:12.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.503+0000 7f657ab9e080 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56471ea08480 con 0x56471ea09220 2024-04-25T13:43:12.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.503+0000 7f657ab9e080 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x56471ea4e9d0 con 0x56471eac1e20 2024-04-25T13:43:12.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.503+0000 7f6573e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56471ea074d0 0x56471eade600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.503+0000 7f6573e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56471ea074d0 0x56471eade600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35114/0 (socket says 172.21.15.123:35114) 2024-04-25T13:43:12.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.503+0000 7f6573e00640 1 -- 172.21.15.123:0/268864788 learned_addr learned my addr 172.21.15.123:0/268864788 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:12.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.503+0000 7f6573400640 1 --2- 172.21.15.123:0/268864788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56471ea09220 0x56471ea4b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.503+0000 7f6574800640 1 --2- 172.21.15.123:0/268864788 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56471eac1e20 0x56471eaddd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.503+0000 7f6573e00640 1 -- 172.21.15.123:0/268864788 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56471eac1e20 msgr2=0x56471eaddd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:12.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.503+0000 7f6573e00640 1 --2- 172.21.15.123:0/268864788 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56471eac1e20 0x56471eaddd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.503+0000 7f6573e00640 1 -- 172.21.15.123:0/268864788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56471ea09220 msgr2=0x56471ea4b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:12.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.503+0000 7f6573e00640 1 --2- 172.21.15.123:0/268864788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56471ea09220 0x56471ea4b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.503+0000 7f6573e00640 1 -- 172.21.15.123:0/268864788 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56471ea4ec70 con 0x56471ea074d0 2024-04-25T13:43:12.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.503+0000 7f6573e00640 1 --2- 172.21.15.123:0/268864788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56471ea074d0 0x56471eade600 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f656401c250 tx=0x7f6564003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d20e0ea1ed388a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:12.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.503+0000 7f6572000640 1 -- 172.21.15.123:0/268864788 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65640b4070 con 0x56471ea074d0 2024-04-25T13:43:12.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.503+0000 7f6572000640 1 -- 172.21.15.123:0/268864788 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65640be070 con 0x56471ea074d0 2024-04-25T13:43:12.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.503+0000 7f6572000640 1 -- 172.21.15.123:0/268864788 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65640b9680 con 0x56471ea074d0 2024-04-25T13:43:12.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f657ab9e080 1 -- 172.21.15.123:0/268864788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56471ea074d0 msgr2=0x56471eade600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f657ab9e080 1 --2- 172.21.15.123:0/268864788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56471ea074d0 0x56471eade600 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f656401c250 tx=0x7f6564003030 comp rx=0 tx=0).stop 2024-04-25T13:43:12.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f657ab9e080 1 -- 172.21.15.123:0/268864788 shutdown_connections 2024-04-25T13:43:12.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f657ab9e080 1 --2- 172.21.15.123:0/268864788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56471ea09220 0x56471ea4b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f657ab9e080 1 --2- 172.21.15.123:0/268864788 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56471eac1e20 0x56471eaddd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f657ab9e080 1 --2- 172.21.15.123:0/268864788 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56471ea074d0 0x56471eade600 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f657ab9e080 1 -- 172.21.15.123:0/268864788 >> 172.21.15.123:0/268864788 conn(0x56471e9f2af0 msgr2=0x56471eadeb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:12.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f657ab9e080 1 -- 172.21.15.123:0/268864788 shutdown_connections 2024-04-25T13:43:12.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f657ab9e080 1 -- 172.21.15.123:0/268864788 wait complete. 2024-04-25T13:43:12.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f657ab9e080 1 Processor -- start 2024-04-25T13:43:12.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f657ab9e080 1 -- start start 2024-04-25T13:43:12.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f657ab9e080 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56471ea074d0 0x56471eabefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f657ab9e080 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56471ea09220 0x56471ea4d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f657ab9e080 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56471eac1e20 0x56471ea4fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f657ab9e080 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x56471ea4f1b0 con 0x56471eac1e20 2024-04-25T13:43:12.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f657ab9e080 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56471ea4ef10 con 0x56471ea074d0 2024-04-25T13:43:12.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f657ab9e080 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x56471ea4f450 con 0x56471ea09220 2024-04-25T13:43:12.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f6574800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56471eac1e20 0x56471ea4fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f6574800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56471eac1e20 0x56471ea4fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35126/0 (socket says 172.21.15.123:35126) 2024-04-25T13:43:12.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f6574800640 1 -- 172.21.15.123:0/2020288451 learned_addr learned my addr 172.21.15.123:0/2020288451 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:12.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f6573e00640 1 --2- 172.21.15.123:0/2020288451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56471ea074d0 0x56471eabefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f6573400640 1 --2- 172.21.15.123:0/2020288451 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56471ea09220 0x56471ea4d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f6574800640 1 -- 172.21.15.123:0/2020288451 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56471ea09220 msgr2=0x56471ea4d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f6574800640 1 --2- 172.21.15.123:0/2020288451 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56471ea09220 0x56471ea4d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f6574800640 1 -- 172.21.15.123:0/2020288451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56471ea074d0 msgr2=0x56471eabefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f6574800640 1 --2- 172.21.15.123:0/2020288451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56471ea074d0 0x56471eabefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f6574800640 1 -- 172.21.15.123:0/2020288451 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56471ea4c6d0 con 0x56471eac1e20 2024-04-25T13:43:12.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.507+0000 7f6573400640 1 --2- 172.21.15.123:0/2020288451 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x56471ea09220 0x56471ea4d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:12.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.511+0000 7f6574800640 1 --2- 172.21.15.123:0/2020288451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56471eac1e20 0x56471ea4fdc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f656c00b4e0 tx=0x7f656c00b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:12.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.511+0000 7f6570c00640 1 -- 172.21.15.123:0/2020288451 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656c016020 con 0x56471eac1e20 2024-04-25T13:43:12.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.511+0000 7f6570c00640 1 -- 172.21.15.123:0/2020288451 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f656c012660 con 0x56471eac1e20 2024-04-25T13:43:12.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.511+0000 7f657ab9e080 1 -- 172.21.15.123:0/2020288451 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56471ea4c970 con 0x56471eac1e20 2024-04-25T13:43:12.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.511+0000 7f6570c00640 1 -- 172.21.15.123:0/2020288451 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656c012850 con 0x56471eac1e20 2024-04-25T13:43:12.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.511+0000 7f657ab9e080 1 -- 172.21.15.123:0/2020288451 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56471ea4ceb0 con 0x56471eac1e20 2024-04-25T13:43:12.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.511+0000 7f6570c00640 1 -- 172.21.15.123:0/2020288451 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f656c019020 con 0x56471eac1e20 2024-04-25T13:43:12.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.511+0000 7f6570c00640 1 --2- 172.21.15.123:0/2020288451 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f655406dde0 0x7f65540702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.511+0000 7f6570c00640 1 -- 172.21.15.123:0/2020288451 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f656c08e210 con 0x56471eac1e20 2024-04-25T13:43:12.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.511+0000 7f6573e00640 1 --2- 172.21.15.123:0/2020288451 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f655406dde0 0x7f65540702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.511+0000 7f657ab9e080 1 --2- 172.21.15.123:0/2020288451 >> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] conn(0x56471eadeb10 0x56471eb73fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.511+0000 7f657ab9e080 1 -- 172.21.15.123:0/2020288451 --> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] -- osd_op(unknown.0.0:1 5.7 5:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56471eb744e0 con 0x56471eadeb10 2024-04-25T13:43:12.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.515+0000 7f6573e00640 1 --2- 172.21.15.123:0/2020288451 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f655406dde0 0x7f65540702f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f65640ba000 tx=0x7f65640a9000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:12.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.515+0000 7f6573400640 1 --2- 172.21.15.123:0/2020288451 >> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] conn(0x56471eadeb10 0x56471eb73fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.515+0000 7f6573400640 1 --2- 172.21.15.123:0/2020288451 >> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] conn(0x56471eadeb10 0x56471eb73fa0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:12.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.515+0000 7f6573400640 1 -- 172.21.15.123:0/2020288451 <== osd.5 v2:172.21.15.130:6800/2763000783 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (92) out=92b] v0'0 uv6 ondisk = 0) ==== 164+0+92 (crc 0 0 0) 0x7f656000f520 con 0x56471eadeb10 2024-04-25T13:43:12.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.515+0000 7f657ab9e080 1 -- 172.21.15.123:0/2020288451 >> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] conn(0x56471eadeb10 msgr2=0x56471eb73fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.515+0000 7f657ab9e080 1 --2- 172.21.15.123:0/2020288451 >> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] conn(0x56471eadeb10 0x56471eb73fa0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.515+0000 7f657ab9e080 1 -- 172.21.15.123:0/2020288451 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f655406dde0 msgr2=0x7f65540702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.515+0000 7f657ab9e080 1 --2- 172.21.15.123:0/2020288451 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f655406dde0 0x7f65540702f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f65640ba000 tx=0x7f65640a9000 comp rx=0 tx=0).stop 2024-04-25T13:43:12.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.515+0000 7f657ab9e080 1 -- 172.21.15.123:0/2020288451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56471eac1e20 msgr2=0x56471ea4fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.515+0000 7f657ab9e080 1 --2- 172.21.15.123:0/2020288451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56471eac1e20 0x56471ea4fdc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f656c00b4e0 tx=0x7f656c00b9a0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.515+0000 7f6574800640 1 -- 172.21.15.123:0/2020288451 reap_dead start 2024-04-25T13:43:12.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.515+0000 7f657ab9e080 1 -- 172.21.15.123:0/2020288451 shutdown_connections 2024-04-25T13:43:12.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.515+0000 7f657ab9e080 1 -- 172.21.15.123:0/2020288451 >> 172.21.15.123:0/2020288451 conn(0x56471e9f2af0 msgr2=0x56471eac4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:12.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.515+0000 7f657ab9e080 1 -- 172.21.15.123:0/2020288451 shutdown_connections 2024-04-25T13:43:12.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.515+0000 7f657ab9e080 1 -- 172.21.15.123:0/2020288451 wait complete. 2024-04-25T13:43:12.523 INFO:teuthology.orchestra.run.smithi123.stdout:Valphamydir 2024-04-25T13:43:12.524 DEBUG:teuthology.orchestra.run.smithi123:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-25T13:43:12.583 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-04-25T13:43:12.583 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 1099511627777, 2024-04-25T13:43:12.583 INFO:teuthology.orchestra.run.smithi123.stdout: "ancestors": [ 2024-04-25T13:43:12.583 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:43:12.583 INFO:teuthology.orchestra.run.smithi123.stdout: "dirino": 1099511627776, 2024-04-25T13:43:12.583 INFO:teuthology.orchestra.run.smithi123.stdout: "dname": "alpha", 2024-04-25T13:43:12.583 INFO:teuthology.orchestra.run.smithi123.stdout: "version": 6 2024-04-25T13:43:12.583 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-04-25T13:43:12.583 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-04-25T13:43:12.584 INFO:teuthology.orchestra.run.smithi123.stdout: "dirino": 1, 2024-04-25T13:43:12.584 INFO:teuthology.orchestra.run.smithi123.stdout: "dname": "mydir", 2024-04-25T13:43:12.584 INFO:teuthology.orchestra.run.smithi123.stdout: "version": 8 2024-04-25T13:43:12.584 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-04-25T13:43:12.584 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-04-25T13:43:12.584 INFO:teuthology.orchestra.run.smithi123.stdout: "pool": 5, 2024-04-25T13:43:12.584 INFO:teuthology.orchestra.run.smithi123.stdout: "old_pools": [] 2024-04-25T13:43:12.584 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-04-25T13:43:12.584 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:12.587 DEBUG:teuthology.orchestra.run.smithi123:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event get summary 2024-04-25T13:43:12.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.683+0000 7fc82176a400 1 -- start start 2024-04-25T13:43:12.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.683+0000 7fc82176a400 1 Processor -- start 2024-04-25T13:43:12.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc82176a400 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5583d11bb680 0x5583d1ec2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc82176a400 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5583d11bbb00 0x5583d1ec2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc82176a400 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5583d11bc400 0x5583d1ec2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc82176a400 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5583d1ecc180 con 0x5583d11bbb00 2024-04-25T13:43:12.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc82176a400 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5583d1ecc300 con 0x5583d11bb680 2024-04-25T13:43:12.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc82176a400 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x5583d1ecc480 con 0x5583d11bc400 2024-04-25T13:43:12.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc81ee00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5583d11bbb00 0x5583d1ec2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc81ee00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5583d11bbb00 0x5583d1ec2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35146/0 (socket says 172.21.15.123:35146) 2024-04-25T13:43:12.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc81ee00640 1 -- 172.21.15.123:0/138488926 learned_addr learned my addr 172.21.15.123:0/138488926 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:12.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc81f800640 1 --2- 172.21.15.123:0/138488926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5583d11bb680 0x5583d1ec2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc81ee00640 1 -- 172.21.15.123:0/138488926 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5583d11bc400 msgr2=0x5583d1ec2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:12.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc820200640 1 --2- 172.21.15.123:0/138488926 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5583d11bc400 0x5583d1ec2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc81ee00640 1 --2- 172.21.15.123:0/138488926 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5583d11bc400 0x5583d1ec2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc81ee00640 1 -- 172.21.15.123:0/138488926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5583d11bb680 msgr2=0x5583d1ec2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:12.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc81ee00640 1 --2- 172.21.15.123:0/138488926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5583d11bb680 0x5583d1ec2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc81ee00640 1 -- 172.21.15.123:0/138488926 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583d1ec0960 con 0x5583d11bbb00 2024-04-25T13:43:12.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc820200640 1 --2- 172.21.15.123:0/138488926 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5583d11bc400 0x5583d1ec2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:12.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc81f800640 1 --2- 172.21.15.123:0/138488926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5583d11bb680 0x5583d1ec2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:12.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc81ee00640 1 --2- 172.21.15.123:0/138488926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5583d11bbb00 0x5583d1ec2000 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x5583d1f52fc0 tx=0x5583d11fe240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb772e416d4a149 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:12.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc81c600640 1 -- 172.21.15.123:0/138488926 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5583d111a9c0 con 0x5583d11bbb00 2024-04-25T13:43:12.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc81c600640 1 -- 172.21.15.123:0/138488926 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5583d112ee00 con 0x5583d11bbb00 2024-04-25T13:43:12.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc81c600640 1 -- 172.21.15.123:0/138488926 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5583d111a4e0 con 0x5583d11bbb00 2024-04-25T13:43:12.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc82176a400 1 -- 172.21.15.123:0/138488926 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583d1ec0d20 con 0x5583d11bbb00 2024-04-25T13:43:12.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc82176a400 1 -- 172.21.15.123:0/138488926 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({fsmap=0}) -- 0x5583d1ec0f00 con 0x5583d11bbb00 2024-04-25T13:43:12.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc82176a400 4 waiting for MDS map... 2024-04-25T13:43:12.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc81c600640 1 -- 172.21.15.123:0/138488926 <== mon.0 v2:172.21.15.123:3300/0 4 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x5583d11c6200 con 0x5583d11bbb00 2024-04-25T13:43:12.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc81c600640 1 -- 172.21.15.123:0/138488926 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x5583d113b180 con 0x5583d11bbb00 2024-04-25T13:43:12.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc82176a400 4 Got MDS map 17 2024-04-25T13:43:12.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc82176a400 10 main: JournalTool::main 2024-04-25T13:43:12.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.687+0000 7fc82176a400 4 main: JournalTool: connecting to RADOS... 2024-04-25T13:43:12.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc82176a400 1 Processor -- start 2024-04-25T13:43:12.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc82176a400 1 -- start start 2024-04-25T13:43:12.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc82176a400 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5583d11bad80 0x5583d1ec3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc82176a400 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5583d11ba900 0x5583d1ec3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc82176a400 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5583d11ba480 0x5583d1ec3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc82176a400 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5583d1ecc600 con 0x5583d11ba480 2024-04-25T13:43:12.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc82176a400 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5583d1ecc780 con 0x5583d11bad80 2024-04-25T13:43:12.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc82176a400 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x5583d1ecc900 con 0x5583d11ba900 2024-04-25T13:43:12.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc81ee00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5583d11ba480 0x5583d1ec3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc81ee00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5583d11ba480 0x5583d1ec3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35160/0 (socket says 172.21.15.123:35160) 2024-04-25T13:43:12.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc81ee00640 1 -- 172.21.15.123:0/3854880891 learned_addr learned my addr 172.21.15.123:0/3854880891 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:12.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc820200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5583d11bad80 0x5583d1ec3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc81f800640 1 --2- 172.21.15.123:0/3854880891 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5583d11ba900 0x5583d1ec3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc81ee00640 1 -- 172.21.15.123:0/3854880891 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5583d11ba900 msgr2=0x5583d1ec3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:12.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc81ee00640 1 --2- 172.21.15.123:0/3854880891 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5583d11ba900 0x5583d1ec3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc81ee00640 1 -- 172.21.15.123:0/3854880891 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5583d11bad80 msgr2=0x5583d1ec3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:12.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc81ee00640 1 --2- 172.21.15.123:0/3854880891 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5583d11bad80 0x5583d1ec3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc81ee00640 1 -- 172.21.15.123:0/3854880891 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583d1ec01e0 con 0x5583d11ba480 2024-04-25T13:43:12.698 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc81ee00640 1 --2- 172.21.15.123:0/3854880891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5583d11ba480 0x5583d1ec3b80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x5583d200eb40 tx=0x5583d11fc5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f85578e38866cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc819e00640 1 -- 172.21.15.123:0/3854880891 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5583d111ab60 con 0x5583d11ba480 2024-04-25T13:43:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc819e00640 1 -- 172.21.15.123:0/3854880891 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5583d112ec40 con 0x5583d11ba480 2024-04-25T13:43:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc819e00640 1 -- 172.21.15.123:0/3854880891 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5583d111a340 con 0x5583d11ba480 2024-04-25T13:43:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc82176a400 1 -- 172.21.15.123:0/3854880891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5583d11ba480 msgr2=0x5583d1ec3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc82176a400 1 --2- 172.21.15.123:0/3854880891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5583d11ba480 0x5583d1ec3b80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x5583d200eb40 tx=0x5583d11fc5a0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc82176a400 1 -- 172.21.15.123:0/3854880891 shutdown_connections 2024-04-25T13:43:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc82176a400 1 --2- 172.21.15.123:0/3854880891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5583d11ba480 0x5583d1ec3b80 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc82176a400 1 --2- 172.21.15.123:0/3854880891 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5583d11ba900 0x5583d1ec3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc82176a400 1 --2- 172.21.15.123:0/3854880891 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5583d11bad80 0x5583d1ec3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc82176a400 1 -- 172.21.15.123:0/3854880891 >> 172.21.15.123:0/3854880891 conn(0x5583d11bb200 msgr2=0x5583d1408000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc82176a400 1 -- 172.21.15.123:0/3854880891 shutdown_connections 2024-04-25T13:43:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.691+0000 7fc82176a400 1 -- 172.21.15.123:0/3854880891 wait complete. 2024-04-25T13:43:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.695+0000 7fc82176a400 1 Processor -- start 2024-04-25T13:43:12.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.695+0000 7fc82176a400 1 -- start start 2024-04-25T13:43:12.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.695+0000 7fc82176a400 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5583d11ba480 0x5583d1ec3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.695+0000 7fc82176a400 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5583d11ba900 0x5583d1ec3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.695+0000 7fc82176a400 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5583d11bad80 0x5583d1ec3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.701 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.695+0000 7fc82176a400 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x5583d1ecdc80 con 0x5583d11bad80 2024-04-25T13:43:12.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.695+0000 7fc82176a400 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5583d1ecdb00 con 0x5583d11ba900 2024-04-25T13:43:12.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.695+0000 7fc82176a400 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x5583d1ecd980 con 0x5583d11ba480 2024-04-25T13:43:12.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.695+0000 7fc81ee00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5583d11bad80 0x5583d1ec3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.695+0000 7fc81ee00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5583d11bad80 0x5583d1ec3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35162/0 (socket says 172.21.15.123:35162) 2024-04-25T13:43:12.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.695+0000 7fc81ee00640 1 -- 172.21.15.123:0/1845811297 learned_addr learned my addr 172.21.15.123:0/1845811297 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:12.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.695+0000 7fc81ee00640 1 -- 172.21.15.123:0/1845811297 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5583d11ba480 msgr2=0x5583d1ec3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.695+0000 7fc81ee00640 1 --2- 172.21.15.123:0/1845811297 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5583d11ba480 0x5583d1ec3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.695+0000 7fc81ee00640 1 -- 172.21.15.123:0/1845811297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5583d11ba900 msgr2=0x5583d1ec3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.695+0000 7fc81ee00640 1 --2- 172.21.15.123:0/1845811297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5583d11ba900 0x5583d1ec3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.695+0000 7fc81ee00640 1 -- 172.21.15.123:0/1845811297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583d1ec1a40 con 0x5583d11bad80 2024-04-25T13:43:12.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.695+0000 7fc81ee00640 1 --2- 172.21.15.123:0/1845811297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5583d11bad80 0x5583d1ec3080 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x5583d200f800 tx=0x5583d11fe2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:12.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.695+0000 7fc818000640 1 -- 172.21.15.123:0/1845811297 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5583d111ab60 con 0x5583d11bad80 2024-04-25T13:43:12.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.695+0000 7fc818000640 1 -- 172.21.15.123:0/1845811297 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5583d112ea80 con 0x5583d11bad80 2024-04-25T13:43:12.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.695+0000 7fc818000640 1 -- 172.21.15.123:0/1845811297 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5583d111a340 con 0x5583d11bad80 2024-04-25T13:43:12.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.695+0000 7fc82176a400 1 -- 172.21.15.123:0/1845811297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583d1ec1c20 con 0x5583d11bad80 2024-04-25T13:43:12.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.695+0000 7fc82176a400 1 -- 172.21.15.123:0/1845811297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583d1ec0f00 con 0x5583d11bad80 2024-04-25T13:43:12.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.695+0000 7fc82176a400 4 main: JournalTool: resolving pool 4 2024-04-25T13:43:12.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.699+0000 7fc818000640 1 -- 172.21.15.123:0/1845811297 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x5583d11c2c00 con 0x5583d11bad80 2024-04-25T13:43:12.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.699+0000 7fc818000640 1 --2- 172.21.15.123:0/1845811297 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x5583d11bd180 0x5583d1ec4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.699+0000 7fc818000640 1 -- 172.21.15.123:0/1845811297 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x5583d11c4600 con 0x5583d11bad80 2024-04-25T13:43:12.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.699+0000 7fc82176a400 4 main: JournalTool: creating IoCtx.. 2024-04-25T13:43:12.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.699+0000 7fc82176a400 4 main: Executing for rank 0 2024-04-25T13:43:12.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.699+0000 7fc82176a400 1 --2- 172.21.15.123:0/1845811297 >> [v2:172.21.15.123:6800/477459895,v1:172.21.15.123:6801/477459895] conn(0x5583d11ba000 0x5583d1ec4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.699+0000 7fc820200640 1 --2- 172.21.15.123:0/1845811297 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x5583d11bd180 0x5583d1ec4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.699+0000 7fc82176a400 1 -- 172.21.15.123:0/1845811297 --> [v2:172.21.15.123:6800/477459895,v1:172.21.15.123:6801/477459895] -- osd_op(unknown.0.0:1 4.f 4:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583d200b400 con 0x5583d11ba000 2024-04-25T13:43:12.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.699+0000 7fc81f800640 1 --2- 172.21.15.123:0/1845811297 >> [v2:172.21.15.123:6800/477459895,v1:172.21.15.123:6801/477459895] conn(0x5583d11ba000 0x5583d1ec4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.699+0000 7fc820200640 1 --2- 172.21.15.123:0/1845811297 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x5583d11bd180 0x5583d1ec4100 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x5583d11e4e70 tx=0x5583d201d260 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:12.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.699+0000 7fc81f800640 1 --2- 172.21.15.123:0/1845811297 >> [v2:172.21.15.123:6800/477459895,v1:172.21.15.123:6801/477459895] conn(0x5583d11ba000 0x5583d1ec4680 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:12.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.699+0000 7fc81f800640 1 -- 172.21.15.123:0/1845811297 <== osd.1 v2:172.21.15.123:6800/477459895 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x5583d123c000 con 0x5583d11ba000 2024-04-25T13:43:12.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.699+0000 7fc82176a400 4 Pointer 400.00000000 is readable 2024-04-25T13:43:12.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.699+0000 7fc82176a400 4 JournalScanner::scan: reading header object '200.00000000' 2024-04-25T13:43:12.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.699+0000 7fc82176a400 1 --2- 172.21.15.123:0/1845811297 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x5583d11bc880 0x5583d1ec4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.699+0000 7fc82176a400 1 -- 172.21.15.123:0/1845811297 --> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] -- osd_op(unknown.0.0:2 4.14 4:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583d200b800 con 0x5583d11bc880 2024-04-25T13:43:12.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.699+0000 7fc820200640 1 --2- 172.21.15.123:0/1845811297 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x5583d11bc880 0x5583d1ec4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.699+0000 7fc820200640 1 --2- 172.21.15.123:0/1845811297 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x5583d11bc880 0x5583d1ec4c00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:12.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc820200640 1 -- 172.21.15.123:0/1845811297 <== osd.3 v2:172.21.15.123:6816/898268961 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv19 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x5583d123c500 con 0x5583d11bc880 2024-04-25T13:43:12.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 10 Header 0x400000 0x402c83 0x403471 2024-04-25T13:43:12.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 10 Starting journal scan from offset 0x402c83 2024-04-25T13:43:12.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 -- 172.21.15.123:0/1845811297 --> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] -- osd_op(unknown.0.0:3 4.14 4:2e2fa760:::200.00000001:head [read 11395~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583d151e800 con 0x5583d11bc880 2024-04-25T13:43:12.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc820200640 1 -- 172.21.15.123:0/1845811297 <== osd.3 v2:172.21.15.123:6816/898268961 2 ==== osd_op_reply(3 200.00000001 [read 11395~2030 out=2030b] v0'0 uv16 ondisk = 0) ==== 156+0+2030 (crc 0 0 0) 0x5583d123c500 con 0x5583d11bc880 2024-04-25T13:43:12.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 4 Read 0x7ee bytes from 200.00000001 gap=0 2024-04-25T13:43:12.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 10 Parsing data, 0x7ee bytes available 2024-04-25T13:43:12.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 10 Attempting decode at 0x402c83 2024-04-25T13:43:12.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 10 Consumed 0x37c bytes 2024-04-25T13:43:12.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 10 Valid entry at 0x402c83 2024-04-25T13:43:12.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 10 Attempting decode at 0x402fff 2024-04-25T13:43:12.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 10 Consumed 0x472 bytes 2024-04-25T13:43:12.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 10 Valid entry at 0x402fff 2024-04-25T13:43:12.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 --2- 172.21.15.123:0/1845811297 >> [v2:172.21.15.130:6821/1535108655,v1:172.21.15.130:6823/1535108655] conn(0x5583d11bcd00 0x5583d1ec5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.708 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 -- 172.21.15.123:0/1845811297 --> [v2:172.21.15.130:6821/1535108655,v1:172.21.15.130:6823/1535108655] -- osd_op(unknown.0.0:4 4.1b 4:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5583d151ec00 con 0x5583d11bcd00 2024-04-25T13:43:12.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc81f800640 1 --2- 172.21.15.123:0/1845811297 >> [v2:172.21.15.130:6821/1535108655,v1:172.21.15.130:6823/1535108655] conn(0x5583d11bcd00 0x5583d1ec5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc81f800640 1 --2- 172.21.15.123:0/1845811297 >> [v2:172.21.15.130:6821/1535108655,v1:172.21.15.130:6823/1535108655] conn(0x5583d11bcd00 0x5583d1ec5180 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:12.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc81f800640 1 -- 172.21.15.123:0/1845811297 <== osd.4 v2:172.21.15.130:6821/1535108655 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x5583d123c000 con 0x5583d11bcd00 2024-04-25T13:43:12.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 4 Reached end of journal objects 2024-04-25T13:43:12.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 4 Scanned objects, 0 missing, 1 valid 2024-04-25T13:43:12.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 4 Events scanned, 0 gaps 2024-04-25T13:43:12.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 4 Found 2 valid events 2024-04-25T13:43:12.710 INFO:teuthology.orchestra.run.smithi123.stdout:Events by type: 2024-04-25T13:43:12.710 INFO:teuthology.orchestra.run.smithi123.stdout: SUBTREEMAP: 1 2024-04-25T13:43:12.710 INFO:teuthology.orchestra.run.smithi123.stdout: UPDATE: 1 2024-04-25T13:43:12.710 INFO:teuthology.orchestra.run.smithi123.stdout:Errors: 0 2024-04-25T13:43:12.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 4 Selected 2 events events for processing 2024-04-25T13:43:12.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 4 2 events 2024-04-25T13:43:12.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 -- 172.21.15.123:0/1845811297 >> [v2:172.21.15.123:6800/477459895,v1:172.21.15.123:6801/477459895] conn(0x5583d11ba000 msgr2=0x5583d1ec4680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 --2- 172.21.15.123:0/1845811297 >> [v2:172.21.15.123:6800/477459895,v1:172.21.15.123:6801/477459895] conn(0x5583d11ba000 0x5583d1ec4680 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 -- 172.21.15.123:0/1845811297 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x5583d11bc880 msgr2=0x5583d1ec4c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 --2- 172.21.15.123:0/1845811297 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x5583d11bc880 0x5583d1ec4c00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 -- 172.21.15.123:0/1845811297 >> [v2:172.21.15.130:6821/1535108655,v1:172.21.15.130:6823/1535108655] conn(0x5583d11bcd00 msgr2=0x5583d1ec5180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 --2- 172.21.15.123:0/1845811297 >> [v2:172.21.15.130:6821/1535108655,v1:172.21.15.130:6823/1535108655] conn(0x5583d11bcd00 0x5583d1ec5180 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc81f800640 1 -- 172.21.15.123:0/1845811297 reap_dead start 2024-04-25T13:43:12.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 -- 172.21.15.123:0/1845811297 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x5583d11bd180 msgr2=0x5583d1ec4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 --2- 172.21.15.123:0/1845811297 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x5583d11bd180 0x5583d1ec4100 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x5583d11e4e70 tx=0x5583d201d260 comp rx=0 tx=0).stop 2024-04-25T13:43:12.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 -- 172.21.15.123:0/1845811297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5583d11bad80 msgr2=0x5583d1ec3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 --2- 172.21.15.123:0/1845811297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5583d11bad80 0x5583d1ec3080 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x5583d200f800 tx=0x5583d11fe2a0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 -- 172.21.15.123:0/1845811297 shutdown_connections 2024-04-25T13:43:12.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 --2- 172.21.15.123:0/1845811297 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x5583d11bd180 0x5583d1ec4100 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 --2- 172.21.15.123:0/1845811297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5583d11bad80 0x5583d1ec3080 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 -- 172.21.15.123:0/1845811297 >> 172.21.15.123:0/1845811297 conn(0x5583d11bb200 msgr2=0x5583d1408000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:12.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 -- 172.21.15.123:0/1845811297 shutdown_connections 2024-04-25T13:43:12.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 -- 172.21.15.123:0/1845811297 wait complete. 2024-04-25T13:43:12.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 -- 172.21.15.123:0/138488926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5583d11bbb00 msgr2=0x5583d1ec2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 --2- 172.21.15.123:0/138488926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5583d11bbb00 0x5583d1ec2000 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x5583d1f52fc0 tx=0x5583d11fe240 comp rx=0 tx=0).stop 2024-04-25T13:43:12.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 -- 172.21.15.123:0/138488926 shutdown_connections 2024-04-25T13:43:12.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 --2- 172.21.15.123:0/138488926 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x5583d11bc400 0x5583d1ec2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 --2- 172.21.15.123:0/138488926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5583d11bbb00 0x5583d1ec2000 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 --2- 172.21.15.123:0/138488926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5583d11bb680 0x5583d1ec2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 -- 172.21.15.123:0/138488926 >> 172.21.15.123:0/138488926 conn(0x5583d11bbf80 msgr2=0x5583cd0e3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:12.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 -- 172.21.15.123:0/138488926 shutdown_connections 2024-04-25T13:43:12.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.703+0000 7fc82176a400 1 -- 172.21.15.123:0/138488926 wait complete. 2024-04-25T13:43:12.718 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'get', 'summary'] in time 0:00:00.126957, result: Events by type: SUBTREEMAP: 1 UPDATE: 1 Errors: 0 2024-04-25T13:43:12.719 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:43:12.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.859+0000 7f3b8ce00640 1 Processor -- start 2024-04-25T13:43:12.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.859+0000 7f3b8ce00640 1 -- start start 2024-04-25T13:43:12.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.863+0000 7f3b8ce00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3b880747a0 0x7f3b8815fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.863+0000 7f3b8ce00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b88145d70 con 0x7f3b881602e0 2024-04-25T13:43:12.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.863+0000 7f3b8ce00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b881606f0 con 0x7f3b880b5670 2024-04-25T13:43:12.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.863+0000 7f3b8ce00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f3b88074290 con 0x7f3b880747a0 2024-04-25T13:43:12.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.863+0000 7f3b85e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3b880747a0 0x7f3b8815fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.863+0000 7f3b7d400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3b881602e0 0x7f3b88072ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54928/0 (socket says 172.21.15.123:54928) 2024-04-25T13:43:12.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.863+0000 7f3b7d400640 1 -- 172.21.15.123:0/3649841587 learned_addr learned my addr 172.21.15.123:0/3649841587 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:12.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.863+0000 7f3b85e00640 1 -- 172.21.15.123:0/3649841587 >> v1:172.21.15.130:6789/0 conn(0x7f3b880b5670 legacy=0x7f3b880731e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:12.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.863+0000 7f3b85e00640 1 -- 172.21.15.123:0/3649841587 >> v1:172.21.15.123:6789/0 conn(0x7f3b881602e0 legacy=0x7f3b88072ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.863+0000 7f3b85e00640 1 -- 172.21.15.123:0/3649841587 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b88073c80 con 0x7f3b880747a0 2024-04-25T13:43:12.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.863+0000 7f3b85400640 1 -- 172.21.15.123:0/3649841587 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 245969726 0 0) 0x7f3b70001120 con 0x7f3b881602e0 2024-04-25T13:43:12.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.867+0000 7f3b85e00640 1 --2- 172.21.15.123:0/3649841587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b880747a0 0x7f3b8815fda0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3b78009d90 tx=0x7f3b7801c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e31a2bde0de520 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:12.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.867+0000 7f3b85400640 1 -- 172.21.15.123:0/3649841587 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b780a6710 con 0x7f3b880747a0 2024-04-25T13:43:12.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.867+0000 7f3b85400640 1 -- 172.21.15.123:0/3649841587 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b780a68b0 con 0x7f3b880747a0 2024-04-25T13:43:12.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.867+0000 7f3b85400640 1 -- 172.21.15.123:0/3649841587 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b780a6c80 con 0x7f3b880747a0 2024-04-25T13:43:12.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.867+0000 7f3b8ce00640 1 -- 172.21.15.123:0/3649841587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b880747a0 msgr2=0x7f3b8815fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.867+0000 7f3b8ce00640 1 --2- 172.21.15.123:0/3649841587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b880747a0 0x7f3b8815fda0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3b78009d90 tx=0x7f3b7801c750 comp rx=0 tx=0).stop 2024-04-25T13:43:12.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.867+0000 7f3b8ce00640 1 -- 172.21.15.123:0/3649841587 shutdown_connections 2024-04-25T13:43:12.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.867+0000 7f3b8ce00640 1 --2- 172.21.15.123:0/3649841587 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b880747a0 0x7f3b8815fda0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.867+0000 7f3b8ce00640 1 -- 172.21.15.123:0/3649841587 >> 172.21.15.123:0/3649841587 conn(0x7f3b8806d210 msgr2=0x7f3b8806ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:12.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.867+0000 7f3b8ce00640 1 -- 172.21.15.123:0/3649841587 shutdown_connections 2024-04-25T13:43:12.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.867+0000 7f3b8ce00640 1 -- 172.21.15.123:0/3649841587 wait complete. 2024-04-25T13:43:12.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.867+0000 7f3b8ce00640 1 Processor -- start 2024-04-25T13:43:12.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.867+0000 7f3b8ce00640 1 -- start start 2024-04-25T13:43:12.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.871+0000 7f3b8ce00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b880747a0 0x7f3b88144520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.871+0000 7f3b8ce00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b880b5670 0x7f3b8815bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.871+0000 7f3b8ce00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b881602e0 0x7f3b880cfff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.871+0000 7f3b8ce00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3b880738f0 con 0x7f3b881602e0 2024-04-25T13:43:12.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.871+0000 7f3b8ce00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3b88074bb0 con 0x7f3b880747a0 2024-04-25T13:43:12.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.871+0000 7f3b8ce00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3b880b6380 con 0x7f3b880b5670 2024-04-25T13:43:12.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.871+0000 7f3b86800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b881602e0 0x7f3b880cfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.871+0000 7f3b86800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b881602e0 0x7f3b880cfff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35174/0 (socket says 172.21.15.123:35174) 2024-04-25T13:43:12.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.871+0000 7f3b86800640 1 -- 172.21.15.123:0/1610426295 learned_addr learned my addr 172.21.15.123:0/1610426295 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:12.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.871+0000 7f3b85e00640 1 --2- 172.21.15.123:0/1610426295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b880747a0 0x7f3b88144520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.876 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.871+0000 7f3b7d400640 1 --2- 172.21.15.123:0/1610426295 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b880b5670 0x7f3b8815bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.871+0000 7f3b86800640 1 -- 172.21.15.123:0/1610426295 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b880b5670 msgr2=0x7f3b8815bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.871+0000 7f3b86800640 1 --2- 172.21.15.123:0/1610426295 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b880b5670 0x7f3b8815bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.871+0000 7f3b86800640 1 -- 172.21.15.123:0/1610426295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b880747a0 msgr2=0x7f3b88144520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:12.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.871+0000 7f3b86800640 1 --2- 172.21.15.123:0/1610426295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b880747a0 0x7f3b88144520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:12.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.871+0000 7f3b86800640 1 -- 172.21.15.123:0/1610426295 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b88141880 con 0x7f3b881602e0 2024-04-25T13:43:12.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.871+0000 7f3b86800640 1 --2- 172.21.15.123:0/1610426295 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b881602e0 0x7f3b880cfff0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3b8000b440 tx=0x7f3b8000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:12.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.871+0000 7f3b7ea00640 1 -- 172.21.15.123:0/1610426295 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b80015020 con 0x7f3b881602e0 2024-04-25T13:43:12.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.871+0000 7f3b7ea00640 1 -- 172.21.15.123:0/1610426295 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b80011850 con 0x7f3b881602e0 2024-04-25T13:43:12.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.871+0000 7f3b7ea00640 1 -- 172.21.15.123:0/1610426295 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b80011c40 con 0x7f3b881602e0 2024-04-25T13:43:12.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.871+0000 7f3b8ce00640 1 -- 172.21.15.123:0/1610426295 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b88141b20 con 0x7f3b881602e0 2024-04-25T13:43:12.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.871+0000 7f3b8ce00640 1 -- 172.21.15.123:0/1610426295 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b881420e0 con 0x7f3b881602e0 2024-04-25T13:43:12.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.871+0000 7f3b8ce00640 1 -- 172.21.15.123:0/1610426295 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b880507c0 con 0x7f3b881602e0 2024-04-25T13:43:12.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.875+0000 7f3b7ea00640 1 -- 172.21.15.123:0/1610426295 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3b80018020 con 0x7f3b881602e0 2024-04-25T13:43:12.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.875+0000 7f3b7ea00640 1 --2- 172.21.15.123:0/1610426295 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3b6406f430 0x7f3b64071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:12.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.875+0000 7f3b7ea00640 1 -- 172.21.15.123:0/1610426295 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3b8008f060 con 0x7f3b881602e0 2024-04-25T13:43:12.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.875+0000 7f3b85e00640 1 --2- 172.21.15.123:0/1610426295 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3b6406f430 0x7f3b64071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:12.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.875+0000 7f3b85e00640 1 --2- 172.21.15.123:0/1610426295 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3b6406f430 0x7f3b64071940 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3b780af000 tx=0x7f3b780a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:12.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:12.879+0000 7f3b7ea00640 1 -- 172.21.15.123:0/1610426295 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3b8001f020 con 0x7f3b881602e0 2024-04-25T13:43:13.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.071+0000 7f3b8ce00640 1 -- 172.21.15.123:0/1610426295 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b88167f20 con 0x7f3b881602e0 2024-04-25T13:43:13.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.071+0000 7f3b7ea00640 1 -- 172.21.15.123:0/1610426295 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5187 (secure 0 0 0) 0x7f3b88141880 con 0x7f3b881602e0 2024-04-25T13:43:13.075 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:13.075 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3582988979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":3582988979},{"type":"v1","addr":"172.21.15.130:6835","nonce":3582988979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4978,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/173287078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":173287078},{"type":"v1","addr":"172.21.15.123:6837","nonce":173287078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4987,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/4025543653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4025543653},{"type":"v1","addr":"172.21.15.130:6834","nonce":4025543653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:43:01.431292+0000","modified":"2024-04-25T13:43:04.442129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6836/499623122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":499623122},{"type":"v1","addr":"172.21.15.123:6836","nonce":499623122}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5046,"qdb_cluster":[5046]},"id":2}]} 2024-04-25T13:43:13.075 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 17 2024-04-25T13:43:13.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.071+0000 7f3b8ce00640 1 -- 172.21.15.123:0/1610426295 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3b6406f430 msgr2=0x7f3b64071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:13.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.071+0000 7f3b8ce00640 1 --2- 172.21.15.123:0/1610426295 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3b6406f430 0x7f3b64071940 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3b780af000 tx=0x7f3b780a7000 comp rx=0 tx=0).stop 2024-04-25T13:43:13.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.075+0000 7f3b8ce00640 1 -- 172.21.15.123:0/1610426295 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b881602e0 msgr2=0x7f3b880cfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:13.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.075+0000 7f3b8ce00640 1 --2- 172.21.15.123:0/1610426295 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b881602e0 0x7f3b880cfff0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3b8000b440 tx=0x7f3b8000b900 comp rx=0 tx=0).stop 2024-04-25T13:43:13.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.075+0000 7f3b8ce00640 1 -- 172.21.15.123:0/1610426295 shutdown_connections 2024-04-25T13:43:13.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.075+0000 7f3b8ce00640 1 --2- 172.21.15.123:0/1610426295 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3b6406f430 0x7f3b64071940 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.075+0000 7f3b8ce00640 1 --2- 172.21.15.123:0/1610426295 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b881602e0 0x7f3b880cfff0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.075+0000 7f3b8ce00640 1 --2- 172.21.15.123:0/1610426295 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b880b5670 0x7f3b8815bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.075+0000 7f3b8ce00640 1 --2- 172.21.15.123:0/1610426295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b880747a0 0x7f3b88144520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.075+0000 7f3b8ce00640 1 -- 172.21.15.123:0/1610426295 >> 172.21.15.123:0/1610426295 conn(0x7f3b8806d210 msgr2=0x7f3b880afb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:13.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.075+0000 7f3b8ce00640 1 -- 172.21.15.123:0/1610426295 shutdown_connections 2024-04-25T13:43:13.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.075+0000 7f3b8ce00640 1 -- 172.21.15.123:0/1610426295 wait complete. 2024-04-25T13:43:13.097 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-25T13:43:13.269 INFO:teuthology.orchestra.run.smithi123.stdout:{"message":"","return_code":0} 2024-04-25T13:43:13.269 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T13:43:13.269 DEBUG:teuthology.orchestra.run.smithi123:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event get summary 2024-04-25T13:43:13.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.323+0000 7f69b073a400 1 -- start start 2024-04-25T13:43:13.328 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.323+0000 7f69b073a400 1 Processor -- start 2024-04-25T13:43:13.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.323+0000 7f69b073a400 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d0b8b3200 0x559d0c5bab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:13.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69b073a400 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d0b8b2d80 0x559d0c5bb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:13.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69b073a400 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559d0b8b2900 0x559d0c5ba000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:13.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69b073a400 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x559d0c5dc180 con 0x559d0b8b2d80 2024-04-25T13:43:13.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69b073a400 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559d0c5dc600 con 0x559d0b8b3200 2024-04-25T13:43:13.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69b073a400 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x559d0c5dc780 con 0x559d0b8b2900 2024-04-25T13:43:13.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69ade00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d0b8b2d80 0x559d0c5bb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:13.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69ade00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d0b8b2d80 0x559d0c5bb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35186/0 (socket says 172.21.15.123:35186) 2024-04-25T13:43:13.331 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69ade00640 1 -- 172.21.15.123:0/901188457 learned_addr learned my addr 172.21.15.123:0/901188457 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:13.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69ae800640 1 --2- 172.21.15.123:0/901188457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d0b8b3200 0x559d0c5bab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:13.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69af200640 1 --2- 172.21.15.123:0/901188457 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559d0b8b2900 0x559d0c5ba000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:13.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69ade00640 1 -- 172.21.15.123:0/901188457 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559d0b8b2900 msgr2=0x559d0c5ba000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:13.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69ade00640 1 --2- 172.21.15.123:0/901188457 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559d0b8b2900 0x559d0c5ba000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69ade00640 1 -- 172.21.15.123:0/901188457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d0b8b3200 msgr2=0x559d0c5bab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:13.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69ade00640 1 --2- 172.21.15.123:0/901188457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d0b8b3200 0x559d0c5bab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69ade00640 1 -- 172.21.15.123:0/901188457 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d0c5b8b40 con 0x559d0b8b2d80 2024-04-25T13:43:13.332 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69af200640 1 --2- 172.21.15.123:0/901188457 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559d0b8b2900 0x559d0c5ba000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:13.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69ade00640 1 --2- 172.21.15.123:0/901188457 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d0b8b2d80 0x559d0c5bb080 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x559d0c651770 tx=0x559d0b8f7620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e88c491f02141d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:13.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69ab600640 1 -- 172.21.15.123:0/901188457 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559d0b812b60 con 0x559d0b8b2d80 2024-04-25T13:43:13.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69ab600640 1 -- 172.21.15.123:0/901188457 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559d0b8261c0 con 0x559d0b8b2d80 2024-04-25T13:43:13.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69ab600640 1 -- 172.21.15.123:0/901188457 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559d0b812340 con 0x559d0b8b2d80 2024-04-25T13:43:13.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69b073a400 1 -- 172.21.15.123:0/901188457 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d0c5b90e0 con 0x559d0b8b2d80 2024-04-25T13:43:13.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69b073a400 1 -- 172.21.15.123:0/901188457 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({fsmap=0}) -- 0x559d0c5b92c0 con 0x559d0b8b2d80 2024-04-25T13:43:13.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69b073a400 4 waiting for MDS map... 2024-04-25T13:43:13.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69ab600640 1 -- 172.21.15.123:0/901188457 <== mon.0 v2:172.21.15.123:3300/0 4 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x559d0c678400 con 0x559d0b8b2d80 2024-04-25T13:43:13.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69ab600640 1 -- 172.21.15.123:0/901188457 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x559d0b833180 con 0x559d0b8b2d80 2024-04-25T13:43:13.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69b073a400 4 Got MDS map 17 2024-04-25T13:43:13.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69b073a400 10 main: JournalTool::main 2024-04-25T13:43:13.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69b073a400 4 main: JournalTool: connecting to RADOS... 2024-04-25T13:43:13.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69b073a400 1 Processor -- start 2024-04-25T13:43:13.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69b073a400 1 -- start start 2024-04-25T13:43:13.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69b073a400 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d0b8b2000 0x559d0c5bbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:13.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69b073a400 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d0b8b4880 0x559d0c5ba580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:13.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69b073a400 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559d0b8b4d00 0x559d0c5bb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:13.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69b073a400 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x559d0b83c180 con 0x559d0b8b4880 2024-04-25T13:43:13.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69b073a400 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559d0c5dd680 con 0x559d0b8b2000 2024-04-25T13:43:13.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.327+0000 7f69b073a400 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x559d0c5dd500 con 0x559d0b8b4d00 2024-04-25T13:43:13.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.331+0000 7f69ae800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d0b8b4880 0x559d0c5ba580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:13.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.331+0000 7f69ae800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d0b8b4880 0x559d0c5ba580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35196/0 (socket says 172.21.15.123:35196) 2024-04-25T13:43:13.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.331+0000 7f69ae800640 1 -- 172.21.15.123:0/3408186825 learned_addr learned my addr 172.21.15.123:0/3408186825 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:13.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.331+0000 7f69ade00640 1 --2- 172.21.15.123:0/3408186825 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559d0b8b4d00 0x559d0c5bb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:13.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.331+0000 7f69af200640 1 --2- 172.21.15.123:0/3408186825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d0b8b2000 0x559d0c5bbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:13.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.331+0000 7f69ae800640 1 -- 172.21.15.123:0/3408186825 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559d0b8b4d00 msgr2=0x559d0c5bb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:13.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.331+0000 7f69ae800640 1 --2- 172.21.15.123:0/3408186825 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559d0b8b4d00 0x559d0c5bb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.331+0000 7f69ae800640 1 -- 172.21.15.123:0/3408186825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d0b8b2000 msgr2=0x559d0c5bbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:13.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.331+0000 7f69ae800640 1 --2- 172.21.15.123:0/3408186825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d0b8b2000 0x559d0c5bbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.331+0000 7f69ae800640 1 -- 172.21.15.123:0/3408186825 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d0c5b81e0 con 0x559d0b8b4880 2024-04-25T13:43:13.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.331+0000 7f69af200640 1 --2- 172.21.15.123:0/3408186825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d0b8b2000 0x559d0c5bbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:13.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.331+0000 7f69ae800640 1 --2- 172.21.15.123:0/3408186825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d0b8b4880 0x559d0c5ba580 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x559d0c726c60 tx=0x559d0c71ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6695225f77b47f93 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:13.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.331+0000 7f69a8e00640 1 -- 172.21.15.123:0/3408186825 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559d0b812b60 con 0x559d0b8b4880 2024-04-25T13:43:13.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.331+0000 7f69a8e00640 1 -- 172.21.15.123:0/3408186825 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559d0b826c40 con 0x559d0b8b4880 2024-04-25T13:43:13.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.331+0000 7f69a8e00640 1 -- 172.21.15.123:0/3408186825 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559d0b812340 con 0x559d0b8b4880 2024-04-25T13:43:13.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.331+0000 7f69b073a400 1 -- 172.21.15.123:0/3408186825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d0b8b4880 msgr2=0x559d0c5ba580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:13.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.331+0000 7f69b073a400 1 --2- 172.21.15.123:0/3408186825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d0b8b4880 0x559d0c5ba580 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x559d0c726c60 tx=0x559d0c71ac00 comp rx=0 tx=0).stop 2024-04-25T13:43:13.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.331+0000 7f69b073a400 1 -- 172.21.15.123:0/3408186825 shutdown_connections 2024-04-25T13:43:13.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.331+0000 7f69b073a400 1 --2- 172.21.15.123:0/3408186825 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559d0b8b4d00 0x559d0c5bb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.331+0000 7f69b073a400 1 --2- 172.21.15.123:0/3408186825 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d0b8b4880 0x559d0c5ba580 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.331+0000 7f69b073a400 1 --2- 172.21.15.123:0/3408186825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d0b8b2000 0x559d0c5bbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.331+0000 7f69b073a400 1 -- 172.21.15.123:0/3408186825 >> 172.21.15.123:0/3408186825 conn(0x559d0b8b2480 msgr2=0x559d0c5e2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:13.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.331+0000 7f69b073a400 1 -- 172.21.15.123:0/3408186825 shutdown_connections 2024-04-25T13:43:13.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.331+0000 7f69b073a400 1 -- 172.21.15.123:0/3408186825 wait complete. 2024-04-25T13:43:13.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.331+0000 7f69b073a400 1 Processor -- start 2024-04-25T13:43:13.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.331+0000 7f69b073a400 1 -- start start 2024-04-25T13:43:13.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.335+0000 7f69b073a400 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559d0b8b2000 0x559d0c5bbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:13.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.335+0000 7f69b073a400 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d0b8b4880 0x559d0c5ba580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:13.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.335+0000 7f69b073a400 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d0b8b4d00 0x559d0c5bb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:13.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.335+0000 7f69b073a400 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x559d0c5dc900 con 0x559d0b8b4d00 2024-04-25T13:43:13.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.335+0000 7f69b073a400 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559d0c5dca80 con 0x559d0b8b4880 2024-04-25T13:43:13.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.335+0000 7f69b073a400 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x559d0c5dc300 con 0x559d0b8b2000 2024-04-25T13:43:13.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.335+0000 7f69ade00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d0b8b4d00 0x559d0c5bb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:13.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.335+0000 7f69ade00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d0b8b4d00 0x559d0c5bb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35210/0 (socket says 172.21.15.123:35210) 2024-04-25T13:43:13.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.335+0000 7f69ade00640 1 -- 172.21.15.123:0/915940045 learned_addr learned my addr 172.21.15.123:0/915940045 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:13.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.335+0000 7f69af200640 1 --2- 172.21.15.123:0/915940045 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559d0b8b2000 0x559d0c5bbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:13.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.335+0000 7f69ae800640 1 --2- 172.21.15.123:0/915940045 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d0b8b4880 0x559d0c5ba580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:13.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.335+0000 7f69ade00640 1 -- 172.21.15.123:0/915940045 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559d0b8b2000 msgr2=0x559d0c5bbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:13.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.335+0000 7f69ade00640 1 --2- 172.21.15.123:0/915940045 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559d0b8b2000 0x559d0c5bbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.335+0000 7f69ade00640 1 -- 172.21.15.123:0/915940045 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d0b8b4880 msgr2=0x559d0c5ba580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:13.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.335+0000 7f69ade00640 1 --2- 172.21.15.123:0/915940045 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d0b8b4880 0x559d0c5ba580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.335+0000 7f69ade00640 1 -- 172.21.15.123:0/915940045 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d0c5b9c20 con 0x559d0b8b4d00 2024-04-25T13:43:13.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.335+0000 7f69ade00640 1 --2- 172.21.15.123:0/915940045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d0b8b4d00 0x559d0c5bb600 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x559d0c727e90 tx=0x559d0b8f4600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:13.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.335+0000 7f69a7000640 1 -- 172.21.15.123:0/915940045 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559d0b812000 con 0x559d0b8b4d00 2024-04-25T13:43:13.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.335+0000 7f69a7000640 1 -- 172.21.15.123:0/915940045 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559d0b826e00 con 0x559d0b8b4d00 2024-04-25T13:43:13.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.335+0000 7f69a7000640 1 -- 172.21.15.123:0/915940045 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559d0b812ea0 con 0x559d0b8b4d00 2024-04-25T13:43:13.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.335+0000 7f69b073a400 1 -- 172.21.15.123:0/915940045 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d0c5b9e00 con 0x559d0b8b4d00 2024-04-25T13:43:13.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.335+0000 7f69b073a400 1 -- 172.21.15.123:0/915940045 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d0bb301e0 con 0x559d0b8b4d00 2024-04-25T13:43:13.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.335+0000 7f69b073a400 4 main: JournalTool: resolving pool 4 2024-04-25T13:43:13.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.335+0000 7f69a7000640 1 -- 172.21.15.123:0/915940045 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x559d0bb22c00 con 0x559d0b8b4d00 2024-04-25T13:43:13.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.335+0000 7f69a7000640 1 --2- 172.21.15.123:0/915940045 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x559d0b8b5180 0x559d0c5bcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:13.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.335+0000 7f69a7000640 1 -- 172.21.15.123:0/915940045 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x559d0bb28800 con 0x559d0b8b4d00 2024-04-25T13:43:13.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.335+0000 7f69b073a400 4 main: JournalTool: creating IoCtx.. 2024-04-25T13:43:13.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69b073a400 4 main: Executing for rank 0 2024-04-25T13:43:13.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69af200640 1 --2- 172.21.15.123:0/915940045 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x559d0b8b5180 0x559d0c5bcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:13.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69b073a400 1 --2- 172.21.15.123:0/915940045 >> [v2:172.21.15.123:6800/477459895,v1:172.21.15.123:6801/477459895] conn(0x559d0b8b4400 0x559d0c5bc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:13.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69b073a400 1 -- 172.21.15.123:0/915940045 --> [v2:172.21.15.123:6800/477459895,v1:172.21.15.123:6801/477459895] -- osd_op(unknown.0.0:1 4.f 4:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559d0bb1b800 con 0x559d0b8b4400 2024-04-25T13:43:13.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69ae800640 1 --2- 172.21.15.123:0/915940045 >> [v2:172.21.15.123:6800/477459895,v1:172.21.15.123:6801/477459895] conn(0x559d0b8b4400 0x559d0c5bc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:13.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69af200640 1 --2- 172.21.15.123:0/915940045 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x559d0b8b5180 0x559d0c5bcc00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x559d0b8dcea0 tx=0x559d0b8f61e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:13.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69ae800640 1 --2- 172.21.15.123:0/915940045 >> [v2:172.21.15.123:6800/477459895,v1:172.21.15.123:6801/477459895] conn(0x559d0b8b4400 0x559d0c5bc100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:13.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69ae800640 1 -- 172.21.15.123:0/915940045 <== osd.1 v2:172.21.15.123:6800/477459895 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) ==== 156+0+22 (crc 0 0 0) 0x559d0b934000 con 0x559d0b8b4400 2024-04-25T13:43:13.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69b073a400 4 Pointer 400.00000000 is readable 2024-04-25T13:43:13.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69b073a400 4 JournalScanner::scan: reading header object '200.00000000' 2024-04-25T13:43:13.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69b073a400 1 --2- 172.21.15.123:0/915940045 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x559d0b8b3b00 0x559d0c5bc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:13.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69b073a400 1 -- 172.21.15.123:0/915940045 --> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] -- osd_op(unknown.0.0:2 4.14 4:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559d0bb1bc00 con 0x559d0b8b3b00 2024-04-25T13:43:13.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69af200640 1 --2- 172.21.15.123:0/915940045 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x559d0b8b3b00 0x559d0c5bc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:13.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69af200640 1 --2- 172.21.15.123:0/915940045 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x559d0b8b3b00 0x559d0c5bc680 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:13.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69af200640 1 -- 172.21.15.123:0/915940045 <== osd.3 v2:172.21.15.123:6816/898268961 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv23 ondisk = 0) ==== 156+0+90 (crc 0 0 0) 0x559d0b934500 con 0x559d0b8b3b00 2024-04-25T13:43:13.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69b073a400 10 Header 0x400000 0x403471 0x4037ed 2024-04-25T13:43:13.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69b073a400 10 Starting journal scan from offset 0x403471 2024-04-25T13:43:13.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69b073a400 1 -- 172.21.15.123:0/915940045 --> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] -- osd_op(unknown.0.0:3 4.14 4:2e2fa760:::200.00000001:head [read 13425~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559d0bb1a400 con 0x559d0b8b3b00 2024-04-25T13:43:13.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69af200640 1 -- 172.21.15.123:0/915940045 <== osd.3 v2:172.21.15.123:6816/898268961 2 ==== osd_op_reply(3 200.00000001 [read 13425~892 out=892b] v0'0 uv20 ondisk = 0) ==== 156+0+892 (crc 0 0 0) 0x559d0b934500 con 0x559d0b8b3b00 2024-04-25T13:43:13.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69b073a400 4 Read 0x37c bytes from 200.00000001 gap=0 2024-04-25T13:43:13.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69b073a400 10 Parsing data, 0x37c bytes available 2024-04-25T13:43:13.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69b073a400 10 Attempting decode at 0x403471 2024-04-25T13:43:13.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69b073a400 10 Consumed 0x37c bytes 2024-04-25T13:43:13.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69b073a400 10 Valid entry at 0x403471 2024-04-25T13:43:13.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69b073a400 1 --2- 172.21.15.123:0/915940045 >> [v2:172.21.15.130:6821/1535108655,v1:172.21.15.130:6823/1535108655] conn(0x559d0b8b3680 0x559d0c5bd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:13.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69b073a400 1 -- 172.21.15.123:0/915940045 --> [v2:172.21.15.130:6821/1535108655,v1:172.21.15.130:6823/1535108655] -- osd_op(unknown.0.0:4 4.1b 4:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559d0bb1a000 con 0x559d0b8b3680 2024-04-25T13:43:13.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69ae800640 1 --2- 172.21.15.123:0/915940045 >> [v2:172.21.15.130:6821/1535108655,v1:172.21.15.130:6823/1535108655] conn(0x559d0b8b3680 0x559d0c5bd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:13.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.339+0000 7f69ae800640 1 --2- 172.21.15.123:0/915940045 >> [v2:172.21.15.130:6821/1535108655,v1:172.21.15.130:6823/1535108655] conn(0x559d0b8b3680 0x559d0c5bd180 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:13.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69ae800640 1 -- 172.21.15.123:0/915940045 <== osd.4 v2:172.21.15.130:6821/1535108655 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 156+0+0 (crc 0 0 0) 0x559d0b934000 con 0x559d0b8b3680 2024-04-25T13:43:13.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 4 Reached end of journal objects 2024-04-25T13:43:13.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 4 Scanned objects, 0 missing, 1 valid 2024-04-25T13:43:13.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 4 Events scanned, 0 gaps 2024-04-25T13:43:13.348 INFO:teuthology.orchestra.run.smithi123.stdout:Events by type: 2024-04-25T13:43:13.348 INFO:teuthology.orchestra.run.smithi123.stdout: SUBTREEMAP: 1 2024-04-25T13:43:13.348 INFO:teuthology.orchestra.run.smithi123.stdout:Errors: 0 2024-04-25T13:43:13.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 4 Found 1 valid events 2024-04-25T13:43:13.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 4 Selected 1 events events for processing 2024-04-25T13:43:13.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 4 1 events 2024-04-25T13:43:13.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 1 -- 172.21.15.123:0/915940045 >> [v2:172.21.15.123:6800/477459895,v1:172.21.15.123:6801/477459895] conn(0x559d0b8b4400 msgr2=0x559d0c5bc100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:13.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 1 --2- 172.21.15.123:0/915940045 >> [v2:172.21.15.123:6800/477459895,v1:172.21.15.123:6801/477459895] conn(0x559d0b8b4400 0x559d0c5bc100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 1 -- 172.21.15.123:0/915940045 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x559d0b8b3b00 msgr2=0x559d0c5bc680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:13.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 1 --2- 172.21.15.123:0/915940045 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x559d0b8b3b00 0x559d0c5bc680 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 1 -- 172.21.15.123:0/915940045 >> [v2:172.21.15.130:6821/1535108655,v1:172.21.15.130:6823/1535108655] conn(0x559d0b8b3680 msgr2=0x559d0c5bd180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:13.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 1 --2- 172.21.15.123:0/915940045 >> [v2:172.21.15.130:6821/1535108655,v1:172.21.15.130:6823/1535108655] conn(0x559d0b8b3680 0x559d0c5bd180 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69ae800640 1 -- 172.21.15.123:0/915940045 reap_dead start 2024-04-25T13:43:13.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 1 -- 172.21.15.123:0/915940045 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x559d0b8b5180 msgr2=0x559d0c5bcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:13.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 1 --2- 172.21.15.123:0/915940045 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x559d0b8b5180 0x559d0c5bcc00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x559d0b8dcea0 tx=0x559d0b8f61e0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 1 -- 172.21.15.123:0/915940045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d0b8b4d00 msgr2=0x559d0c5bb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:13.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 1 --2- 172.21.15.123:0/915940045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d0b8b4d00 0x559d0c5bb600 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x559d0c727e90 tx=0x559d0b8f4600 comp rx=0 tx=0).stop 2024-04-25T13:43:13.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 1 -- 172.21.15.123:0/915940045 shutdown_connections 2024-04-25T13:43:13.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 1 --2- 172.21.15.123:0/915940045 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x559d0b8b5180 0x559d0c5bcc00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 1 --2- 172.21.15.123:0/915940045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d0b8b4d00 0x559d0c5bb600 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 1 -- 172.21.15.123:0/915940045 >> 172.21.15.123:0/915940045 conn(0x559d0b8b2480 msgr2=0x559d0c5e2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:13.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 1 -- 172.21.15.123:0/915940045 shutdown_connections 2024-04-25T13:43:13.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 1 -- 172.21.15.123:0/915940045 wait complete. 2024-04-25T13:43:13.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 1 -- 172.21.15.123:0/901188457 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d0b8b2d80 msgr2=0x559d0c5bb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:13.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 1 --2- 172.21.15.123:0/901188457 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d0b8b2d80 0x559d0c5bb080 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x559d0c651770 tx=0x559d0b8f7620 comp rx=0 tx=0).stop 2024-04-25T13:43:13.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 1 -- 172.21.15.123:0/901188457 shutdown_connections 2024-04-25T13:43:13.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 1 --2- 172.21.15.123:0/901188457 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559d0b8b2900 0x559d0c5ba000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 1 --2- 172.21.15.123:0/901188457 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559d0b8b2d80 0x559d0c5bb080 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 1 --2- 172.21.15.123:0/901188457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559d0b8b3200 0x559d0c5bab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 1 -- 172.21.15.123:0/901188457 >> 172.21.15.123:0/901188457 conn(0x559d0b8b3f80 msgr2=0x559d0c5e2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:13.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 1 -- 172.21.15.123:0/901188457 shutdown_connections 2024-04-25T13:43:13.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.343+0000 7f69b073a400 1 -- 172.21.15.123:0/901188457 wait complete. 2024-04-25T13:43:13.353 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'get', 'summary'] in time 0:00:00.084009, result: Events by type: SUBTREEMAP: 1 Errors: 0 2024-04-25T13:43:13.354 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:43:13.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.495+0000 7efd4bc00640 1 Processor -- start 2024-04-25T13:43:13.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.495+0000 7efd4bc00640 1 -- start start 2024-04-25T13:43:13.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.495+0000 7efd4bc00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efd4406e580 0x7efd4406e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:13.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.495+0000 7efd4bc00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efd440ce730 0x7efd440ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:13.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.495+0000 7efd4bc00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7efd44164390 0x7efd441647a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:13.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.495+0000 7efd4bc00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7efd44074780 con 0x7efd440ce730 2024-04-25T13:43:13.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.495+0000 7efd4bc00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7efd440cf080 con 0x7efd44164390 2024-04-25T13:43:13.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.495+0000 7efd4bc00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7efd4406d9a0 con 0x7efd4406e580 2024-04-25T13:43:13.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.495+0000 7efd43e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efd440ce730 0x7efd440ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:13.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.495+0000 7efd49200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efd4406e580 0x7efd4406e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:13.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.495+0000 7efd49c00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7efd44164390 0x7efd441647a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:13.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.495+0000 7efd43e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7efd440ce730 0x7efd440ceb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35222/0 (socket says 172.21.15.123:35222) 2024-04-25T13:43:13.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.495+0000 7efd43e00640 1 -- 172.21.15.123:0/236351168 learned_addr learned my addr 172.21.15.123:0/236351168 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:13.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.499+0000 7efd43e00640 1 -- 172.21.15.123:0/236351168 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efd4406e580 msgr2=0x7efd4406e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:13.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.499+0000 7efd43e00640 1 --2- 172.21.15.123:0/236351168 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efd4406e580 0x7efd4406e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.499+0000 7efd43e00640 1 -- 172.21.15.123:0/236351168 >> v2:172.21.15.130:3300/0 conn(0x7efd44164390 msgr2=0x7efd441647a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:13.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.499+0000 7efd43e00640 1 --2- 172.21.15.123:0/236351168 >> v2:172.21.15.130:3300/0 conn(0x7efd44164390 0x7efd441647a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.499+0000 7efd43e00640 1 -- 172.21.15.123:0/236351168 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd440d0e80 con 0x7efd440ce730 2024-04-25T13:43:13.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.499+0000 7efd43e00640 1 --2- 172.21.15.123:0/236351168 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd440ce730 0x7efd440ceb40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7efd44073c70 tx=0x7efd3001c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9939b272d13e20f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:13.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.499+0000 7efd43400640 1 -- 172.21.15.123:0/236351168 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd300b0070 con 0x7efd440ce730 2024-04-25T13:43:13.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.499+0000 7efd43400640 1 -- 172.21.15.123:0/236351168 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd300ab600 con 0x7efd440ce730 2024-04-25T13:43:13.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.499+0000 7efd43400640 1 -- 172.21.15.123:0/236351168 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd300ab9d0 con 0x7efd440ce730 2024-04-25T13:43:13.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.503+0000 7efd4bc00640 1 -- 172.21.15.123:0/236351168 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd440ce730 msgr2=0x7efd440ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:13.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.503+0000 7efd4bc00640 1 --2- 172.21.15.123:0/236351168 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd440ce730 0x7efd440ceb40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7efd44073c70 tx=0x7efd3001c340 comp rx=0 tx=0).stop 2024-04-25T13:43:13.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.503+0000 7efd4bc00640 1 -- 172.21.15.123:0/236351168 shutdown_connections 2024-04-25T13:43:13.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.503+0000 7efd4bc00640 1 --2- 172.21.15.123:0/236351168 >> v2:172.21.15.130:3300/0 conn(0x7efd44164390 0x7efd441647a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.503+0000 7efd4bc00640 1 --2- 172.21.15.123:0/236351168 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd440ce730 0x7efd440ceb40 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.503+0000 7efd4bc00640 1 --2- 172.21.15.123:0/236351168 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efd4406e580 0x7efd4406e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.503+0000 7efd4bc00640 1 -- 172.21.15.123:0/236351168 >> 172.21.15.123:0/236351168 conn(0x7efd440d0150 msgr2=0x7efd440d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:13.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.503+0000 7efd4bc00640 1 -- 172.21.15.123:0/236351168 shutdown_connections 2024-04-25T13:43:13.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.503+0000 7efd4bc00640 1 -- 172.21.15.123:0/236351168 wait complete. 2024-04-25T13:43:13.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.503+0000 7efd4bc00640 1 Processor -- start 2024-04-25T13:43:13.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.503+0000 7efd4bc00640 1 -- start start 2024-04-25T13:43:13.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.503+0000 7efd4bc00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efd4406e580 0x7efd4415e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:13.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.507+0000 7efd4bc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd440ce730 0x7efd44156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:13.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.507+0000 7efd4bc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd44164390 0x7efd4415a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:13.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.507+0000 7efd4bc00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efd441650f0 con 0x7efd44164390 2024-04-25T13:43:13.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.507+0000 7efd4bc00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efd44073dc0 con 0x7efd440ce730 2024-04-25T13:43:13.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.507+0000 7efd4bc00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7efd440b9030 con 0x7efd4406e580 2024-04-25T13:43:13.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.507+0000 7efd49c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd44164390 0x7efd4415a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:13.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.507+0000 7efd49c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd44164390 0x7efd4415a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35226/0 (socket says 172.21.15.123:35226) 2024-04-25T13:43:13.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.507+0000 7efd49c00640 1 -- 172.21.15.123:0/1390204739 learned_addr learned my addr 172.21.15.123:0/1390204739 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:13.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.507+0000 7efd49200640 1 --2- 172.21.15.123:0/1390204739 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efd4406e580 0x7efd4415e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:13.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.507+0000 7efd43e00640 1 --2- 172.21.15.123:0/1390204739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd440ce730 0x7efd44156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:13.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.507+0000 7efd49c00640 1 -- 172.21.15.123:0/1390204739 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efd4406e580 msgr2=0x7efd4415e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:13.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.507+0000 7efd49c00640 1 --2- 172.21.15.123:0/1390204739 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efd4406e580 0x7efd4415e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.507+0000 7efd49c00640 1 -- 172.21.15.123:0/1390204739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd440ce730 msgr2=0x7efd44156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:13.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.507+0000 7efd49c00640 1 --2- 172.21.15.123:0/1390204739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd440ce730 0x7efd44156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.507+0000 7efd49c00640 1 -- 172.21.15.123:0/1390204739 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd4415ecd0 con 0x7efd44164390 2024-04-25T13:43:13.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.507+0000 7efd49200640 1 --2- 172.21.15.123:0/1390204739 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efd4406e580 0x7efd4415e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:13.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.507+0000 7efd43e00640 1 --2- 172.21.15.123:0/1390204739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd440ce730 0x7efd44156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:13.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.507+0000 7efd49c00640 1 --2- 172.21.15.123:0/1390204739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd44164390 0x7efd4415a410 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7efd3c00ef90 tx=0x7efd3c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:13.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.507+0000 7efd40c00640 1 -- 172.21.15.123:0/1390204739 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3c018020 con 0x7efd44164390 2024-04-25T13:43:13.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.507+0000 7efd40c00640 1 -- 172.21.15.123:0/1390204739 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd3c014480 con 0x7efd44164390 2024-04-25T13:43:13.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.507+0000 7efd40c00640 1 -- 172.21.15.123:0/1390204739 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd3c009e60 con 0x7efd44164390 2024-04-25T13:43:13.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.507+0000 7efd4bc00640 1 -- 172.21.15.123:0/1390204739 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd4415efb0 con 0x7efd44164390 2024-04-25T13:43:13.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.507+0000 7efd4bc00640 1 -- 172.21.15.123:0/1390204739 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd4415f570 con 0x7efd44164390 2024-04-25T13:43:13.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.507+0000 7efd4bc00640 1 -- 172.21.15.123:0/1390204739 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd440507c0 con 0x7efd44164390 2024-04-25T13:43:13.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.507+0000 7efd40c00640 1 -- 172.21.15.123:0/1390204739 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7efd3c01b020 con 0x7efd44164390 2024-04-25T13:43:13.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.511+0000 7efd40c00640 1 --2- 172.21.15.123:0/1390204739 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7efd2406f400 0x7efd24071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:13.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.511+0000 7efd40c00640 1 -- 172.21.15.123:0/1390204739 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7efd3c08ffe0 con 0x7efd44164390 2024-04-25T13:43:13.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.511+0000 7efd49200640 1 --2- 172.21.15.123:0/1390204739 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7efd2406f400 0x7efd24071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:13.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.511+0000 7efd49200640 1 --2- 172.21.15.123:0/1390204739 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7efd2406f400 0x7efd24071910 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7efd340099c0 tx=0x7efd34008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:13.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.515+0000 7efd40c00640 1 -- 172.21.15.123:0/1390204739 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efd3c022030 con 0x7efd44164390 2024-04-25T13:43:13.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.707+0000 7efd4bc00640 1 -- 172.21.15.123:0/1390204739 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd440cdae0 con 0x7efd44164390 2024-04-25T13:43:13.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.707+0000 7efd40c00640 1 -- 172.21.15.123:0/1390204739 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5187 (secure 0 0 0) 0x7efd3c010040 con 0x7efd44164390 2024-04-25T13:43:13.711 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:13.711 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3582988979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":3582988979},{"type":"v1","addr":"172.21.15.130:6835","nonce":3582988979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4978,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/173287078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":173287078},{"type":"v1","addr":"172.21.15.123:6837","nonce":173287078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4987,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/4025543653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4025543653},{"type":"v1","addr":"172.21.15.130:6834","nonce":4025543653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:43:01.431292+0000","modified":"2024-04-25T13:43:04.442129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6836/499623122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":499623122},{"type":"v1","addr":"172.21.15.123:6836","nonce":499623122}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5046,"qdb_cluster":[5046]},"id":2}]} 2024-04-25T13:43:13.711 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 17 2024-04-25T13:43:13.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.707+0000 7efd4bc00640 1 -- 172.21.15.123:0/1390204739 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7efd2406f400 msgr2=0x7efd24071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:13.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.707+0000 7efd4bc00640 1 --2- 172.21.15.123:0/1390204739 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7efd2406f400 0x7efd24071910 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7efd340099c0 tx=0x7efd34008040 comp rx=0 tx=0).stop 2024-04-25T13:43:13.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.707+0000 7efd4bc00640 1 -- 172.21.15.123:0/1390204739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd44164390 msgr2=0x7efd4415a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:13.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.707+0000 7efd4bc00640 1 --2- 172.21.15.123:0/1390204739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd44164390 0x7efd4415a410 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7efd3c00ef90 tx=0x7efd3c00c490 comp rx=0 tx=0).stop 2024-04-25T13:43:13.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.707+0000 7efd4bc00640 1 -- 172.21.15.123:0/1390204739 shutdown_connections 2024-04-25T13:43:13.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.707+0000 7efd4bc00640 1 --2- 172.21.15.123:0/1390204739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd440ce730 0x7efd44156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.707+0000 7efd4bc00640 1 --2- 172.21.15.123:0/1390204739 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7efd2406f400 0x7efd24071910 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.707+0000 7efd4bc00640 1 --2- 172.21.15.123:0/1390204739 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efd44164390 0x7efd4415a410 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.707+0000 7efd4bc00640 1 --2- 172.21.15.123:0/1390204739 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efd4406e580 0x7efd4415e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:13.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.707+0000 7efd4bc00640 1 -- 172.21.15.123:0/1390204739 >> 172.21.15.123:0/1390204739 conn(0x7efd440d0150 msgr2=0x7efd4415ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:13.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.707+0000 7efd4bc00640 1 -- 172.21.15.123:0/1390204739 shutdown_connections 2024-04-25T13:43:13.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:13.707+0000 7efd4bc00640 1 -- 172.21.15.123:0/1390204739 wait complete. 2024-04-25T13:43:13.733 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump objecter 2024-04-25T13:43:13.900 INFO:teuthology.orchestra.run.smithi123.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":568,"op_send_bytes":29673,"op_resend":37,"op_reply":568,"op_latency":{"avgcount":568,"sum":22.138950374,"avgtime":0.038977025},"op_inflight":0,"oplen_avg":{"avgcount":568,"sum":605},"op":568,"op_r":0,"op_w":568,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":14,"osdop_read":0,"osdop_write":11,"osdop_writefull":15,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":506,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":28,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":34,"map_full":0,"map_inc":1,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":26,"omap_rd":0,"omap_del":3}} 2024-04-25T13:43:13.900 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 34, "map_full": 0, "map_inc": 1, "omap_del": 3, "omap_rd": 0, "omap_wr": 26, "op": 568, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 568, "avgtime": 0.038977025, "sum": 22.138950374 }, "op_pg": 0, "op_r": 0, "op_reply": 568, "op_resend": 37, "op_rmw": 0, "op_send": 568, "op_send_bytes": 29673, "op_w": 568, "oplen_avg": { "avgcount": 568, "sum": 605 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 14, "osdop_delete": 506, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 28, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 11, "osdop_writefull": 15, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2024-04-25T13:43:13.901 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:43:14.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.043+0000 7f8573600640 1 Processor -- start 2024-04-25T13:43:14.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.043+0000 7f8573600640 1 -- start start 2024-04-25T13:43:14.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.043+0000 7f8573600640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f856c0b32f0 0x7f856c0b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:14.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.043+0000 7f8573600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f856c0b5010 0x7f856c0b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:14.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.043+0000 7f8573600640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f856c0b3c40 con 0x7f856c0d0f80 2024-04-25T13:43:14.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.043+0000 7f8573600640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f856c15cfe0 con 0x7f856c0b5010 2024-04-25T13:43:14.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.043+0000 7f8573600640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f856c15d240 con 0x7f856c0b32f0 2024-04-25T13:43:14.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.043+0000 7f8570c00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f856c0d0f80 0x7f856c160fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54950/0 (socket says 172.21.15.123:54950) 2024-04-25T13:43:14.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.043+0000 7f8570c00640 1 -- 172.21.15.123:0/3539018578 learned_addr learned my addr 172.21.15.123:0/3539018578 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:14.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.043+0000 7f8571600640 1 --2- 172.21.15.123:0/3539018578 >> v2:172.21.15.123:3300/0 conn(0x7f856c0b5010 0x7f856c0b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:14.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.043+0000 7f8563e00640 1 --2- 172.21.15.123:0/3539018578 >> v2:172.21.15.130:3300/0 conn(0x7f856c0b32f0 0x7f856c0b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:14.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.043+0000 7f856be00640 1 -- 172.21.15.123:0/3539018578 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1957004723 0 0) 0x7f855c001120 con 0x7f856c0d0f80 2024-04-25T13:43:14.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.043+0000 7f856be00640 1 -- 172.21.15.123:0/3539018578 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8550005740 con 0x7f856c0d0f80 2024-04-25T13:43:14.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.043+0000 7f8571600640 1 -- 172.21.15.123:0/3539018578 >> v2:172.21.15.130:3300/0 conn(0x7f856c0b32f0 msgr2=0x7f856c0b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:14.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.043+0000 7f8571600640 1 --2- 172.21.15.123:0/3539018578 >> v2:172.21.15.130:3300/0 conn(0x7f856c0b32f0 0x7f856c0b3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:14.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.043+0000 7f8571600640 1 -- 172.21.15.123:0/3539018578 >> v1:172.21.15.123:6789/0 conn(0x7f856c0d0f80 legacy=0x7f856c160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:14.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.043+0000 7f8571600640 1 -- 172.21.15.123:0/3539018578 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f856c15d520 con 0x7f856c0b5010 2024-04-25T13:43:14.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.043+0000 7f8563e00640 1 --2- 172.21.15.123:0/3539018578 >> v2:172.21.15.130:3300/0 conn(0x7f856c0b32f0 0x7f856c0b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:14.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.047+0000 7f8571600640 1 --2- 172.21.15.123:0/3539018578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f856c0b5010 0x7f856c0b5420 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f856c0b4420 tx=0x7f856401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca469aa099a40d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:14.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.047+0000 7f856be00640 1 -- 172.21.15.123:0/3539018578 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85640b2070 con 0x7f856c0b5010 2024-04-25T13:43:14.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.047+0000 7f856be00640 1 -- 172.21.15.123:0/3539018578 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85640a5850 con 0x7f856c0b5010 2024-04-25T13:43:14.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.047+0000 7f856be00640 1 -- 172.21.15.123:0/3539018578 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85640a5c20 con 0x7f856c0b5010 2024-04-25T13:43:14.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.047+0000 7f8573600640 1 -- 172.21.15.123:0/3539018578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f856c0b5010 msgr2=0x7f856c0b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:14.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.047+0000 7f8573600640 1 --2- 172.21.15.123:0/3539018578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f856c0b5010 0x7f856c0b5420 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f856c0b4420 tx=0x7f856401c870 comp rx=0 tx=0).stop 2024-04-25T13:43:14.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.047+0000 7f8573600640 1 -- 172.21.15.123:0/3539018578 shutdown_connections 2024-04-25T13:43:14.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.047+0000 7f8573600640 1 --2- 172.21.15.123:0/3539018578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f856c0b5010 0x7f856c0b5420 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:14.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.047+0000 7f8573600640 1 --2- 172.21.15.123:0/3539018578 >> v2:172.21.15.130:3300/0 conn(0x7f856c0b32f0 0x7f856c0b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:14.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.047+0000 7f8573600640 1 -- 172.21.15.123:0/3539018578 >> 172.21.15.123:0/3539018578 conn(0x7f856c06d210 msgr2=0x7f856c06ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:14.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.047+0000 7f8573600640 1 -- 172.21.15.123:0/3539018578 shutdown_connections 2024-04-25T13:43:14.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.047+0000 7f8573600640 1 -- 172.21.15.123:0/3539018578 wait complete. 2024-04-25T13:43:14.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.051+0000 7f8573600640 1 Processor -- start 2024-04-25T13:43:14.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.051+0000 7f8573600640 1 -- start start 2024-04-25T13:43:14.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.051+0000 7f8573600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f856c0b32f0 0x7f856c15b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:14.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.051+0000 7f8573600640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f856c0b5010 0x7f856c15c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:14.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.051+0000 7f8573600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f856c0d0f80 0x7f856c0b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:14.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.051+0000 7f8573600640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f856c072ad0 con 0x7f856c0b32f0 2024-04-25T13:43:14.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.051+0000 7f8573600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f856c0b6470 con 0x7f856c0d0f80 2024-04-25T13:43:14.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.051+0000 7f8573600640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f856c072c50 con 0x7f856c0b5010 2024-04-25T13:43:14.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.051+0000 7f8570c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f856c0b32f0 0x7f856c15b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:14.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.051+0000 7f8570c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f856c0b32f0 0x7f856c15b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35242/0 (socket says 172.21.15.123:35242) 2024-04-25T13:43:14.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.051+0000 7f8570c00640 1 -- 172.21.15.123:0/3424508596 learned_addr learned my addr 172.21.15.123:0/3424508596 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:14.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.055+0000 7f8570c00640 1 -- 172.21.15.123:0/3424508596 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f856c0b5010 msgr2=0x7f856c15c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:14.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.055+0000 7f8570c00640 1 --2- 172.21.15.123:0/3424508596 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f856c0b5010 0x7f856c15c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:14.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.055+0000 7f8570c00640 1 -- 172.21.15.123:0/3424508596 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f856c0d0f80 msgr2=0x7f856c0b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:14.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.055+0000 7f8570c00640 1 --2- 172.21.15.123:0/3424508596 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f856c0d0f80 0x7f856c0b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:14.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.055+0000 7f8570c00640 1 -- 172.21.15.123:0/3424508596 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f856c0b1e40 con 0x7f856c0b32f0 2024-04-25T13:43:14.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.055+0000 7f8570c00640 1 --2- 172.21.15.123:0/3424508596 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f856c0b32f0 0x7f856c15b7f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f855c00c420 tx=0x7f855c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:14.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.055+0000 7f8569600640 1 -- 172.21.15.123:0/3424508596 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c017070 con 0x7f856c0b32f0 2024-04-25T13:43:14.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.055+0000 7f8569600640 1 -- 172.21.15.123:0/3424508596 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f855c005cf0 con 0x7f856c0b32f0 2024-04-25T13:43:14.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.055+0000 7f8573600640 1 -- 172.21.15.123:0/3424508596 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f856c0b2120 con 0x7f856c0b32f0 2024-04-25T13:43:14.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.055+0000 7f8569600640 1 -- 172.21.15.123:0/3424508596 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c0072f0 con 0x7f856c0b32f0 2024-04-25T13:43:14.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.055+0000 7f8573600640 1 -- 172.21.15.123:0/3424508596 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f856c0b26e0 con 0x7f856c0b32f0 2024-04-25T13:43:14.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.055+0000 7f8573600640 1 -- 172.21.15.123:0/3424508596 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f856c0507c0 con 0x7f856c0b32f0 2024-04-25T13:43:14.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.055+0000 7f8569600640 1 -- 172.21.15.123:0/3424508596 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f855c01a070 con 0x7f856c0b32f0 2024-04-25T13:43:14.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.059+0000 7f8569600640 1 --2- 172.21.15.123:0/3424508596 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f854806f430 0x7f8548071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:14.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.059+0000 7f8569600640 1 -- 172.21.15.123:0/3424508596 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f855c08e720 con 0x7f856c0b32f0 2024-04-25T13:43:14.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.059+0000 7f8563e00640 1 --2- 172.21.15.123:0/3424508596 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f854806f430 0x7f8548071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:14.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.059+0000 7f8563e00640 1 --2- 172.21.15.123:0/3424508596 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f854806f430 0x7f8548071940 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f856c0b0560 tx=0x7f8554008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:14.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.063+0000 7f8569600640 1 -- 172.21.15.123:0/3424508596 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f856c0b3c40 con 0x7f856c0b32f0 2024-04-25T13:43:14.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.251+0000 7f8573600640 1 -- 172.21.15.123:0/3424508596 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f856c15bea0 con 0x7f856c0b32f0 2024-04-25T13:43:14.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.255+0000 7f8569600640 1 -- 172.21.15.123:0/3424508596 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5187 (secure 0 0 0) 0x7f855c05b570 con 0x7f856c0b32f0 2024-04-25T13:43:14.257 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:14.258 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3582988979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":3582988979},{"type":"v1","addr":"172.21.15.130:6835","nonce":3582988979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4978,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/173287078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":173287078},{"type":"v1","addr":"172.21.15.123:6837","nonce":173287078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4987,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/4025543653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4025543653},{"type":"v1","addr":"172.21.15.130:6834","nonce":4025543653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:43:01.431292+0000","modified":"2024-04-25T13:43:04.442129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6836/499623122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":499623122},{"type":"v1","addr":"172.21.15.123:6836","nonce":499623122}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5046,"qdb_cluster":[5046]},"id":2}]} 2024-04-25T13:43:14.258 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 17 2024-04-25T13:43:14.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.255+0000 7f8573600640 1 -- 172.21.15.123:0/3424508596 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f854806f430 msgr2=0x7f8548071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:14.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.255+0000 7f8573600640 1 --2- 172.21.15.123:0/3424508596 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f854806f430 0x7f8548071940 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f856c0b0560 tx=0x7f8554008040 comp rx=0 tx=0).stop 2024-04-25T13:43:14.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.255+0000 7f8573600640 1 -- 172.21.15.123:0/3424508596 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f856c0b32f0 msgr2=0x7f856c15b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:14.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.255+0000 7f8573600640 1 --2- 172.21.15.123:0/3424508596 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f856c0b32f0 0x7f856c15b7f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f855c00c420 tx=0x7f855c00c8e0 comp rx=0 tx=0).stop 2024-04-25T13:43:14.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.255+0000 7f8573600640 1 -- 172.21.15.123:0/3424508596 shutdown_connections 2024-04-25T13:43:14.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.255+0000 7f8573600640 1 --2- 172.21.15.123:0/3424508596 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f856c0d0f80 0x7f856c0b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:14.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.255+0000 7f8573600640 1 --2- 172.21.15.123:0/3424508596 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f854806f430 0x7f8548071940 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:14.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.255+0000 7f8573600640 1 --2- 172.21.15.123:0/3424508596 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f856c0b5010 0x7f856c15c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:14.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.255+0000 7f8573600640 1 --2- 172.21.15.123:0/3424508596 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f856c0b32f0 0x7f856c15b7f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:14.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.255+0000 7f8573600640 1 -- 172.21.15.123:0/3424508596 >> 172.21.15.123:0/3424508596 conn(0x7f856c06d210 msgr2=0x7f856c074430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:14.260 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.255+0000 7f8573600640 1 -- 172.21.15.123:0/3424508596 shutdown_connections 2024-04-25T13:43:14.261 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.255+0000 7f8573600640 1 -- 172.21.15.123:0/3424508596 wait complete. 2024-04-25T13:43:14.279 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump mds_cache 2024-04-25T13:43:14.444 INFO:teuthology.orchestra.run.smithi123.stdout:{"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0}} 2024-04-25T13:43:14.444 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 } } 2024-04-25T13:43:14.445 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T13:43:14.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.587+0000 7efc7be00640 1 Processor -- start 2024-04-25T13:43:14.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.587+0000 7efc7be00640 1 -- start start 2024-04-25T13:43:14.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.587+0000 7efc7be00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7efc740cfc70 0x7efc74073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:14.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.587+0000 7efc7be00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc740745b0 con 0x7efc740b14a0 2024-04-25T13:43:14.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.587+0000 7efc7be00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc740aede0 con 0x7efc74158400 2024-04-25T13:43:14.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.587+0000 7efc7be00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7efc7409ff00 con 0x7efc740cfc70 2024-04-25T13:43:14.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.587+0000 7efc79e00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7efc740b14a0 0x7efc74167890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54954/0 (socket says 172.21.15.123:54954) 2024-04-25T13:43:14.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.587+0000 7efc79e00640 1 -- 172.21.15.123:0/1546102228 learned_addr learned my addr 172.21.15.123:0/1546102228 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:14.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.587+0000 7efc79400640 1 --2- 172.21.15.123:0/1546102228 >> v2:172.21.15.130:3300/0 conn(0x7efc740cfc70 0x7efc74073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:14.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.587+0000 7efc73e00640 1 -- 172.21.15.123:0/1546102228 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2706588772 0 0) 0x7efc740745b0 con 0x7efc740b14a0 2024-04-25T13:43:14.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.591+0000 7efc73e00640 1 -- 172.21.15.123:0/1546102228 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc5c003530 con 0x7efc740b14a0 2024-04-25T13:43:14.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.591+0000 7efc73e00640 1 -- 172.21.15.123:0/1546102228 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2721064684 0 0) 0x7efc5c003530 con 0x7efc740b14a0 2024-04-25T13:43:14.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.591+0000 7efc73e00640 1 -- 172.21.15.123:0/1546102228 >> v2:172.21.15.130:3300/0 conn(0x7efc740cfc70 msgr2=0x7efc74073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:14.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.591+0000 7efc73e00640 1 --2- 172.21.15.123:0/1546102228 >> v2:172.21.15.130:3300/0 conn(0x7efc740cfc70 0x7efc74073ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:14.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.591+0000 7efc73e00640 1 -- 172.21.15.123:0/1546102228 >> v1:172.21.15.130:6789/0 conn(0x7efc74158400 legacy=0x7efc740b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:14.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.591+0000 7efc73e00640 1 -- 172.21.15.123:0/1546102228 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc740af0c0 con 0x7efc740b14a0 2024-04-25T13:43:14.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.591+0000 7efc73e00640 1 -- 172.21.15.123:0/1546102228 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7efc6c001a00 con 0x7efc740b14a0 2024-04-25T13:43:14.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.591+0000 7efc73e00640 1 -- 172.21.15.123:0/1546102228 >> v1:172.21.15.123:6789/0 conn(0x7efc740b14a0 legacy=0x7efc74167890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:14.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.591+0000 7efc73e00640 1 --2- 172.21.15.123:0/1546102228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc5c003a30 0x7efc5c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:14.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.591+0000 7efc73e00640 1 --2- 172.21.15.123:0/1546102228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc5c004810 0x7efc5c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:14.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.591+0000 7efc73e00640 1 --2- 172.21.15.123:0/1546102228 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efc5c005280 0x7efc5c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:14.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.591+0000 7efc73e00640 1 -- 172.21.15.123:0/1546102228 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efc7409ff00 con 0x7efc5c003a30 2024-04-25T13:43:14.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.591+0000 7efc73e00640 1 -- 172.21.15.123:0/1546102228 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efc5c00c1d0 con 0x7efc5c004810 2024-04-25T13:43:14.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.591+0000 7efc73e00640 1 -- 172.21.15.123:0/1546102228 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7efc5c00c3d0 con 0x7efc5c005280 2024-04-25T13:43:14.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.591+0000 7efc79400640 1 --2- 172.21.15.123:0/1546102228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc5c003a30 0x7efc5c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:14.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.591+0000 7efc79e00640 1 --2- 172.21.15.123:0/1546102228 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efc5c005280 0x7efc5c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:14.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.591+0000 7efc78a00640 1 --2- 172.21.15.123:0/1546102228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc5c004810 0x7efc5c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:14.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.591+0000 7efc79400640 1 -- 172.21.15.123:0/1546102228 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efc5c005280 msgr2=0x7efc5c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:14.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.591+0000 7efc79400640 1 --2- 172.21.15.123:0/1546102228 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efc5c005280 0x7efc5c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:14.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.591+0000 7efc79400640 1 -- 172.21.15.123:0/1546102228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc5c004810 msgr2=0x7efc5c004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:14.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.591+0000 7efc79400640 1 --2- 172.21.15.123:0/1546102228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc5c004810 0x7efc5c004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:14.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.591+0000 7efc79400640 1 -- 172.21.15.123:0/1546102228 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc5c003530 con 0x7efc5c003a30 2024-04-25T13:43:14.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.591+0000 7efc79e00640 1 -- 172.21.15.123:0/1546102228 reap_dead start 2024-04-25T13:43:14.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.591+0000 7efc79400640 1 --2- 172.21.15.123:0/1546102228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc5c003a30 0x7efc5c003e60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7efc740d1d40 tx=0x7efc6801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6461fa372798e1a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:14.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.595+0000 7efc73e00640 1 -- 172.21.15.123:0/1546102228 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc680b2070 con 0x7efc5c003a30 2024-04-25T13:43:14.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.595+0000 7efc73e00640 1 -- 172.21.15.123:0/1546102228 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc680a5600 con 0x7efc5c003a30 2024-04-25T13:43:14.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.595+0000 7efc73e00640 1 -- 172.21.15.123:0/1546102228 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc680096b0 con 0x7efc5c003a30 2024-04-25T13:43:14.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.595+0000 7efc7be00640 1 -- 172.21.15.123:0/1546102228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc5c003a30 msgr2=0x7efc5c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:14.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.595+0000 7efc7be00640 1 --2- 172.21.15.123:0/1546102228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc5c003a30 0x7efc5c003e60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7efc740d1d40 tx=0x7efc6801ca10 comp rx=0 tx=0).stop 2024-04-25T13:43:14.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.595+0000 7efc7be00640 1 -- 172.21.15.123:0/1546102228 shutdown_connections 2024-04-25T13:43:14.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.595+0000 7efc7be00640 1 --2- 172.21.15.123:0/1546102228 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc5c003a30 0x7efc5c003e60 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:14.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.595+0000 7efc7be00640 1 -- 172.21.15.123:0/1546102228 >> 172.21.15.123:0/1546102228 conn(0x7efc740733b0 msgr2=0x7efc740737c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:14.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.595+0000 7efc7be00640 1 -- 172.21.15.123:0/1546102228 shutdown_connections 2024-04-25T13:43:14.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.595+0000 7efc7be00640 1 -- 172.21.15.123:0/1546102228 wait complete. 2024-04-25T13:43:14.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.595+0000 7efc7be00640 1 Processor -- start 2024-04-25T13:43:14.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.595+0000 7efc7be00640 1 -- start start 2024-04-25T13:43:14.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.599+0000 7efc7be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc5c003a30 0x7efc7414b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:14.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.599+0000 7efc7be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc7409f0b0 0x7efc7409f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:14.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.599+0000 7efc7be00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efc740b4e60 0x7efc740b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:14.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.599+0000 7efc7be00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7efc7415ece0 con 0x7efc7409f0b0 2024-04-25T13:43:14.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.599+0000 7efc7be00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efc7415eb60 con 0x7efc5c003a30 2024-04-25T13:43:14.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.599+0000 7efc7be00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7efc7415ee60 con 0x7efc740b4e60 2024-04-25T13:43:14.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.599+0000 7efc78a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc7409f0b0 0x7efc7409f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:14.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.599+0000 7efc78a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc7409f0b0 0x7efc7409f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35260/0 (socket says 172.21.15.123:35260) 2024-04-25T13:43:14.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.599+0000 7efc78a00640 1 -- 172.21.15.123:0/2812384240 learned_addr learned my addr 172.21.15.123:0/2812384240 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:14.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.599+0000 7efc79400640 1 --2- 172.21.15.123:0/2812384240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc5c003a30 0x7efc7414b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:14.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.599+0000 7efc79e00640 1 --2- 172.21.15.123:0/2812384240 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efc740b4e60 0x7efc740b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:14.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.599+0000 7efc78a00640 1 -- 172.21.15.123:0/2812384240 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efc740b4e60 msgr2=0x7efc740b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:14.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.599+0000 7efc78a00640 1 --2- 172.21.15.123:0/2812384240 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efc740b4e60 0x7efc740b5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:14.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.599+0000 7efc78a00640 1 -- 172.21.15.123:0/2812384240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc5c003a30 msgr2=0x7efc7414b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:14.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.599+0000 7efc78a00640 1 --2- 172.21.15.123:0/2812384240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc5c003a30 0x7efc7414b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:14.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.599+0000 7efc78a00640 1 -- 172.21.15.123:0/2812384240 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc740b57b0 con 0x7efc7409f0b0 2024-04-25T13:43:14.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.599+0000 7efc79400640 1 --2- 172.21.15.123:0/2812384240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc5c003a30 0x7efc7414b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:14.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.599+0000 7efc78a00640 1 --2- 172.21.15.123:0/2812384240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc7409f0b0 0x7efc7409f4c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7efc6000e5d0 tx=0x7efc6000ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:14.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.599+0000 7efc71600640 1 -- 172.21.15.123:0/2812384240 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc600053a0 con 0x7efc7409f0b0 2024-04-25T13:43:14.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.599+0000 7efc71600640 1 -- 172.21.15.123:0/2812384240 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc60018070 con 0x7efc7409f0b0 2024-04-25T13:43:14.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.599+0000 7efc71600640 1 -- 172.21.15.123:0/2812384240 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc60003840 con 0x7efc7409f0b0 2024-04-25T13:43:14.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.599+0000 7efc7be00640 1 -- 172.21.15.123:0/2812384240 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc741559e0 con 0x7efc7409f0b0 2024-04-25T13:43:14.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.599+0000 7efc7be00640 1 -- 172.21.15.123:0/2812384240 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc74155fa0 con 0x7efc7409f0b0 2024-04-25T13:43:14.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.599+0000 7efc7be00640 1 -- 172.21.15.123:0/2812384240 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc740507c0 con 0x7efc7409f0b0 2024-04-25T13:43:14.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.603+0000 7efc71600640 1 -- 172.21.15.123:0/2812384240 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7efc600039e0 con 0x7efc7409f0b0 2024-04-25T13:43:14.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.603+0000 7efc71600640 1 --2- 172.21.15.123:0/2812384240 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7efc5406f400 0x7efc54071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:14.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.603+0000 7efc71600640 1 -- 172.21.15.123:0/2812384240 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7efc6008f0f0 con 0x7efc7409f0b0 2024-04-25T13:43:14.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.603+0000 7efc79400640 1 --2- 172.21.15.123:0/2812384240 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7efc5406f400 0x7efc54071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:14.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.603+0000 7efc79400640 1 --2- 172.21.15.123:0/2812384240 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7efc5406f400 0x7efc54071910 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efc680af000 tx=0x7efc68008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:14.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.607+0000 7efc71600640 1 -- 172.21.15.123:0/2812384240 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efc740b57b0 con 0x7efc7409f0b0 2024-04-25T13:43:14.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.795+0000 7efc7be00640 1 -- 172.21.15.123:0/2812384240 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efc74157f50 con 0x7efc7409f0b0 2024-04-25T13:43:14.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.795+0000 7efc71600640 1 -- 172.21.15.123:0/2812384240 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7efc6005bfd0 con 0x7efc7409f0b0 2024-04-25T13:43:14.801 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T13:43:14.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.799+0000 7efc7be00640 1 -- 172.21.15.123:0/2812384240 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7efc5406f400 msgr2=0x7efc54071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:14.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.799+0000 7efc7be00640 1 --2- 172.21.15.123:0/2812384240 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7efc5406f400 0x7efc54071910 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efc680af000 tx=0x7efc68008040 comp rx=0 tx=0).stop 2024-04-25T13:43:14.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.799+0000 7efc7be00640 1 -- 172.21.15.123:0/2812384240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc7409f0b0 msgr2=0x7efc7409f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:14.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.799+0000 7efc7be00640 1 --2- 172.21.15.123:0/2812384240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc7409f0b0 0x7efc7409f4c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7efc6000e5d0 tx=0x7efc6000ea90 comp rx=0 tx=0).stop 2024-04-25T13:43:14.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.799+0000 7efc7be00640 1 -- 172.21.15.123:0/2812384240 shutdown_connections 2024-04-25T13:43:14.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.799+0000 7efc7be00640 1 --2- 172.21.15.123:0/2812384240 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7efc5406f400 0x7efc54071910 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:14.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.799+0000 7efc7be00640 1 --2- 172.21.15.123:0/2812384240 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efc740b4e60 0x7efc740b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:14.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.799+0000 7efc7be00640 1 --2- 172.21.15.123:0/2812384240 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efc7409f0b0 0x7efc7409f4c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:14.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.799+0000 7efc7be00640 1 --2- 172.21.15.123:0/2812384240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efc5c003a30 0x7efc7414b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:14.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.799+0000 7efc7be00640 1 -- 172.21.15.123:0/2812384240 >> 172.21.15.123:0/2812384240 conn(0x7efc740733b0 msgr2=0x7efc7415f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:14.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.799+0000 7efc7be00640 1 -- 172.21.15.123:0/2812384240 shutdown_connections 2024-04-25T13:43:14.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:14.799+0000 7efc7be00640 1 -- 172.21.15.123:0/2812384240 wait complete. 2024-04-25T13:43:14.822 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T13:43:14.822 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T13:43:14.823 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-04-25T13:43:14.823 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T13:43:14.823 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T13:43:14.823 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T13:43:14.823 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T13:43:14.823 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T13:43:14.823 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T13:43:14.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:14.823 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-04-25T13:43:14.833 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T13:43:14.833 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T13:43:14.833 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T13:43:14.833 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:43:14.833 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-04-25T13:43:14.833 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:43:14.833 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T13:43:14.833 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-04-25T13:43:14.833 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-04-25T13:43:14.833 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T13:43:14.833 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-04-25T13:43:14.833 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-04-25T13:43:14.833 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T13:43:14.834 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:43:14.834 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T13:43:14.834 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:43:14.834 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T13:43:14.834 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 42431sec preferred_lft 42431sec 2024-04-25T13:43:14.834 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::ec4:7aff:fe8f:d3f1/64 scope link 2024-04-25T13:43:14.834 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:43:14.834 INFO:teuthology.orchestra.run.smithi123.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T13:43:14.834 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 02:42:49:08:34:c5 brd ff:ff:ff:ff:ff:ff 2024-04-25T13:43:14.834 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T13:43:14.834 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:43:14.834 INFO:teuthology.orchestra.run.smithi123.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T13:43:14.834 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T13:43:14.835 INFO:teuthology.orchestra.run.smithi123.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T13:43:14.835 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:43:14.835 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T13:43:14.835 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:43:14.835 INFO:teuthology.orchestra.run.smithi123.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T13:43:14.835 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:43:14.835 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T13:43:14.835 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:43:14.835 INFO:teuthology.orchestra.run.smithi123.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T13:43:14.836 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T13:43:14.836 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T13:43:14.836 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-04-25T13:43:14.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:14.836 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T13:43:14.894 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-04-25T13:43:14.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:14.896 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-04-25T13:43:14.953 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-04-25T13:43:14.953 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T13:43:14.953 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T13:43:14.953 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T13:43:14.954 INFO:teuthology.orchestra.run.smithi123.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T13:43:14.954 INFO:teuthology.orchestra.run.smithi123.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T13:43:14.954 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T13:43:14.954 INFO:teuthology.orchestra.run.smithi123.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T13:43:14.954 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T13:43:14.954 INFO:teuthology.orchestra.run.smithi123.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T13:43:14.954 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T13:43:14.954 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T13:43:14.954 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-04-25T13:43:14.954 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T13:43:14.955 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T13:43:14.955 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T13:43:14.955 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-04-25T13:43:15.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T13:43:15.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:43:15.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:15.089 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-04-25T13:43:15.140 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T13:43:15.141 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T13:43:15.142 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T13:43:15.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:15.142 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-04-25T13:43:15.204 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:43:15.204 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T13:43:15.252 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T13:43:15.253 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T13:43:15.253 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T13:43:15.304 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T13:43:15.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:15.304 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T13:43:15.403 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T13:43:15.403 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T13:43:15.404 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-04-25T13:43:15.421 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T13:43:15.421 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T13:43:15.421 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-04-25T13:43:15.421 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.130:3300,172.21.15.130:3301" 2024-04-25T13:43:15.421 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T13:43:15.430 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T13:43:15.430 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T13:43:15.430 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-04-25T13:43:15.430 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.130:3300,172.21.15.130:3301" 2024-04-25T13:43:15.431 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T13:43:15.431 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:6789,172.21.15.130:6789,172.21.15.130:6790" 2024-04-25T13:43:15.431 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:6789,172.21.15.130:6789,172.21.15.130:6790:/ 2024-04-25T13:43:15.431 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=95274ccf-6ec8-480a-933e-b3986da91a7e" will pass to kernel 2024-04-25T13:43:15.434 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T13:43:15.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:15.435 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T13:43:15.454 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T13:43:15.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T13:43:15.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T13:43:15.556 INFO:teuthology.orchestra.run.smithi123.stdout:client4982 2024-04-25T13:43:15.556 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:43:15.556 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:43:15.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:15.565 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -rf mydir) 2024-04-25T13:43:15.627 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:43:15.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.815+0000 7f895d400640 1 Processor -- start 2024-04-25T13:43:15.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.815+0000 7f895d400640 1 -- start start 2024-04-25T13:43:15.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.815+0000 7f895d400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89580b3a00 0x7f89580b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:15.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.815+0000 7f895d400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8958074440 con 0x7f895815fef0 2024-04-25T13:43:15.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.815+0000 7f895d400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8958163b60 con 0x7f89580cd850 2024-04-25T13:43:15.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.815+0000 7f895d400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8958163910 con 0x7f89580b3a00 2024-04-25T13:43:15.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.815+0000 7f8956800640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f895815fef0 0x7f89580b32f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54956/0 (socket says 172.21.15.123:54956) 2024-04-25T13:43:15.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.815+0000 7f8956800640 1 -- 172.21.15.123:0/3524953751 learned_addr learned my addr 172.21.15.123:0/3524953751 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:15.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.815+0000 7f8955e00640 1 --2- 172.21.15.123:0/3524953751 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89580b3a00 0x7f89580b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:15.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.815+0000 7f8955400640 1 -- 172.21.15.123:0/3524953751 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3453232585 0 0) 0x7f8958074440 con 0x7f895815fef0 2024-04-25T13:43:15.821 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.815+0000 7f8955400640 1 -- 172.21.15.123:0/3524953751 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f893c003530 con 0x7f895815fef0 2024-04-25T13:43:15.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.819+0000 7f8955400640 1 -- 172.21.15.123:0/3524953751 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1226477184 0 0) 0x7f893c003530 con 0x7f895815fef0 2024-04-25T13:43:15.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.819+0000 7f8955400640 1 -- 172.21.15.123:0/3524953751 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89580b3a00 msgr2=0x7f89580b55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:15.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.819+0000 7f8955400640 1 --2- 172.21.15.123:0/3524953751 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89580b3a00 0x7f89580b55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:15.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.819+0000 7f8955400640 1 -- 172.21.15.123:0/3524953751 >> v1:172.21.15.130:6789/0 conn(0x7f89580cd850 legacy=0x7f89580b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:15.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.819+0000 7f8955400640 1 -- 172.21.15.123:0/3524953751 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8958163e40 con 0x7f895815fef0 2024-04-25T13:43:15.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.819+0000 7f8955400640 1 -- 172.21.15.123:0/3524953751 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7f8948001680 con 0x7f895815fef0 2024-04-25T13:43:15.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.819+0000 7f8955e00640 1 --2- 172.21.15.123:0/3524953751 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89580b3a00 0x7f89580b55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:43:15.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.819+0000 7f8955400640 1 -- 172.21.15.123:0/3524953751 >> v1:172.21.15.123:6789/0 conn(0x7f895815fef0 legacy=0x7f89580b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:15.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.819+0000 7f8955400640 1 --2- 172.21.15.123:0/3524953751 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f893c003a60 0x7f893c003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:15.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.819+0000 7f8955400640 1 --2- 172.21.15.123:0/3524953751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f893c004810 0x7f893c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:15.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.819+0000 7f8955400640 1 --2- 172.21.15.123:0/3524953751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f893c0051d0 0x7f893c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:15.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.819+0000 7f8955400640 1 -- 172.21.15.123:0/3524953751 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8958163910 con 0x7f893c0051d0 2024-04-25T13:43:15.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.819+0000 7f8955400640 1 -- 172.21.15.123:0/3524953751 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f893c00c150 con 0x7f893c004810 2024-04-25T13:43:15.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.819+0000 7f8955400640 1 -- 172.21.15.123:0/3524953751 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f893c00c350 con 0x7f893c003a60 2024-04-25T13:43:15.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.819+0000 7f8957200640 1 --2- 172.21.15.123:0/3524953751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f893c0051d0 0x7f893c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:15.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.819+0000 7f8956800640 1 --2- 172.21.15.123:0/3524953751 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f893c003a60 0x7f893c003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:15.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.819+0000 7f8955e00640 1 --2- 172.21.15.123:0/3524953751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f893c004810 0x7f893c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:15.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.819+0000 7f8957200640 1 -- 172.21.15.123:0/3524953751 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f893c003a60 msgr2=0x7f893c003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:15.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.819+0000 7f8957200640 1 --2- 172.21.15.123:0/3524953751 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f893c003a60 0x7f893c003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:15.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.819+0000 7f8957200640 1 -- 172.21.15.123:0/3524953751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f893c004810 msgr2=0x7f893c004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:15.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.819+0000 7f8957200640 1 --2- 172.21.15.123:0/3524953751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f893c004810 0x7f893c004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:15.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.819+0000 7f8957200640 1 -- 172.21.15.123:0/3524953751 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f893c003530 con 0x7f893c0051d0 2024-04-25T13:43:15.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.819+0000 7f8957200640 1 --2- 172.21.15.123:0/3524953751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f893c0051d0 0x7f893c00b9d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8958073ed0 tx=0x7f895001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538fd089bf4a4234 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:15.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.823+0000 7f8955400640 1 -- 172.21.15.123:0/3524953751 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8950001c10 con 0x7f893c0051d0 2024-04-25T13:43:15.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.823+0000 7f8955400640 1 -- 172.21.15.123:0/3524953751 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89500a96a0 con 0x7f893c0051d0 2024-04-25T13:43:15.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.823+0000 7f8955400640 1 -- 172.21.15.123:0/3524953751 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89500a9a90 con 0x7f893c0051d0 2024-04-25T13:43:15.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.823+0000 7f895d400640 1 -- 172.21.15.123:0/3524953751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f893c0051d0 msgr2=0x7f893c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:15.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.823+0000 7f895d400640 1 --2- 172.21.15.123:0/3524953751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f893c0051d0 0x7f893c00b9d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8958073ed0 tx=0x7f895001c8a0 comp rx=0 tx=0).stop 2024-04-25T13:43:15.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.823+0000 7f8957200640 1 -- 172.21.15.123:0/3524953751 reap_dead start 2024-04-25T13:43:15.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.823+0000 7f895d400640 1 -- 172.21.15.123:0/3524953751 shutdown_connections 2024-04-25T13:43:15.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.823+0000 7f895d400640 1 -- 172.21.15.123:0/3524953751 >> 172.21.15.123:0/3524953751 conn(0x7f895806d210 msgr2=0x7f895806ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:15.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.823+0000 7f895d400640 1 -- 172.21.15.123:0/3524953751 shutdown_connections 2024-04-25T13:43:15.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.823+0000 7f895d400640 1 -- 172.21.15.123:0/3524953751 wait complete. 2024-04-25T13:43:15.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.823+0000 7f895d400640 1 Processor -- start 2024-04-25T13:43:15.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.823+0000 7f895d400640 1 -- start start 2024-04-25T13:43:15.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.827+0000 7f895d400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f893c0051d0 0x7f8958160390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:15.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.827+0000 7f895d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89580b1a90 0x7f89580b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:15.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.827+0000 7f895d400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89581f90d0 0x7f89581f94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:15.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.827+0000 7f895d400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f89580b65a0 con 0x7f89581f90d0 2024-04-25T13:43:15.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.827+0000 7f895d400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f89580b6420 con 0x7f89580b1a90 2024-04-25T13:43:15.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.827+0000 7f895d400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8958164850 con 0x7f893c0051d0 2024-04-25T13:43:15.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.827+0000 7f8957200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89581f90d0 0x7f89581f94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:15.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.827+0000 7f8957200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89581f90d0 0x7f89581f94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35286/0 (socket says 172.21.15.123:35286) 2024-04-25T13:43:15.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.827+0000 7f8957200640 1 -- 172.21.15.123:0/3082256193 learned_addr learned my addr 172.21.15.123:0/3082256193 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:15.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.827+0000 7f8956800640 1 --2- 172.21.15.123:0/3082256193 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f893c0051d0 0x7f8958160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:15.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.827+0000 7f8955e00640 1 --2- 172.21.15.123:0/3082256193 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89580b1a90 0x7f89580b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:15.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.827+0000 7f8957200640 1 -- 172.21.15.123:0/3082256193 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f893c0051d0 msgr2=0x7f8958160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:15.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.827+0000 7f8957200640 1 --2- 172.21.15.123:0/3082256193 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f893c0051d0 0x7f8958160390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:15.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.827+0000 7f8957200640 1 -- 172.21.15.123:0/3082256193 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89580b1a90 msgr2=0x7f89580b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:15.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.827+0000 7f8957200640 1 --2- 172.21.15.123:0/3082256193 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89580b1a90 0x7f89580b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:15.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.827+0000 7f8957200640 1 -- 172.21.15.123:0/3082256193 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f895815c640 con 0x7f89581f90d0 2024-04-25T13:43:15.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.827+0000 7f8957200640 1 --2- 172.21.15.123:0/3082256193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89581f90d0 0x7f89581f94e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f895001cd80 tx=0x7f893c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:15.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.827+0000 7f894ea00640 1 -- 172.21.15.123:0/3082256193 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8950001bf0 con 0x7f89581f90d0 2024-04-25T13:43:15.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.827+0000 7f894ea00640 1 -- 172.21.15.123:0/3082256193 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89500a9850 con 0x7f89581f90d0 2024-04-25T13:43:15.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.827+0000 7f895d400640 1 -- 172.21.15.123:0/3082256193 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f895815c920 con 0x7f89581f90d0 2024-04-25T13:43:15.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.827+0000 7f894ea00640 1 -- 172.21.15.123:0/3082256193 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8950006b60 con 0x7f89581f90d0 2024-04-25T13:43:15.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.827+0000 7f895d400640 1 -- 172.21.15.123:0/3082256193 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f895815cee0 con 0x7f89581f90d0 2024-04-25T13:43:15.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.827+0000 7f895d400640 1 -- 172.21.15.123:0/3082256193 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89580507c0 con 0x7f89581f90d0 2024-04-25T13:43:15.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.831+0000 7f894ea00640 1 -- 172.21.15.123:0/3082256193 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f89500b9030 con 0x7f89581f90d0 2024-04-25T13:43:15.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.831+0000 7f894ea00640 1 --2- 172.21.15.123:0/3082256193 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f893806f400 0x7f8938071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:15.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.831+0000 7f894ea00640 1 -- 172.21.15.123:0/3082256193 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8950128e50 con 0x7f89581f90d0 2024-04-25T13:43:15.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.831+0000 7f8956800640 1 --2- 172.21.15.123:0/3082256193 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f893806f400 0x7f8938071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:15.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.831+0000 7f8956800640 1 --2- 172.21.15.123:0/3082256193 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f893806f400 0x7f8938071910 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f89480010f0 tx=0x7f8948001e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:15.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:15.835+0000 7f894ea00640 1 -- 172.21.15.123:0/3082256193 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f89500ad020 con 0x7f89581f90d0 2024-04-25T13:43:16.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.023+0000 7f895d400640 1 -- 172.21.15.123:0/3082256193 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89581657a0 con 0x7f89581f90d0 2024-04-25T13:43:16.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.023+0000 7f894ea00640 1 -- 172.21.15.123:0/3082256193 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5187 (secure 0 0 0) 0x7f89500165b0 con 0x7f89581f90d0 2024-04-25T13:43:16.028 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:16.028 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3582988979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":3582988979},{"type":"v1","addr":"172.21.15.130:6835","nonce":3582988979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4978,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/173287078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":173287078},{"type":"v1","addr":"172.21.15.123:6837","nonce":173287078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4987,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/4025543653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4025543653},{"type":"v1","addr":"172.21.15.130:6834","nonce":4025543653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:43:01.431292+0000","modified":"2024-04-25T13:43:04.442129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6836/499623122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":499623122},{"type":"v1","addr":"172.21.15.123:6836","nonce":499623122}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5046,"qdb_cluster":[5046]},"id":2}]} 2024-04-25T13:43:16.028 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 17 2024-04-25T13:43:16.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.027+0000 7f895d400640 1 -- 172.21.15.123:0/3082256193 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f893806f400 msgr2=0x7f8938071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:16.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.027+0000 7f895d400640 1 --2- 172.21.15.123:0/3082256193 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f893806f400 0x7f8938071910 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f89480010f0 tx=0x7f8948001e30 comp rx=0 tx=0).stop 2024-04-25T13:43:16.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.027+0000 7f895d400640 1 -- 172.21.15.123:0/3082256193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89581f90d0 msgr2=0x7f89581f94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:16.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.027+0000 7f895d400640 1 --2- 172.21.15.123:0/3082256193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89581f90d0 0x7f89581f94e0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f895001cd80 tx=0x7f893c005840 comp rx=0 tx=0).stop 2024-04-25T13:43:16.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.027+0000 7f895d400640 1 -- 172.21.15.123:0/3082256193 shutdown_connections 2024-04-25T13:43:16.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.027+0000 7f895d400640 1 --2- 172.21.15.123:0/3082256193 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89580b1a90 0x7f89580b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:16.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.027+0000 7f895d400640 1 --2- 172.21.15.123:0/3082256193 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f893806f400 0x7f8938071910 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:16.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.027+0000 7f895d400640 1 --2- 172.21.15.123:0/3082256193 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f89581f90d0 0x7f89581f94e0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:16.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.027+0000 7f895d400640 1 --2- 172.21.15.123:0/3082256193 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f893c0051d0 0x7f8958160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:16.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.027+0000 7f895d400640 1 -- 172.21.15.123:0/3082256193 >> 172.21.15.123:0/3082256193 conn(0x7f895806d210 msgr2=0x7f8958165090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:16.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.027+0000 7f895d400640 1 -- 172.21.15.123:0/3082256193 shutdown_connections 2024-04-25T13:43:16.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.027+0000 7f895d400640 1 -- 172.21.15.123:0/3082256193 wait complete. 2024-04-25T13:43:16.049 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-25T13:43:16.229 INFO:teuthology.orchestra.run.smithi123.stdout:{"message":"","return_code":0} 2024-04-25T13:43:16.230 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T13:43:16.230 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:43:16.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.371+0000 7f8ec8400640 1 Processor -- start 2024-04-25T13:43:16.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.371+0000 7f8ec8400640 1 -- start start 2024-04-25T13:43:16.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ec8400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ec01604b0 0x7f8ec00b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:16.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ec8400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ec0145d70 con 0x7f8ec00747a0 2024-04-25T13:43:16.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ec8400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ec0073c80 con 0x7f8ec00b4ba0 2024-04-25T13:43:16.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ec8400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8ec0074290 con 0x7f8ec01604b0 2024-04-25T13:43:16.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ec5a00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8ec00747a0 0x7f8ec015fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:54962/0 (socket says 172.21.15.123:54962) 2024-04-25T13:43:16.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ec5a00640 1 -- 172.21.15.123:0/3041059486 learned_addr learned my addr 172.21.15.123:0/3041059486 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:16.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ec5000640 1 --2- 172.21.15.123:0/3041059486 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ec01604b0 0x7f8ec00b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:16.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ebfe00640 1 -- 172.21.15.123:0/3041059486 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2999931384 0 0) 0x7f8eb40014a0 con 0x7f8ec00747a0 2024-04-25T13:43:16.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ebfe00640 1 -- 172.21.15.123:0/3041059486 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ea8003530 con 0x7f8ec00747a0 2024-04-25T13:43:16.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ebfe00640 1 -- 172.21.15.123:0/3041059486 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1472216239 0 0) 0x7f8ea8003530 con 0x7f8ec00747a0 2024-04-25T13:43:16.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ebfe00640 1 -- 172.21.15.123:0/3041059486 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ec01604b0 msgr2=0x7f8ec00b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:16.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ebfe00640 1 --2- 172.21.15.123:0/3041059486 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ec01604b0 0x7f8ec00b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:16.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ebfe00640 1 -- 172.21.15.123:0/3041059486 >> v1:172.21.15.130:6789/0 conn(0x7f8ec00b4ba0 legacy=0x7f8ec00b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:16.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ebfe00640 1 -- 172.21.15.123:0/3041059486 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec00ce030 con 0x7f8ec00747a0 2024-04-25T13:43:16.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ebfe00640 1 -- 172.21.15.123:0/3041059486 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7f8eb4001bd0 con 0x7f8ec00747a0 2024-04-25T13:43:16.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ebfe00640 1 -- 172.21.15.123:0/3041059486 >> v1:172.21.15.123:6789/0 conn(0x7f8ec00747a0 legacy=0x7f8ec015fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:16.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ebfe00640 1 --2- 172.21.15.123:0/3041059486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ea8003a60 0x7f8ea8003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:16.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ebfe00640 1 --2- 172.21.15.123:0/3041059486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ea8004810 0x7f8ea8004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:16.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ebfe00640 1 --2- 172.21.15.123:0/3041059486 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ea80051b0 0x7f8ea800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:16.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ebfe00640 1 -- 172.21.15.123:0/3041059486 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec0074290 con 0x7f8ea8003a60 2024-04-25T13:43:16.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ebfe00640 1 -- 172.21.15.123:0/3041059486 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea800bf10 con 0x7f8ea8004810 2024-04-25T13:43:16.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ebfe00640 1 -- 172.21.15.123:0/3041059486 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8ea800c110 con 0x7f8ea80051b0 2024-04-25T13:43:16.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ec5a00640 1 --2- 172.21.15.123:0/3041059486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ea8003a60 0x7f8ea8003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:16.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ec5000640 1 --2- 172.21.15.123:0/3041059486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ea8004810 0x7f8ea8004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:16.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ec6400640 1 --2- 172.21.15.123:0/3041059486 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ea80051b0 0x7f8ea800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:16.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ec5a00640 1 -- 172.21.15.123:0/3041059486 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ea80051b0 msgr2=0x7f8ea800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:16.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ec5a00640 1 --2- 172.21.15.123:0/3041059486 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ea80051b0 0x7f8ea800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:16.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ec5a00640 1 -- 172.21.15.123:0/3041059486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ea8004810 msgr2=0x7f8ea8004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:16.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ec5a00640 1 --2- 172.21.15.123:0/3041059486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ea8004810 0x7f8ea8004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:16.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ec5a00640 1 -- 172.21.15.123:0/3041059486 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea8003530 con 0x7f8ea8003a60 2024-04-25T13:43:16.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.375+0000 7f8ec5000640 1 --2- 172.21.15.123:0/3041059486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ea8004810 0x7f8ea8004c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:16.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.379+0000 7f8ec5a00640 1 --2- 172.21.15.123:0/3041059486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ea8003a60 0x7f8ea8003eb0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8eb400aa40 tx=0x7f8eb401d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d458528d13c96e0f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:16.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.379+0000 7f8ebfe00640 1 -- 172.21.15.123:0/3041059486 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb400a690 con 0x7f8ea8003a60 2024-04-25T13:43:16.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.379+0000 7f8ebfe00640 1 -- 172.21.15.123:0/3041059486 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eb40072d0 con 0x7f8ea8003a60 2024-04-25T13:43:16.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.379+0000 7f8ebfe00640 1 -- 172.21.15.123:0/3041059486 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb40076c0 con 0x7f8ea8003a60 2024-04-25T13:43:16.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.379+0000 7f8ec8400640 1 -- 172.21.15.123:0/3041059486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ea8003a60 msgr2=0x7f8ea8003eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:16.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.379+0000 7f8ec8400640 1 --2- 172.21.15.123:0/3041059486 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ea8003a60 0x7f8ea8003eb0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f8eb400aa40 tx=0x7f8eb401d380 comp rx=0 tx=0).stop 2024-04-25T13:43:16.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.379+0000 7f8ec6400640 1 -- 172.21.15.123:0/3041059486 reap_dead start 2024-04-25T13:43:16.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.379+0000 7f8ec8400640 1 -- 172.21.15.123:0/3041059486 shutdown_connections 2024-04-25T13:43:16.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.379+0000 7f8ec8400640 1 -- 172.21.15.123:0/3041059486 >> 172.21.15.123:0/3041059486 conn(0x7f8ec006d210 msgr2=0x7f8ec006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:16.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.379+0000 7f8ec8400640 1 -- 172.21.15.123:0/3041059486 shutdown_connections 2024-04-25T13:43:16.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.379+0000 7f8ec8400640 1 -- 172.21.15.123:0/3041059486 wait complete. 2024-04-25T13:43:16.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.383+0000 7f8ec8400640 1 Processor -- start 2024-04-25T13:43:16.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.383+0000 7f8ec8400640 1 -- start start 2024-04-25T13:43:16.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.383+0000 7f8ec8400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ea8003a60 0x7f8ec015bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:16.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.383+0000 7f8ec8400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ec0143700 0x7f8ec0143b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:16.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.383+0000 7f8ec8400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ec0144050 0x7f8ec01e9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:16.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.383+0000 7f8ec8400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec00b6500 con 0x7f8ec0143700 2024-04-25T13:43:16.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.383+0000 7f8ec8400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec00b6380 con 0x7f8ec0144050 2024-04-25T13:43:16.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.383+0000 7f8ec8400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8ec01604b0 con 0x7f8ea8003a60 2024-04-25T13:43:16.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.383+0000 7f8ec5000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ec0143700 0x7f8ec0143b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:16.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.383+0000 7f8ec5000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ec0143700 0x7f8ec0143b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35306/0 (socket says 172.21.15.123:35306) 2024-04-25T13:43:16.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.383+0000 7f8ec5000640 1 -- 172.21.15.123:0/332468331 learned_addr learned my addr 172.21.15.123:0/332468331 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:16.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.383+0000 7f8ec6400640 1 --2- 172.21.15.123:0/332468331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ec0144050 0x7f8ec01e9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:16.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.383+0000 7f8ec5a00640 1 --2- 172.21.15.123:0/332468331 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ea8003a60 0x7f8ec015bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:16.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.383+0000 7f8ec5000640 1 -- 172.21.15.123:0/332468331 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ea8003a60 msgr2=0x7f8ec015bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:16.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.383+0000 7f8ec5000640 1 --2- 172.21.15.123:0/332468331 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ea8003a60 0x7f8ec015bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:16.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.383+0000 7f8ec5000640 1 -- 172.21.15.123:0/332468331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ec0144050 msgr2=0x7f8ec01e9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:16.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.383+0000 7f8ec5000640 1 --2- 172.21.15.123:0/332468331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ec0144050 0x7f8ec01e9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:16.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.383+0000 7f8ec5000640 1 -- 172.21.15.123:0/332468331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec01ef110 con 0x7f8ec0143700 2024-04-25T13:43:16.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.383+0000 7f8ec5000640 1 --2- 172.21.15.123:0/332468331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ec0143700 0x7f8ec0143b10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8eac0109c0 tx=0x7f8eac010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:16.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.383+0000 7f8ebd600640 1 -- 172.21.15.123:0/332468331 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac00b040 con 0x7f8ec0143700 2024-04-25T13:43:16.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.383+0000 7f8ebd600640 1 -- 172.21.15.123:0/332468331 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eac00ec40 con 0x7f8ec0143700 2024-04-25T13:43:16.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.383+0000 7f8ec8400640 1 -- 172.21.15.123:0/332468331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ec01eaf70 con 0x7f8ec0143700 2024-04-25T13:43:16.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.383+0000 7f8ebd600640 1 -- 172.21.15.123:0/332468331 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac004020 con 0x7f8ec0143700 2024-04-25T13:43:16.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.383+0000 7f8ec8400640 1 -- 172.21.15.123:0/332468331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ec0144780 con 0x7f8ec0143700 2024-04-25T13:43:16.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.387+0000 7f8ec8400640 1 -- 172.21.15.123:0/332468331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ec00507c0 con 0x7f8ec0143700 2024-04-25T13:43:16.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.387+0000 7f8ebd600640 1 -- 172.21.15.123:0/332468331 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8eac0041c0 con 0x7f8ec0143700 2024-04-25T13:43:16.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.387+0000 7f8ebd600640 1 --2- 172.21.15.123:0/332468331 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8ea006f400 0x7f8ea0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:16.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.387+0000 7f8ebd600640 1 -- 172.21.15.123:0/332468331 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8eac08fab0 con 0x7f8ec0143700 2024-04-25T13:43:16.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.387+0000 7f8ec5a00640 1 --2- 172.21.15.123:0/332468331 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8ea006f400 0x7f8ea0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:16.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.387+0000 7f8ec5a00640 1 --2- 172.21.15.123:0/332468331 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8ea006f400 0x7f8ea0071910 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8004790 tx=0x7f8eb4009050 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:16.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.391+0000 7f8ebd600640 1 -- 172.21.15.123:0/332468331 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8eac05c990 con 0x7f8ec0143700 2024-04-25T13:43:16.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.579+0000 7f8ec8400640 1 -- 172.21.15.123:0/332468331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ec00b6780 con 0x7f8ec0143700 2024-04-25T13:43:16.583 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.579+0000 7f8ebd600640 1 -- 172.21.15.123:0/332468331 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5187 (secure 0 0 0) 0x7f8eac05c290 con 0x7f8ec0143700 2024-04-25T13:43:16.584 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:16.584 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3582988979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":3582988979},{"type":"v1","addr":"172.21.15.130:6835","nonce":3582988979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4978,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/173287078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":173287078},{"type":"v1","addr":"172.21.15.123:6837","nonce":173287078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4987,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/4025543653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4025543653},{"type":"v1","addr":"172.21.15.130:6834","nonce":4025543653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:43:01.431292+0000","modified":"2024-04-25T13:43:04.442129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6836/499623122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":499623122},{"type":"v1","addr":"172.21.15.123:6836","nonce":499623122}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5046,"qdb_cluster":[5046]},"id":2}]} 2024-04-25T13:43:16.584 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 17 2024-04-25T13:43:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.583+0000 7f8ec8400640 1 -- 172.21.15.123:0/332468331 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8ea006f400 msgr2=0x7f8ea0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.583+0000 7f8ec8400640 1 --2- 172.21.15.123:0/332468331 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8ea006f400 0x7f8ea0071910 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8004790 tx=0x7f8eb4009050 comp rx=0 tx=0).stop 2024-04-25T13:43:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.583+0000 7f8ec8400640 1 -- 172.21.15.123:0/332468331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ec0143700 msgr2=0x7f8ec0143b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.583+0000 7f8ec8400640 1 --2- 172.21.15.123:0/332468331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ec0143700 0x7f8ec0143b10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8eac0109c0 tx=0x7f8eac010e80 comp rx=0 tx=0).stop 2024-04-25T13:43:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.583+0000 7f8ec8400640 1 -- 172.21.15.123:0/332468331 shutdown_connections 2024-04-25T13:43:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.583+0000 7f8ec8400640 1 --2- 172.21.15.123:0/332468331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ec0144050 0x7f8ec01e9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.583+0000 7f8ec8400640 1 --2- 172.21.15.123:0/332468331 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8ea006f400 0x7f8ea0071910 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.583+0000 7f8ec8400640 1 --2- 172.21.15.123:0/332468331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ec0143700 0x7f8ec0143b10 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.583+0000 7f8ec8400640 1 --2- 172.21.15.123:0/332468331 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ea8003a60 0x7f8ec015bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:16.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.583+0000 7f8ec8400640 1 -- 172.21.15.123:0/332468331 >> 172.21.15.123:0/332468331 conn(0x7f8ec006d210 msgr2=0x7f8ec006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:16.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.583+0000 7f8ec8400640 1 -- 172.21.15.123:0/332468331 shutdown_connections 2024-04-25T13:43:16.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:16.583+0000 7f8ec8400640 1 -- 172.21.15.123:0/332468331 wait complete. 2024-04-25T13:43:16.606 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump mds_cache 2024-04-25T13:43:16.773 INFO:teuthology.orchestra.run.smithi123.stdout:{"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":2,"num_strays_delayed":2,"num_strays_enqueuing":0,"strays_created":2,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0}} 2024-04-25T13:43:16.773 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 2, "num_strays_delayed": 2, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 2, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 } } 2024-04-25T13:43:16.773 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-04-25T13:43:21.774 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:43:21.931 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.927+0000 7faa42800640 1 Processor -- start 2024-04-25T13:43:21.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.927+0000 7faa42800640 1 -- start start 2024-04-25T13:43:21.933 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.931+0000 7faa42800640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7faa3c0b32f0 0x7faa3c0b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:21.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.931+0000 7faa42800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faa3c0b5010 0x7faa3c0b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:21.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.931+0000 7faa42800640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa3c0b3c40 con 0x7faa3c0d0f80 2024-04-25T13:43:21.934 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.931+0000 7faa42800640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7faa3c15cfe0 con 0x7faa3c0b32f0 2024-04-25T13:43:21.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.931+0000 7faa42800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7faa3c15d240 con 0x7faa3c0b5010 2024-04-25T13:43:21.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.931+0000 7faa32a00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7faa3c0b32f0 0x7faa3c0b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:21.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.931+0000 7faa3be00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faa3c0b5010 0x7faa3c0b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:21.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.931+0000 7faa32a00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7faa3c0b32f0 0x7faa3c0b3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:41906/0 (socket says 172.21.15.123:41906) 2024-04-25T13:43:21.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.931+0000 7faa32a00640 1 -- 172.21.15.123:0/87598228 learned_addr learned my addr 172.21.15.123:0/87598228 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:21.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.931+0000 7faa3be00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faa3c0b5010 0x7faa3c0b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:37390/0 (socket says 172.21.15.123:37390) 2024-04-25T13:43:21.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.931+0000 7faa3be00640 1 -- 172.21.15.123:0/87598228 >> v2:172.21.15.130:3300/0 conn(0x7faa3c0b32f0 msgr2=0x7faa3c0b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:21.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.931+0000 7faa3be00640 1 --2- 172.21.15.123:0/87598228 >> v2:172.21.15.130:3300/0 conn(0x7faa3c0b32f0 0x7faa3c0b3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:21.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.931+0000 7faa3be00640 1 -- 172.21.15.123:0/87598228 >> v1:172.21.15.130:6789/0 conn(0x7faa3c0d0f80 legacy=0x7faa3c160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:21.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.931+0000 7faa3be00640 1 -- 172.21.15.123:0/87598228 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa3c15d520 con 0x7faa3c0b5010 2024-04-25T13:43:21.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.931+0000 7faa32a00640 1 --2- 172.21.15.123:0/87598228 >> v2:172.21.15.130:3300/0 conn(0x7faa3c0b32f0 0x7faa3c0b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:43:21.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.935+0000 7faa3be00640 1 --2- 172.21.15.123:0/87598228 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faa3c0b5010 0x7faa3c0b5420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faa340097c0 tx=0x7faa3401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e127707a440e768 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:21.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.935+0000 7faa3aa00640 1 -- 172.21.15.123:0/87598228 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa340b0070 con 0x7faa3c0b5010 2024-04-25T13:43:21.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.935+0000 7faa3aa00640 1 -- 172.21.15.123:0/87598228 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa340ab600 con 0x7faa3c0b5010 2024-04-25T13:43:21.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.935+0000 7faa3aa00640 1 -- 172.21.15.123:0/87598228 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa340ab9d0 con 0x7faa3c0b5010 2024-04-25T13:43:21.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.935+0000 7faa42800640 1 -- 172.21.15.123:0/87598228 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faa3c0b5010 msgr2=0x7faa3c0b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:21.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.935+0000 7faa42800640 1 --2- 172.21.15.123:0/87598228 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faa3c0b5010 0x7faa3c0b5420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faa340097c0 tx=0x7faa3401c3e0 comp rx=0 tx=0).stop 2024-04-25T13:43:21.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.935+0000 7faa42800640 1 -- 172.21.15.123:0/87598228 shutdown_connections 2024-04-25T13:43:21.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.935+0000 7faa42800640 1 --2- 172.21.15.123:0/87598228 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faa3c0b5010 0x7faa3c0b5420 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:21.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.935+0000 7faa42800640 1 --2- 172.21.15.123:0/87598228 >> v2:172.21.15.130:3300/0 conn(0x7faa3c0b32f0 0x7faa3c0b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:21.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.935+0000 7faa42800640 1 -- 172.21.15.123:0/87598228 >> 172.21.15.123:0/87598228 conn(0x7faa3c06d210 msgr2=0x7faa3c06ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:21.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.935+0000 7faa42800640 1 -- 172.21.15.123:0/87598228 shutdown_connections 2024-04-25T13:43:21.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.935+0000 7faa42800640 1 -- 172.21.15.123:0/87598228 wait complete. 2024-04-25T13:43:21.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.939+0000 7faa42800640 1 Processor -- start 2024-04-25T13:43:21.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.939+0000 7faa42800640 1 -- start start 2024-04-25T13:43:21.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.939+0000 7faa42800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa3c0b32f0 0x7faa3c146110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:21.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.939+0000 7faa42800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faa3c0b5010 0x7faa3c0cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:21.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.939+0000 7faa42800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa3c0d0f80 0x7faa3c0cfce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:21.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.939+0000 7faa42800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c1697b0 con 0x7faa3c0d0f80 2024-04-25T13:43:21.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.939+0000 7faa42800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faa3c0b6470 con 0x7faa3c0b32f0 2024-04-25T13:43:21.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.939+0000 7faa42800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7faa3c169930 con 0x7faa3c0b5010 2024-04-25T13:43:21.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.939+0000 7faa3be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa3c0d0f80 0x7faa3c0cfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:21.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.939+0000 7faa3be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa3c0d0f80 0x7faa3c0cfce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40816/0 (socket says 172.21.15.123:40816) 2024-04-25T13:43:21.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.939+0000 7faa3be00640 1 -- 172.21.15.123:0/3775323607 learned_addr learned my addr 172.21.15.123:0/3775323607 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:21.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.939+0000 7faa3b400640 1 --2- 172.21.15.123:0/3775323607 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa3c0b32f0 0x7faa3c146110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:21.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.939+0000 7faa32a00640 1 --2- 172.21.15.123:0/3775323607 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faa3c0b5010 0x7faa3c0cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:21.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.939+0000 7faa3be00640 1 -- 172.21.15.123:0/3775323607 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faa3c0b5010 msgr2=0x7faa3c0cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:21.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.939+0000 7faa3be00640 1 --2- 172.21.15.123:0/3775323607 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faa3c0b5010 0x7faa3c0cf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:21.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.939+0000 7faa3be00640 1 -- 172.21.15.123:0/3775323607 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa3c0b32f0 msgr2=0x7faa3c146110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:21.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.939+0000 7faa3be00640 1 --2- 172.21.15.123:0/3775323607 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa3c0b32f0 0x7faa3c146110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:21.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.939+0000 7faa3be00640 1 -- 172.21.15.123:0/3775323607 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa3c159810 con 0x7faa3c0d0f80 2024-04-25T13:43:21.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.939+0000 7faa3be00640 1 --2- 172.21.15.123:0/3775323607 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa3c0d0f80 0x7faa3c0cfce0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7faa340ae040 tx=0x7faa34019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:21.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.939+0000 7faa33e00640 1 -- 172.21.15.123:0/3775323607 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa340b0040 con 0x7faa3c0d0f80 2024-04-25T13:43:21.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.939+0000 7faa33e00640 1 -- 172.21.15.123:0/3775323607 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa340b9070 con 0x7faa3c0d0f80 2024-04-25T13:43:21.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.939+0000 7faa42800640 1 -- 172.21.15.123:0/3775323607 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa3c159af0 con 0x7faa3c0d0f80 2024-04-25T13:43:21.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.939+0000 7faa33e00640 1 -- 172.21.15.123:0/3775323607 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa340b4650 con 0x7faa3c0d0f80 2024-04-25T13:43:21.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.939+0000 7faa42800640 1 -- 172.21.15.123:0/3775323607 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa3c146650 con 0x7faa3c0d0f80 2024-04-25T13:43:21.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.943+0000 7faa42800640 1 -- 172.21.15.123:0/3775323607 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa3c0507c0 con 0x7faa3c0d0f80 2024-04-25T13:43:21.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.943+0000 7faa33e00640 1 -- 172.21.15.123:0/3775323607 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7faa340b47f0 con 0x7faa3c0d0f80 2024-04-25T13:43:21.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.943+0000 7faa33e00640 1 --2- 172.21.15.123:0/3775323607 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7faa1806f430 0x7faa18071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:21.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.943+0000 7faa33e00640 1 -- 172.21.15.123:0/3775323607 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7faa34128da0 con 0x7faa3c0d0f80 2024-04-25T13:43:21.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.943+0000 7faa3b400640 1 --2- 172.21.15.123:0/3775323607 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7faa1806f430 0x7faa18071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:21.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.943+0000 7faa3b400640 1 --2- 172.21.15.123:0/3775323607 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7faa1806f430 0x7faa18071940 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faa3c070fa0 tx=0x7faa2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:21.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:21.947+0000 7faa33e00640 1 -- 172.21.15.123:0/3775323607 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7faa34016090 con 0x7faa3c0d0f80 2024-04-25T13:43:22.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.139+0000 7faa42800640 1 -- 172.21.15.123:0/3775323607 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa3c0d1a80 con 0x7faa3c0d0f80 2024-04-25T13:43:22.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.139+0000 7faa33e00640 1 -- 172.21.15.123:0/3775323607 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5187 (secure 0 0 0) 0x7faa340f55c0 con 0x7faa3c0d0f80 2024-04-25T13:43:22.145 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:22.145 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3582988979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":3582988979},{"type":"v1","addr":"172.21.15.130:6835","nonce":3582988979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4978,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/173287078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":173287078},{"type":"v1","addr":"172.21.15.123:6837","nonce":173287078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4987,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/4025543653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4025543653},{"type":"v1","addr":"172.21.15.130:6834","nonce":4025543653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:43:01.431292+0000","modified":"2024-04-25T13:43:04.442129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6836/499623122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":499623122},{"type":"v1","addr":"172.21.15.123:6836","nonce":499623122}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5046,"qdb_cluster":[5046]},"id":2}]} 2024-04-25T13:43:22.146 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 17 2024-04-25T13:43:22.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.143+0000 7faa42800640 1 -- 172.21.15.123:0/3775323607 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7faa1806f430 msgr2=0x7faa18071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:22.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.143+0000 7faa42800640 1 --2- 172.21.15.123:0/3775323607 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7faa1806f430 0x7faa18071940 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faa3c070fa0 tx=0x7faa2c009040 comp rx=0 tx=0).stop 2024-04-25T13:43:22.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.143+0000 7faa42800640 1 -- 172.21.15.123:0/3775323607 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa3c0d0f80 msgr2=0x7faa3c0cfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:22.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.143+0000 7faa42800640 1 --2- 172.21.15.123:0/3775323607 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa3c0d0f80 0x7faa3c0cfce0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7faa340ae040 tx=0x7faa34019180 comp rx=0 tx=0).stop 2024-04-25T13:43:22.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.143+0000 7faa42800640 1 -- 172.21.15.123:0/3775323607 shutdown_connections 2024-04-25T13:43:22.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.143+0000 7faa42800640 1 --2- 172.21.15.123:0/3775323607 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7faa1806f430 0x7faa18071940 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:22.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.143+0000 7faa42800640 1 --2- 172.21.15.123:0/3775323607 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa3c0d0f80 0x7faa3c0cfce0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:22.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.143+0000 7faa42800640 1 --2- 172.21.15.123:0/3775323607 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faa3c0b5010 0x7faa3c0cf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:22.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.143+0000 7faa42800640 1 --2- 172.21.15.123:0/3775323607 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa3c0b32f0 0x7faa3c146110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:22.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.143+0000 7faa42800640 1 -- 172.21.15.123:0/3775323607 >> 172.21.15.123:0/3775323607 conn(0x7faa3c06d210 msgr2=0x7faa3c0d1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:22.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.143+0000 7faa42800640 1 -- 172.21.15.123:0/3775323607 shutdown_connections 2024-04-25T13:43:22.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.143+0000 7faa42800640 1 -- 172.21.15.123:0/3775323607 wait complete. 2024-04-25T13:43:22.168 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump mds_cache 2024-04-25T13:43:22.333 INFO:teuthology.orchestra.run.smithi123.stdout:{"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":2,"strays_enqueued":2,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0}} 2024-04-25T13:43:22.334 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 2, "strays_enqueued": 2, "strays_migrated": 0, "strays_reintegrated": 0 } } 2024-04-25T13:43:22.334 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-04-25T13:43:22.334 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:43:22.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.475+0000 7fe704800640 1 Processor -- start 2024-04-25T13:43:22.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.475+0000 7fe704800640 1 -- start start 2024-04-25T13:43:22.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.479+0000 7fe704800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6fc0b32f0 0x7fe6fc0b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:22.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.479+0000 7fe704800640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6fc0b3c40 con 0x7fe6fc0d0f80 2024-04-25T13:43:22.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.479+0000 7fe704800640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6fc15d240 con 0x7fe6fc0b5010 2024-04-25T13:43:22.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.479+0000 7fe704800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe6fc15cfe0 con 0x7fe6fc0b32f0 2024-04-25T13:43:22.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.479+0000 7fe701e00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe6fc0d0f80 0x7fe6fc160fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58458/0 (socket says 172.21.15.123:58458) 2024-04-25T13:43:22.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.479+0000 7fe701e00640 1 -- 172.21.15.123:0/1640685872 learned_addr learned my addr 172.21.15.123:0/1640685872 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:22.482 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.479+0000 7fe701400640 1 --2- 172.21.15.123:0/1640685872 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6fc0b32f0 0x7fe6fc0b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:22.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.479+0000 7fe700a00640 1 -- 172.21.15.123:0/1640685872 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2457752065 0 0) 0x7fe6f0001120 con 0x7fe6fc0d0f80 2024-04-25T13:43:22.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.479+0000 7fe700a00640 1 -- 172.21.15.123:0/1640685872 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6e4003530 con 0x7fe6fc0d0f80 2024-04-25T13:43:22.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.479+0000 7fe700a00640 1 -- 172.21.15.123:0/1640685872 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2837219233 0 0) 0x7fe6fc15d240 con 0x7fe6fc0b5010 2024-04-25T13:43:22.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.479+0000 7fe701400640 1 -- 172.21.15.123:0/1640685872 >> v1:172.21.15.130:6789/0 conn(0x7fe6fc0b5010 legacy=0x7fe6fc0b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:22.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.479+0000 7fe701400640 1 -- 172.21.15.123:0/1640685872 >> v1:172.21.15.123:6789/0 conn(0x7fe6fc0d0f80 legacy=0x7fe6fc160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:22.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.479+0000 7fe701400640 1 -- 172.21.15.123:0/1640685872 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6fc15d520 con 0x7fe6fc0b32f0 2024-04-25T13:43:22.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.483+0000 7fe701400640 1 --2- 172.21.15.123:0/1640685872 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6fc0b32f0 0x7fe6fc0b3700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0097f0 tx=0x7fe6ec01c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=857b6d65beaae44d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:22.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.483+0000 7fe700a00640 1 -- 172.21.15.123:0/1640685872 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec0ab620 con 0x7fe6fc0b32f0 2024-04-25T13:43:22.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.483+0000 7fe700a00640 1 -- 172.21.15.123:0/1640685872 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ec0b0070 con 0x7fe6fc0b32f0 2024-04-25T13:43:22.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.483+0000 7fe700a00640 1 -- 172.21.15.123:0/1640685872 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec0ab9e0 con 0x7fe6fc0b32f0 2024-04-25T13:43:22.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.483+0000 7fe704800640 1 -- 172.21.15.123:0/1640685872 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6fc0b32f0 msgr2=0x7fe6fc0b3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:22.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.483+0000 7fe704800640 1 --2- 172.21.15.123:0/1640685872 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6fc0b32f0 0x7fe6fc0b3700 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0097f0 tx=0x7fe6ec01c420 comp rx=0 tx=0).stop 2024-04-25T13:43:22.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.483+0000 7fe704800640 1 -- 172.21.15.123:0/1640685872 shutdown_connections 2024-04-25T13:43:22.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.483+0000 7fe704800640 1 --2- 172.21.15.123:0/1640685872 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6fc0b32f0 0x7fe6fc0b3700 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:22.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.483+0000 7fe704800640 1 -- 172.21.15.123:0/1640685872 >> 172.21.15.123:0/1640685872 conn(0x7fe6fc06d210 msgr2=0x7fe6fc06ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:22.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.483+0000 7fe704800640 1 -- 172.21.15.123:0/1640685872 shutdown_connections 2024-04-25T13:43:22.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.483+0000 7fe704800640 1 -- 172.21.15.123:0/1640685872 wait complete. 2024-04-25T13:43:22.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.483+0000 7fe704800640 1 Processor -- start 2024-04-25T13:43:22.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.487+0000 7fe704800640 1 -- start start 2024-04-25T13:43:22.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.487+0000 7fe704800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6fc0b32f0 0x7fe6fc167090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:22.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.487+0000 7fe704800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6fc0b5010 0x7fe6fc15bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:22.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.487+0000 7fe704800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6fc0d0f80 0x7fe6fc156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:22.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.487+0000 7fe704800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe6fc0b5f40 con 0x7fe6fc0b5010 2024-04-25T13:43:22.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.487+0000 7fe704800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe6fc0b6470 con 0x7fe6fc0d0f80 2024-04-25T13:43:22.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.487+0000 7fe704800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe6fc0b60c0 con 0x7fe6fc0b32f0 2024-04-25T13:43:22.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.487+0000 7fe701400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6fc0b5010 0x7fe6fc15bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:22.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.487+0000 7fe701400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6fc0b5010 0x7fe6fc15bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40830/0 (socket says 172.21.15.123:40830) 2024-04-25T13:43:22.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.487+0000 7fe701400640 1 -- 172.21.15.123:0/904265445 learned_addr learned my addr 172.21.15.123:0/904265445 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:22.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.487+0000 7fe701e00640 1 --2- 172.21.15.123:0/904265445 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6fc0b32f0 0x7fe6fc167090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:22.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.487+0000 7fe702800640 1 --2- 172.21.15.123:0/904265445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6fc0d0f80 0x7fe6fc156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:22.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.487+0000 7fe701400640 1 -- 172.21.15.123:0/904265445 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6fc0b32f0 msgr2=0x7fe6fc167090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:22.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.487+0000 7fe701400640 1 --2- 172.21.15.123:0/904265445 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6fc0b32f0 0x7fe6fc167090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:22.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.487+0000 7fe701400640 1 -- 172.21.15.123:0/904265445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6fc0d0f80 msgr2=0x7fe6fc156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:22.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.487+0000 7fe701400640 1 --2- 172.21.15.123:0/904265445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6fc0d0f80 0x7fe6fc156e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:22.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.487+0000 7fe701400640 1 -- 172.21.15.123:0/904265445 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6fc166220 con 0x7fe6fc0b5010 2024-04-25T13:43:22.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.487+0000 7fe701400640 1 --2- 172.21.15.123:0/904265445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6fc0b5010 0x7fe6fc15bd20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0097f0 tx=0x7fe6ec01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:22.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.487+0000 7fe6f6000640 1 -- 172.21.15.123:0/904265445 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec0abbc0 con 0x7fe6fc0b5010 2024-04-25T13:43:22.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.487+0000 7fe6f6000640 1 -- 172.21.15.123:0/904265445 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ec0abd60 con 0x7fe6fc0b5010 2024-04-25T13:43:22.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.487+0000 7fe704800640 1 -- 172.21.15.123:0/904265445 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6fc15b240 con 0x7fe6fc0b5010 2024-04-25T13:43:22.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.487+0000 7fe6f6000640 1 -- 172.21.15.123:0/904265445 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec004260 con 0x7fe6fc0b5010 2024-04-25T13:43:22.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.487+0000 7fe704800640 1 -- 172.21.15.123:0/904265445 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6fc15b800 con 0x7fe6fc0b5010 2024-04-25T13:43:22.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.487+0000 7fe704800640 1 -- 172.21.15.123:0/904265445 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6fc0507c0 con 0x7fe6fc0b5010 2024-04-25T13:43:22.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.491+0000 7fe6f6000640 1 -- 172.21.15.123:0/904265445 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe6ec003620 con 0x7fe6fc0b5010 2024-04-25T13:43:22.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.491+0000 7fe6f6000640 1 --2- 172.21.15.123:0/904265445 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe6e006f430 0x7fe6e0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:22.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.491+0000 7fe6f6000640 1 -- 172.21.15.123:0/904265445 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fe6ec128b60 con 0x7fe6fc0b5010 2024-04-25T13:43:22.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.491+0000 7fe701e00640 1 --2- 172.21.15.123:0/904265445 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe6e006f430 0x7fe6e0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:22.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.491+0000 7fe701e00640 1 --2- 172.21.15.123:0/904265445 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe6e006f430 0x7fe6e0071940 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0005890 tx=0x7fe6f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:22.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.495+0000 7fe6f6000640 1 -- 172.21.15.123:0/904265445 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe6ec0c4020 con 0x7fe6fc0b5010 2024-04-25T13:43:22.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.683+0000 7fe704800640 1 -- 172.21.15.123:0/904265445 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6fc167fc0 con 0x7fe6fc0b5010 2024-04-25T13:43:22.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.683+0000 7fe6f6000640 1 -- 172.21.15.123:0/904265445 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5187 (secure 0 0 0) 0x7fe6ec0160d0 con 0x7fe6fc0b5010 2024-04-25T13:43:22.689 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:22.689 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3582988979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":3582988979},{"type":"v1","addr":"172.21.15.130:6835","nonce":3582988979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4978,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/173287078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":173287078},{"type":"v1","addr":"172.21.15.123:6837","nonce":173287078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4987,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/4025543653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4025543653},{"type":"v1","addr":"172.21.15.130:6834","nonce":4025543653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:43:01.431292+0000","modified":"2024-04-25T13:43:04.442129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6836/499623122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":499623122},{"type":"v1","addr":"172.21.15.123:6836","nonce":499623122}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5046,"qdb_cluster":[5046]},"id":2}]} 2024-04-25T13:43:22.690 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 17 2024-04-25T13:43:22.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.687+0000 7fe704800640 1 -- 172.21.15.123:0/904265445 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe6e006f430 msgr2=0x7fe6e0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:22.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.687+0000 7fe704800640 1 --2- 172.21.15.123:0/904265445 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe6e006f430 0x7fe6e0071940 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0005890 tx=0x7fe6f0009040 comp rx=0 tx=0).stop 2024-04-25T13:43:22.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.687+0000 7fe704800640 1 -- 172.21.15.123:0/904265445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6fc0b5010 msgr2=0x7fe6fc15bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:22.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.687+0000 7fe704800640 1 --2- 172.21.15.123:0/904265445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6fc0b5010 0x7fe6fc15bd20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0097f0 tx=0x7fe6ec01ac60 comp rx=0 tx=0).stop 2024-04-25T13:43:22.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.687+0000 7fe704800640 1 -- 172.21.15.123:0/904265445 shutdown_connections 2024-04-25T13:43:22.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.687+0000 7fe704800640 1 --2- 172.21.15.123:0/904265445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6fc0d0f80 0x7fe6fc156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:22.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.687+0000 7fe704800640 1 --2- 172.21.15.123:0/904265445 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe6e006f430 0x7fe6e0071940 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:22.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.687+0000 7fe704800640 1 --2- 172.21.15.123:0/904265445 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6fc0b5010 0x7fe6fc15bd20 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:22.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.687+0000 7fe704800640 1 --2- 172.21.15.123:0/904265445 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe6fc0b32f0 0x7fe6fc167090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:22.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.687+0000 7fe704800640 1 -- 172.21.15.123:0/904265445 >> 172.21.15.123:0/904265445 conn(0x7fe6fc06d210 msgr2=0x7fe6fc0cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:22.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.687+0000 7fe704800640 1 -- 172.21.15.123:0/904265445 shutdown_connections 2024-04-25T13:43:22.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.687+0000 7fe704800640 1 -- 172.21.15.123:0/904265445 wait complete. 2024-04-25T13:43:22.711 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json perf dump objecter 2024-04-25T13:43:22.877 INFO:teuthology.orchestra.run.smithi123.stdout:{"objecter":{"op_active":0,"op_laggy":0,"op_send":597,"op_send_bytes":44911,"op_resend":37,"op_reply":597,"op_latency":{"avgcount":597,"sum":22.214947387,"avgtime":0.037210967},"op_inflight":0,"oplen_avg":{"avgcount":597,"sum":650},"op":597,"op_r":1,"op_w":596,"op_rmw":0,"op_pg":0,"osdop_stat":5,"osdop_create":17,"osdop_read":1,"osdop_write":16,"osdop_writefull":20,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":514,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":34,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":34,"map_full":0,"map_inc":1,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":38,"omap_rd":0,"omap_del":5}} 2024-04-25T13:43:22.878 DEBUG:tasks.cephfs.filesystem:_json_asok output { "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 34, "map_full": 0, "map_inc": 1, "omap_del": 5, "omap_rd": 0, "omap_wr": 38, "op": 597, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 597, "avgtime": 0.037210967, "sum": 22.214947387 }, "op_pg": 0, "op_r": 1, "op_reply": 597, "op_resend": 37, "op_rmw": 0, "op_send": 597, "op_send_bytes": 44911, "op_w": 596, "oplen_avg": { "avgcount": 597, "sum": 650 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 17, "osdop_delete": 514, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 1, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 34, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 5, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 16, "osdop_writefull": 20, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 } } 2024-04-25T13:43:22.878 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T13:43:22.878 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.00000000 2024-04-25T13:43:22.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.931+0000 7fdc7564e080 1 Processor -- start 2024-04-25T13:43:22.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.931+0000 7fdc7564e080 1 -- start start 2024-04-25T13:43:22.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc7564e080 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d62512f1e0 0x55d6251e8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:22.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc7564e080 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d6251e6570 0x55d625130380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:22.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc7564e080 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55d6251e6b30 0x55d6251fb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:22.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc7564e080 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d6250d19a0 con 0x55d62512f1e0 2024-04-25T13:43:22.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc7564e080 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d6250d59e0 con 0x55d6251e6570 2024-04-25T13:43:22.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc7564e080 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x55d625173710 con 0x55d6251e6b30 2024-04-25T13:43:22.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc6e800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d62512f1e0 0x55d6251e8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:22.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc6e800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d62512f1e0 0x55d6251e8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40840/0 (socket says 172.21.15.123:40840) 2024-04-25T13:43:22.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc6e800640 1 -- 172.21.15.123:0/1858819393 learned_addr learned my addr 172.21.15.123:0/1858819393 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:22.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc6e800640 1 -- 172.21.15.123:0/1858819393 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55d6251e6b30 msgr2=0x55d6251fb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:22.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc6e800640 1 --2- 172.21.15.123:0/1858819393 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55d6251e6b30 0x55d6251fb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:22.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc6e800640 1 -- 172.21.15.123:0/1858819393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d6251e6570 msgr2=0x55d625130380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:22.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc6e800640 1 --2- 172.21.15.123:0/1858819393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d6251e6570 0x55d625130380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:22.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc6e800640 1 -- 172.21.15.123:0/1858819393 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6251e7bf0 con 0x55d62512f1e0 2024-04-25T13:43:22.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc6e800640 1 --2- 172.21.15.123:0/1858819393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d62512f1e0 0x55d6251e8b10 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdc600ad040 tx=0x7fdc60003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2691c4433d91af3a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:22.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc6ca00640 1 -- 172.21.15.123:0/1858819393 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc600bb070 con 0x55d62512f1e0 2024-04-25T13:43:22.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc6ca00640 1 -- 172.21.15.123:0/1858819393 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc600aa9f0 con 0x55d62512f1e0 2024-04-25T13:43:22.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc6ca00640 1 -- 172.21.15.123:0/1858819393 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc600af040 con 0x55d62512f1e0 2024-04-25T13:43:22.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc7564e080 1 -- 172.21.15.123:0/1858819393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d62512f1e0 msgr2=0x55d6251e8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:22.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc7564e080 1 --2- 172.21.15.123:0/1858819393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d62512f1e0 0x55d6251e8b10 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdc600ad040 tx=0x7fdc60003030 comp rx=0 tx=0).stop 2024-04-25T13:43:22.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc7564e080 1 -- 172.21.15.123:0/1858819393 shutdown_connections 2024-04-25T13:43:22.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc7564e080 1 --2- 172.21.15.123:0/1858819393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d6251e6570 0x55d625130380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:22.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc7564e080 1 --2- 172.21.15.123:0/1858819393 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55d6251e6b30 0x55d6251fb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:22.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc7564e080 1 --2- 172.21.15.123:0/1858819393 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d62512f1e0 0x55d6251e8b10 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:22.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc7564e080 1 -- 172.21.15.123:0/1858819393 >> 172.21.15.123:0/1858819393 conn(0x55d625116af0 msgr2=0x55d6251ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:22.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc7564e080 1 -- 172.21.15.123:0/1858819393 shutdown_connections 2024-04-25T13:43:22.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc7564e080 1 -- 172.21.15.123:0/1858819393 wait complete. 2024-04-25T13:43:22.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc7564e080 1 Processor -- start 2024-04-25T13:43:22.941 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.935+0000 7fdc7564e080 1 -- start start 2024-04-25T13:43:22.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.939+0000 7fdc7564e080 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55d62512f1e0 0x55d625158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:22.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.939+0000 7fdc7564e080 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6251e6570 0x55d6251de020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:22.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.939+0000 7fdc7564e080 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d6251e6b30 0x55d6251de560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:22.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.939+0000 7fdc7564e080 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x55d6251e5380 con 0x55d6251e6570 2024-04-25T13:43:22.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.939+0000 7fdc7564e080 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d62512e7f0 con 0x55d6251e6b30 2024-04-25T13:43:22.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.939+0000 7fdc7564e080 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x55d6251df1b0 con 0x55d62512f1e0 2024-04-25T13:43:22.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.939+0000 7fdc6de00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6251e6570 0x55d6251de020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:22.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.939+0000 7fdc6de00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6251e6570 0x55d6251de020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40846/0 (socket says 172.21.15.123:40846) 2024-04-25T13:43:22.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.939+0000 7fdc6de00640 1 -- 172.21.15.123:0/2421082998 learned_addr learned my addr 172.21.15.123:0/2421082998 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:22.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.939+0000 7fdc6e800640 1 --2- 172.21.15.123:0/2421082998 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55d62512f1e0 0x55d625158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:22.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.939+0000 7fdc6f200640 1 --2- 172.21.15.123:0/2421082998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d6251e6b30 0x55d6251de560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:22.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.939+0000 7fdc6de00640 1 -- 172.21.15.123:0/2421082998 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55d62512f1e0 msgr2=0x55d625158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:22.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.939+0000 7fdc6de00640 1 --2- 172.21.15.123:0/2421082998 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55d62512f1e0 0x55d625158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:22.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.939+0000 7fdc6de00640 1 -- 172.21.15.123:0/2421082998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d6251e6b30 msgr2=0x55d6251de560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:22.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.939+0000 7fdc6de00640 1 --2- 172.21.15.123:0/2421082998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d6251e6b30 0x55d6251de560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:22.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.939+0000 7fdc6de00640 1 -- 172.21.15.123:0/2421082998 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6251df450 con 0x55d6251e6570 2024-04-25T13:43:22.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.939+0000 7fdc6f200640 1 --2- 172.21.15.123:0/2421082998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d6251e6b30 0x55d6251de560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:22.944 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.939+0000 7fdc6de00640 1 --2- 172.21.15.123:0/2421082998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6251e6570 0x55d6251de020 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c00bea0 tx=0x7fdc5c00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:22.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.939+0000 7fdc67400640 1 -- 172.21.15.123:0/2421082998 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c012070 con 0x55d6251e6570 2024-04-25T13:43:22.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.939+0000 7fdc67400640 1 -- 172.21.15.123:0/2421082998 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc5c009e10 con 0x55d6251e6570 2024-04-25T13:43:22.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.939+0000 7fdc67400640 1 -- 172.21.15.123:0/2421082998 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c00e8d0 con 0x55d6251e6570 2024-04-25T13:43:22.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.939+0000 7fdc7564e080 1 -- 172.21.15.123:0/2421082998 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d6251df6f0 con 0x55d6251e6570 2024-04-25T13:43:22.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.939+0000 7fdc7564e080 1 -- 172.21.15.123:0/2421082998 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d625158670 con 0x55d6251e6570 2024-04-25T13:43:22.945 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.943+0000 7fdc67400640 1 -- 172.21.15.123:0/2421082998 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fdc5c015070 con 0x55d6251e6570 2024-04-25T13:43:22.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.943+0000 7fdc67400640 1 --2- 172.21.15.123:0/2421082998 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdc5006de10 0x7fdc50070320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:22.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.943+0000 7fdc67400640 1 -- 172.21.15.123:0/2421082998 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fdc5c08e070 con 0x55d6251e6570 2024-04-25T13:43:22.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.943+0000 7fdc6e800640 1 --2- 172.21.15.123:0/2421082998 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdc5006de10 0x7fdc50070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:22.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.943+0000 7fdc7564e080 1 --2- 172.21.15.123:0/2421082998 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x55d6251fe500 0x55d6251e05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:22.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.943+0000 7fdc7564e080 1 -- 172.21.15.123:0/2421082998 --> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] -- osd_op(unknown.0.0:1 4.10 4:0cf6ad0f:::10000000000.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d6251ff480 con 0x55d6251fe500 2024-04-25T13:43:22.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.943+0000 7fdc6f200640 1 --2- 172.21.15.123:0/2421082998 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x55d6251fe500 0x55d6251e05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:22.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.943+0000 7fdc6e800640 1 --2- 172.21.15.123:0/2421082998 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdc5006de10 0x7fdc50070320 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdc600b8000 tx=0x7fdc600a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:22.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.943+0000 7fdc6f200640 1 --2- 172.21.15.123:0/2421082998 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x55d6251fe500 0x55d6251e05e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:22.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.943+0000 7fdc6f200640 1 -- 172.21.15.123:0/2421082998 <== osd.3 v2:172.21.15.123:6816/898268961 1 ==== osd_op_reply(1 10000000000.00000000 [omap-get-keys] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7fdc68002730 con 0x55d6251fe500 2024-04-25T13:43:22.949 INFO:teuthology.orchestra.run.smithi123.stderr:error getting omap key set cephfs_metadata/10000000000.00000000: (2) No such file or directory 2024-04-25T13:43:22.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.943+0000 7fdc7564e080 1 -- 172.21.15.123:0/2421082998 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x55d6251fe500 msgr2=0x55d6251e05e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:22.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.943+0000 7fdc7564e080 1 --2- 172.21.15.123:0/2421082998 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x55d6251fe500 0x55d6251e05e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:22.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.943+0000 7fdc7564e080 1 -- 172.21.15.123:0/2421082998 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdc5006de10 msgr2=0x7fdc50070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:22.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.943+0000 7fdc7564e080 1 --2- 172.21.15.123:0/2421082998 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fdc5006de10 0x7fdc50070320 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdc600b8000 tx=0x7fdc600a7000 comp rx=0 tx=0).stop 2024-04-25T13:43:22.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.943+0000 7fdc7564e080 1 -- 172.21.15.123:0/2421082998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6251e6570 msgr2=0x55d6251de020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:22.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.943+0000 7fdc7564e080 1 --2- 172.21.15.123:0/2421082998 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55d6251e6570 0x55d6251de020 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c00bea0 tx=0x7fdc5c00bf90 comp rx=0 tx=0).stop 2024-04-25T13:43:22.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.943+0000 7fdc6f200640 1 -- 172.21.15.123:0/2421082998 reap_dead start 2024-04-25T13:43:22.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.943+0000 7fdc7564e080 1 -- 172.21.15.123:0/2421082998 shutdown_connections 2024-04-25T13:43:22.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.943+0000 7fdc7564e080 1 -- 172.21.15.123:0/2421082998 >> 172.21.15.123:0/2421082998 conn(0x55d625116af0 msgr2=0x55d625202de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:22.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.943+0000 7fdc7564e080 1 -- 172.21.15.123:0/2421082998 shutdown_connections 2024-04-25T13:43:22.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:22.943+0000 7fdc7564e080 1 -- 172.21.15.123:0/2421082998 wait complete. 2024-04-25T13:43:22.953 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:43:22.953 ERROR:tasks.cephfs.filesystem:Command failed on smithi123 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.00000000' 2024-04-25T13:43:22.953 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-25T13:43:23.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.007+0000 7f39d0a7e080 1 Processor -- start 2024-04-25T13:43:23.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.007+0000 7f39d0a7e080 1 -- start start 2024-04-25T13:43:23.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.007+0000 7f39d0a7e080 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e850e0070 0x557e85024900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.007+0000 7f39d0a7e080 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557e850e0480 0x557e850dd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.007+0000 7f39d0a7e080 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557e85024e40 0x557e850ddd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.007+0000 7f39d0a7e080 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x557e850e1910 con 0x557e85024e40 2024-04-25T13:43:23.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.007+0000 7f39d0a7e080 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557e84fcb9a0 con 0x557e850e0070 2024-04-25T13:43:23.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.007+0000 7f39d0a7e080 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x557e850e1a90 con 0x557e850e0480 2024-04-25T13:43:23.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.007+0000 7f39ca600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557e85024e40 0x557e850ddd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.007+0000 7f39ca600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557e85024e40 0x557e850ddd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40858/0 (socket says 172.21.15.123:40858) 2024-04-25T13:43:23.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.007+0000 7f39ca600640 1 -- 172.21.15.123:0/1424062345 learned_addr learned my addr 172.21.15.123:0/1424062345 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:23.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.007+0000 7f39c9c00640 1 --2- 172.21.15.123:0/1424062345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e850e0070 0x557e85024900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.007+0000 7f39c9200640 1 --2- 172.21.15.123:0/1424062345 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557e850e0480 0x557e850dd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.007+0000 7f39ca600640 1 -- 172.21.15.123:0/1424062345 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557e850e0480 msgr2=0x557e850dd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:23.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.007+0000 7f39ca600640 1 --2- 172.21.15.123:0/1424062345 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557e850e0480 0x557e850dd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.007+0000 7f39ca600640 1 -- 172.21.15.123:0/1424062345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e850e0070 msgr2=0x557e85024900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:23.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.007+0000 7f39ca600640 1 --2- 172.21.15.123:0/1424062345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e850e0070 0x557e85024900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.007+0000 7f39ca600640 1 -- 172.21.15.123:0/1424062345 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e850e36e0 con 0x557e85024e40 2024-04-25T13:43:23.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.007+0000 7f39c9200640 1 --2- 172.21.15.123:0/1424062345 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557e850e0480 0x557e850dd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:23.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.007+0000 7f39c9c00640 1 --2- 172.21.15.123:0/1424062345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e850e0070 0x557e85024900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:23.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.007+0000 7f39ca600640 1 --2- 172.21.15.123:0/1424062345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557e85024e40 0x557e850ddd40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f39c400c460 tx=0x7f39c400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc83963c74235dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:23.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.007+0000 7f39c3400640 1 -- 172.21.15.123:0/1424062345 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c40116b0 con 0x557e85024e40 2024-04-25T13:43:23.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.007+0000 7f39c3400640 1 -- 172.21.15.123:0/1424062345 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39c4017070 con 0x557e85024e40 2024-04-25T13:43:23.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.007+0000 7f39c3400640 1 -- 172.21.15.123:0/1424062345 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c4011ab0 con 0x557e85024e40 2024-04-25T13:43:23.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.011+0000 7f39d0a7e080 1 -- 172.21.15.123:0/1424062345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557e85024e40 msgr2=0x557e850ddd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:23.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.011+0000 7f39d0a7e080 1 --2- 172.21.15.123:0/1424062345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557e85024e40 0x557e850ddd40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f39c400c460 tx=0x7f39c400c920 comp rx=0 tx=0).stop 2024-04-25T13:43:23.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.011+0000 7f39d0a7e080 1 -- 172.21.15.123:0/1424062345 shutdown_connections 2024-04-25T13:43:23.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.011+0000 7f39d0a7e080 1 --2- 172.21.15.123:0/1424062345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557e85024e40 0x557e850ddd40 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.011+0000 7f39d0a7e080 1 --2- 172.21.15.123:0/1424062345 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557e850e0480 0x557e850dd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.011+0000 7f39d0a7e080 1 --2- 172.21.15.123:0/1424062345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e850e0070 0x557e85024900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.011+0000 7f39d0a7e080 1 -- 172.21.15.123:0/1424062345 >> 172.21.15.123:0/1424062345 conn(0x557e85010af0 msgr2=0x557e850fa240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:23.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.011+0000 7f39d0a7e080 1 -- 172.21.15.123:0/1424062345 shutdown_connections 2024-04-25T13:43:23.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.011+0000 7f39d0a7e080 1 -- 172.21.15.123:0/1424062345 wait complete. 2024-04-25T13:43:23.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.011+0000 7f39d0a7e080 1 Processor -- start 2024-04-25T13:43:23.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.011+0000 7f39d0a7e080 1 -- start start 2024-04-25T13:43:23.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.011+0000 7f39d0a7e080 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e85024e40 0x557e8506ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.011+0000 7f39d0a7e080 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557e850e0070 0x557e85102de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.011+0000 7f39d0a7e080 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557e850e0480 0x557e85053ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.011+0000 7f39d0a7e080 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x557e850fbf40 con 0x557e850e0070 2024-04-25T13:43:23.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.011+0000 7f39d0a7e080 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557e850fbca0 con 0x557e85024e40 2024-04-25T13:43:23.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.011+0000 7f39d0a7e080 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x557e85055510 con 0x557e850e0480 2024-04-25T13:43:23.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.011+0000 7f39c9200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557e850e0070 0x557e85102de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.011+0000 7f39c9200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557e850e0070 0x557e85102de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40866/0 (socket says 172.21.15.123:40866) 2024-04-25T13:43:23.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.011+0000 7f39c9200640 1 -- 172.21.15.123:0/1043478703 learned_addr learned my addr 172.21.15.123:0/1043478703 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:23.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.011+0000 7f39c9c00640 1 --2- 172.21.15.123:0/1043478703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e85024e40 0x557e8506ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.011+0000 7f39ca600640 1 --2- 172.21.15.123:0/1043478703 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557e850e0480 0x557e85053ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.011+0000 7f39c9200640 1 -- 172.21.15.123:0/1043478703 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557e850e0480 msgr2=0x557e85053ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:23.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.011+0000 7f39c9200640 1 --2- 172.21.15.123:0/1043478703 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x557e850e0480 0x557e85053ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.011+0000 7f39c9200640 1 -- 172.21.15.123:0/1043478703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e85024e40 msgr2=0x557e8506ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:23.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.011+0000 7f39c9200640 1 --2- 172.21.15.123:0/1043478703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e85024e40 0x557e8506ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.015+0000 7f39c9200640 1 -- 172.21.15.123:0/1043478703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e85103320 con 0x557e850e0070 2024-04-25T13:43:23.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.015+0000 7f39c9200640 1 --2- 172.21.15.123:0/1043478703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557e850e0070 0x557e85102de0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f39b80ad040 tx=0x7f39b8018160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:23.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.015+0000 7f39c2000640 1 -- 172.21.15.123:0/1043478703 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b80bb070 con 0x557e850e0070 2024-04-25T13:43:23.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.015+0000 7f39c2000640 1 -- 172.21.15.123:0/1043478703 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b80b5860 con 0x557e850e0070 2024-04-25T13:43:23.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.015+0000 7f39d0a7e080 1 -- 172.21.15.123:0/1043478703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557e8506e420 con 0x557e850e0070 2024-04-25T13:43:23.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.015+0000 7f39c2000640 1 -- 172.21.15.123:0/1043478703 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b80af040 con 0x557e850e0070 2024-04-25T13:43:23.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.015+0000 7f39d0a7e080 1 -- 172.21.15.123:0/1043478703 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e8506d7a0 con 0x557e850e0070 2024-04-25T13:43:23.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.015+0000 7f39c2000640 1 -- 172.21.15.123:0/1043478703 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f39b80be070 con 0x557e850e0070 2024-04-25T13:43:23.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.015+0000 7f39c2000640 1 --2- 172.21.15.123:0/1043478703 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f39ac06dde0 0x7f39ac0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.015+0000 7f39c2000640 1 -- 172.21.15.123:0/1043478703 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f39b8129300 con 0x557e850e0070 2024-04-25T13:43:23.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.019+0000 7f39c9c00640 1 --2- 172.21.15.123:0/1043478703 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f39ac06dde0 0x7f39ac0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.019+0000 7f39d0a7e080 1 --2- 172.21.15.123:0/1043478703 >> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] conn(0x557e850540e0 0x557e850ea030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.019+0000 7f39d0a7e080 1 -- 172.21.15.123:0/1043478703 --> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] -- osd_op(unknown.0.0:1 5.7 5:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557e850ea570 con 0x557e850540e0 2024-04-25T13:43:23.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.019+0000 7f39ca600640 1 --2- 172.21.15.123:0/1043478703 >> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] conn(0x557e850540e0 0x557e850ea030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.019+0000 7f39c9c00640 1 --2- 172.21.15.123:0/1043478703 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f39ac06dde0 0x7f39ac0702f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f39bc010500 tx=0x7f39bc0037e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:23.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.019+0000 7f39ca600640 1 --2- 172.21.15.123:0/1043478703 >> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] conn(0x557e850540e0 0x557e850ea030 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:23.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.019+0000 7f39ca600640 1 -- 172.21.15.123:0/1043478703 <== osd.5 v2:172.21.15.130:6800/2763000783 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 164+0+0 (crc 0 0 0) 0x7f39c4011910 con 0x557e850540e0 2024-04-25T13:43:23.023 INFO:teuthology.orchestra.run.smithi123.stderr:error getting xattr cephfs_data/10000000001.00000000/parent: (2) No such file or directory 2024-04-25T13:43:23.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.019+0000 7f39d0a7e080 1 -- 172.21.15.123:0/1043478703 >> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] conn(0x557e850540e0 msgr2=0x557e850ea030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:23.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.019+0000 7f39d0a7e080 1 --2- 172.21.15.123:0/1043478703 >> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] conn(0x557e850540e0 0x557e850ea030 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.019+0000 7f39d0a7e080 1 -- 172.21.15.123:0/1043478703 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f39ac06dde0 msgr2=0x7f39ac0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:23.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.019+0000 7f39d0a7e080 1 --2- 172.21.15.123:0/1043478703 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f39ac06dde0 0x7f39ac0702f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f39bc010500 tx=0x7f39bc0037e0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.019+0000 7f39d0a7e080 1 -- 172.21.15.123:0/1043478703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557e850e0070 msgr2=0x557e85102de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:23.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.019+0000 7f39d0a7e080 1 --2- 172.21.15.123:0/1043478703 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x557e850e0070 0x557e85102de0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f39b80ad040 tx=0x7f39b8018160 comp rx=0 tx=0).stop 2024-04-25T13:43:23.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.019+0000 7f39ca600640 1 -- 172.21.15.123:0/1043478703 reap_dead start 2024-04-25T13:43:23.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.019+0000 7f39d0a7e080 1 -- 172.21.15.123:0/1043478703 shutdown_connections 2024-04-25T13:43:23.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.019+0000 7f39d0a7e080 1 -- 172.21.15.123:0/1043478703 >> 172.21.15.123:0/1043478703 conn(0x557e85010af0 msgr2=0x557e850df2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:23.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.019+0000 7f39d0a7e080 1 -- 172.21.15.123:0/1043478703 shutdown_connections 2024-04-25T13:43:23.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.019+0000 7f39d0a7e080 1 -- 172.21.15.123:0/1043478703 wait complete. 2024-04-25T13:43:23.027 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:43:23.028 ERROR:tasks.cephfs.filesystem:Command failed on smithi123 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent' 2024-04-25T13:43:23.028 DEBUG:teuthology.orchestra.run.smithi123:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 1.00000000 2024-04-25T13:43:23.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.079+0000 7fa6917b4080 1 Processor -- start 2024-04-25T13:43:23.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.079+0000 7fa6917b4080 1 -- start start 2024-04-25T13:43:23.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa6917b4080 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555db3caff20 0x555db3d3a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa6917b4080 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555db3cb0330 0x555db3d3a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa6917b4080 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555db3c9c910 0x555db3cb43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa6917b4080 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x555db3cb61d0 con 0x555db3cb0330 2024-04-25T13:43:23.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa6917b4080 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555db3c129a0 con 0x555db3c9c910 2024-04-25T13:43:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa6917b4080 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x555db3cb3e50 con 0x555db3caff20 2024-04-25T13:43:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa68a000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555db3cb0330 0x555db3d3a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa68a000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555db3cb0330 0x555db3d3a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40880/0 (socket says 172.21.15.123:40880) 2024-04-25T13:43:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa68aa00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555db3caff20 0x555db3d3a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa68a000640 1 -- 172.21.15.123:0/3228820247 learned_addr learned my addr 172.21.15.123:0/3228820247 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa68b400640 1 --2- 172.21.15.123:0/3228820247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555db3c9c910 0x555db3cb43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa68a000640 1 -- 172.21.15.123:0/3228820247 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555db3caff20 msgr2=0x555db3d3a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa68a000640 1 --2- 172.21.15.123:0/3228820247 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555db3caff20 0x555db3d3a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa68a000640 1 -- 172.21.15.123:0/3228820247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555db3c9c910 msgr2=0x555db3cb43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa68a000640 1 --2- 172.21.15.123:0/3228820247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555db3c9c910 0x555db3cb43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa68a000640 1 -- 172.21.15.123:0/3228820247 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555db3dd5270 con 0x555db3cb0330 2024-04-25T13:43:23.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa68a000640 1 --2- 172.21.15.123:0/3228820247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555db3cb0330 0x555db3d3a820 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa67800b250 tx=0x7fa67800b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=160289702910a440 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:23.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa688c00640 1 -- 172.21.15.123:0/3228820247 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67800d510 con 0x555db3cb0330 2024-04-25T13:43:23.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa688c00640 1 -- 172.21.15.123:0/3228820247 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa678008070 con 0x555db3cb0330 2024-04-25T13:43:23.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa688c00640 1 -- 172.21.15.123:0/3228820247 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67800d8f0 con 0x555db3cb0330 2024-04-25T13:43:23.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa6917b4080 1 -- 172.21.15.123:0/3228820247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555db3cb0330 msgr2=0x555db3d3a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:23.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa6917b4080 1 --2- 172.21.15.123:0/3228820247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555db3cb0330 0x555db3d3a820 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa67800b250 tx=0x7fa67800b710 comp rx=0 tx=0).stop 2024-04-25T13:43:23.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa6917b4080 1 -- 172.21.15.123:0/3228820247 shutdown_connections 2024-04-25T13:43:23.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa6917b4080 1 --2- 172.21.15.123:0/3228820247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555db3c9c910 0x555db3cb43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa6917b4080 1 --2- 172.21.15.123:0/3228820247 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555db3cb0330 0x555db3d3a820 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa6917b4080 1 --2- 172.21.15.123:0/3228820247 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555db3caff20 0x555db3d3a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa6917b4080 1 -- 172.21.15.123:0/3228820247 >> 172.21.15.123:0/3228820247 conn(0x555db3c57af0 msgr2=0x555db3c9c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:23.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa6917b4080 1 -- 172.21.15.123:0/3228820247 shutdown_connections 2024-04-25T13:43:23.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa6917b4080 1 -- 172.21.15.123:0/3228820247 wait complete. 2024-04-25T13:43:23.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa6917b4080 1 Processor -- start 2024-04-25T13:43:23.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.083+0000 7fa6917b4080 1 -- start start 2024-04-25T13:43:23.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.087+0000 7fa6917b4080 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555db3c9c910 0x555db3d3f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.087+0000 7fa6917b4080 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555db3caff20 0x555db3d39d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.087+0000 7fa6917b4080 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555db3cb0330 0x555db3c6d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.087+0000 7fa6917b4080 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x555db3dd57b0 con 0x555db3c9c910 2024-04-25T13:43:23.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.087+0000 7fa6917b4080 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555db3dd5510 con 0x555db3cb0330 2024-04-25T13:43:23.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.087+0000 7fa6917b4080 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x555db3dd5a50 con 0x555db3caff20 2024-04-25T13:43:23.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.087+0000 7fa68aa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555db3c9c910 0x555db3d3f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.087+0000 7fa68aa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555db3c9c910 0x555db3d3f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40896/0 (socket says 172.21.15.123:40896) 2024-04-25T13:43:23.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.087+0000 7fa68aa00640 1 -- 172.21.15.123:0/3292245173 learned_addr learned my addr 172.21.15.123:0/3292245173 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:23.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.087+0000 7fa68b400640 1 --2- 172.21.15.123:0/3292245173 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555db3cb0330 0x555db3c6d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.087+0000 7fa68a000640 1 --2- 172.21.15.123:0/3292245173 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555db3caff20 0x555db3d39d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.087+0000 7fa68aa00640 1 -- 172.21.15.123:0/3292245173 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555db3caff20 msgr2=0x555db3d39d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.087+0000 7fa68aa00640 1 --2- 172.21.15.123:0/3292245173 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x555db3caff20 0x555db3d39d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.087+0000 7fa68aa00640 1 -- 172.21.15.123:0/3292245173 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555db3cb0330 msgr2=0x555db3c6d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.087+0000 7fa68aa00640 1 --2- 172.21.15.123:0/3292245173 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555db3cb0330 0x555db3c6d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.087+0000 7fa68aa00640 1 -- 172.21.15.123:0/3292245173 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555db3c6e040 con 0x555db3c9c910 2024-04-25T13:43:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.087+0000 7fa68aa00640 1 --2- 172.21.15.123:0/3292245173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555db3c9c910 0x555db3d3f610 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa67c00a500 tx=0x7fa67c018110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.087+0000 7fa683400640 1 -- 172.21.15.123:0/3292245173 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67c0b0040 con 0x555db3c9c910 2024-04-25T13:43:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.087+0000 7fa683400640 1 -- 172.21.15.123:0/3292245173 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa67c0b1040 con 0x555db3c9c910 2024-04-25T13:43:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.087+0000 7fa6917b4080 1 -- 172.21.15.123:0/3292245173 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555db3c6e2e0 con 0x555db3c9c910 2024-04-25T13:43:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.087+0000 7fa683400640 1 -- 172.21.15.123:0/3292245173 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67c0b6840 con 0x555db3c9c910 2024-04-25T13:43:23.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.087+0000 7fa6917b4080 1 -- 172.21.15.123:0/3292245173 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555db3c6edb0 con 0x555db3c9c910 2024-04-25T13:43:23.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.091+0000 7fa683400640 1 -- 172.21.15.123:0/3292245173 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa67c0b69e0 con 0x555db3c9c910 2024-04-25T13:43:23.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.091+0000 7fa683400640 1 --2- 172.21.15.123:0/3292245173 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa66c06dde0 0x7fa66c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.091+0000 7fa683400640 1 -- 172.21.15.123:0/3292245173 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fa67c128be0 con 0x555db3c9c910 2024-04-25T13:43:23.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.091+0000 7fa68a000640 1 --2- 172.21.15.123:0/3292245173 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa66c06dde0 0x7fa66c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.091+0000 7fa6917b4080 1 --2- 172.21.15.123:0/3292245173 >> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] conn(0x555db3d3a670 0x555db3de8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.091+0000 7fa6917b4080 1 -- 172.21.15.123:0/3292245173 --> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] -- osd_op(unknown.0.0:1 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555db3de85b0 con 0x555db3d3a670 2024-04-25T13:43:23.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.091+0000 7fa68b400640 1 --2- 172.21.15.123:0/3292245173 >> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] conn(0x555db3d3a670 0x555db3de8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.091+0000 7fa68a000640 1 --2- 172.21.15.123:0/3292245173 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa66c06dde0 0x7fa66c0702f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa67800b250 tx=0x7fa678008000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:23.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.091+0000 7fa68b400640 1 --2- 172.21.15.123:0/3292245173 >> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] conn(0x555db3d3a670 0x555db3de8070 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:23.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.091+0000 7fa68b400640 1 -- 172.21.15.123:0/3292245173 <== osd.6 v2:172.21.15.130:6801/3650490477 1 ==== osd_op_reply(1 1.00000000 [omap-get-keys out=5b] v0'0 uv8 ondisk = 0) ==== 154+0+5 (crc 0 0 0) 0x7fa68400d900 con 0x555db3d3a670 2024-04-25T13:43:23.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.091+0000 7fa6917b4080 1 -- 172.21.15.123:0/3292245173 >> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] conn(0x555db3d3a670 msgr2=0x555db3de8070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:23.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.091+0000 7fa6917b4080 1 --2- 172.21.15.123:0/3292245173 >> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] conn(0x555db3d3a670 0x555db3de8070 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.091+0000 7fa6917b4080 1 -- 172.21.15.123:0/3292245173 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa66c06dde0 msgr2=0x7fa66c0702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:23.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.091+0000 7fa6917b4080 1 --2- 172.21.15.123:0/3292245173 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa66c06dde0 0x7fa66c0702f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa67800b250 tx=0x7fa678008000 comp rx=0 tx=0).stop 2024-04-25T13:43:23.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.091+0000 7fa6917b4080 1 -- 172.21.15.123:0/3292245173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555db3c9c910 msgr2=0x555db3d3f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:23.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.091+0000 7fa6917b4080 1 --2- 172.21.15.123:0/3292245173 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x555db3c9c910 0x555db3d3f610 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa67c00a500 tx=0x7fa67c018110 comp rx=0 tx=0).stop 2024-04-25T13:43:23.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.091+0000 7fa68b400640 1 -- 172.21.15.123:0/3292245173 reap_dead start 2024-04-25T13:43:23.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.091+0000 7fa6917b4080 1 -- 172.21.15.123:0/3292245173 shutdown_connections 2024-04-25T13:43:23.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.091+0000 7fa6917b4080 1 -- 172.21.15.123:0/3292245173 >> 172.21.15.123:0/3292245173 conn(0x555db3c57af0 msgr2=0x555db3c9c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:23.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.091+0000 7fa6917b4080 1 -- 172.21.15.123:0/3292245173 shutdown_connections 2024-04-25T13:43:23.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.091+0000 7fa6917b4080 1 -- 172.21.15.123:0/3292245173 wait complete. 2024-04-25T13:43:23.102 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T13:43:23.102 DEBUG:teuthology.orchestra.run.smithi123:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T13:43:23.179 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T13:43:23.259 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T13:43:23.259 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T13:43:23.259 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:43:23.260 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:43:23.268 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:43:23.268 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:43:23.317 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:43:23.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc26da00640 1 Processor -- start 2024-04-25T13:43:23.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc26da00640 1 -- start start 2024-04-25T13:43:23.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc26da00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc2680b4d70 0x7fc2680b5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc26da00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc268145d70 con 0x7fc2680747a0 2024-04-25T13:43:23.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc26da00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc268073c80 con 0x7fc2681604b0 2024-04-25T13:43:23.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc26da00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fc268074290 con 0x7fc2680b4d70 2024-04-25T13:43:23.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc266a00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fc2680747a0 0x7fc26815fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58484/0 (socket says 172.21.15.123:58484) 2024-04-25T13:43:23.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc266a00640 1 -- 172.21.15.123:0/3988038107 learned_addr learned my addr 172.21.15.123:0/3988038107 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:23.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc265600640 1 -- 172.21.15.123:0/3988038107 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3968336935 0 0) 0x7fc2580014a0 con 0x7fc2680747a0 2024-04-25T13:43:23.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc265600640 1 -- 172.21.15.123:0/3988038107 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc24c003530 con 0x7fc2680747a0 2024-04-25T13:43:23.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc267400640 1 --2- 172.21.15.123:0/3988038107 >> v2:172.21.15.130:3300/0 conn(0x7fc2680b4d70 0x7fc2680b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc265600640 1 -- 172.21.15.123:0/3988038107 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 165550024 0 0) 0x7fc24c003530 con 0x7fc2680747a0 2024-04-25T13:43:23.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc265600640 1 -- 172.21.15.123:0/3988038107 >> v2:172.21.15.130:3300/0 conn(0x7fc2680b4d70 msgr2=0x7fc2680b5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:23.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc265600640 1 --2- 172.21.15.123:0/3988038107 >> v2:172.21.15.130:3300/0 conn(0x7fc2680b4d70 0x7fc2680b5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc265600640 1 -- 172.21.15.123:0/3988038107 >> v1:172.21.15.130:6789/0 conn(0x7fc2681604b0 legacy=0x7fc2680b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:23.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc265600640 1 -- 172.21.15.123:0/3988038107 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2680ce030 con 0x7fc2680747a0 2024-04-25T13:43:23.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc265600640 1 -- 172.21.15.123:0/3988038107 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7fc258001bd0 con 0x7fc2680747a0 2024-04-25T13:43:23.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc265600640 1 -- 172.21.15.123:0/3988038107 >> v1:172.21.15.123:6789/0 conn(0x7fc2680747a0 legacy=0x7fc26815fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:23.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc265600640 1 --2- 172.21.15.123:0/3988038107 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc24c003a30 0x7fc24c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc265600640 1 --2- 172.21.15.123:0/3988038107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc24c004810 0x7fc24c004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc265600640 1 --2- 172.21.15.123:0/3988038107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc24c005360 0x7fc24c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc265600640 1 -- 172.21.15.123:0/3988038107 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc268074290 con 0x7fc24c004810 2024-04-25T13:43:23.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc265600640 1 -- 172.21.15.123:0/3988038107 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc24c00c290 con 0x7fc24c005360 2024-04-25T13:43:23.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc265600640 1 -- 172.21.15.123:0/3988038107 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc24c00c490 con 0x7fc24c003a30 2024-04-25T13:43:23.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc266000640 1 --2- 172.21.15.123:0/3988038107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc24c004810 0x7fc24c004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.510 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc266a00640 1 --2- 172.21.15.123:0/3988038107 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc24c003a30 0x7fc24c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc267400640 1 --2- 172.21.15.123:0/3988038107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc24c005360 0x7fc24c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc266000640 1 -- 172.21.15.123:0/3988038107 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc24c003a30 msgr2=0x7fc24c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:23.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc266000640 1 --2- 172.21.15.123:0/3988038107 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc24c003a30 0x7fc24c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc266000640 1 -- 172.21.15.123:0/3988038107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc24c005360 msgr2=0x7fc24c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:23.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc266000640 1 --2- 172.21.15.123:0/3988038107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc24c005360 0x7fc24c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc266000640 1 -- 172.21.15.123:0/3988038107 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24c003530 con 0x7fc24c004810 2024-04-25T13:43:23.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc267400640 1 --2- 172.21.15.123:0/3988038107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc24c005360 0x7fc24c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:23.511 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.503+0000 7fc267400640 1 -- 172.21.15.123:0/3988038107 reap_dead start 2024-04-25T13:43:23.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.507+0000 7fc266000640 1 --2- 172.21.15.123:0/3988038107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc24c004810 0x7fc24c004c20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc254001780 tx=0x7fc25401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d9b72a7fa9c72c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:23.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.507+0000 7fc265600640 1 -- 172.21.15.123:0/3988038107 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2540013a0 con 0x7fc24c004810 2024-04-25T13:43:23.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.507+0000 7fc265600640 1 -- 172.21.15.123:0/3988038107 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2540052f0 con 0x7fc24c004810 2024-04-25T13:43:23.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.507+0000 7fc265600640 1 -- 172.21.15.123:0/3988038107 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc254003840 con 0x7fc24c004810 2024-04-25T13:43:23.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.507+0000 7fc26da00640 1 -- 172.21.15.123:0/3988038107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc24c004810 msgr2=0x7fc24c004c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:23.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.507+0000 7fc26da00640 1 --2- 172.21.15.123:0/3988038107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc24c004810 0x7fc24c004c20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc254001780 tx=0x7fc25401c400 comp rx=0 tx=0).stop 2024-04-25T13:43:23.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.507+0000 7fc26da00640 1 -- 172.21.15.123:0/3988038107 shutdown_connections 2024-04-25T13:43:23.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.507+0000 7fc26da00640 1 --2- 172.21.15.123:0/3988038107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc24c004810 0x7fc24c004c20 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.507+0000 7fc26da00640 1 -- 172.21.15.123:0/3988038107 >> 172.21.15.123:0/3988038107 conn(0x7fc26806d210 msgr2=0x7fc26806ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:23.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.507+0000 7fc26da00640 1 -- 172.21.15.123:0/3988038107 shutdown_connections 2024-04-25T13:43:23.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.507+0000 7fc26da00640 1 -- 172.21.15.123:0/3988038107 wait complete. 2024-04-25T13:43:23.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.511+0000 7fc26da00640 1 Processor -- start 2024-04-25T13:43:23.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.511+0000 7fc26da00640 1 -- start start 2024-04-25T13:43:23.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.511+0000 7fc26da00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc24c004810 0x7fc26815d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.511+0000 7fc26da00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc26815dda0 0x7fc26813ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.511+0000 7fc26da00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc26815f690 0x7fc26813f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.511+0000 7fc26da00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc268074bb0 con 0x7fc26815f690 2024-04-25T13:43:23.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.511+0000 7fc26da00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc268073f20 con 0x7fc26815dda0 2024-04-25T13:43:23.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.511+0000 7fc26da00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc2680b6380 con 0x7fc24c004810 2024-04-25T13:43:23.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.511+0000 7fc267400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc26815f690 0x7fc26813f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.511+0000 7fc267400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc26815f690 0x7fc26813f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40916/0 (socket says 172.21.15.123:40916) 2024-04-25T13:43:23.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.511+0000 7fc267400640 1 -- 172.21.15.123:0/1451957166 learned_addr learned my addr 172.21.15.123:0/1451957166 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:23.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.511+0000 7fc266a00640 1 --2- 172.21.15.123:0/1451957166 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc24c004810 0x7fc26815d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.511+0000 7fc266000640 1 --2- 172.21.15.123:0/1451957166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc26815dda0 0x7fc26813ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.515+0000 7fc267400640 1 -- 172.21.15.123:0/1451957166 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc24c004810 msgr2=0x7fc26815d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:23.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.515+0000 7fc267400640 1 --2- 172.21.15.123:0/1451957166 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc24c004810 0x7fc26815d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.515+0000 7fc267400640 1 -- 172.21.15.123:0/1451957166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc26815dda0 msgr2=0x7fc26813ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:23.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.515+0000 7fc267400640 1 --2- 172.21.15.123:0/1451957166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc26815dda0 0x7fc26813ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.515+0000 7fc267400640 1 -- 172.21.15.123:0/1451957166 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2680d1780 con 0x7fc26815f690 2024-04-25T13:43:23.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.515+0000 7fc267400640 1 --2- 172.21.15.123:0/1451957166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc26815f690 0x7fc26813f3a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc2680722a0 tx=0x7fc26000f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:23.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.515+0000 7fc25ea00640 1 -- 172.21.15.123:0/1451957166 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc26000b040 con 0x7fc26815f690 2024-04-25T13:43:23.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.515+0000 7fc25ea00640 1 -- 172.21.15.123:0/1451957166 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc26001b070 con 0x7fc26815f690 2024-04-25T13:43:23.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.515+0000 7fc26da00640 1 -- 172.21.15.123:0/1451957166 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2680d1a60 con 0x7fc26815f690 2024-04-25T13:43:23.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.515+0000 7fc25ea00640 1 -- 172.21.15.123:0/1451957166 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc260011ab0 con 0x7fc26815f690 2024-04-25T13:43:23.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.515+0000 7fc26da00640 1 -- 172.21.15.123:0/1451957166 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2680aec80 con 0x7fc26815f690 2024-04-25T13:43:23.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.515+0000 7fc26da00640 1 -- 172.21.15.123:0/1451957166 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2680507c0 con 0x7fc26815f690 2024-04-25T13:43:23.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.515+0000 7fc25ea00640 1 -- 172.21.15.123:0/1451957166 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc260011c50 con 0x7fc26815f690 2024-04-25T13:43:23.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.515+0000 7fc25ea00640 1 --2- 172.21.15.123:0/1451957166 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fc24806f400 0x7fc248071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.519+0000 7fc25ea00640 1 -- 172.21.15.123:0/1451957166 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc26008ee70 con 0x7fc26815f690 2024-04-25T13:43:23.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.519+0000 7fc266a00640 1 --2- 172.21.15.123:0/1451957166 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fc24806f400 0x7fc248071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.519+0000 7fc266a00640 1 --2- 172.21.15.123:0/1451957166 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fc24806f400 0x7fc248071910 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc258001760 tx=0x7fc258001550 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:23.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.523+0000 7fc25ea00640 1 -- 172.21.15.123:0/1451957166 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc26005b700 con 0x7fc26815f690 2024-04-25T13:43:23.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.683+0000 7fc26da00640 1 -- 172.21.15.123:0/1451957166 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc2680b6780 con 0x7fc26815f690 2024-04-25T13:43:23.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.683+0000 7fc25ea00640 1 -- 172.21.15.123:0/1451957166 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16693 (secure 0 0 0) 0x7fc26005fa00 con 0x7fc26815f690 2024-04-25T13:43:23.687 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:23.688 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":34,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:43:03.039428+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:59.250248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T13:43:00.396458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:43:23.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.687+0000 7fc26da00640 1 -- 172.21.15.123:0/1451957166 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fc24806f400 msgr2=0x7fc248071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:23.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.687+0000 7fc26da00640 1 --2- 172.21.15.123:0/1451957166 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fc24806f400 0x7fc248071910 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc258001760 tx=0x7fc258001550 comp rx=0 tx=0).stop 2024-04-25T13:43:23.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.687+0000 7fc26da00640 1 -- 172.21.15.123:0/1451957166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc26815f690 msgr2=0x7fc26813f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:23.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.687+0000 7fc26da00640 1 --2- 172.21.15.123:0/1451957166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc26815f690 0x7fc26813f3a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc2680722a0 tx=0x7fc26000f9a0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.687+0000 7fc26da00640 1 -- 172.21.15.123:0/1451957166 shutdown_connections 2024-04-25T13:43:23.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.687+0000 7fc26da00640 1 --2- 172.21.15.123:0/1451957166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc26815dda0 0x7fc26813ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.687+0000 7fc26da00640 1 --2- 172.21.15.123:0/1451957166 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fc24806f400 0x7fc248071910 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.687+0000 7fc26da00640 1 --2- 172.21.15.123:0/1451957166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc26815f690 0x7fc26813f3a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.687+0000 7fc26da00640 1 --2- 172.21.15.123:0/1451957166 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc24c004810 0x7fc26815d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.687+0000 7fc26da00640 1 -- 172.21.15.123:0/1451957166 >> 172.21.15.123:0/1451957166 conn(0x7fc26806d210 msgr2=0x7fc2680b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:23.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.687+0000 7fc26da00640 1 -- 172.21.15.123:0/1451957166 shutdown_connections 2024-04-25T13:43:23.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.687+0000 7fc26da00640 1 -- 172.21.15.123:0/1451957166 wait complete. 2024-04-25T13:43:23.709 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:41:53.602480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:42:59.250248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:43:00.396458+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:43:23.710 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:43:23.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.855+0000 7f0717800640 1 Processor -- start 2024-04-25T13:43:23.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.855+0000 7f0717800640 1 -- start start 2024-04-25T13:43:23.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.855+0000 7f0717800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f07100b3870 0x7f07100b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.855+0000 7f0717800640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0710072af0 0x7f0710072f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.855+0000 7f0717800640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07100b41c0 con 0x7f07101571b0 2024-04-25T13:43:23.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.855+0000 7f0717800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f07100cdee0 con 0x7f07100b3870 2024-04-25T13:43:23.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.855+0000 7f0717800640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f071015d570 con 0x7f0710072af0 2024-04-25T13:43:23.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.855+0000 7f070fe00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f07100b3870 0x7f07100b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.855+0000 7f070fe00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f07100b3870 0x7f07100b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40928/0 (socket says 172.21.15.123:40928) 2024-04-25T13:43:23.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.855+0000 7f070fe00640 1 -- 172.21.15.123:0/3404535442 learned_addr learned my addr 172.21.15.123:0/3404535442 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:23.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.855+0000 7f0715800640 1 --2- 172.21.15.123:0/3404535442 >> v2:172.21.15.130:3300/0 conn(0x7f0710072af0 0x7f0710072f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.855+0000 7f070fe00640 1 -- 172.21.15.123:0/3404535442 >> v2:172.21.15.130:3300/0 conn(0x7f0710072af0 msgr2=0x7f0710072f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:23.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.855+0000 7f070fe00640 1 --2- 172.21.15.123:0/3404535442 >> v2:172.21.15.130:3300/0 conn(0x7f0710072af0 0x7f0710072f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.855+0000 7f070fe00640 1 -- 172.21.15.123:0/3404535442 >> v1:172.21.15.130:6789/0 conn(0x7f07101571b0 legacy=0x7f07100cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:23.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.855+0000 7f070fe00640 1 -- 172.21.15.123:0/3404535442 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f071015d850 con 0x7f07100b3870 2024-04-25T13:43:23.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.859+0000 7f070fe00640 1 --2- 172.21.15.123:0/3404535442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07100b3870 0x7f07100b3c80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00bb10 tx=0x7f06fc01eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee7771710d976468 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:23.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.859+0000 7f070f400640 1 -- 172.21.15.123:0/3404535442 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06fc0b4070 con 0x7f07100b3870 2024-04-25T13:43:23.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.859+0000 7f070f400640 1 -- 172.21.15.123:0/3404535442 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06fc0a7b20 con 0x7f07100b3870 2024-04-25T13:43:23.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.859+0000 7f070f400640 1 -- 172.21.15.123:0/3404535442 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06fc0af440 con 0x7f07100b3870 2024-04-25T13:43:23.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.859+0000 7f0717800640 1 -- 172.21.15.123:0/3404535442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07100b3870 msgr2=0x7f07100b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:23.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.859+0000 7f0717800640 1 --2- 172.21.15.123:0/3404535442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07100b3870 0x7f07100b3c80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00bb10 tx=0x7f06fc01eb30 comp rx=0 tx=0).stop 2024-04-25T13:43:23.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.859+0000 7f0717800640 1 -- 172.21.15.123:0/3404535442 shutdown_connections 2024-04-25T13:43:23.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.859+0000 7f0717800640 1 --2- 172.21.15.123:0/3404535442 >> v2:172.21.15.130:3300/0 conn(0x7f0710072af0 0x7f0710072f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.859+0000 7f0717800640 1 --2- 172.21.15.123:0/3404535442 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07100b3870 0x7f07100b3c80 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.859+0000 7f0717800640 1 -- 172.21.15.123:0/3404535442 >> 172.21.15.123:0/3404535442 conn(0x7f071006ca70 msgr2=0x7f071006ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:23.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.859+0000 7f0717800640 1 -- 172.21.15.123:0/3404535442 shutdown_connections 2024-04-25T13:43:23.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.859+0000 7f0717800640 1 -- 172.21.15.123:0/3404535442 wait complete. 2024-04-25T13:43:23.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.863+0000 7f0717800640 1 Processor -- start 2024-04-25T13:43:23.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.863+0000 7f0717800640 1 -- start start 2024-04-25T13:43:23.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.863+0000 7f0717800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0710072af0 0x7f071014ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.863+0000 7f0717800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07100b3870 0x7f0710141450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.863+0000 7f0717800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07101571b0 0x7f07100d0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.863+0000 7f0717800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f0710157740 con 0x7f07100b3870 2024-04-25T13:43:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.863+0000 7f0717800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f07101575c0 con 0x7f07101571b0 2024-04-25T13:43:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.863+0000 7f0717800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0710073850 con 0x7f0710072af0 2024-04-25T13:43:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.863+0000 7f070fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07100b3870 0x7f0710141450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.863+0000 7f070fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07100b3870 0x7f0710141450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40934/0 (socket says 172.21.15.123:40934) 2024-04-25T13:43:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.863+0000 7f070fe00640 1 -- 172.21.15.123:0/2716913236 learned_addr learned my addr 172.21.15.123:0/2716913236 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.863+0000 7f0715800640 1 --2- 172.21.15.123:0/2716913236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07101571b0 0x7f07100d0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.863+0000 7f0714e00640 1 --2- 172.21.15.123:0/2716913236 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0710072af0 0x7f071014ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.867+0000 7f070fe00640 1 -- 172.21.15.123:0/2716913236 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0710072af0 msgr2=0x7f071014ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.867+0000 7f070fe00640 1 --2- 172.21.15.123:0/2716913236 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0710072af0 0x7f071014ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.867+0000 7f070fe00640 1 -- 172.21.15.123:0/2716913236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07101571b0 msgr2=0x7f07100d0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.867+0000 7f070fe00640 1 --2- 172.21.15.123:0/2716913236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07101571b0 0x7f07100d0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.867+0000 7f070fe00640 1 -- 172.21.15.123:0/2716913236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0710156800 con 0x7f07100b3870 2024-04-25T13:43:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.867+0000 7f0715800640 1 --2- 172.21.15.123:0/2716913236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07101571b0 0x7f07100d0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:23.870 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.867+0000 7f070fe00640 1 --2- 172.21.15.123:0/2716913236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07100b3870 0x7f0710141450 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f06fc01b740 tx=0x7f06fc01b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:23.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.867+0000 7f070cc00640 1 -- 172.21.15.123:0/2716913236 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06fc0b4040 con 0x7f07100b3870 2024-04-25T13:43:23.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.867+0000 7f070cc00640 1 -- 172.21.15.123:0/2716913236 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06fc0bf070 con 0x7f07100b3870 2024-04-25T13:43:23.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.867+0000 7f070cc00640 1 -- 172.21.15.123:0/2716913236 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06fc0ba680 con 0x7f07100b3870 2024-04-25T13:43:23.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.867+0000 7f0717800640 1 -- 172.21.15.123:0/2716913236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0710153cf0 con 0x7f07100b3870 2024-04-25T13:43:23.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.867+0000 7f0717800640 1 -- 172.21.15.123:0/2716913236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0710156290 con 0x7f07100b3870 2024-04-25T13:43:23.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.867+0000 7f0717800640 1 -- 172.21.15.123:0/2716913236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0710153ae0 con 0x7f07100b3870 2024-04-25T13:43:23.872 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.867+0000 7f070cc00640 1 -- 172.21.15.123:0/2716913236 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f06fc0ba820 con 0x7f07100b3870 2024-04-25T13:43:23.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.867+0000 7f070cc00640 1 --2- 172.21.15.123:0/2716913236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f06f006f430 0x7f06f0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:23.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.871+0000 7f070cc00640 1 -- 172.21.15.123:0/2716913236 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f06fc12c7c0 con 0x7f07100b3870 2024-04-25T13:43:23.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.871+0000 7f0714e00640 1 --2- 172.21.15.123:0/2716913236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f06f006f430 0x7f06f0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:23.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.871+0000 7f0714e00640 1 --2- 172.21.15.123:0/2716913236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f06f006f430 0x7f06f0071940 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0710070f70 tx=0x7f0700009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:23.877 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:23.875+0000 7f070cc00640 1 -- 172.21.15.123:0/2716913236 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f06fc0187e0 con 0x7f07100b3870 2024-04-25T13:43:24.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.031+0000 7f0717800640 1 -- 172.21.15.123:0/2716913236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0710050750 con 0x7f07100b3870 2024-04-25T13:43:24.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.031+0000 7f070cc00640 1 -- 172.21.15.123:0/2716913236 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) ==== 93+0+10 (secure 0 0 0) 0x7f06fc0f9730 con 0x7f07100b3870 2024-04-25T13:43:24.037 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-04-25T13:43:24.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.035+0000 7f0717800640 1 -- 172.21.15.123:0/2716913236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f06f006f430 msgr2=0x7f06f0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:24.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.035+0000 7f0717800640 1 --2- 172.21.15.123:0/2716913236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f06f006f430 0x7f06f0071940 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0710070f70 tx=0x7f0700009040 comp rx=0 tx=0).stop 2024-04-25T13:43:24.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.035+0000 7f0717800640 1 -- 172.21.15.123:0/2716913236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07100b3870 msgr2=0x7f0710141450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:24.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.035+0000 7f0717800640 1 --2- 172.21.15.123:0/2716913236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07100b3870 0x7f0710141450 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f06fc01b740 tx=0x7f06fc01b8d0 comp rx=0 tx=0).stop 2024-04-25T13:43:24.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.035+0000 7f0717800640 1 -- 172.21.15.123:0/2716913236 shutdown_connections 2024-04-25T13:43:24.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.035+0000 7f0717800640 1 --2- 172.21.15.123:0/2716913236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f07101571b0 0x7f07100d0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:24.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.035+0000 7f0717800640 1 --2- 172.21.15.123:0/2716913236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f06f006f430 0x7f06f0071940 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:24.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.035+0000 7f0717800640 1 --2- 172.21.15.123:0/2716913236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07100b3870 0x7f0710141450 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:24.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.035+0000 7f0717800640 1 --2- 172.21.15.123:0/2716913236 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0710072af0 0x7f071014ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:24.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.035+0000 7f0717800640 1 -- 172.21.15.123:0/2716913236 >> 172.21.15.123:0/2716913236 conn(0x7f071006ca70 msgr2=0x7f071014f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:24.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.035+0000 7f0717800640 1 -- 172.21.15.123:0/2716913236 shutdown_connections 2024-04-25T13:43:24.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.035+0000 7f0717800640 1 -- 172.21.15.123:0/2716913236 wait complete. 2024-04-25T13:43:24.058 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:43:24.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.203+0000 7fe769200640 1 Processor -- start 2024-04-25T13:43:24.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.207+0000 7fe769200640 1 -- start start 2024-04-25T13:43:24.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.207+0000 7fe769200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7640b2b10 0x7fe7640d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:24.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.207+0000 7fe769200640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe7640d06f0 0x7fe7640b7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:24.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.207+0000 7fe769200640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7640ce200 con 0x7fe7640cddf0 2024-04-25T13:43:24.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.207+0000 7fe769200640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fe7640b73a0 con 0x7fe7640d06f0 2024-04-25T13:43:24.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.207+0000 7fe769200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe7640d0b00 con 0x7fe7640b2b10 2024-04-25T13:43:24.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.207+0000 7fe762a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7640b2b10 0x7fe7640d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:24.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.207+0000 7fe763e00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe7640d06f0 0x7fe7640b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:24.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.207+0000 7fe763e00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe7640d06f0 0x7fe7640b7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:42096/0 (socket says 172.21.15.123:42096) 2024-04-25T13:43:24.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.207+0000 7fe763e00640 1 -- 172.21.15.123:0/3642426373 learned_addr learned my addr 172.21.15.123:0/3642426373 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:24.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.207+0000 7fe762a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7640b2b10 0x7fe7640d01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:37506/0 (socket says 172.21.15.123:37506) 2024-04-25T13:43:24.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.207+0000 7fe763e00640 1 -- 172.21.15.123:0/3642426373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7640b2b10 msgr2=0x7fe7640d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:24.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.207+0000 7fe763e00640 1 --2- 172.21.15.123:0/3642426373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7640b2b10 0x7fe7640d01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:24.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.207+0000 7fe763e00640 1 -- 172.21.15.123:0/3642426373 >> v1:172.21.15.130:6789/0 conn(0x7fe7640cddf0 legacy=0x7fe76406d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:24.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.207+0000 7fe763e00640 1 -- 172.21.15.123:0/3642426373 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7640b6790 con 0x7fe7640d06f0 2024-04-25T13:43:24.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.211+0000 7fe763e00640 1 --2- 172.21.15.123:0/3642426373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7640d06f0 0x7fe7640b7830 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009e50 tx=0x7fe75c01ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f166e6e3efe933a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:24.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.211+0000 7fe762000640 1 -- 172.21.15.123:0/3642426373 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c0a57f0 con 0x7fe7640d06f0 2024-04-25T13:43:24.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.211+0000 7fe762000640 1 -- 172.21.15.123:0/3642426373 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe75c0a5990 con 0x7fe7640d06f0 2024-04-25T13:43:24.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.211+0000 7fe762000640 1 -- 172.21.15.123:0/3642426373 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c0a5d60 con 0x7fe7640d06f0 2024-04-25T13:43:24.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.211+0000 7fe769200640 1 -- 172.21.15.123:0/3642426373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7640d06f0 msgr2=0x7fe7640b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:24.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.211+0000 7fe769200640 1 --2- 172.21.15.123:0/3642426373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7640d06f0 0x7fe7640b7830 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009e50 tx=0x7fe75c01ca30 comp rx=0 tx=0).stop 2024-04-25T13:43:24.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.211+0000 7fe769200640 1 -- 172.21.15.123:0/3642426373 shutdown_connections 2024-04-25T13:43:24.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.211+0000 7fe769200640 1 --2- 172.21.15.123:0/3642426373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7640d06f0 0x7fe7640b7830 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:24.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.211+0000 7fe769200640 1 --2- 172.21.15.123:0/3642426373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7640b2b10 0x7fe7640d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:24.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.211+0000 7fe769200640 1 -- 172.21.15.123:0/3642426373 >> 172.21.15.123:0/3642426373 conn(0x7fe76409cb10 msgr2=0x7fe76408cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:24.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.211+0000 7fe769200640 1 -- 172.21.15.123:0/3642426373 shutdown_connections 2024-04-25T13:43:24.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.211+0000 7fe769200640 1 -- 172.21.15.123:0/3642426373 wait complete. 2024-04-25T13:43:24.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.215+0000 7fe769200640 1 Processor -- start 2024-04-25T13:43:24.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.215+0000 7fe769200640 1 -- start start 2024-04-25T13:43:24.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.215+0000 7fe769200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7640b2b10 0x7fe764150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:24.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.215+0000 7fe769200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7640cddf0 0x7fe764154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:24.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.215+0000 7fe769200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7640d06f0 0x7fe764154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:24.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.215+0000 7fe769200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe7640d35d0 con 0x7fe7640b2b10 2024-04-25T13:43:24.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.215+0000 7fe769200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe7640b2f20 con 0x7fe7640d06f0 2024-04-25T13:43:24.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.215+0000 7fe769200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe7640d3750 con 0x7fe7640cddf0 2024-04-25T13:43:24.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.215+0000 7fe763400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7640b2b10 0x7fe764150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:24.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.215+0000 7fe763400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7640b2b10 0x7fe764150240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40946/0 (socket says 172.21.15.123:40946) 2024-04-25T13:43:24.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.215+0000 7fe763400640 1 -- 172.21.15.123:0/496341135 learned_addr learned my addr 172.21.15.123:0/496341135 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:24.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.215+0000 7fe762a00640 1 --2- 172.21.15.123:0/496341135 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7640cddf0 0x7fe764154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:24.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.215+0000 7fe763e00640 1 --2- 172.21.15.123:0/496341135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7640d06f0 0x7fe764154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:24.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.215+0000 7fe763400640 1 -- 172.21.15.123:0/496341135 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7640cddf0 msgr2=0x7fe764154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:24.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.215+0000 7fe763400640 1 --2- 172.21.15.123:0/496341135 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7640cddf0 0x7fe764154820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:24.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.215+0000 7fe763400640 1 -- 172.21.15.123:0/496341135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7640d06f0 msgr2=0x7fe764154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:24.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.215+0000 7fe763400640 1 --2- 172.21.15.123:0/496341135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7640d06f0 0x7fe764154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:24.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.215+0000 7fe763400640 1 -- 172.21.15.123:0/496341135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe76415ed50 con 0x7fe7640b2b10 2024-04-25T13:43:24.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.215+0000 7fe763400640 1 --2- 172.21.15.123:0/496341135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7640b2b10 0x7fe764150240 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe75400c440 tx=0x7fe75400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:24.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.219+0000 7fe75b400640 1 -- 172.21.15.123:0/496341135 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7540052d0 con 0x7fe7640b2b10 2024-04-25T13:43:24.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.219+0000 7fe75b400640 1 -- 172.21.15.123:0/496341135 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe754005490 con 0x7fe7640b2b10 2024-04-25T13:43:24.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.219+0000 7fe75b400640 1 -- 172.21.15.123:0/496341135 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe754006a70 con 0x7fe7640b2b10 2024-04-25T13:43:24.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.219+0000 7fe769200640 1 -- 172.21.15.123:0/496341135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7640b0650 con 0x7fe7640b2b10 2024-04-25T13:43:24.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.219+0000 7fe769200640 1 -- 172.21.15.123:0/496341135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7640b2310 con 0x7fe7640b2b10 2024-04-25T13:43:24.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.219+0000 7fe769200640 1 -- 172.21.15.123:0/496341135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe76415cf10 con 0x7fe7640b2b10 2024-04-25T13:43:24.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.219+0000 7fe75b400640 1 -- 172.21.15.123:0/496341135 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe754003650 con 0x7fe7640b2b10 2024-04-25T13:43:24.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.219+0000 7fe75b400640 1 --2- 172.21.15.123:0/496341135 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe74406f430 0x7fe744071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:24.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.219+0000 7fe75b400640 1 -- 172.21.15.123:0/496341135 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fe75408e5d0 con 0x7fe7640b2b10 2024-04-25T13:43:24.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.219+0000 7fe762a00640 1 --2- 172.21.15.123:0/496341135 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe74406f430 0x7fe744071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:24.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.223+0000 7fe762a00640 1 --2- 172.21.15.123:0/496341135 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe74406f430 0x7fe744071940 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe764151280 tx=0x7fe750009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:24.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.223+0000 7fe75b400640 1 -- 172.21.15.123:0/496341135 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe76415ed50 con 0x7fe7640b2b10 2024-04-25T13:43:24.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.379+0000 7fe769200640 1 -- 172.21.15.123:0/496341135 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe7640b1e20 con 0x7fe7640b2b10 2024-04-25T13:43:24.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.379+0000 7fe75b400640 1 -- 172.21.15.123:0/496341135 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) ==== 104+0+11 (secure 0 0 0) 0x7fe7640ce200 con 0x7fe7640b2b10 2024-04-25T13:43:24.384 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-04-25T13:43:24.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.383+0000 7fe769200640 1 -- 172.21.15.123:0/496341135 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe74406f430 msgr2=0x7fe744071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:24.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.383+0000 7fe769200640 1 --2- 172.21.15.123:0/496341135 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe74406f430 0x7fe744071940 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe764151280 tx=0x7fe750009190 comp rx=0 tx=0).stop 2024-04-25T13:43:24.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.383+0000 7fe769200640 1 -- 172.21.15.123:0/496341135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7640b2b10 msgr2=0x7fe764150240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:24.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.383+0000 7fe769200640 1 --2- 172.21.15.123:0/496341135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7640b2b10 0x7fe764150240 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe75400c440 tx=0x7fe75400c900 comp rx=0 tx=0).stop 2024-04-25T13:43:24.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.383+0000 7fe769200640 1 -- 172.21.15.123:0/496341135 shutdown_connections 2024-04-25T13:43:24.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.383+0000 7fe769200640 1 --2- 172.21.15.123:0/496341135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7640d06f0 0x7fe764154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:24.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.383+0000 7fe769200640 1 --2- 172.21.15.123:0/496341135 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe74406f430 0x7fe744071940 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:24.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.383+0000 7fe769200640 1 --2- 172.21.15.123:0/496341135 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7640cddf0 0x7fe764154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:24.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.383+0000 7fe769200640 1 --2- 172.21.15.123:0/496341135 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe7640b2b10 0x7fe764150240 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:24.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.383+0000 7fe769200640 1 -- 172.21.15.123:0/496341135 >> 172.21.15.123:0/496341135 conn(0x7fe76409cb10 msgr2=0x7fe7640b7550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:24.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.383+0000 7fe769200640 1 -- 172.21.15.123:0/496341135 shutdown_connections 2024-04-25T13:43:24.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.383+0000 7fe769200640 1 -- 172.21.15.123:0/496341135 wait complete. 2024-04-25T13:43:24.406 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:43:24.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.551+0000 7f056f200640 1 Processor -- start 2024-04-25T13:43:24.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.551+0000 7f056f200640 1 -- start start 2024-04-25T13:43:24.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.555+0000 7f056f200640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0568149b00 0x7f056806fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:24.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.555+0000 7f056f200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05680b5550 0x7f05680b5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:24.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.555+0000 7f056f200640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05680b5ea0 con 0x7f0568163a20 2024-04-25T13:43:24.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.555+0000 7f056f200640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f0568070410 con 0x7f0568149b00 2024-04-25T13:43:24.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.555+0000 7f056f200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f05680706f0 con 0x7f05680b5550 2024-04-25T13:43:24.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.555+0000 7f055f400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05680b5550 0x7f05680b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:24.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.555+0000 7f055f400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05680b5550 0x7f05680b5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:37514/0 (socket says 172.21.15.123:37514) 2024-04-25T13:43:24.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.555+0000 7f0567e00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0568149b00 0x7f056806fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:24.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.555+0000 7f055f400640 1 -- 172.21.15.123:0/1419498973 learned_addr learned my addr 172.21.15.123:0/1419498973 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:24.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.555+0000 7f055f400640 1 -- 172.21.15.123:0/1419498973 >> v2:172.21.15.130:3300/0 conn(0x7f0568149b00 msgr2=0x7f056806fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:24.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.555+0000 7f055f400640 1 --2- 172.21.15.123:0/1419498973 >> v2:172.21.15.130:3300/0 conn(0x7f0568149b00 0x7f056806fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:24.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.555+0000 7f055f400640 1 -- 172.21.15.123:0/1419498973 >> v1:172.21.15.130:6789/0 conn(0x7f0568163a20 legacy=0x7f0568163e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:24.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.555+0000 7f055f400640 1 -- 172.21.15.123:0/1419498973 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05680709d0 con 0x7f05680b5550 2024-04-25T13:43:24.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.559+0000 7f055f400640 1 --2- 172.21.15.123:0/1419498973 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05680b5550 0x7f05680b5960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0550009870 tx=0x7f055001c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cf4071a7e2d5efb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:24.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.559+0000 7f0567400640 1 -- 172.21.15.123:0/1419498973 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05500a95f0 con 0x7f05680b5550 2024-04-25T13:43:24.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.559+0000 7f0567400640 1 -- 172.21.15.123:0/1419498973 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05500a9790 con 0x7f05680b5550 2024-04-25T13:43:24.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.559+0000 7f0567400640 1 -- 172.21.15.123:0/1419498973 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05500a9b60 con 0x7f05680b5550 2024-04-25T13:43:24.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.559+0000 7f056f200640 1 -- 172.21.15.123:0/1419498973 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05680b5550 msgr2=0x7f05680b5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:24.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.559+0000 7f056f200640 1 --2- 172.21.15.123:0/1419498973 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05680b5550 0x7f05680b5960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0550009870 tx=0x7f055001c530 comp rx=0 tx=0).stop 2024-04-25T13:43:24.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.559+0000 7f056f200640 1 -- 172.21.15.123:0/1419498973 shutdown_connections 2024-04-25T13:43:24.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.559+0000 7f056f200640 1 --2- 172.21.15.123:0/1419498973 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05680b5550 0x7f05680b5960 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:24.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.559+0000 7f056f200640 1 --2- 172.21.15.123:0/1419498973 >> v2:172.21.15.130:3300/0 conn(0x7f0568149b00 0x7f056806fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:24.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.559+0000 7f056f200640 1 -- 172.21.15.123:0/1419498973 >> 172.21.15.123:0/1419498973 conn(0x7f05680d2180 msgr2=0x7f05680d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:24.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.559+0000 7f056f200640 1 -- 172.21.15.123:0/1419498973 shutdown_connections 2024-04-25T13:43:24.563 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.559+0000 7f056f200640 1 -- 172.21.15.123:0/1419498973 wait complete. 2024-04-25T13:43:24.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.563+0000 7f056f200640 1 Processor -- start 2024-04-25T13:43:24.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.563+0000 7f056f200640 1 -- start start 2024-04-25T13:43:24.567 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.563+0000 7f056f200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05680b5550 0x7f05681435c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:24.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.563+0000 7f056f200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0568149b00 0x7f056813ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:24.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.563+0000 7f056f200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0568163a20 0x7f0568148310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:24.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.563+0000 7f056f200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f056816d750 con 0x7f0568163a20 2024-04-25T13:43:24.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.563+0000 7f056f200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f056816d5d0 con 0x7f0568149b00 2024-04-25T13:43:24.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.563+0000 7f056f200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f056816d8d0 con 0x7f05680b5550 2024-04-25T13:43:24.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.563+0000 7f056d200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0568163a20 0x7f0568148310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:24.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.563+0000 7f056d200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0568163a20 0x7f0568148310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40948/0 (socket says 172.21.15.123:40948) 2024-04-25T13:43:24.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.563+0000 7f056d200640 1 -- 172.21.15.123:0/581343717 learned_addr learned my addr 172.21.15.123:0/581343717 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:24.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.563+0000 7f055f400640 1 --2- 172.21.15.123:0/581343717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0568149b00 0x7f056813ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:24.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.563+0000 7f0567e00640 1 --2- 172.21.15.123:0/581343717 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05680b5550 0x7f05681435c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:24.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.563+0000 7f056d200640 1 -- 172.21.15.123:0/581343717 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05680b5550 msgr2=0x7f05681435c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:24.568 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.563+0000 7f056d200640 1 --2- 172.21.15.123:0/581343717 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05680b5550 0x7f05681435c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:24.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.563+0000 7f056d200640 1 -- 172.21.15.123:0/581343717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0568149b00 msgr2=0x7f056813ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:24.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.563+0000 7f056d200640 1 --2- 172.21.15.123:0/581343717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0568149b00 0x7f056813ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:24.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.563+0000 7f056d200640 1 -- 172.21.15.123:0/581343717 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f056806fe30 con 0x7f0568163a20 2024-04-25T13:43:24.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.563+0000 7f056d200640 1 --2- 172.21.15.123:0/581343717 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0568163a20 0x7f0568148310 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f056000c760 tx=0x7f056000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:24.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.563+0000 7f0564c00640 1 -- 172.21.15.123:0/581343717 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0560003b80 con 0x7f0568163a20 2024-04-25T13:43:24.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.563+0000 7f0564c00640 1 -- 172.21.15.123:0/581343717 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0560003d20 con 0x7f0568163a20 2024-04-25T13:43:24.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.563+0000 7f056f200640 1 -- 172.21.15.123:0/581343717 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05681440e0 con 0x7f0568163a20 2024-04-25T13:43:24.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.563+0000 7f0564c00640 1 -- 172.21.15.123:0/581343717 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f056000aa30 con 0x7f0568163a20 2024-04-25T13:43:24.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.563+0000 7f056f200640 1 -- 172.21.15.123:0/581343717 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0568158000 con 0x7f0568163a20 2024-04-25T13:43:24.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.567+0000 7f056f200640 1 -- 172.21.15.123:0/581343717 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0568050750 con 0x7f0568163a20 2024-04-25T13:43:24.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.567+0000 7f0564c00640 1 -- 172.21.15.123:0/581343717 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f056000abd0 con 0x7f0568163a20 2024-04-25T13:43:24.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.567+0000 7f0564c00640 1 --2- 172.21.15.123:0/581343717 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f054406f400 0x7f0544071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:24.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.567+0000 7f0564c00640 1 -- 172.21.15.123:0/581343717 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f056008f0b0 con 0x7f0568163a20 2024-04-25T13:43:24.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.567+0000 7f0567e00640 1 --2- 172.21.15.123:0/581343717 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f054406f400 0x7f0544071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:24.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.567+0000 7f0567e00640 1 --2- 172.21.15.123:0/581343717 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f054406f400 0x7f0544071910 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0558009ac0 tx=0x7f0558009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:24.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.571+0000 7f0564c00640 1 -- 172.21.15.123:0/581343717 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f05680b5ea0 con 0x7f0568163a20 2024-04-25T13:43:24.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.727+0000 7f056f200640 1 -- 172.21.15.123:0/581343717 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f05680b61a0 con 0x7f0568163a20 2024-04-25T13:43:24.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.731+0000 7f0564c00640 1 -- 172.21.15.123:0/581343717 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) ==== 100+0+11 (secure 0 0 0) 0x7f056005b830 con 0x7f0568163a20 2024-04-25T13:43:24.734 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-04-25T13:43:24.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.731+0000 7f056f200640 1 -- 172.21.15.123:0/581343717 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f054406f400 msgr2=0x7f0544071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:24.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.731+0000 7f056f200640 1 --2- 172.21.15.123:0/581343717 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f054406f400 0x7f0544071910 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0558009ac0 tx=0x7f0558009190 comp rx=0 tx=0).stop 2024-04-25T13:43:24.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.731+0000 7f056f200640 1 -- 172.21.15.123:0/581343717 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0568163a20 msgr2=0x7f0568148310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:24.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.731+0000 7f056f200640 1 --2- 172.21.15.123:0/581343717 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0568163a20 0x7f0568148310 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f056000c760 tx=0x7f056000cc20 comp rx=0 tx=0).stop 2024-04-25T13:43:24.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.731+0000 7f056f200640 1 -- 172.21.15.123:0/581343717 shutdown_connections 2024-04-25T13:43:24.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.731+0000 7f056f200640 1 --2- 172.21.15.123:0/581343717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0568149b00 0x7f056813ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:24.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.731+0000 7f056f200640 1 --2- 172.21.15.123:0/581343717 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f054406f400 0x7f0544071910 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:24.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.731+0000 7f056f200640 1 --2- 172.21.15.123:0/581343717 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0568163a20 0x7f0568148310 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:24.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.731+0000 7f056f200640 1 --2- 172.21.15.123:0/581343717 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05680b5550 0x7f05681435c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:24.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.731+0000 7f056f200640 1 -- 172.21.15.123:0/581343717 >> 172.21.15.123:0/581343717 conn(0x7f05680d2180 msgr2=0x7f0568161ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:24.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.731+0000 7f056f200640 1 -- 172.21.15.123:0/581343717 shutdown_connections 2024-04-25T13:43:24.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.731+0000 7f056f200640 1 -- 172.21.15.123:0/581343717 wait complete. 2024-04-25T13:43:24.756 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T13:43:24.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.899+0000 7f5b99200640 1 Processor -- start 2024-04-25T13:43:24.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.899+0000 7f5b99200640 1 -- start start 2024-04-25T13:43:24.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.903+0000 7f5b99200640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5b940b3870 0x7f5b940b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:24.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.903+0000 7f5b99200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b940b41c0 con 0x7f5b94072af0 2024-04-25T13:43:24.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.903+0000 7f5b99200640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b940cdee0 con 0x7f5b941571b0 2024-04-25T13:43:24.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.903+0000 7f5b99200640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f5b9415d570 con 0x7f5b940b3870 2024-04-25T13:43:24.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.903+0000 7f5b92800640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5b94072af0 0x7f5b94072f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58494/0 (socket says 172.21.15.123:58494) 2024-04-25T13:43:24.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.903+0000 7f5b92800640 1 -- 172.21.15.123:0/2641091604 learned_addr learned my addr 172.21.15.123:0/2641091604 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:24.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.903+0000 7f5b89400640 1 --2- 172.21.15.123:0/2641091604 >> v2:172.21.15.130:3300/0 conn(0x7f5b940b3870 0x7f5b940b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:24.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.903+0000 7f5b91400640 1 -- 172.21.15.123:0/2641091604 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3466799154 0 0) 0x7f5b8c001120 con 0x7f5b94072af0 2024-04-25T13:43:24.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.903+0000 7f5b91400640 1 -- 172.21.15.123:0/2641091604 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b78003530 con 0x7f5b94072af0 2024-04-25T13:43:24.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.903+0000 7f5b91400640 1 -- 172.21.15.123:0/2641091604 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2028378457 0 0) 0x7f5b940cdee0 con 0x7f5b941571b0 2024-04-25T13:43:24.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.903+0000 7f5b91400640 1 -- 172.21.15.123:0/2641091604 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b8c001120 con 0x7f5b941571b0 2024-04-25T13:43:24.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.903+0000 7f5b89400640 1 -- 172.21.15.123:0/2641091604 >> v1:172.21.15.130:6789/0 conn(0x7f5b941571b0 legacy=0x7f5b940cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:24.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.903+0000 7f5b89400640 1 -- 172.21.15.123:0/2641091604 >> v1:172.21.15.123:6789/0 conn(0x7f5b94072af0 legacy=0x7f5b94072f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:24.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.903+0000 7f5b89400640 1 -- 172.21.15.123:0/2641091604 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b9415d850 con 0x7f5b940b3870 2024-04-25T13:43:24.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.907+0000 7f5b89400640 1 --2- 172.21.15.123:0/2641091604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b940b3870 0x7f5b940b3c80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0097f0 tx=0x7f5b7c01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9deec97cd84f7c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:24.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.907+0000 7f5b91400640 1 -- 172.21.15.123:0/2641091604 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c0ab600 con 0x7f5b940b3870 2024-04-25T13:43:24.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.907+0000 7f5b91400640 1 -- 172.21.15.123:0/2641091604 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b7c0b0070 con 0x7f5b940b3870 2024-04-25T13:43:24.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.907+0000 7f5b91400640 1 -- 172.21.15.123:0/2641091604 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c0ab9c0 con 0x7f5b940b3870 2024-04-25T13:43:24.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.907+0000 7f5b99200640 1 -- 172.21.15.123:0/2641091604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b940b3870 msgr2=0x7f5b940b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:24.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.907+0000 7f5b99200640 1 --2- 172.21.15.123:0/2641091604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b940b3870 0x7f5b940b3c80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0097f0 tx=0x7f5b7c01c3e0 comp rx=0 tx=0).stop 2024-04-25T13:43:24.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.907+0000 7f5b99200640 1 -- 172.21.15.123:0/2641091604 shutdown_connections 2024-04-25T13:43:24.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.907+0000 7f5b99200640 1 --2- 172.21.15.123:0/2641091604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b940b3870 0x7f5b940b3c80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:24.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.907+0000 7f5b99200640 1 -- 172.21.15.123:0/2641091604 >> 172.21.15.123:0/2641091604 conn(0x7f5b9406ca70 msgr2=0x7f5b9406ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:24.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.907+0000 7f5b99200640 1 -- 172.21.15.123:0/2641091604 shutdown_connections 2024-04-25T13:43:24.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.907+0000 7f5b99200640 1 -- 172.21.15.123:0/2641091604 wait complete. 2024-04-25T13:43:24.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.907+0000 7f5b99200640 1 Processor -- start 2024-04-25T13:43:24.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.907+0000 7f5b99200640 1 -- start start 2024-04-25T13:43:24.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.911+0000 7f5b99200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5b94072af0 0x7f5b9414fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:24.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.911+0000 7f5b99200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b940b3870 0x7f5b940cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:24.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.911+0000 7f5b99200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b941571b0 0x7f5b940cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:24.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.911+0000 7f5b99200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9415e050 con 0x7f5b940b3870 2024-04-25T13:43:24.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.911+0000 7f5b99200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5b941575c0 con 0x7f5b941571b0 2024-04-25T13:43:24.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.911+0000 7f5b99200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f5b9414d670 con 0x7f5b94072af0 2024-04-25T13:43:24.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.911+0000 7f5b89400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b940b3870 0x7f5b940cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:24.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.911+0000 7f5b89400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b940b3870 0x7f5b940cbb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40964/0 (socket says 172.21.15.123:40964) 2024-04-25T13:43:24.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.911+0000 7f5b89400640 1 -- 172.21.15.123:0/4028263718 learned_addr learned my addr 172.21.15.123:0/4028263718 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:24.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.911+0000 7f5b92800640 1 --2- 172.21.15.123:0/4028263718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b941571b0 0x7f5b940cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:24.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.911+0000 7f5b91e00640 1 --2- 172.21.15.123:0/4028263718 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5b94072af0 0x7f5b9414fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:24.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.911+0000 7f5b89400640 1 -- 172.21.15.123:0/4028263718 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5b94072af0 msgr2=0x7f5b9414fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:24.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.911+0000 7f5b89400640 1 --2- 172.21.15.123:0/4028263718 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5b94072af0 0x7f5b9414fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:24.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.911+0000 7f5b89400640 1 -- 172.21.15.123:0/4028263718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b941571b0 msgr2=0x7f5b940cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:24.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.911+0000 7f5b89400640 1 --2- 172.21.15.123:0/4028263718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b941571b0 0x7f5b940cc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:24.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.911+0000 7f5b89400640 1 -- 172.21.15.123:0/4028263718 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b94150290 con 0x7f5b940b3870 2024-04-25T13:43:24.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.911+0000 7f5b92800640 1 --2- 172.21.15.123:0/4028263718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b941571b0 0x7f5b940cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:24.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.911+0000 7f5b89400640 1 --2- 172.21.15.123:0/4028263718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b940b3870 0x7f5b940cbb30 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0097f0 tx=0x7f5b7c01ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:24.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.911+0000 7f5b8aa00640 1 -- 172.21.15.123:0/4028263718 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c0b5610 con 0x7f5b940b3870 2024-04-25T13:43:24.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.911+0000 7f5b8aa00640 1 -- 172.21.15.123:0/4028263718 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b7c0b57d0 con 0x7f5b940b3870 2024-04-25T13:43:24.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.911+0000 7f5b99200640 1 -- 172.21.15.123:0/4028263718 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b94150570 con 0x7f5b940b3870 2024-04-25T13:43:24.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.911+0000 7f5b8aa00640 1 -- 172.21.15.123:0/4028263718 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c0b5bc0 con 0x7f5b940b3870 2024-04-25T13:43:24.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.911+0000 7f5b99200640 1 -- 172.21.15.123:0/4028263718 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b940c7f90 con 0x7f5b940b3870 2024-04-25T13:43:24.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.911+0000 7f5b99200640 1 -- 172.21.15.123:0/4028263718 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b94050750 con 0x7f5b940b3870 2024-04-25T13:43:24.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.915+0000 7f5b8aa00640 1 -- 172.21.15.123:0/4028263718 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5b7c0bd020 con 0x7f5b940b3870 2024-04-25T13:43:24.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.915+0000 7f5b8aa00640 1 --2- 172.21.15.123:0/4028263718 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5b7006f430 0x7f5b70071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:24.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.915+0000 7f5b8aa00640 1 -- 172.21.15.123:0/4028263718 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f5b7c129510 con 0x7f5b940b3870 2024-04-25T13:43:24.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.915+0000 7f5b91e00640 1 --2- 172.21.15.123:0/4028263718 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5b7006f430 0x7f5b70071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:24.919 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.915+0000 7f5b91e00640 1 --2- 172.21.15.123:0/4028263718 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5b7006f430 0x7f5b70071940 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5b84007fd0 tx=0x7f5b84009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:24.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:24.919+0000 7f5b8aa00640 1 -- 172.21.15.123:0/4028263718 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5b7c0c4060 con 0x7f5b940b3870 2024-04-25T13:43:25.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.091+0000 7f5b99200640 1 -- 172.21.15.123:0/4028263718 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5b94150020 con 0x7f5b940b3870 2024-04-25T13:43:25.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.091+0000 7f5b8aa00640 1 -- 172.21.15.123:0/4028263718 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7f5b7c016090 con 0x7f5b940b3870 2024-04-25T13:43:25.096 INFO:teuthology.orchestra.run.smithi123.stderr:listed 0 entries 2024-04-25T13:43:25.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.095+0000 7f5b99200640 1 -- 172.21.15.123:0/4028263718 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5b7006f430 msgr2=0x7f5b70071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:25.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.095+0000 7f5b99200640 1 --2- 172.21.15.123:0/4028263718 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5b7006f430 0x7f5b70071940 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5b84007fd0 tx=0x7f5b84009040 comp rx=0 tx=0).stop 2024-04-25T13:43:25.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.095+0000 7f5b99200640 1 -- 172.21.15.123:0/4028263718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b940b3870 msgr2=0x7f5b940cbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:25.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.095+0000 7f5b99200640 1 --2- 172.21.15.123:0/4028263718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b940b3870 0x7f5b940cbb30 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0097f0 tx=0x7f5b7c01ac20 comp rx=0 tx=0).stop 2024-04-25T13:43:25.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.095+0000 7f5b99200640 1 -- 172.21.15.123:0/4028263718 shutdown_connections 2024-04-25T13:43:25.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.095+0000 7f5b99200640 1 --2- 172.21.15.123:0/4028263718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b941571b0 0x7f5b940cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:25.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.095+0000 7f5b99200640 1 --2- 172.21.15.123:0/4028263718 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5b7006f430 0x7f5b70071940 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:25.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.095+0000 7f5b99200640 1 --2- 172.21.15.123:0/4028263718 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5b940b3870 0x7f5b940cbb30 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:25.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.095+0000 7f5b99200640 1 --2- 172.21.15.123:0/4028263718 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5b94072af0 0x7f5b9414fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:25.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.095+0000 7f5b99200640 1 -- 172.21.15.123:0/4028263718 >> 172.21.15.123:0/4028263718 conn(0x7f5b9406ca70 msgr2=0x7f5b940cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:25.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.095+0000 7f5b99200640 1 -- 172.21.15.123:0/4028263718 shutdown_connections 2024-04-25T13:43:25.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.095+0000 7f5b99200640 1 -- 172.21.15.123:0/4028263718 wait complete. 2024-04-25T13:43:25.117 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T13:43:25.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:25.117 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T13:43:25.145 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-04-25T13:43:25.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:25.145 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T13:43:25.201 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T13:43:25.201 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:43:25.201 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:43:25.211 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6205 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T13:43:25.211 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T13:43:25.211 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:43:25.212 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:43:25.257 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8300 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T13:43:25.257 INFO:tasks.cephfs.mount:Terminating background process 2024-04-25T13:43:25.257 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:43:25.257 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:43:25.266 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6205 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T13:43:25.266 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:43:25.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.443+0000 7f0996a00640 1 Processor -- start 2024-04-25T13:43:25.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.447+0000 7f0996a00640 1 -- start start 2024-04-25T13:43:25.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.447+0000 7f0996a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09900d0f80 0x7f0990160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:25.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.447+0000 7f0996a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f09900b32f0 0x7f09900b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:25.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.447+0000 7f0996a00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09900b3c40 con 0x7f0990073be0 2024-04-25T13:43:25.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.447+0000 7f0996a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f099015cfe0 con 0x7f09900b32f0 2024-04-25T13:43:25.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.447+0000 7f0996a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f0990161520 con 0x7f09900d0f80 2024-04-25T13:43:25.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.447+0000 7f098f400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f09900b32f0 0x7f09900b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:25.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.447+0000 7f098f400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f09900b32f0 0x7f09900b3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40974/0 (socket says 172.21.15.123:40974) 2024-04-25T13:43:25.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.447+0000 7f098f400640 1 -- 172.21.15.123:0/3965809617 learned_addr learned my addr 172.21.15.123:0/3965809617 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:25.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.447+0000 7f098f400640 1 -- 172.21.15.123:0/3965809617 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09900d0f80 msgr2=0x7f0990160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:25.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.447+0000 7f098fe00640 1 --2- 172.21.15.123:0/3965809617 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09900d0f80 0x7f0990160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:25.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.447+0000 7f098f400640 1 --2- 172.21.15.123:0/3965809617 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09900d0f80 0x7f0990160fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:25.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.447+0000 7f098f400640 1 -- 172.21.15.123:0/3965809617 >> v1:172.21.15.130:6789/0 conn(0x7f0990073be0 legacy=0x7f0990073ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:25.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.447+0000 7f098f400640 1 -- 172.21.15.123:0/3965809617 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099015d240 con 0x7f09900b32f0 2024-04-25T13:43:25.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.447+0000 7f098fe00640 1 --2- 172.21.15.123:0/3965809617 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09900d0f80 0x7f0990160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:25.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.451+0000 7f098f400640 1 --2- 172.21.15.123:0/3965809617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09900b32f0 0x7f09900b3700 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f097c009870 tx=0x7f097c01c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882b51cb87631e8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:25.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.451+0000 7f098ea00640 1 -- 172.21.15.123:0/3965809617 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c0b0070 con 0x7f09900b32f0 2024-04-25T13:43:25.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.451+0000 7f098ea00640 1 -- 172.21.15.123:0/3965809617 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f097c0ab600 con 0x7f09900b32f0 2024-04-25T13:43:25.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.451+0000 7f098ea00640 1 -- 172.21.15.123:0/3965809617 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c0ab9d0 con 0x7f09900b32f0 2024-04-25T13:43:25.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.451+0000 7f0996a00640 1 -- 172.21.15.123:0/3965809617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09900b32f0 msgr2=0x7f09900b3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:25.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.451+0000 7f0996a00640 1 --2- 172.21.15.123:0/3965809617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09900b32f0 0x7f09900b3700 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f097c009870 tx=0x7f097c01c280 comp rx=0 tx=0).stop 2024-04-25T13:43:25.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.451+0000 7f0996a00640 1 -- 172.21.15.123:0/3965809617 shutdown_connections 2024-04-25T13:43:25.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.451+0000 7f0996a00640 1 --2- 172.21.15.123:0/3965809617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09900b32f0 0x7f09900b3700 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:25.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.451+0000 7f0996a00640 1 --2- 172.21.15.123:0/3965809617 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09900d0f80 0x7f0990160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:25.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.451+0000 7f0996a00640 1 -- 172.21.15.123:0/3965809617 >> 172.21.15.123:0/3965809617 conn(0x7f099006d210 msgr2=0x7f099006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:25.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.451+0000 7f0996a00640 1 -- 172.21.15.123:0/3965809617 shutdown_connections 2024-04-25T13:43:25.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.451+0000 7f0996a00640 1 -- 172.21.15.123:0/3965809617 wait complete. 2024-04-25T13:43:25.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.455+0000 7f0996a00640 1 Processor -- start 2024-04-25T13:43:25.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.455+0000 7f0996a00640 1 -- start start 2024-04-25T13:43:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.455+0000 7f0996a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0990073be0 0x7f099013e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.455+0000 7f0996a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09900b32f0 0x7f09901f71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.455+0000 7f0996a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09900d0f80 0x7f099015bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.455+0000 7f0996a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f09900b6020 con 0x7f09900b32f0 2024-04-25T13:43:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.455+0000 7f0996a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f099015ddc0 con 0x7f0990073be0 2024-04-25T13:43:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.455+0000 7f0996a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f09900b6470 con 0x7f09900d0f80 2024-04-25T13:43:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.455+0000 7f098f400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09900b32f0 0x7f09901f71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:25.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.455+0000 7f098f400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09900b32f0 0x7f09901f71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40978/0 (socket says 172.21.15.123:40978) 2024-04-25T13:43:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.455+0000 7f098f400640 1 -- 172.21.15.123:0/2195441748 learned_addr learned my addr 172.21.15.123:0/2195441748 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.455+0000 7f098fe00640 1 --2- 172.21.15.123:0/2195441748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0990073be0 0x7f099013e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.455+0000 7f0994a00640 1 --2- 172.21.15.123:0/2195441748 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09900d0f80 0x7f099015bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.455+0000 7f098f400640 1 -- 172.21.15.123:0/2195441748 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09900d0f80 msgr2=0x7f099015bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.455+0000 7f098f400640 1 --2- 172.21.15.123:0/2195441748 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09900d0f80 0x7f099015bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.455+0000 7f098f400640 1 -- 172.21.15.123:0/2195441748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0990073be0 msgr2=0x7f099013e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.455+0000 7f098f400640 1 --2- 172.21.15.123:0/2195441748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0990073be0 0x7f099013e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.455+0000 7f098f400640 1 -- 172.21.15.123:0/2195441748 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09901f7cc0 con 0x7f09900b32f0 2024-04-25T13:43:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.455+0000 7f098f400640 1 --2- 172.21.15.123:0/2195441748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09900b32f0 0x7f09901f71b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f097c0ae040 tx=0x7f097c019020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.455+0000 7f0987e00640 1 -- 172.21.15.123:0/2195441748 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c0ba070 con 0x7f09900b32f0 2024-04-25T13:43:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.455+0000 7f0987e00640 1 -- 172.21.15.123:0/2195441748 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f097c0b4640 con 0x7f09900b32f0 2024-04-25T13:43:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.455+0000 7f0987e00640 1 -- 172.21.15.123:0/2195441748 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c0b0040 con 0x7f09900b32f0 2024-04-25T13:43:25.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.455+0000 7f0996a00640 1 -- 172.21.15.123:0/2195441748 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09901f7fa0 con 0x7f09900b32f0 2024-04-25T13:43:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.455+0000 7f0996a00640 1 -- 172.21.15.123:0/2195441748 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f099013f120 con 0x7f09900b32f0 2024-04-25T13:43:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.459+0000 7f0996a00640 1 -- 172.21.15.123:0/2195441748 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0990140980 con 0x7f09900b32f0 2024-04-25T13:43:25.463 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.459+0000 7f0987e00640 1 -- 172.21.15.123:0/2195441748 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f097c0ab4c0 con 0x7f09900b32f0 2024-04-25T13:43:25.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.459+0000 7f0987e00640 1 --2- 172.21.15.123:0/2195441748 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f097006f400 0x7f0970071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:25.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.459+0000 7f0987e00640 1 -- 172.21.15.123:0/2195441748 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f097c128600 con 0x7f09900b32f0 2024-04-25T13:43:25.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.459+0000 7f098fe00640 1 --2- 172.21.15.123:0/2195441748 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f097006f400 0x7f0970071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:25.465 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.459+0000 7f098fe00640 1 --2- 172.21.15.123:0/2195441748 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f097006f400 0x7f0970071910 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f09800070b0 tx=0x7f0980007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:25.468 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.463+0000 7f0987e00640 1 -- 172.21.15.123:0/2195441748 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f097c0eee70 con 0x7f09900b32f0 2024-04-25T13:43:25.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.655+0000 7f0996a00640 1 -- 172.21.15.123:0/2195441748 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f099013ec30 con 0x7f09900b32f0 2024-04-25T13:43:25.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.655+0000 7f0987e00640 1 -- 172.21.15.123:0/2195441748 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5187 (secure 0 0 0) 0x7f09900b3c40 con 0x7f09900b32f0 2024-04-25T13:43:25.661 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:25.661 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3582988979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":3582988979},{"type":"v1","addr":"172.21.15.130:6835","nonce":3582988979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4978,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/173287078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":173287078},{"type":"v1","addr":"172.21.15.123:6837","nonce":173287078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4987,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/4025543653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4025543653},{"type":"v1","addr":"172.21.15.130:6834","nonce":4025543653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:43:01.431292+0000","modified":"2024-04-25T13:43:04.442129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6836/499623122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":499623122},{"type":"v1","addr":"172.21.15.123:6836","nonce":499623122}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5046,"qdb_cluster":[5046]},"id":2}]} 2024-04-25T13:43:25.661 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 17 2024-04-25T13:43:25.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.659+0000 7f0996a00640 1 -- 172.21.15.123:0/2195441748 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f097006f400 msgr2=0x7f0970071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:25.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.659+0000 7f0996a00640 1 --2- 172.21.15.123:0/2195441748 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f097006f400 0x7f0970071910 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f09800070b0 tx=0x7f0980007040 comp rx=0 tx=0).stop 2024-04-25T13:43:25.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.659+0000 7f0996a00640 1 -- 172.21.15.123:0/2195441748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09900b32f0 msgr2=0x7f09901f71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:25.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.659+0000 7f0996a00640 1 --2- 172.21.15.123:0/2195441748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09900b32f0 0x7f09901f71b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f097c0ae040 tx=0x7f097c019020 comp rx=0 tx=0).stop 2024-04-25T13:43:25.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.659+0000 7f0996a00640 1 -- 172.21.15.123:0/2195441748 shutdown_connections 2024-04-25T13:43:25.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.659+0000 7f0996a00640 1 --2- 172.21.15.123:0/2195441748 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f097006f400 0x7f0970071910 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:25.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.659+0000 7f0996a00640 1 --2- 172.21.15.123:0/2195441748 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09900d0f80 0x7f099015bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:25.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.659+0000 7f0996a00640 1 --2- 172.21.15.123:0/2195441748 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09900b32f0 0x7f09901f71b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:25.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.659+0000 7f0996a00640 1 --2- 172.21.15.123:0/2195441748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0990073be0 0x7f099013e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:25.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.659+0000 7f0996a00640 1 -- 172.21.15.123:0/2195441748 >> 172.21.15.123:0/2195441748 conn(0x7f099006d210 msgr2=0x7f0990073ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:25.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.659+0000 7f0996a00640 1 -- 172.21.15.123:0/2195441748 shutdown_connections 2024-04-25T13:43:25.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.659+0000 7f0996a00640 1 -- 172.21.15.123:0/2195441748 wait complete. 2024-04-25T13:43:25.683 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:43:25.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.827+0000 7fcb2d000640 1 Processor -- start 2024-04-25T13:43:25.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.827+0000 7fcb2d000640 1 -- start start 2024-04-25T13:43:25.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.827+0000 7fcb2d000640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcb280d0e30 0x7fcb280b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:25.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.827+0000 7fcb2d000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb28160520 con 0x7fcb2806d680 2024-04-25T13:43:25.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.827+0000 7fcb2d000640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb281607e0 con 0x7fcb280758b0 2024-04-25T13:43:25.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.827+0000 7fcb2d000640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fcb28160ac0 con 0x7fcb280d0e30 2024-04-25T13:43:25.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.827+0000 7fcb1d400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fcb2806d680 0x7fcb2806da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58506/0 (socket says 172.21.15.123:58506) 2024-04-25T13:43:25.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.827+0000 7fcb1d400640 1 -- 172.21.15.123:0/4112929266 learned_addr learned my addr 172.21.15.123:0/4112929266 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:25.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.827+0000 7fcb26800640 1 --2- 172.21.15.123:0/4112929266 >> v2:172.21.15.130:3300/0 conn(0x7fcb280d0e30 0x7fcb280b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:25.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.827+0000 7fcb25400640 1 -- 172.21.15.123:0/4112929266 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2582539077 0 0) 0x7fcb28160520 con 0x7fcb2806d680 2024-04-25T13:43:25.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.827+0000 7fcb25400640 1 -- 172.21.15.123:0/4112929266 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb0c003530 con 0x7fcb2806d680 2024-04-25T13:43:25.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.827+0000 7fcb25400640 1 -- 172.21.15.123:0/4112929266 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2642740200 0 0) 0x7fcb281607e0 con 0x7fcb280758b0 2024-04-25T13:43:25.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.827+0000 7fcb25400640 1 -- 172.21.15.123:0/4112929266 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb28160520 con 0x7fcb280758b0 2024-04-25T13:43:25.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.827+0000 7fcb26800640 1 -- 172.21.15.123:0/4112929266 >> v1:172.21.15.130:6789/0 conn(0x7fcb280758b0 legacy=0x7fcb2815a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:25.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.827+0000 7fcb26800640 1 -- 172.21.15.123:0/4112929266 >> v1:172.21.15.123:6789/0 conn(0x7fcb2806d680 legacy=0x7fcb2806da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:25.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.827+0000 7fcb25400640 1 -- 172.21.15.123:0/4112929266 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 347669961 0 0) 0x7fcb0c003530 con 0x7fcb2806d680 2024-04-25T13:43:25.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.827+0000 7fcb26800640 1 -- 172.21.15.123:0/4112929266 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb28160da0 con 0x7fcb280d0e30 2024-04-25T13:43:25.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.831+0000 7fcb26800640 1 --2- 172.21.15.123:0/4112929266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb280d0e30 0x7fcb280b4d60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcb20009d90 tx=0x7fcb2001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=600819a3e777be82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:25.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.831+0000 7fcb25400640 1 -- 172.21.15.123:0/4112929266 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb200b2070 con 0x7fcb280d0e30 2024-04-25T13:43:25.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.831+0000 7fcb25400640 1 -- 172.21.15.123:0/4112929266 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb200a5960 con 0x7fcb280d0e30 2024-04-25T13:43:25.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.831+0000 7fcb25400640 1 -- 172.21.15.123:0/4112929266 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb200a5d30 con 0x7fcb280d0e30 2024-04-25T13:43:25.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.831+0000 7fcb2d000640 1 -- 172.21.15.123:0/4112929266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb280d0e30 msgr2=0x7fcb280b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:25.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.831+0000 7fcb2d000640 1 --2- 172.21.15.123:0/4112929266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb280d0e30 0x7fcb280b4d60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcb20009d90 tx=0x7fcb2001c970 comp rx=0 tx=0).stop 2024-04-25T13:43:25.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.831+0000 7fcb2d000640 1 -- 172.21.15.123:0/4112929266 shutdown_connections 2024-04-25T13:43:25.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.831+0000 7fcb2d000640 1 --2- 172.21.15.123:0/4112929266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb280d0e30 0x7fcb280b4d60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:25.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.831+0000 7fcb2d000640 1 -- 172.21.15.123:0/4112929266 >> 172.21.15.123:0/4112929266 conn(0x7fcb280733b0 msgr2=0x7fcb280737c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:25.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.831+0000 7fcb2d000640 1 -- 172.21.15.123:0/4112929266 shutdown_connections 2024-04-25T13:43:25.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.831+0000 7fcb2d000640 1 -- 172.21.15.123:0/4112929266 wait complete. 2024-04-25T13:43:25.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.835+0000 7fcb2d000640 1 Processor -- start 2024-04-25T13:43:25.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.835+0000 7fcb2d000640 1 -- start start 2024-04-25T13:43:25.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.835+0000 7fcb2d000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb2806d680 0x7fcb281fa560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:25.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.835+0000 7fcb2d000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb280758b0 0x7fcb28158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:25.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.835+0000 7fcb2d000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb280d0e30 0x7fcb280b2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:25.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.835+0000 7fcb2d000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2816e250 con 0x7fcb280d0e30 2024-04-25T13:43:25.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.835+0000 7fcb2d000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2816e0d0 con 0x7fcb2806d680 2024-04-25T13:43:25.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.835+0000 7fcb2d000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fcb2816e3d0 con 0x7fcb280758b0 2024-04-25T13:43:25.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.835+0000 7fcb26800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb280d0e30 0x7fcb280b2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:25.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.835+0000 7fcb26800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb280d0e30 0x7fcb280b2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:40982/0 (socket says 172.21.15.123:40982) 2024-04-25T13:43:25.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.835+0000 7fcb26800640 1 -- 172.21.15.123:0/1561161205 learned_addr learned my addr 172.21.15.123:0/1561161205 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:25.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.835+0000 7fcb25e00640 1 --2- 172.21.15.123:0/1561161205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb2806d680 0x7fcb281fa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:25.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.835+0000 7fcb1d400640 1 --2- 172.21.15.123:0/1561161205 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb280758b0 0x7fcb28158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:25.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.835+0000 7fcb26800640 1 -- 172.21.15.123:0/1561161205 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb280758b0 msgr2=0x7fcb28158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:25.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.835+0000 7fcb26800640 1 --2- 172.21.15.123:0/1561161205 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb280758b0 0x7fcb28158c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:25.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.835+0000 7fcb26800640 1 -- 172.21.15.123:0/1561161205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb2806d680 msgr2=0x7fcb281fa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:25.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.835+0000 7fcb26800640 1 --2- 172.21.15.123:0/1561161205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb2806d680 0x7fcb281fa560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:25.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.835+0000 7fcb26800640 1 -- 172.21.15.123:0/1561161205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb28156720 con 0x7fcb280d0e30 2024-04-25T13:43:25.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.839+0000 7fcb26800640 1 --2- 172.21.15.123:0/1561161205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb280d0e30 0x7fcb280b2a10 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcb200b0040 tx=0x7fcb20019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:25.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.839+0000 7fcb1ea00640 1 -- 172.21.15.123:0/1561161205 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb200b2040 con 0x7fcb280d0e30 2024-04-25T13:43:25.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.839+0000 7fcb1ea00640 1 -- 172.21.15.123:0/1561161205 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb200039a0 con 0x7fcb280d0e30 2024-04-25T13:43:25.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.839+0000 7fcb1ea00640 1 -- 172.21.15.123:0/1561161205 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb20003d90 con 0x7fcb280d0e30 2024-04-25T13:43:25.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.839+0000 7fcb2d000640 1 -- 172.21.15.123:0/1561161205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb28156a00 con 0x7fcb280d0e30 2024-04-25T13:43:25.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.839+0000 7fcb2d000640 1 -- 172.21.15.123:0/1561161205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb28156fc0 con 0x7fcb280d0e30 2024-04-25T13:43:25.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.839+0000 7fcb2d000640 1 -- 172.21.15.123:0/1561161205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb280507c0 con 0x7fcb280d0e30 2024-04-25T13:43:25.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.839+0000 7fcb1ea00640 1 -- 172.21.15.123:0/1561161205 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fcb200c2060 con 0x7fcb280d0e30 2024-04-25T13:43:25.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.839+0000 7fcb1ea00640 1 --2- 172.21.15.123:0/1561161205 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fcb0406f430 0x7fcb04071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:25.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.839+0000 7fcb1ea00640 1 -- 172.21.15.123:0/1561161205 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fcb20129390 con 0x7fcb280d0e30 2024-04-25T13:43:25.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.839+0000 7fcb25e00640 1 --2- 172.21.15.123:0/1561161205 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fcb0406f430 0x7fcb04071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:25.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.843+0000 7fcb25e00640 1 --2- 172.21.15.123:0/1561161205 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fcb0406f430 0x7fcb04071940 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcb180011f0 tx=0x7fcb18009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:25.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:25.847+0000 7fcb1ea00640 1 -- 172.21.15.123:0/1561161205 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcb20016560 con 0x7fcb280d0e30 2024-04-25T13:43:26.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.011+0000 7fcb2d000640 1 -- 172.21.15.123:0/1561161205 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb28074660 con 0x7fcb280d0e30 2024-04-25T13:43:26.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.011+0000 7fcb1ea00640 1 -- 172.21.15.123:0/1561161205 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16693 (secure 0 0 0) 0x7fcb200f5c30 con 0x7fcb280d0e30 2024-04-25T13:43:26.015 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:26.016 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":34,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:43:03.039428+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:59.250248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T13:43:00.396458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:43:26.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.011+0000 7fcb2d000640 1 -- 172.21.15.123:0/1561161205 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fcb0406f430 msgr2=0x7fcb04071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:26.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.011+0000 7fcb2d000640 1 --2- 172.21.15.123:0/1561161205 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fcb0406f430 0x7fcb04071940 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcb180011f0 tx=0x7fcb18009040 comp rx=0 tx=0).stop 2024-04-25T13:43:26.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.011+0000 7fcb2d000640 1 -- 172.21.15.123:0/1561161205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb280d0e30 msgr2=0x7fcb280b2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:26.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.011+0000 7fcb2d000640 1 --2- 172.21.15.123:0/1561161205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb280d0e30 0x7fcb280b2a10 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcb200b0040 tx=0x7fcb20019710 comp rx=0 tx=0).stop 2024-04-25T13:43:26.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.015+0000 7fcb2d000640 1 -- 172.21.15.123:0/1561161205 shutdown_connections 2024-04-25T13:43:26.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.015+0000 7fcb2d000640 1 --2- 172.21.15.123:0/1561161205 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fcb0406f430 0x7fcb04071940 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.015+0000 7fcb2d000640 1 --2- 172.21.15.123:0/1561161205 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcb280d0e30 0x7fcb280b2a10 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.015+0000 7fcb2d000640 1 --2- 172.21.15.123:0/1561161205 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb280758b0 0x7fcb28158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.015+0000 7fcb2d000640 1 --2- 172.21.15.123:0/1561161205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb2806d680 0x7fcb281fa560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.015+0000 7fcb2d000640 1 -- 172.21.15.123:0/1561161205 >> 172.21.15.123:0/1561161205 conn(0x7fcb280733b0 msgr2=0x7fcb280b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:26.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.015+0000 7fcb2d000640 1 -- 172.21.15.123:0/1561161205 shutdown_connections 2024-04-25T13:43:26.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.015+0000 7fcb2d000640 1 -- 172.21.15.123:0/1561161205 wait complete. 2024-04-25T13:43:26.038 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T13:41:53.602480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T13:42:59.250248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T13:43:00.396458+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T13:43:26.039 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T13:43:26.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.191+0000 7f4c7ac00640 1 Processor -- start 2024-04-25T13:43:26.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.191+0000 7f4c7ac00640 1 -- start start 2024-04-25T13:43:26.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.191+0000 7f4c7ac00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4c74148d20 0x7f4c74163a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:26.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.191+0000 7f4c7ac00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4c74163f80 0x7f4c74164390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:26.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.191+0000 7f4c7ac00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c7406c710 con 0x7f4c7406fb00 2024-04-25T13:43:26.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.191+0000 7f4c7ac00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4c74070c90 con 0x7f4c74148d20 2024-04-25T13:43:26.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.191+0000 7f4c7ac00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f4c74070f70 con 0x7f4c74163f80 2024-04-25T13:43:26.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.191+0000 7f4c73e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4c74148d20 0x7f4c74163a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:26.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.191+0000 7f4c78c00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4c7406fb00 0x7f4c7406ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58508/0 (socket says 172.21.15.123:58508) 2024-04-25T13:43:26.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.191+0000 7f4c78c00640 1 -- 172.21.15.123:0/2007866947 learned_addr learned my addr 172.21.15.123:0/2007866947 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:26.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.191+0000 7f4c73e00640 1 -- 172.21.15.123:0/2007866947 >> v2:172.21.15.130:3300/0 conn(0x7f4c74163f80 msgr2=0x7f4c74164390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:26.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.191+0000 7f4c73400640 1 --2- 172.21.15.123:0/2007866947 >> v2:172.21.15.130:3300/0 conn(0x7f4c74163f80 0x7f4c74164390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:26.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.191+0000 7f4c73e00640 1 --2- 172.21.15.123:0/2007866947 >> v2:172.21.15.130:3300/0 conn(0x7f4c74163f80 0x7f4c74164390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.191+0000 7f4c72a00640 1 -- 172.21.15.123:0/2007866947 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3113307718 0 0) 0x7f4c7406c710 con 0x7f4c7406fb00 2024-04-25T13:43:26.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.191+0000 7f4c73e00640 1 -- 172.21.15.123:0/2007866947 >> v1:172.21.15.123:6789/0 conn(0x7f4c7406fb00 legacy=0x7f4c7406ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:26.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.191+0000 7f4c73e00640 1 -- 172.21.15.123:0/2007866947 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c74071250 con 0x7f4c74148d20 2024-04-25T13:43:26.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.191+0000 7f4c73400640 1 --2- 172.21.15.123:0/2007866947 >> v2:172.21.15.130:3300/0 conn(0x7f4c74163f80 0x7f4c74164390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:26.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.195+0000 7f4c73e00640 1 --2- 172.21.15.123:0/2007866947 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c74148d20 0x7f4c74163a40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4c7409fed0 tx=0x7f4c6401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0b1150ef10ca0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:26.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.195+0000 7f4c72a00640 1 -- 172.21.15.123:0/2007866947 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c640ab610 con 0x7f4c74148d20 2024-04-25T13:43:26.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.195+0000 7f4c72a00640 1 -- 172.21.15.123:0/2007866947 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c640b0070 con 0x7f4c74148d20 2024-04-25T13:43:26.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.195+0000 7f4c72a00640 1 -- 172.21.15.123:0/2007866947 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c640ab9d0 con 0x7f4c74148d20 2024-04-25T13:43:26.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.195+0000 7f4c7ac00640 1 -- 172.21.15.123:0/2007866947 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c74148d20 msgr2=0x7f4c74163a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:26.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.195+0000 7f4c7ac00640 1 --2- 172.21.15.123:0/2007866947 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c74148d20 0x7f4c74163a40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4c7409fed0 tx=0x7f4c6401c3f0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.195+0000 7f4c7ac00640 1 -- 172.21.15.123:0/2007866947 shutdown_connections 2024-04-25T13:43:26.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.195+0000 7f4c7ac00640 1 --2- 172.21.15.123:0/2007866947 >> v2:172.21.15.130:3300/0 conn(0x7f4c74163f80 0x7f4c74164390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.195+0000 7f4c7ac00640 1 --2- 172.21.15.123:0/2007866947 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c74148d20 0x7f4c74163a40 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.195+0000 7f4c7ac00640 1 -- 172.21.15.123:0/2007866947 >> 172.21.15.123:0/2007866947 conn(0x7f4c740d2180 msgr2=0x7f4c740d2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:26.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.195+0000 7f4c7ac00640 1 -- 172.21.15.123:0/2007866947 shutdown_connections 2024-04-25T13:43:26.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.195+0000 7f4c7ac00640 1 -- 172.21.15.123:0/2007866947 wait complete. 2024-04-25T13:43:26.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.199+0000 7f4c7ac00640 1 Processor -- start 2024-04-25T13:43:26.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.199+0000 7f4c7ac00640 1 -- start start 2024-04-25T13:43:26.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.199+0000 7f4c7ac00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c7406fb00 0x7f4c7413d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:26.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.199+0000 7f4c7ac00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4c74148d20 0x7f4c7415bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:26.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.199+0000 7f4c7ac00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c74163f80 0x7f4c7415c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:26.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.199+0000 7f4c7ac00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4c7416d800 con 0x7f4c74163f80 2024-04-25T13:43:26.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.199+0000 7f4c7ac00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4c74070a30 con 0x7f4c7406fb00 2024-04-25T13:43:26.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.199+0000 7f4c7ac00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4c7416d980 con 0x7f4c74148d20 2024-04-25T13:43:26.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.199+0000 7f4c78c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c74163f80 0x7f4c7415c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:26.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.199+0000 7f4c73e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c7406fb00 0x7f4c7413d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:26.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.199+0000 7f4c78c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c74163f80 0x7f4c7415c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41004/0 (socket says 172.21.15.123:41004) 2024-04-25T13:43:26.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.199+0000 7f4c78c00640 1 -- 172.21.15.123:0/265118560 learned_addr learned my addr 172.21.15.123:0/265118560 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:26.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.199+0000 7f4c73400640 1 --2- 172.21.15.123:0/265118560 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4c74148d20 0x7f4c7415bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:26.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.199+0000 7f4c78c00640 1 -- 172.21.15.123:0/265118560 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4c74148d20 msgr2=0x7f4c7415bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:26.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.199+0000 7f4c78c00640 1 --2- 172.21.15.123:0/265118560 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4c74148d20 0x7f4c7415bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.199+0000 7f4c78c00640 1 -- 172.21.15.123:0/265118560 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c7406fb00 msgr2=0x7f4c7413d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:26.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.199+0000 7f4c78c00640 1 --2- 172.21.15.123:0/265118560 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c7406fb00 0x7f4c7413d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.199+0000 7f4c78c00640 1 -- 172.21.15.123:0/265118560 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7415cd00 con 0x7f4c74163f80 2024-04-25T13:43:26.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.203+0000 7f4c78c00640 1 --2- 172.21.15.123:0/265118560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c74163f80 0x7f4c7415c490 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c00caf0 tx=0x7f4c6c0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:26.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.203+0000 7f4c6be00640 1 -- 172.21.15.123:0/265118560 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c00aba0 con 0x7f4c74163f80 2024-04-25T13:43:26.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.203+0000 7f4c6be00640 1 -- 172.21.15.123:0/265118560 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c6c00ad40 con 0x7f4c74163f80 2024-04-25T13:43:26.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.203+0000 7f4c6be00640 1 -- 172.21.15.123:0/265118560 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c012640 con 0x7f4c74163f80 2024-04-25T13:43:26.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.203+0000 7f4c7ac00640 1 -- 172.21.15.123:0/265118560 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c7415cfe0 con 0x7f4c74163f80 2024-04-25T13:43:26.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.203+0000 7f4c7ac00640 1 -- 172.21.15.123:0/265118560 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c7415a2b0 con 0x7f4c74163f80 2024-04-25T13:43:26.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.203+0000 7f4c7ac00640 1 -- 172.21.15.123:0/265118560 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c7415d500 con 0x7f4c74163f80 2024-04-25T13:43:26.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.203+0000 7f4c6be00640 1 -- 172.21.15.123:0/265118560 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4c6c0127e0 con 0x7f4c74163f80 2024-04-25T13:43:26.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.203+0000 7f4c6be00640 1 --2- 172.21.15.123:0/265118560 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4c5406f430 0x7f4c54071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:26.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.203+0000 7f4c6be00640 1 -- 172.21.15.123:0/265118560 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f4c6c08f700 con 0x7f4c74163f80 2024-04-25T13:43:26.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.203+0000 7f4c73e00640 1 --2- 172.21.15.123:0/265118560 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4c5406f430 0x7f4c54071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:26.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.207+0000 7f4c73e00640 1 --2- 172.21.15.123:0/265118560 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4c5406f430 0x7f4c54071940 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4c640af000 tx=0x7f4c640a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:26.213 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.211+0000 7f4c6be00640 1 -- 172.21.15.123:0/265118560 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4c6c05bfa0 con 0x7f4c74163f80 2024-04-25T13:43:26.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.367+0000 7f4c7ac00640 1 -- 172.21.15.123:0/265118560 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4c741f9fd0 con 0x7f4c74163f80 2024-04-25T13:43:26.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.367+0000 7f4c6be00640 1 -- 172.21.15.123:0/265118560 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) ==== 93+0+10 (secure 0 0 0) 0x7f4c741f9fd0 con 0x7f4c74163f80 2024-04-25T13:43:26.370 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-04-25T13:43:26.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.367+0000 7f4c7ac00640 1 -- 172.21.15.123:0/265118560 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4c5406f430 msgr2=0x7f4c54071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:26.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.367+0000 7f4c7ac00640 1 --2- 172.21.15.123:0/265118560 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4c5406f430 0x7f4c54071940 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4c640af000 tx=0x7f4c640a7000 comp rx=0 tx=0).stop 2024-04-25T13:43:26.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.367+0000 7f4c7ac00640 1 -- 172.21.15.123:0/265118560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c74163f80 msgr2=0x7f4c7415c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:26.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.367+0000 7f4c7ac00640 1 --2- 172.21.15.123:0/265118560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c74163f80 0x7f4c7415c490 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c00caf0 tx=0x7f4c6c0021d0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.367+0000 7f4c7ac00640 1 -- 172.21.15.123:0/265118560 shutdown_connections 2024-04-25T13:43:26.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.367+0000 7f4c7ac00640 1 --2- 172.21.15.123:0/265118560 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4c5406f430 0x7f4c54071940 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.367+0000 7f4c7ac00640 1 --2- 172.21.15.123:0/265118560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4c74163f80 0x7f4c7415c490 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.367+0000 7f4c7ac00640 1 --2- 172.21.15.123:0/265118560 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4c74148d20 0x7f4c7415bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.367+0000 7f4c7ac00640 1 --2- 172.21.15.123:0/265118560 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c7406fb00 0x7f4c7413d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.367+0000 7f4c7ac00640 1 -- 172.21.15.123:0/265118560 >> 172.21.15.123:0/265118560 conn(0x7f4c740d2180 msgr2=0x7f4c74073b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:26.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.367+0000 7f4c7ac00640 1 -- 172.21.15.123:0/265118560 shutdown_connections 2024-04-25T13:43:26.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.367+0000 7f4c7ac00640 1 -- 172.21.15.123:0/265118560 wait complete. 2024-04-25T13:43:26.391 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T13:43:26.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.535+0000 7fa4fde00640 1 Processor -- start 2024-04-25T13:43:26.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.535+0000 7fa4fde00640 1 -- start start 2024-04-25T13:43:26.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.539+0000 7fa4fde00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa4f81571b0 0x7fa4f80cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:26.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.539+0000 7fa4fde00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa4f80b3870 0x7fa4f80b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:26.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.539+0000 7fa4fde00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4f80b41c0 con 0x7fa4f80b4770 2024-04-25T13:43:26.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.539+0000 7fa4fde00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fa4f80cdee0 con 0x7fa4f80b3870 2024-04-25T13:43:26.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.539+0000 7fa4fde00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fa4f815d570 con 0x7fa4f81571b0 2024-04-25T13:43:26.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.539+0000 7fa4f6000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa4f80b3870 0x7fa4f80b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:26.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.539+0000 7fa4f6000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fa4f80b3870 0x7fa4f80b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41006/0 (socket says 172.21.15.123:41006) 2024-04-25T13:43:26.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.539+0000 7fa4f6000640 1 -- 172.21.15.123:0/4008735808 learned_addr learned my addr 172.21.15.123:0/4008735808 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:26.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.539+0000 7fa4f6a00640 1 --2- 172.21.15.123:0/4008735808 >> v2:172.21.15.130:3300/0 conn(0x7fa4f81571b0 0x7fa4f80cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:26.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.539+0000 7fa4f6000640 1 -- 172.21.15.123:0/4008735808 >> v2:172.21.15.130:3300/0 conn(0x7fa4f81571b0 msgr2=0x7fa4f80cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:26.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.539+0000 7fa4f6000640 1 --2- 172.21.15.123:0/4008735808 >> v2:172.21.15.130:3300/0 conn(0x7fa4f81571b0 0x7fa4f80cd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.539+0000 7fa4f6000640 1 -- 172.21.15.123:0/4008735808 >> v1:172.21.15.130:6789/0 conn(0x7fa4f80b4770 legacy=0x7fa4f80b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:26.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.539+0000 7fa4f6000640 1 -- 172.21.15.123:0/4008735808 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f815d850 con 0x7fa4f80b3870 2024-04-25T13:43:26.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.543+0000 7fa4f6000640 1 --2- 172.21.15.123:0/4008735808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4f80b3870 0x7fa4f80b3c80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80722c0 tx=0x7fa4e401c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=438382f7d009cde4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:26.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.543+0000 7fa4f5600640 1 -- 172.21.15.123:0/4008735808 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e40b0070 con 0x7fa4f80b3870 2024-04-25T13:43:26.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.543+0000 7fa4f5600640 1 -- 172.21.15.123:0/4008735808 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e40ab600 con 0x7fa4f80b3870 2024-04-25T13:43:26.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.543+0000 7fa4f5600640 1 -- 172.21.15.123:0/4008735808 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e40ab9d0 con 0x7fa4f80b3870 2024-04-25T13:43:26.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.543+0000 7fa4fde00640 1 -- 172.21.15.123:0/4008735808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4f80b3870 msgr2=0x7fa4f80b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:26.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.543+0000 7fa4fde00640 1 --2- 172.21.15.123:0/4008735808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4f80b3870 0x7fa4f80b3c80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80722c0 tx=0x7fa4e401c270 comp rx=0 tx=0).stop 2024-04-25T13:43:26.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.543+0000 7fa4fde00640 1 -- 172.21.15.123:0/4008735808 shutdown_connections 2024-04-25T13:43:26.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.543+0000 7fa4fde00640 1 --2- 172.21.15.123:0/4008735808 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4f80b3870 0x7fa4f80b3c80 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.543+0000 7fa4fde00640 1 --2- 172.21.15.123:0/4008735808 >> v2:172.21.15.130:3300/0 conn(0x7fa4f81571b0 0x7fa4f80cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.543+0000 7fa4fde00640 1 -- 172.21.15.123:0/4008735808 >> 172.21.15.123:0/4008735808 conn(0x7fa4f806ca70 msgr2=0x7fa4f806ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:26.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.543+0000 7fa4fde00640 1 -- 172.21.15.123:0/4008735808 shutdown_connections 2024-04-25T13:43:26.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.543+0000 7fa4fde00640 1 -- 172.21.15.123:0/4008735808 wait complete. 2024-04-25T13:43:26.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.543+0000 7fa4fde00640 1 Processor -- start 2024-04-25T13:43:26.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.543+0000 7fa4fde00640 1 -- start start 2024-04-25T13:43:26.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.547+0000 7fa4fde00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4f80b3870 0x7fa4f80cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:26.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.547+0000 7fa4fde00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4f80b4770 0x7fa4f80ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:26.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.547+0000 7fa4fde00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa4f81571b0 0x7fa4f814b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:26.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.547+0000 7fa4fde00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f815e050 con 0x7fa4f80b3870 2024-04-25T13:43:26.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.547+0000 7fa4fde00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f81575c0 con 0x7fa4f80b4770 2024-04-25T13:43:26.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.547+0000 7fa4fde00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fa4f8147000 con 0x7fa4f81571b0 2024-04-25T13:43:26.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.547+0000 7fa4f6a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4f80b3870 0x7fa4f80cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:26.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.547+0000 7fa4f6a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4f80b3870 0x7fa4f80cc5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41016/0 (socket says 172.21.15.123:41016) 2024-04-25T13:43:26.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.547+0000 7fa4f6a00640 1 -- 172.21.15.123:0/2607108183 learned_addr learned my addr 172.21.15.123:0/2607108183 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:26.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.547+0000 7fa4f6000640 1 --2- 172.21.15.123:0/2607108183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4f80b4770 0x7fa4f80ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:26.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.547+0000 7fa4f6a00640 1 -- 172.21.15.123:0/2607108183 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa4f81571b0 msgr2=0x7fa4f814b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:26.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.547+0000 7fa4f7400640 1 --2- 172.21.15.123:0/2607108183 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa4f81571b0 0x7fa4f814b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:26.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.547+0000 7fa4f6a00640 1 --2- 172.21.15.123:0/2607108183 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa4f81571b0 0x7fa4f814b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.547+0000 7fa4f6a00640 1 -- 172.21.15.123:0/2607108183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4f80b4770 msgr2=0x7fa4f80ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:26.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.547+0000 7fa4f6a00640 1 --2- 172.21.15.123:0/2607108183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4f80b4770 0x7fa4f80ccb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.547+0000 7fa4f6a00640 1 -- 172.21.15.123:0/2607108183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f8146df0 con 0x7fa4f80b3870 2024-04-25T13:43:26.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.547+0000 7fa4f6000640 1 --2- 172.21.15.123:0/2607108183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4f80b4770 0x7fa4f80ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:26.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.547+0000 7fa4f7400640 1 --2- 172.21.15.123:0/2607108183 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa4f81571b0 0x7fa4f814b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:26.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.547+0000 7fa4f6a00640 1 --2- 172.21.15.123:0/2607108183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4f80b3870 0x7fa4f80cc5d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa4e800d600 tx=0x7fa4e800dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:26.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.547+0000 7fa4ef400640 1 -- 172.21.15.123:0/2607108183 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8004240 con 0x7fa4f80b3870 2024-04-25T13:43:26.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.547+0000 7fa4ef400640 1 -- 172.21.15.123:0/2607108183 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e80043e0 con 0x7fa4f80b3870 2024-04-25T13:43:26.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.547+0000 7fa4fde00640 1 -- 172.21.15.123:0/2607108183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4f814f070 con 0x7fa4f80b3870 2024-04-25T13:43:26.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.547+0000 7fa4ef400640 1 -- 172.21.15.123:0/2607108183 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8003840 con 0x7fa4f80b3870 2024-04-25T13:43:26.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.547+0000 7fa4fde00640 1 -- 172.21.15.123:0/2607108183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4f814a8a0 con 0x7fa4f80b3870 2024-04-25T13:43:26.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.547+0000 7fa4fde00640 1 -- 172.21.15.123:0/2607108183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4f8050750 con 0x7fa4f80b3870 2024-04-25T13:43:26.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.551+0000 7fa4ef400640 1 -- 172.21.15.123:0/2607108183 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa4e80039e0 con 0x7fa4f80b3870 2024-04-25T13:43:26.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.551+0000 7fa4ef400640 1 --2- 172.21.15.123:0/2607108183 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa4d806f430 0x7fa4d8071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:26.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.551+0000 7fa4ef400640 1 -- 172.21.15.123:0/2607108183 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fa4e808f580 con 0x7fa4f80b3870 2024-04-25T13:43:26.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.551+0000 7fa4f6000640 1 --2- 172.21.15.123:0/2607108183 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa4d806f430 0x7fa4d8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:26.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.551+0000 7fa4f6000640 1 --2- 172.21.15.123:0/2607108183 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa4d806f430 0x7fa4d8071940 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa4e40ad000 tx=0x7fa4e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:26.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.555+0000 7fa4ef400640 1 -- 172.21.15.123:0/2607108183 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa4e805c3d0 con 0x7fa4f80b3870 2024-04-25T13:43:26.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.711+0000 7fa4fde00640 1 -- 172.21.15.123:0/2607108183 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa4f8074cc0 con 0x7fa4f80b3870 2024-04-25T13:43:26.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.711+0000 7fa4ef400640 1 -- 172.21.15.123:0/2607108183 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) ==== 104+0+11 (secure 0 0 0) 0x7fa4e805bcd0 con 0x7fa4f80b3870 2024-04-25T13:43:26.716 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-04-25T13:43:26.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.715+0000 7fa4fde00640 1 -- 172.21.15.123:0/2607108183 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa4d806f430 msgr2=0x7fa4d8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:26.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.715+0000 7fa4fde00640 1 --2- 172.21.15.123:0/2607108183 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa4d806f430 0x7fa4d8071940 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa4e40ad000 tx=0x7fa4e4008040 comp rx=0 tx=0).stop 2024-04-25T13:43:26.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.715+0000 7fa4fde00640 1 -- 172.21.15.123:0/2607108183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4f80b3870 msgr2=0x7fa4f80cc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:26.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.715+0000 7fa4fde00640 1 --2- 172.21.15.123:0/2607108183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4f80b3870 0x7fa4f80cc5d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa4e800d600 tx=0x7fa4e800dac0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.715+0000 7fa4fde00640 1 -- 172.21.15.123:0/2607108183 shutdown_connections 2024-04-25T13:43:26.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.715+0000 7fa4fde00640 1 --2- 172.21.15.123:0/2607108183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa4f80b4770 0x7fa4f80ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.715+0000 7fa4fde00640 1 --2- 172.21.15.123:0/2607108183 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fa4d806f430 0x7fa4d8071940 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.715+0000 7fa4fde00640 1 --2- 172.21.15.123:0/2607108183 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa4f81571b0 0x7fa4f814b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.715+0000 7fa4fde00640 1 --2- 172.21.15.123:0/2607108183 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa4f80b3870 0x7fa4f80cc5d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.715+0000 7fa4fde00640 1 -- 172.21.15.123:0/2607108183 >> 172.21.15.123:0/2607108183 conn(0x7fa4f806ca70 msgr2=0x7fa4f80d0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:26.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.715+0000 7fa4fde00640 1 -- 172.21.15.123:0/2607108183 shutdown_connections 2024-04-25T13:43:26.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.715+0000 7fa4fde00640 1 -- 172.21.15.123:0/2607108183 wait complete. 2024-04-25T13:43:26.738 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T13:43:26.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.882+0000 7fc55d400640 1 Processor -- start 2024-04-25T13:43:26.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.882+0000 7fc55d400640 1 -- start start 2024-04-25T13:43:26.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.882+0000 7fc55d400640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc5581534e0 0x7fc558074240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:26.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.882+0000 7fc55d400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc5580cdeb0 0x7fc5580ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:26.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.882+0000 7fc55d400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc558072af0 0x7fc558072f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:26.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.882+0000 7fc55d400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc5580ce800 con 0x7fc5580cdeb0 2024-04-25T13:43:26.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.882+0000 7fc55d400640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fc5581538f0 con 0x7fc5581534e0 2024-04-25T13:43:26.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.882+0000 7fc55d400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc558074780 con 0x7fc558072af0 2024-04-25T13:43:26.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.882+0000 7fc54de00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc5580cdeb0 0x7fc5580ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:26.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.882+0000 7fc54de00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc5580cdeb0 0x7fc5580ce2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41024/0 (socket says 172.21.15.123:41024) 2024-04-25T13:43:26.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.882+0000 7fc54de00640 1 -- 172.21.15.123:0/2176381676 learned_addr learned my addr 172.21.15.123:0/2176381676 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:26.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.882+0000 7fc556800640 1 --2- 172.21.15.123:0/2176381676 >> v2:172.21.15.130:3300/0 conn(0x7fc5581534e0 0x7fc558074240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:26.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.882+0000 7fc557200640 1 --2- 172.21.15.123:0/2176381676 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc558072af0 0x7fc558072f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:26.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.882+0000 7fc54de00640 1 -- 172.21.15.123:0/2176381676 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc558072af0 msgr2=0x7fc558072f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:26.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.882+0000 7fc54de00640 1 --2- 172.21.15.123:0/2176381676 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc558072af0 0x7fc558072f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.882+0000 7fc54de00640 1 -- 172.21.15.123:0/2176381676 >> v2:172.21.15.130:3300/0 conn(0x7fc5581534e0 msgr2=0x7fc558074240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:26.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.882+0000 7fc54de00640 1 --2- 172.21.15.123:0/2176381676 >> v2:172.21.15.130:3300/0 conn(0x7fc5581534e0 0x7fc558074240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.882+0000 7fc54de00640 1 -- 172.21.15.123:0/2176381676 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc558074a50 con 0x7fc5580cdeb0 2024-04-25T13:43:26.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.886+0000 7fc54de00640 1 --2- 172.21.15.123:0/2176381676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5580cdeb0 0x7fc5580ce2c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc558070cc0 tx=0x7fc54001d860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=167ab5cc4a808b53 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:26.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.886+0000 7fc555e00640 1 -- 172.21.15.123:0/2176381676 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5400b3070 con 0x7fc5580cdeb0 2024-04-25T13:43:26.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.886+0000 7fc555e00640 1 -- 172.21.15.123:0/2176381676 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5400a6740 con 0x7fc5580cdeb0 2024-04-25T13:43:26.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.886+0000 7fc555e00640 1 -- 172.21.15.123:0/2176381676 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54000b040 con 0x7fc5580cdeb0 2024-04-25T13:43:26.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.886+0000 7fc55d400640 1 -- 172.21.15.123:0/2176381676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5580cdeb0 msgr2=0x7fc5580ce2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:26.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.886+0000 7fc55d400640 1 --2- 172.21.15.123:0/2176381676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5580cdeb0 0x7fc5580ce2c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc558070cc0 tx=0x7fc54001d860 comp rx=0 tx=0).stop 2024-04-25T13:43:26.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.886+0000 7fc55d400640 1 -- 172.21.15.123:0/2176381676 shutdown_connections 2024-04-25T13:43:26.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.886+0000 7fc55d400640 1 --2- 172.21.15.123:0/2176381676 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc558072af0 0x7fc558072f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.886+0000 7fc55d400640 1 --2- 172.21.15.123:0/2176381676 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5580cdeb0 0x7fc5580ce2c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.886+0000 7fc55d400640 1 --2- 172.21.15.123:0/2176381676 >> v2:172.21.15.130:3300/0 conn(0x7fc5581534e0 0x7fc558074240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.886+0000 7fc55d400640 1 -- 172.21.15.123:0/2176381676 >> 172.21.15.123:0/2176381676 conn(0x7fc55806ca70 msgr2=0x7fc55806ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:26.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.886+0000 7fc55d400640 1 -- 172.21.15.123:0/2176381676 shutdown_connections 2024-04-25T13:43:26.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.886+0000 7fc55d400640 1 -- 172.21.15.123:0/2176381676 wait complete. 2024-04-25T13:43:26.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.890+0000 7fc55d400640 1 Processor -- start 2024-04-25T13:43:26.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.890+0000 7fc55d400640 1 -- start start 2024-04-25T13:43:26.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.890+0000 7fc55d400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc558072af0 0x7fc55814dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:26.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.890+0000 7fc55d400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5580cdeb0 0x7fc5581555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:26.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.890+0000 7fc55d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5581534e0 0x7fc558151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:26.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.890+0000 7fc55d400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc55815d8c0 con 0x7fc5580cdeb0 2024-04-25T13:43:26.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.890+0000 7fc55d400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc558073850 con 0x7fc5581534e0 2024-04-25T13:43:26.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.890+0000 7fc55d400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc55815da40 con 0x7fc558072af0 2024-04-25T13:43:26.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.890+0000 7fc54de00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5580cdeb0 0x7fc5581555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:26.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.890+0000 7fc54de00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5580cdeb0 0x7fc5581555c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41028/0 (socket says 172.21.15.123:41028) 2024-04-25T13:43:26.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.890+0000 7fc54de00640 1 -- 172.21.15.123:0/2580605052 learned_addr learned my addr 172.21.15.123:0/2580605052 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:26.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.890+0000 7fc557200640 1 --2- 172.21.15.123:0/2580605052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5581534e0 0x7fc558151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:26.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.890+0000 7fc556800640 1 --2- 172.21.15.123:0/2580605052 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc558072af0 0x7fc55814dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:26.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.890+0000 7fc54de00640 1 -- 172.21.15.123:0/2580605052 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc558072af0 msgr2=0x7fc55814dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:26.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.890+0000 7fc54de00640 1 --2- 172.21.15.123:0/2580605052 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc558072af0 0x7fc55814dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.890+0000 7fc54de00640 1 -- 172.21.15.123:0/2580605052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5581534e0 msgr2=0x7fc558151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:26.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.890+0000 7fc54de00640 1 --2- 172.21.15.123:0/2580605052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5581534e0 0x7fc558151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:26.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.890+0000 7fc54de00640 1 -- 172.21.15.123:0/2580605052 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc558161f10 con 0x7fc5580cdeb0 2024-04-25T13:43:26.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.894+0000 7fc54de00640 1 --2- 172.21.15.123:0/2580605052 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5580cdeb0 0x7fc5581555c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc54000a1c0 tx=0x7fc54001c0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:26.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.894+0000 7fc54f400640 1 -- 172.21.15.123:0/2580605052 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5400b3070 con 0x7fc5580cdeb0 2024-04-25T13:43:26.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.894+0000 7fc54f400640 1 -- 172.21.15.123:0/2580605052 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5400b5070 con 0x7fc5580cdeb0 2024-04-25T13:43:26.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.894+0000 7fc55d400640 1 -- 172.21.15.123:0/2580605052 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5581621f0 con 0x7fc5580cdeb0 2024-04-25T13:43:26.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.894+0000 7fc54f400640 1 -- 172.21.15.123:0/2580605052 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5400aeab0 con 0x7fc5580cdeb0 2024-04-25T13:43:26.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.894+0000 7fc55d400640 1 -- 172.21.15.123:0/2580605052 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5581627b0 con 0x7fc5580cdeb0 2024-04-25T13:43:26.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.894+0000 7fc55d400640 1 -- 172.21.15.123:0/2580605052 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc558050750 con 0x7fc5580cdeb0 2024-04-25T13:43:26.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.894+0000 7fc54f400640 1 -- 172.21.15.123:0/2580605052 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc5400aec50 con 0x7fc5580cdeb0 2024-04-25T13:43:26.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.894+0000 7fc54f400640 1 --2- 172.21.15.123:0/2580605052 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fc53406f430 0x7fc534071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:26.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.894+0000 7fc54f400640 1 -- 172.21.15.123:0/2580605052 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc540128ff0 con 0x7fc5580cdeb0 2024-04-25T13:43:26.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.894+0000 7fc556800640 1 --2- 172.21.15.123:0/2580605052 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fc53406f430 0x7fc534071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:26.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.898+0000 7fc556800640 1 --2- 172.21.15.123:0/2580605052 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fc53406f430 0x7fc534071940 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc558070e80 tx=0x7fc548008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:26.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:26.898+0000 7fc54f400640 1 -- 172.21.15.123:0/2580605052 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc5400174e0 con 0x7fc5580cdeb0 2024-04-25T13:43:27.063 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.058+0000 7fc55d400640 1 -- 172.21.15.123:0/2580605052 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc5580ce360 con 0x7fc5580cdeb0 2024-04-25T13:43:27.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.058+0000 7fc54f400640 1 -- 172.21.15.123:0/2580605052 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) ==== 100+0+11 (secure 0 0 0) 0x7fc5400f5970 con 0x7fc5580cdeb0 2024-04-25T13:43:27.064 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-04-25T13:43:27.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.062+0000 7fc55d400640 1 -- 172.21.15.123:0/2580605052 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fc53406f430 msgr2=0x7fc534071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:27.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.062+0000 7fc55d400640 1 --2- 172.21.15.123:0/2580605052 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fc53406f430 0x7fc534071940 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc558070e80 tx=0x7fc548008040 comp rx=0 tx=0).stop 2024-04-25T13:43:27.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.062+0000 7fc55d400640 1 -- 172.21.15.123:0/2580605052 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5580cdeb0 msgr2=0x7fc5581555c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:27.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.062+0000 7fc55d400640 1 --2- 172.21.15.123:0/2580605052 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5580cdeb0 0x7fc5581555c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc54000a1c0 tx=0x7fc54001c0a0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.062+0000 7fc55d400640 1 -- 172.21.15.123:0/2580605052 shutdown_connections 2024-04-25T13:43:27.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.062+0000 7fc55d400640 1 --2- 172.21.15.123:0/2580605052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5581534e0 0x7fc558151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.062+0000 7fc55d400640 1 --2- 172.21.15.123:0/2580605052 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fc53406f430 0x7fc534071940 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.066 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.062+0000 7fc55d400640 1 --2- 172.21.15.123:0/2580605052 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5580cdeb0 0x7fc5581555c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.062+0000 7fc55d400640 1 --2- 172.21.15.123:0/2580605052 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc558072af0 0x7fc55814dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.062+0000 7fc55d400640 1 -- 172.21.15.123:0/2580605052 >> 172.21.15.123:0/2580605052 conn(0x7fc55806ca70 msgr2=0x7fc55806ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:27.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.062+0000 7fc55d400640 1 -- 172.21.15.123:0/2580605052 shutdown_connections 2024-04-25T13:43:27.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.062+0000 7fc55d400640 1 -- 172.21.15.123:0/2580605052 wait complete. 2024-04-25T13:43:27.086 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:43:27.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.226+0000 7f01ec400640 1 Processor -- start 2024-04-25T13:43:27.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.226+0000 7f01ec400640 1 -- start start 2024-04-25T13:43:27.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01ec400640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f01e40747a0 0x7f01e415fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:27.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01ec400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01e4145d70 con 0x7f01e40b5670 2024-04-25T13:43:27.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01ec400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01e41606f0 con 0x7f01e41602e0 2024-04-25T13:43:27.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01ec400640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f01e4074290 con 0x7f01e40747a0 2024-04-25T13:43:27.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01ea400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f01e40b5670 0x7f01e40731e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58520/0 (socket says 172.21.15.123:58520) 2024-04-25T13:43:27.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01ea400640 1 -- 172.21.15.123:0/2869207430 learned_addr learned my addr 172.21.15.123:0/2869207430 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:27.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01e9a00640 1 --2- 172.21.15.123:0/2869207430 >> v2:172.21.15.130:3300/0 conn(0x7f01e40747a0 0x7f01e415fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:27.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01e3e00640 1 -- 172.21.15.123:0/2869207430 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 490637823 0 0) 0x7f01dc0014a0 con 0x7f01e40b5670 2024-04-25T13:43:27.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01e3e00640 1 -- 172.21.15.123:0/2869207430 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01cc003530 con 0x7f01e40b5670 2024-04-25T13:43:27.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01e3e00640 1 -- 172.21.15.123:0/2869207430 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3666008966 0 0) 0x7f01cc003530 con 0x7f01e40b5670 2024-04-25T13:43:27.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01e3e00640 1 -- 172.21.15.123:0/2869207430 >> v2:172.21.15.130:3300/0 conn(0x7f01e40747a0 msgr2=0x7f01e415fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:27.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01e3e00640 1 --2- 172.21.15.123:0/2869207430 >> v2:172.21.15.130:3300/0 conn(0x7f01e40747a0 0x7f01e415fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01e3e00640 1 -- 172.21.15.123:0/2869207430 >> v1:172.21.15.130:6789/0 conn(0x7f01e41602e0 legacy=0x7f01e4072ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:27.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01e3e00640 1 -- 172.21.15.123:0/2869207430 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e4073c80 con 0x7f01e40b5670 2024-04-25T13:43:27.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01e3e00640 1 -- 172.21.15.123:0/2869207430 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7f01dc001bd0 con 0x7f01e40b5670 2024-04-25T13:43:27.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01e3e00640 1 -- 172.21.15.123:0/2869207430 >> v1:172.21.15.123:6789/0 conn(0x7f01e40b5670 legacy=0x7f01e40731e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:27.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01e3e00640 1 --2- 172.21.15.123:0/2869207430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01cc003a30 0x7f01cc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:27.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01e3e00640 1 --2- 172.21.15.123:0/2869207430 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f01cc004810 0x7f01cc004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:27.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01e3e00640 1 --2- 172.21.15.123:0/2869207430 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01cc005230 0x7f01cc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:27.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01e3e00640 1 -- 172.21.15.123:0/2869207430 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f01e4074290 con 0x7f01cc005230 2024-04-25T13:43:27.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01e3e00640 1 -- 172.21.15.123:0/2869207430 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f01cc00c1c0 con 0x7f01cc003a30 2024-04-25T13:43:27.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01e3e00640 1 -- 172.21.15.123:0/2869207430 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f01cc00c3c0 con 0x7f01cc004810 2024-04-25T13:43:27.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01e9a00640 1 --2- 172.21.15.123:0/2869207430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01cc003a30 0x7f01cc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:27.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01ea400640 1 --2- 172.21.15.123:0/2869207430 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01cc005230 0x7f01cc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:27.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01e9000640 1 --2- 172.21.15.123:0/2869207430 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f01cc004810 0x7f01cc004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:27.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01e9a00640 1 -- 172.21.15.123:0/2869207430 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f01cc004810 msgr2=0x7f01cc004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:27.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01e9a00640 1 --2- 172.21.15.123:0/2869207430 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f01cc004810 0x7f01cc004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01e9a00640 1 -- 172.21.15.123:0/2869207430 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01cc005230 msgr2=0x7f01cc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:27.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01e9a00640 1 --2- 172.21.15.123:0/2869207430 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01cc005230 0x7f01cc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01e9a00640 1 -- 172.21.15.123:0/2869207430 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01cc003530 con 0x7f01cc003a30 2024-04-25T13:43:27.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.230+0000 7f01ea400640 1 -- 172.21.15.123:0/2869207430 reap_dead start 2024-04-25T13:43:27.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.234+0000 7f01e9a00640 1 --2- 172.21.15.123:0/2869207430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01cc003a30 0x7f01cc003ea0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009ae0 tx=0x7f01d801ca70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f19426aca4a13d4c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:27.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.234+0000 7f01e3e00640 1 -- 172.21.15.123:0/2869207430 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d80b2070 con 0x7f01cc003a30 2024-04-25T13:43:27.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.234+0000 7f01e3e00640 1 -- 172.21.15.123:0/2869207430 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01d80a5660 con 0x7f01cc003a30 2024-04-25T13:43:27.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.234+0000 7f01e3e00640 1 -- 172.21.15.123:0/2869207430 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d80096b0 con 0x7f01cc003a30 2024-04-25T13:43:27.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.234+0000 7f01ec400640 1 -- 172.21.15.123:0/2869207430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01cc003a30 msgr2=0x7f01cc003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:27.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.234+0000 7f01ec400640 1 --2- 172.21.15.123:0/2869207430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01cc003a30 0x7f01cc003ea0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009ae0 tx=0x7f01d801ca70 comp rx=0 tx=0).stop 2024-04-25T13:43:27.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.234+0000 7f01ec400640 1 -- 172.21.15.123:0/2869207430 shutdown_connections 2024-04-25T13:43:27.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.234+0000 7f01ec400640 1 --2- 172.21.15.123:0/2869207430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01cc003a30 0x7f01cc003ea0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.234+0000 7f01ec400640 1 -- 172.21.15.123:0/2869207430 >> 172.21.15.123:0/2869207430 conn(0x7f01e406d210 msgr2=0x7f01e406ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:27.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.234+0000 7f01ec400640 1 -- 172.21.15.123:0/2869207430 shutdown_connections 2024-04-25T13:43:27.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.234+0000 7f01ec400640 1 -- 172.21.15.123:0/2869207430 wait complete. 2024-04-25T13:43:27.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.238+0000 7f01ec400640 1 Processor -- start 2024-04-25T13:43:27.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.238+0000 7f01ec400640 1 -- start start 2024-04-25T13:43:27.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.238+0000 7f01ec400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01cc003a30 0x7f01e415b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:27.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.238+0000 7f01ec400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01e41f6930 0x7f01e41f6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:27.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.238+0000 7f01ec400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f01e40d1d30 0x7f01e40d2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:27.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.238+0000 7f01ec400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f01e4073f20 con 0x7f01e41f6930 2024-04-25T13:43:27.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.238+0000 7f01ec400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f01e40cdd50 con 0x7f01cc003a30 2024-04-25T13:43:27.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.238+0000 7f01ec400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f01e4074bb0 con 0x7f01e40d1d30 2024-04-25T13:43:27.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.238+0000 7f01e9000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01e41f6930 0x7f01e41f6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:27.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.238+0000 7f01e9000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01e41f6930 0x7f01e41f6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41050/0 (socket says 172.21.15.123:41050) 2024-04-25T13:43:27.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.238+0000 7f01e9000640 1 -- 172.21.15.123:0/117660099 learned_addr learned my addr 172.21.15.123:0/117660099 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:27.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.238+0000 7f01ea400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f01e40d1d30 0x7f01e40d2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:27.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.238+0000 7f01e9a00640 1 --2- 172.21.15.123:0/117660099 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01cc003a30 0x7f01e415b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:27.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.238+0000 7f01e9000640 1 -- 172.21.15.123:0/117660099 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f01e40d1d30 msgr2=0x7f01e40d2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:27.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.238+0000 7f01e9000640 1 --2- 172.21.15.123:0/117660099 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f01e40d1d30 0x7f01e40d2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.238+0000 7f01e9000640 1 -- 172.21.15.123:0/117660099 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01cc003a30 msgr2=0x7f01e415b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:27.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.238+0000 7f01e9000640 1 --2- 172.21.15.123:0/117660099 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01cc003a30 0x7f01e415b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.238+0000 7f01e9000640 1 -- 172.21.15.123:0/117660099 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e40d2680 con 0x7f01e41f6930 2024-04-25T13:43:27.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.238+0000 7f01e9000640 1 --2- 172.21.15.123:0/117660099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01e41f6930 0x7f01e41f6d40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f01d000f770 tx=0x7f01d000fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:27.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.238+0000 7f01e1600640 1 -- 172.21.15.123:0/117660099 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d00050d0 con 0x7f01e41f6930 2024-04-25T13:43:27.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.238+0000 7f01e1600640 1 -- 172.21.15.123:0/117660099 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01d0018070 con 0x7f01e41f6930 2024-04-25T13:43:27.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.238+0000 7f01ec400640 1 -- 172.21.15.123:0/117660099 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01e41f9e80 con 0x7f01e41f6930 2024-04-25T13:43:27.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.238+0000 7f01e1600640 1 -- 172.21.15.123:0/117660099 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d0005490 con 0x7f01e41f6930 2024-04-25T13:43:27.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.238+0000 7f01ec400640 1 -- 172.21.15.123:0/117660099 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01e41fa440 con 0x7f01e41f6930 2024-04-25T13:43:27.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.242+0000 7f01ec400640 1 -- 172.21.15.123:0/117660099 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01e41f7460 con 0x7f01e41f6930 2024-04-25T13:43:27.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.242+0000 7f01e1600640 1 -- 172.21.15.123:0/117660099 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f01d000d730 con 0x7f01e41f6930 2024-04-25T13:43:27.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.242+0000 7f01e1600640 1 --2- 172.21.15.123:0/117660099 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f01c406f5a0 0x7f01c4071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:27.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.242+0000 7f01e1600640 1 -- 172.21.15.123:0/117660099 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f01d008eed0 con 0x7f01e41f6930 2024-04-25T13:43:27.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.242+0000 7f01e9a00640 1 --2- 172.21.15.123:0/117660099 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f01c406f5a0 0x7f01c4071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:27.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.242+0000 7f01e9a00640 1 --2- 172.21.15.123:0/117660099 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f01c406f5a0 0x7f01c4071ab0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f01d80af000 tx=0x7f01d80046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:27.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.246+0000 7f01e1600640 1 -- 172.21.15.123:0/117660099 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f01e40d2680 con 0x7f01e41f6930 2024-04-25T13:43:27.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.438+0000 7f01ec400640 1 -- 172.21.15.123:0/117660099 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01e40507c0 con 0x7f01e41f6930 2024-04-25T13:43:27.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.438+0000 7f01e1600640 1 -- 172.21.15.123:0/117660099 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5187 (secure 0 0 0) 0x7f01e41606f0 con 0x7f01e41f6930 2024-04-25T13:43:27.443 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:27.443 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3582988979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":3582988979},{"type":"v1","addr":"172.21.15.130:6835","nonce":3582988979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4978,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/173287078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":173287078},{"type":"v1","addr":"172.21.15.123:6837","nonce":173287078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4987,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/4025543653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4025543653},{"type":"v1","addr":"172.21.15.130:6834","nonce":4025543653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:43:01.431292+0000","modified":"2024-04-25T13:43:04.442129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6836/499623122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":499623122},{"type":"v1","addr":"172.21.15.123:6836","nonce":499623122}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5046,"qdb_cluster":[5046]},"id":2}]} 2024-04-25T13:43:27.443 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 17 2024-04-25T13:43:27.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.438+0000 7f01ec400640 1 -- 172.21.15.123:0/117660099 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f01c406f5a0 msgr2=0x7f01c4071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:27.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.438+0000 7f01ec400640 1 --2- 172.21.15.123:0/117660099 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f01c406f5a0 0x7f01c4071ab0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f01d80af000 tx=0x7f01d80046d0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.438+0000 7f01ec400640 1 -- 172.21.15.123:0/117660099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01e41f6930 msgr2=0x7f01e41f6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:27.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.438+0000 7f01ec400640 1 --2- 172.21.15.123:0/117660099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01e41f6930 0x7f01e41f6d40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f01d000f770 tx=0x7f01d000fb70 comp rx=0 tx=0).stop 2024-04-25T13:43:27.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.438+0000 7f01ec400640 1 -- 172.21.15.123:0/117660099 shutdown_connections 2024-04-25T13:43:27.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.438+0000 7f01ec400640 1 --2- 172.21.15.123:0/117660099 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f01c406f5a0 0x7f01c4071ab0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.438+0000 7f01ec400640 1 --2- 172.21.15.123:0/117660099 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f01e40d1d30 0x7f01e40d2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.438+0000 7f01ec400640 1 --2- 172.21.15.123:0/117660099 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f01e41f6930 0x7f01e41f6d40 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.438+0000 7f01ec400640 1 --2- 172.21.15.123:0/117660099 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f01cc003a30 0x7f01e415b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.438+0000 7f01ec400640 1 -- 172.21.15.123:0/117660099 >> 172.21.15.123:0/117660099 conn(0x7f01e406d210 msgr2=0x7f01e40b3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:27.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.438+0000 7f01ec400640 1 -- 172.21.15.123:0/117660099 shutdown_connections 2024-04-25T13:43:27.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.438+0000 7f01ec400640 1 -- 172.21.15.123:0/117660099 wait complete. 2024-04-25T13:43:27.465 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:43:27.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.606+0000 7f3bd5400640 1 Processor -- start 2024-04-25T13:43:27.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.606+0000 7f3bd5400640 1 -- start start 2024-04-25T13:43:27.614 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.610+0000 7f3bd5400640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3bd00d0f80 0x7f3bd0160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:27.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.610+0000 7f3bd5400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3bd00b32f0 0x7f3bd00b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:27.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.610+0000 7f3bd5400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bd00b3c40 con 0x7f3bd0073be0 2024-04-25T13:43:27.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.610+0000 7f3bd5400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f3bd015cfe0 con 0x7f3bd00b32f0 2024-04-25T13:43:27.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.610+0000 7f3bd5400640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f3bd0161520 con 0x7f3bd00d0f80 2024-04-25T13:43:27.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.610+0000 7f3bcde00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3bd00b32f0 0x7f3bd00b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:27.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.610+0000 7f3bcf200640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3bd0073be0 0x7f3bd0073ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58530/0 (socket says 172.21.15.123:58530) 2024-04-25T13:43:27.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.610+0000 7f3bcf200640 1 -- 172.21.15.123:0/3839012614 learned_addr learned my addr 172.21.15.123:0/3839012614 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:27.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.610+0000 7f3bcde00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3bd00b32f0 0x7f3bd00b3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41054/0 (socket says 172.21.15.123:41054) 2024-04-25T13:43:27.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.610+0000 7f3bce800640 1 --2- 172.21.15.123:0/3839012614 >> v2:172.21.15.130:3300/0 conn(0x7f3bd00d0f80 0x7f3bd0160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:27.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.610+0000 7f3bcde00640 1 -- 172.21.15.123:0/3839012614 >> v2:172.21.15.130:3300/0 conn(0x7f3bd00d0f80 msgr2=0x7f3bd0160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:27.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.610+0000 7f3bcde00640 1 --2- 172.21.15.123:0/3839012614 >> v2:172.21.15.130:3300/0 conn(0x7f3bd00d0f80 0x7f3bd0160fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.610+0000 7f3bcde00640 1 -- 172.21.15.123:0/3839012614 >> v1:172.21.15.123:6789/0 conn(0x7f3bd0073be0 legacy=0x7f3bd0073ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:27.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.610+0000 7f3bcde00640 1 -- 172.21.15.123:0/3839012614 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd015d240 con 0x7f3bd00b32f0 2024-04-25T13:43:27.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.614+0000 7f3bcde00640 1 --2- 172.21.15.123:0/3839012614 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bd00b32f0 0x7f3bd00b3700 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0070e80 tx=0x7f3bbc01ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf802985f0931f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:27.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.614+0000 7f3bcd400640 1 -- 172.21.15.123:0/3839012614 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc0b4070 con 0x7f3bd00b32f0 2024-04-25T13:43:27.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.614+0000 7f3bcd400640 1 -- 172.21.15.123:0/3839012614 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bbc0a7a60 con 0x7f3bd00b32f0 2024-04-25T13:43:27.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.614+0000 7f3bcd400640 1 -- 172.21.15.123:0/3839012614 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc0a7e30 con 0x7f3bd00b32f0 2024-04-25T13:43:27.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.614+0000 7f3bd5400640 1 -- 172.21.15.123:0/3839012614 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bd00b32f0 msgr2=0x7f3bd00b3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:27.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.614+0000 7f3bd5400640 1 --2- 172.21.15.123:0/3839012614 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bd00b32f0 0x7f3bd00b3700 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0070e80 tx=0x7f3bbc01ea90 comp rx=0 tx=0).stop 2024-04-25T13:43:27.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.614+0000 7f3bd5400640 1 -- 172.21.15.123:0/3839012614 shutdown_connections 2024-04-25T13:43:27.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.614+0000 7f3bd5400640 1 --2- 172.21.15.123:0/3839012614 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bd00b32f0 0x7f3bd00b3700 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.614+0000 7f3bd5400640 1 --2- 172.21.15.123:0/3839012614 >> v2:172.21.15.130:3300/0 conn(0x7f3bd00d0f80 0x7f3bd0160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.614+0000 7f3bd5400640 1 -- 172.21.15.123:0/3839012614 >> 172.21.15.123:0/3839012614 conn(0x7f3bd006d210 msgr2=0x7f3bd006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:27.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.614+0000 7f3bd5400640 1 -- 172.21.15.123:0/3839012614 shutdown_connections 2024-04-25T13:43:27.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.614+0000 7f3bd5400640 1 -- 172.21.15.123:0/3839012614 wait complete. 2024-04-25T13:43:27.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.618+0000 7f3bd5400640 1 Processor -- start 2024-04-25T13:43:27.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.618+0000 7f3bd5400640 1 -- start start 2024-04-25T13:43:27.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.618+0000 7f3bd5400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bd0073be0 0x7f3bd0141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:27.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.618+0000 7f3bd5400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3bd00b32f0 0x7f3bd0152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:27.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.618+0000 7f3bd5400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3bd00d0f80 0x7f3bd0153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:27.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.618+0000 7f3bd5400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd00b6020 con 0x7f3bd0073be0 2024-04-25T13:43:27.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.618+0000 7f3bd5400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd015ddc0 con 0x7f3bd00d0f80 2024-04-25T13:43:27.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.618+0000 7f3bd5400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3bd00b6470 con 0x7f3bd00b32f0 2024-04-25T13:43:27.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.618+0000 7f3bce800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bd0073be0 0x7f3bd0141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:27.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.618+0000 7f3bce800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bd0073be0 0x7f3bd0141fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41068/0 (socket says 172.21.15.123:41068) 2024-04-25T13:43:27.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.618+0000 7f3bce800640 1 -- 172.21.15.123:0/1719292984 learned_addr learned my addr 172.21.15.123:0/1719292984 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:27.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.618+0000 7f3bcde00640 1 --2- 172.21.15.123:0/1719292984 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3bd00b32f0 0x7f3bd0152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:27.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.618+0000 7f3bcf200640 1 --2- 172.21.15.123:0/1719292984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3bd00d0f80 0x7f3bd0153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:27.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.618+0000 7f3bce800640 1 -- 172.21.15.123:0/1719292984 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3bd00b32f0 msgr2=0x7f3bd0152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:27.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.618+0000 7f3bce800640 1 --2- 172.21.15.123:0/1719292984 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3bd00b32f0 0x7f3bd0152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.618+0000 7f3bce800640 1 -- 172.21.15.123:0/1719292984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3bd00d0f80 msgr2=0x7f3bd0153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:27.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.618+0000 7f3bce800640 1 --2- 172.21.15.123:0/1719292984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3bd00d0f80 0x7f3bd0153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.618+0000 7f3bce800640 1 -- 172.21.15.123:0/1719292984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd01508e0 con 0x7f3bd0073be0 2024-04-25T13:43:27.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.618+0000 7f3bce800640 1 --2- 172.21.15.123:0/1719292984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bd0073be0 0x7f3bd0141fc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000e840 tx=0x7f3bc000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:27.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.618+0000 7f3bc6a00640 1 -- 172.21.15.123:0/1719292984 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0017070 con 0x7f3bd0073be0 2024-04-25T13:43:27.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.618+0000 7f3bc6a00640 1 -- 172.21.15.123:0/1719292984 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bc000ee90 con 0x7f3bd0073be0 2024-04-25T13:43:27.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.618+0000 7f3bc6a00640 1 -- 172.21.15.123:0/1719292984 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc000cb00 con 0x7f3bd0073be0 2024-04-25T13:43:27.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.618+0000 7f3bd5400640 1 -- 172.21.15.123:0/1719292984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd0150bc0 con 0x7f3bd0073be0 2024-04-25T13:43:27.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.618+0000 7f3bd5400640 1 -- 172.21.15.123:0/1719292984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd014aea0 con 0x7f3bd0073be0 2024-04-25T13:43:27.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.622+0000 7f3bd5400640 1 -- 172.21.15.123:0/1719292984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd00507c0 con 0x7f3bd0073be0 2024-04-25T13:43:27.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.622+0000 7f3bc6a00640 1 -- 172.21.15.123:0/1719292984 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3bc001a070 con 0x7f3bd0073be0 2024-04-25T13:43:27.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.622+0000 7f3bc6a00640 1 --2- 172.21.15.123:0/1719292984 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3bb006f400 0x7f3bb0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:27.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.622+0000 7f3bc6a00640 1 -- 172.21.15.123:0/1719292984 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3bc008f4e0 con 0x7f3bd0073be0 2024-04-25T13:43:27.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.622+0000 7f3bcde00640 1 --2- 172.21.15.123:0/1719292984 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3bb006f400 0x7f3bb0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:27.628 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.622+0000 7f3bcde00640 1 --2- 172.21.15.123:0/1719292984 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3bb006f400 0x7f3bb0071910 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc0b1000 tx=0x7f3bbc0a9070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:27.631 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.626+0000 7f3bc6a00640 1 -- 172.21.15.123:0/1719292984 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3bc005bce0 con 0x7f3bd0073be0 2024-04-25T13:43:27.788 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.782+0000 7f3bd5400640 1 -- 172.21.15.123:0/1719292984 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3bd0069a00 con 0x7f3bd0073be0 2024-04-25T13:43:27.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.786+0000 7f3bc6a00640 1 -- 172.21.15.123:0/1719292984 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16693 (secure 0 0 0) 0x7f3bc005ffe0 con 0x7f3bd0073be0 2024-04-25T13:43:27.790 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:27.790 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":34,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:43:03.039428+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:59.250248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T13:43:00.396458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:43:27.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.786+0000 7f3bd5400640 1 -- 172.21.15.123:0/1719292984 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3bb006f400 msgr2=0x7f3bb0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:27.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.786+0000 7f3bd5400640 1 --2- 172.21.15.123:0/1719292984 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3bb006f400 0x7f3bb0071910 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc0b1000 tx=0x7f3bbc0a9070 comp rx=0 tx=0).stop 2024-04-25T13:43:27.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.786+0000 7f3bd5400640 1 -- 172.21.15.123:0/1719292984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bd0073be0 msgr2=0x7f3bd0141fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:27.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.786+0000 7f3bd5400640 1 --2- 172.21.15.123:0/1719292984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bd0073be0 0x7f3bd0141fc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000e840 tx=0x7f3bc000ec40 comp rx=0 tx=0).stop 2024-04-25T13:43:27.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.786+0000 7f3bd5400640 1 -- 172.21.15.123:0/1719292984 shutdown_connections 2024-04-25T13:43:27.792 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.786+0000 7f3bd5400640 1 --2- 172.21.15.123:0/1719292984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3bd00d0f80 0x7f3bd0153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.786+0000 7f3bd5400640 1 --2- 172.21.15.123:0/1719292984 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3bb006f400 0x7f3bb0071910 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.786+0000 7f3bd5400640 1 --2- 172.21.15.123:0/1719292984 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3bd00b32f0 0x7f3bd0152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.786+0000 7f3bd5400640 1 --2- 172.21.15.123:0/1719292984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3bd0073be0 0x7f3bd0141fc0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.786+0000 7f3bd5400640 1 -- 172.21.15.123:0/1719292984 >> 172.21.15.123:0/1719292984 conn(0x7f3bd006d210 msgr2=0x7f3bd00b6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:27.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.786+0000 7f3bd5400640 1 -- 172.21.15.123:0/1719292984 shutdown_connections 2024-04-25T13:43:27.793 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.786+0000 7f3bd5400640 1 -- 172.21.15.123:0/1719292984 wait complete. 2024-04-25T13:43:27.812 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T13:43:27.812 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:43:27.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.954+0000 7f33caa00640 1 Processor -- start 2024-04-25T13:43:27.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.954+0000 7f33caa00640 1 -- start start 2024-04-25T13:43:27.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.954+0000 7f33caa00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f33c40d30a0 0x7f33c40b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:27.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.954+0000 7f33caa00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f33c40ce9d0 0x7f33c40cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:27.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.954+0000 7f33caa00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33c40b2e20 con 0x7f33c406c670 2024-04-25T13:43:27.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.954+0000 7f33caa00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f33c40b2320 con 0x7f33c40d30a0 2024-04-25T13:43:27.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.954+0000 7f33caa00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f33c40b2580 con 0x7f33c40ce9d0 2024-04-25T13:43:27.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.954+0000 7f33c3400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f33c406c670 0x7f33c406ca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58534/0 (socket says 172.21.15.123:58534) 2024-04-25T13:43:27.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.954+0000 7f33c3400640 1 -- 172.21.15.123:0/400820228 learned_addr learned my addr 172.21.15.123:0/400820228 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:27.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.954+0000 7f33c3e00640 1 --2- 172.21.15.123:0/400820228 >> v2:172.21.15.130:3300/0 conn(0x7f33c40d30a0 0x7f33c40b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:27.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.954+0000 7f33c8a00640 1 --2- 172.21.15.123:0/400820228 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f33c40ce9d0 0x7f33c40cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:27.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.954+0000 7f33c2a00640 1 -- 172.21.15.123:0/400820228 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 336756026 0 0) 0x7f33c40b2e20 con 0x7f33c406c670 2024-04-25T13:43:27.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.954+0000 7f33c2a00640 1 -- 172.21.15.123:0/400820228 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33a8003530 con 0x7f33c406c670 2024-04-25T13:43:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.954+0000 7f33c3e00640 1 -- 172.21.15.123:0/400820228 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f33c40ce9d0 msgr2=0x7f33c40cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.954+0000 7f33c3e00640 1 --2- 172.21.15.123:0/400820228 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f33c40ce9d0 0x7f33c40cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.954+0000 7f33c2a00640 1 -- 172.21.15.123:0/400820228 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1063738410 0 0) 0x7f33a8003530 con 0x7f33c406c670 2024-04-25T13:43:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.954+0000 7f33c3e00640 1 -- 172.21.15.123:0/400820228 >> v1:172.21.15.123:6789/0 conn(0x7f33c406c670 legacy=0x7f33c406ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.954+0000 7f33c3e00640 1 -- 172.21.15.123:0/400820228 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c40b2860 con 0x7f33c40d30a0 2024-04-25T13:43:27.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.958+0000 7f33c3e00640 1 --2- 172.21.15.123:0/400820228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33c40d30a0 0x7f33c40b1de0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f33b40097a0 tx=0x7f33b401c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99e524253dbe0cbe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:27.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.958+0000 7f33c2a00640 1 -- 172.21.15.123:0/400820228 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b40b0070 con 0x7f33c40d30a0 2024-04-25T13:43:27.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.958+0000 7f33c2a00640 1 -- 172.21.15.123:0/400820228 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33b40ab400 con 0x7f33c40d30a0 2024-04-25T13:43:27.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.958+0000 7f33c2a00640 1 -- 172.21.15.123:0/400820228 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b0001680 con 0x7f33c40d30a0 2024-04-25T13:43:27.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.958+0000 7f33caa00640 1 -- 172.21.15.123:0/400820228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33c40d30a0 msgr2=0x7f33c40b1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:27.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.958+0000 7f33caa00640 1 --2- 172.21.15.123:0/400820228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33c40d30a0 0x7f33c40b1de0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f33b40097a0 tx=0x7f33b401c3a0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.958+0000 7f33caa00640 1 -- 172.21.15.123:0/400820228 shutdown_connections 2024-04-25T13:43:27.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.958+0000 7f33caa00640 1 --2- 172.21.15.123:0/400820228 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f33c40ce9d0 0x7f33c40cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.958+0000 7f33caa00640 1 --2- 172.21.15.123:0/400820228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33c40d30a0 0x7f33c40b1de0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.958+0000 7f33caa00640 1 -- 172.21.15.123:0/400820228 >> 172.21.15.123:0/400820228 conn(0x7f33c40d2580 msgr2=0x7f33c40d2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:27.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.958+0000 7f33caa00640 1 -- 172.21.15.123:0/400820228 shutdown_connections 2024-04-25T13:43:27.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.958+0000 7f33caa00640 1 -- 172.21.15.123:0/400820228 wait complete. 2024-04-25T13:43:27.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.962+0000 7f33caa00640 1 Processor -- start 2024-04-25T13:43:27.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.962+0000 7f33caa00640 1 -- start start 2024-04-25T13:43:27.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.962+0000 7f33caa00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f33c406c670 0x7f33c414bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:27.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.962+0000 7f33caa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33c40ce9d0 0x7f33c40b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:27.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.962+0000 7f33caa00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33c40d30a0 0x7f33c40b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:27.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.962+0000 7f33caa00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f33c416ad80 con 0x7f33c40d30a0 2024-04-25T13:43:27.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.962+0000 7f33caa00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f33c416ac00 con 0x7f33c40ce9d0 2024-04-25T13:43:27.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.962+0000 7f33caa00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f33c416af00 con 0x7f33c406c670 2024-04-25T13:43:27.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.962+0000 7f33c8a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33c40d30a0 0x7f33c40b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:27.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.962+0000 7f33c8a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33c40d30a0 0x7f33c40b3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41076/0 (socket says 172.21.15.123:41076) 2024-04-25T13:43:27.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.962+0000 7f33c8a00640 1 -- 172.21.15.123:0/2118696092 learned_addr learned my addr 172.21.15.123:0/2118696092 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:27.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.962+0000 7f33c3400640 1 --2- 172.21.15.123:0/2118696092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33c40ce9d0 0x7f33c40b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:27.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.962+0000 7f33c3e00640 1 --2- 172.21.15.123:0/2118696092 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f33c406c670 0x7f33c414bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:27.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.966+0000 7f33c8a00640 1 -- 172.21.15.123:0/2118696092 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f33c406c670 msgr2=0x7f33c414bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:27.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.966+0000 7f33c8a00640 1 --2- 172.21.15.123:0/2118696092 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f33c406c670 0x7f33c414bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.966+0000 7f33c8a00640 1 -- 172.21.15.123:0/2118696092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33c40ce9d0 msgr2=0x7f33c40b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:27.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.966+0000 7f33c8a00640 1 --2- 172.21.15.123:0/2118696092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33c40ce9d0 0x7f33c40b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:27.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.966+0000 7f33c8a00640 1 -- 172.21.15.123:0/2118696092 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c40b0da0 con 0x7f33c40d30a0 2024-04-25T13:43:27.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.966+0000 7f33c8a00640 1 --2- 172.21.15.123:0/2118696092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33c40d30a0 0x7f33c40b3c70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f33bc00efc0 tx=0x7f33bc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:27.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.966+0000 7f33bbe00640 1 -- 172.21.15.123:0/2118696092 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc018020 con 0x7f33c40d30a0 2024-04-25T13:43:27.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.966+0000 7f33bbe00640 1 -- 172.21.15.123:0/2118696092 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33bc014480 con 0x7f33c40d30a0 2024-04-25T13:43:27.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.966+0000 7f33caa00640 1 -- 172.21.15.123:0/2118696092 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33c40b1080 con 0x7f33c40d30a0 2024-04-25T13:43:27.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.966+0000 7f33bbe00640 1 -- 172.21.15.123:0/2118696092 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc009e60 con 0x7f33c40d30a0 2024-04-25T13:43:27.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.966+0000 7f33caa00640 1 -- 172.21.15.123:0/2118696092 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33c40b1640 con 0x7f33c40d30a0 2024-04-25T13:43:27.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.966+0000 7f33caa00640 1 -- 172.21.15.123:0/2118696092 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33c40507c0 con 0x7f33c40d30a0 2024-04-25T13:43:27.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.966+0000 7f33bbe00640 1 -- 172.21.15.123:0/2118696092 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f33bc01b020 con 0x7f33c40d30a0 2024-04-25T13:43:27.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.970+0000 7f33bbe00640 1 --2- 172.21.15.123:0/2118696092 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f33a406f430 0x7f33a4071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:27.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.970+0000 7f33bbe00640 1 -- 172.21.15.123:0/2118696092 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f33bc08ff60 con 0x7f33c40d30a0 2024-04-25T13:43:27.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.970+0000 7f33c3e00640 1 --2- 172.21.15.123:0/2118696092 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f33a406f430 0x7f33a4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:27.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.970+0000 7f33c3e00640 1 --2- 172.21.15.123:0/2118696092 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f33a406f430 0x7f33a4071940 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f33b40ad000 tx=0x7f33b40a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:27.978 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:27.974+0000 7f33bbe00640 1 -- 172.21.15.123:0/2118696092 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f33bc022020 con 0x7f33c40d30a0 2024-04-25T13:43:28.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.162+0000 7f33caa00640 1 -- 172.21.15.123:0/2118696092 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33c415a1d0 con 0x7f33c40d30a0 2024-04-25T13:43:28.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.162+0000 7f33bbe00640 1 -- 172.21.15.123:0/2118696092 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5187 (secure 0 0 0) 0x7f33bc010040 con 0x7f33c40d30a0 2024-04-25T13:43:28.168 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:28.168 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3582988979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":3582988979},{"type":"v1","addr":"172.21.15.130:6835","nonce":3582988979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4978,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/173287078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":173287078},{"type":"v1","addr":"172.21.15.123:6837","nonce":173287078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4987,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/4025543653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4025543653},{"type":"v1","addr":"172.21.15.130:6834","nonce":4025543653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:43:01.431292+0000","modified":"2024-04-25T13:43:04.442129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6836/499623122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":499623122},{"type":"v1","addr":"172.21.15.123:6836","nonce":499623122}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5046,"qdb_cluster":[5046]},"id":2}]} 2024-04-25T13:43:28.168 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 17 2024-04-25T13:43:28.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.166+0000 7f33caa00640 1 -- 172.21.15.123:0/2118696092 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f33a406f430 msgr2=0x7f33a4071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:28.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.166+0000 7f33caa00640 1 --2- 172.21.15.123:0/2118696092 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f33a406f430 0x7f33a4071940 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f33b40ad000 tx=0x7f33b40a6000 comp rx=0 tx=0).stop 2024-04-25T13:43:28.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.166+0000 7f33caa00640 1 -- 172.21.15.123:0/2118696092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33c40d30a0 msgr2=0x7f33c40b3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:28.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.166+0000 7f33caa00640 1 --2- 172.21.15.123:0/2118696092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33c40d30a0 0x7f33c40b3c70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f33bc00efc0 tx=0x7f33bc00c490 comp rx=0 tx=0).stop 2024-04-25T13:43:28.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.166+0000 7f33caa00640 1 -- 172.21.15.123:0/2118696092 shutdown_connections 2024-04-25T13:43:28.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.166+0000 7f33caa00640 1 --2- 172.21.15.123:0/2118696092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33c40ce9d0 0x7f33c40b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.166+0000 7f33caa00640 1 --2- 172.21.15.123:0/2118696092 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f33a406f430 0x7f33a4071940 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.166+0000 7f33caa00640 1 --2- 172.21.15.123:0/2118696092 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f33c40d30a0 0x7f33c40b3c70 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.166+0000 7f33caa00640 1 --2- 172.21.15.123:0/2118696092 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f33c406c670 0x7f33c414bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.166+0000 7f33caa00640 1 -- 172.21.15.123:0/2118696092 >> 172.21.15.123:0/2118696092 conn(0x7f33c40d2580 msgr2=0x7f33c4159440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:28.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.166+0000 7f33caa00640 1 -- 172.21.15.123:0/2118696092 shutdown_connections 2024-04-25T13:43:28.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.166+0000 7f33caa00640 1 -- 172.21.15.123:0/2118696092 wait complete. 2024-04-25T13:43:28.189 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:43:28.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.330+0000 7f4ceac00640 1 Processor -- start 2024-04-25T13:43:28.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.330+0000 7f4ceac00640 1 -- start start 2024-04-25T13:43:28.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.334+0000 7f4ceac00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ce41474f0 0x7f4ce415eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:28.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.334+0000 7f4ceac00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4ce40b6970 0x7f4ce40b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:28.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.334+0000 7f4ceac00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ce415f0d0 con 0x7f4ce40b32f0 2024-04-25T13:43:28.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.334+0000 7f4ceac00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f4ce40d0d10 con 0x7f4ce40b6970 2024-04-25T13:43:28.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.334+0000 7f4ceac00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4ce40ce8f0 con 0x7f4ce41474f0 2024-04-25T13:43:28.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.334+0000 7f4ce8c00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4ce40b32f0 0x7f4ce40b3700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58546/0 (socket says 172.21.15.123:58546) 2024-04-25T13:43:28.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.334+0000 7f4ce8c00640 1 -- 172.21.15.123:0/1694392874 learned_addr learned my addr 172.21.15.123:0/1694392874 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:28.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.334+0000 7f4ce3e00640 1 --2- 172.21.15.123:0/1694392874 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ce41474f0 0x7f4ce415eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:28.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.334+0000 7f4cdb400640 1 --2- 172.21.15.123:0/1694392874 >> v2:172.21.15.130:3300/0 conn(0x7f4ce40b6970 0x7f4ce40b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:28.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.334+0000 7f4ce3400640 1 -- 172.21.15.123:0/1694392874 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3012277490 0 0) 0x7f4cdc0014a0 con 0x7f4ce40b32f0 2024-04-25T13:43:28.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.334+0000 7f4ce3400640 1 -- 172.21.15.123:0/1694392874 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cc8003530 con 0x7f4ce40b32f0 2024-04-25T13:43:28.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.334+0000 7f4cdb400640 1 -- 172.21.15.123:0/1694392874 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ce41474f0 msgr2=0x7f4ce415eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:28.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.334+0000 7f4cdb400640 1 --2- 172.21.15.123:0/1694392874 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ce41474f0 0x7f4ce415eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.334+0000 7f4cdb400640 1 -- 172.21.15.123:0/1694392874 >> v1:172.21.15.123:6789/0 conn(0x7f4ce40b32f0 legacy=0x7f4ce40b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:28.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.334+0000 7f4cdb400640 1 -- 172.21.15.123:0/1694392874 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce40b72c0 con 0x7f4ce40b6970 2024-04-25T13:43:28.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.334+0000 7f4ce3e00640 1 --2- 172.21.15.123:0/1694392874 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ce41474f0 0x7f4ce415eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:43:28.342 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.338+0000 7f4cdb400640 1 --2- 172.21.15.123:0/1694392874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ce40b6970 0x7f4ce40b6d80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc0097c0 tx=0x7f4ccc01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=789d611ee632b3ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:28.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.338+0000 7f4ce3400640 1 -- 172.21.15.123:0/1694392874 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc0a7070 con 0x7f4ce40b6970 2024-04-25T13:43:28.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.338+0000 7f4ce3400640 1 -- 172.21.15.123:0/1694392874 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ccc0b0070 con 0x7f4ce40b6970 2024-04-25T13:43:28.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.338+0000 7f4ce3400640 1 -- 172.21.15.123:0/1694392874 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc0ab890 con 0x7f4ce40b6970 2024-04-25T13:43:28.343 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.338+0000 7f4ceac00640 1 -- 172.21.15.123:0/1694392874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ce40b6970 msgr2=0x7f4ce40b6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:28.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.338+0000 7f4ceac00640 1 --2- 172.21.15.123:0/1694392874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ce40b6970 0x7f4ce40b6d80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc0097c0 tx=0x7f4ccc01c470 comp rx=0 tx=0).stop 2024-04-25T13:43:28.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.338+0000 7f4ceac00640 1 -- 172.21.15.123:0/1694392874 shutdown_connections 2024-04-25T13:43:28.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.338+0000 7f4ceac00640 1 --2- 172.21.15.123:0/1694392874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ce40b6970 0x7f4ce40b6d80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.338+0000 7f4ceac00640 1 --2- 172.21.15.123:0/1694392874 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ce41474f0 0x7f4ce415eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.338+0000 7f4ceac00640 1 -- 172.21.15.123:0/1694392874 >> 172.21.15.123:0/1694392874 conn(0x7f4ce406d210 msgr2=0x7f4ce406ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:28.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.338+0000 7f4ceac00640 1 -- 172.21.15.123:0/1694392874 shutdown_connections 2024-04-25T13:43:28.344 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.338+0000 7f4ceac00640 1 -- 172.21.15.123:0/1694392874 wait complete. 2024-04-25T13:43:28.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.342+0000 7f4ceac00640 1 Processor -- start 2024-04-25T13:43:28.346 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.342+0000 7f4ceac00640 1 -- start start 2024-04-25T13:43:28.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.342+0000 7f4ceac00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ce40b32f0 0x7f4ce4142a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:28.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.342+0000 7f4ceac00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ce40b6970 0x7f4ce41440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:28.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.342+0000 7f4ceac00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ce41474f0 0x7f4ce4144610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:28.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.342+0000 7f4ceac00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce4073f80 con 0x7f4ce41474f0 2024-04-25T13:43:28.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.342+0000 7f4ceac00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce4073ca0 con 0x7f4ce40b32f0 2024-04-25T13:43:28.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.342+0000 7f4ceac00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4ce40744a0 con 0x7f4ce40b6970 2024-04-25T13:43:28.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.342+0000 7f4ce8c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ce41474f0 0x7f4ce4144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:28.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.342+0000 7f4ce8c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ce41474f0 0x7f4ce4144610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41084/0 (socket says 172.21.15.123:41084) 2024-04-25T13:43:28.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.342+0000 7f4ce8c00640 1 -- 172.21.15.123:0/1944039280 learned_addr learned my addr 172.21.15.123:0/1944039280 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:28.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.342+0000 7f4ce3e00640 1 --2- 172.21.15.123:0/1944039280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ce40b32f0 0x7f4ce4142a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:28.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.342+0000 7f4cdb400640 1 --2- 172.21.15.123:0/1944039280 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ce40b6970 0x7f4ce41440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:28.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.342+0000 7f4ce8c00640 1 -- 172.21.15.123:0/1944039280 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ce40b6970 msgr2=0x7f4ce41440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:28.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.342+0000 7f4ce8c00640 1 --2- 172.21.15.123:0/1944039280 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ce40b6970 0x7f4ce41440d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.342+0000 7f4ce8c00640 1 -- 172.21.15.123:0/1944039280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ce40b32f0 msgr2=0x7f4ce4142a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:28.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.342+0000 7f4ce8c00640 1 --2- 172.21.15.123:0/1944039280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ce40b32f0 0x7f4ce4142a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.342+0000 7f4ce8c00640 1 -- 172.21.15.123:0/1944039280 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce4140490 con 0x7f4ce41474f0 2024-04-25T13:43:28.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.342+0000 7f4ce8c00640 1 --2- 172.21.15.123:0/1944039280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ce41474f0 0x7f4ce4144610 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc00ca70 tx=0x7f4cdc00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:28.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.342+0000 7f4ce0c00640 1 -- 172.21.15.123:0/1944039280 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc017070 con 0x7f4ce41474f0 2024-04-25T13:43:28.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.342+0000 7f4ce0c00640 1 -- 172.21.15.123:0/1944039280 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cdc00abd0 con 0x7f4ce41474f0 2024-04-25T13:43:28.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.342+0000 7f4ceac00640 1 -- 172.21.15.123:0/1944039280 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce4143300 con 0x7f4ce41474f0 2024-04-25T13:43:28.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.342+0000 7f4ce0c00640 1 -- 172.21.15.123:0/1944039280 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc012400 con 0x7f4ce41474f0 2024-04-25T13:43:28.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.342+0000 7f4ceac00640 1 -- 172.21.15.123:0/1944039280 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce413ec10 con 0x7f4ce41474f0 2024-04-25T13:43:28.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.346+0000 7f4ceac00640 1 -- 172.21.15.123:0/1944039280 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ce41f7470 con 0x7f4ce41474f0 2024-04-25T13:43:28.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.346+0000 7f4ce0c00640 1 -- 172.21.15.123:0/1944039280 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4cdc01a070 con 0x7f4ce41474f0 2024-04-25T13:43:28.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.346+0000 7f4ce0c00640 1 --2- 172.21.15.123:0/1944039280 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4cc006f430 0x7f4cc0071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:28.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.346+0000 7f4ce0c00640 1 -- 172.21.15.123:0/1944039280 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f4cdc08f060 con 0x7f4ce41474f0 2024-04-25T13:43:28.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.346+0000 7f4ce3e00640 1 --2- 172.21.15.123:0/1944039280 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4cc006f430 0x7f4cc0071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:28.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.346+0000 7f4ce3e00640 1 --2- 172.21.15.123:0/1944039280 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4cc006f430 0x7f4cc0071940 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4009a50 tx=0x7f4cd4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:28.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.350+0000 7f4ce0c00640 1 -- 172.21.15.123:0/1944039280 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4ce41f7470 con 0x7f4ce41474f0 2024-04-25T13:43:28.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.538+0000 7f4ceac00640 1 -- 172.21.15.123:0/1944039280 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ce40507c0 con 0x7f4ce41474f0 2024-04-25T13:43:28.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.538+0000 7f4ce0c00640 1 -- 172.21.15.123:0/1944039280 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5187 (secure 0 0 0) 0x7f4ce415f0d0 con 0x7f4ce41474f0 2024-04-25T13:43:28.545 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:28.545 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3582988979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":3582988979},{"type":"v1","addr":"172.21.15.130:6835","nonce":3582988979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4978,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/173287078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":173287078},{"type":"v1","addr":"172.21.15.123:6837","nonce":173287078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4987,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/4025543653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4025543653},{"type":"v1","addr":"172.21.15.130:6834","nonce":4025543653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T13:43:01.431292+0000","modified":"2024-04-25T13:43:04.442129+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5046},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5046":{"gid":5046,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.123:6836/499623122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":499623122},{"type":"v1","addr":"172.21.15.123:6836","nonce":499623122}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5046,"qdb_cluster":[5046]},"id":2}]} 2024-04-25T13:43:28.545 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 17 2024-04-25T13:43:28.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.542+0000 7f4ceac00640 1 -- 172.21.15.123:0/1944039280 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4cc006f430 msgr2=0x7f4cc0071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:28.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.542+0000 7f4ceac00640 1 --2- 172.21.15.123:0/1944039280 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4cc006f430 0x7f4cc0071940 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4009a50 tx=0x7f4cd4008040 comp rx=0 tx=0).stop 2024-04-25T13:43:28.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.542+0000 7f4ceac00640 1 -- 172.21.15.123:0/1944039280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ce41474f0 msgr2=0x7f4ce4144610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:28.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.542+0000 7f4ceac00640 1 --2- 172.21.15.123:0/1944039280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ce41474f0 0x7f4ce4144610 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc00ca70 tx=0x7f4cdc00cf30 comp rx=0 tx=0).stop 2024-04-25T13:43:28.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.542+0000 7f4ceac00640 1 -- 172.21.15.123:0/1944039280 shutdown_connections 2024-04-25T13:43:28.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.542+0000 7f4ceac00640 1 --2- 172.21.15.123:0/1944039280 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4cc006f430 0x7f4cc0071940 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.542+0000 7f4ceac00640 1 --2- 172.21.15.123:0/1944039280 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4ce41474f0 0x7f4ce4144610 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.542+0000 7f4ceac00640 1 --2- 172.21.15.123:0/1944039280 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ce40b6970 0x7f4ce41440d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.542+0000 7f4ceac00640 1 --2- 172.21.15.123:0/1944039280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ce40b32f0 0x7f4ce4142a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.542+0000 7f4ceac00640 1 -- 172.21.15.123:0/1944039280 >> 172.21.15.123:0/1944039280 conn(0x7f4ce406d210 msgr2=0x7f4ce40ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:28.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.542+0000 7f4ceac00640 1 -- 172.21.15.123:0/1944039280 shutdown_connections 2024-04-25T13:43:28.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.542+0000 7f4ceac00640 1 -- 172.21.15.123:0/1944039280 wait complete. 2024-04-25T13:43:28.567 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:43:28.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.710+0000 7f8de0a00640 1 Processor -- start 2024-04-25T13:43:28.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.710+0000 7f8de0a00640 1 -- start start 2024-04-25T13:43:28.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.710+0000 7f8de0a00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8ddc06f4b0 0x7f8ddc06f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:28.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.710+0000 7f8de0a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ddc0ccec0 con 0x7f8ddc0b4cd0 2024-04-25T13:43:28.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.710+0000 7f8de0a00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ddc0cd1a0 con 0x7f8ddc0b41b0 2024-04-25T13:43:28.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.710+0000 7f8de0a00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f8ddc0cd480 con 0x7f8ddc06f4b0 2024-04-25T13:43:28.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.710+0000 7f8dd3e00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f8ddc0b4cd0 0x7f8ddc06eda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58558/0 (socket says 172.21.15.123:58558) 2024-04-25T13:43:28.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.710+0000 7f8dd3e00640 1 -- 172.21.15.123:0/1799675048 learned_addr learned my addr 172.21.15.123:0/1799675048 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:28.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.710+0000 7f8ddb200640 1 --2- 172.21.15.123:0/1799675048 >> v2:172.21.15.130:3300/0 conn(0x7f8ddc06f4b0 0x7f8ddc06f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:28.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.710+0000 7f8dd9e00640 1 -- 172.21.15.123:0/1799675048 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2654238782 0 0) 0x7f8ddc0ccec0 con 0x7f8ddc0b4cd0 2024-04-25T13:43:28.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.710+0000 7f8dd9e00640 1 -- 172.21.15.123:0/1799675048 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dc0003530 con 0x7f8ddc0b4cd0 2024-04-25T13:43:28.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.710+0000 7f8ddb200640 1 -- 172.21.15.123:0/1799675048 >> v1:172.21.15.130:6789/0 conn(0x7f8ddc0b41b0 legacy=0x7f8ddc0b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:28.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.710+0000 7f8ddb200640 1 -- 172.21.15.123:0/1799675048 >> v1:172.21.15.123:6789/0 conn(0x7f8ddc0b4cd0 legacy=0x7f8ddc06eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:28.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.710+0000 7f8ddb200640 1 -- 172.21.15.123:0/1799675048 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ddc0cd760 con 0x7f8ddc06f4b0 2024-04-25T13:43:28.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.714+0000 7f8ddb200640 1 --2- 172.21.15.123:0/1799675048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ddc06f4b0 0x7f8ddc06f8c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009d90 tx=0x7f8dd401f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8bad563e136952c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:28.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.714+0000 7f8dd9e00640 1 -- 172.21.15.123:0/1799675048 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd40b4070 con 0x7f8ddc06f4b0 2024-04-25T13:43:28.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.714+0000 7f8dd9e00640 1 -- 172.21.15.123:0/1799675048 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dd40af600 con 0x7f8ddc06f4b0 2024-04-25T13:43:28.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.714+0000 7f8dd9e00640 1 -- 172.21.15.123:0/1799675048 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd40af9b0 con 0x7f8ddc06f4b0 2024-04-25T13:43:28.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.714+0000 7f8de0a00640 1 -- 172.21.15.123:0/1799675048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ddc06f4b0 msgr2=0x7f8ddc06f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:28.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.714+0000 7f8de0a00640 1 --2- 172.21.15.123:0/1799675048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ddc06f4b0 0x7f8ddc06f8c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009d90 tx=0x7f8dd401f150 comp rx=0 tx=0).stop 2024-04-25T13:43:28.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.714+0000 7f8de0a00640 1 -- 172.21.15.123:0/1799675048 shutdown_connections 2024-04-25T13:43:28.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.714+0000 7f8de0a00640 1 --2- 172.21.15.123:0/1799675048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ddc06f4b0 0x7f8ddc06f8c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.714+0000 7f8de0a00640 1 -- 172.21.15.123:0/1799675048 >> 172.21.15.123:0/1799675048 conn(0x7f8ddc06cca0 msgr2=0x7f8ddc0b2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:28.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.714+0000 7f8de0a00640 1 -- 172.21.15.123:0/1799675048 shutdown_connections 2024-04-25T13:43:28.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.714+0000 7f8de0a00640 1 -- 172.21.15.123:0/1799675048 wait complete. 2024-04-25T13:43:28.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.718+0000 7f8de0a00640 1 Processor -- start 2024-04-25T13:43:28.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.718+0000 7f8de0a00640 1 -- start start 2024-04-25T13:43:28.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.718+0000 7f8de0a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ddc06f4b0 0x7f8ddc0cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:28.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.718+0000 7f8de0a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ddc0b41b0 0x7f8ddc15f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:28.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.718+0000 7f8de0a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ddc0b4cd0 0x7f8ddc0c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:28.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.718+0000 7f8de0a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc0b5260 con 0x7f8ddc0b4cd0 2024-04-25T13:43:28.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.718+0000 7f8de0a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc0b50e0 con 0x7f8ddc06f4b0 2024-04-25T13:43:28.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.718+0000 7f8de0a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f8ddc0cca70 con 0x7f8ddc0b41b0 2024-04-25T13:43:28.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.718+0000 7f8ddb200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ddc0b4cd0 0x7f8ddc0c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:28.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.718+0000 7f8ddb200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ddc0b4cd0 0x7f8ddc0c5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41100/0 (socket says 172.21.15.123:41100) 2024-04-25T13:43:28.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.718+0000 7f8ddb200640 1 -- 172.21.15.123:0/4250280834 learned_addr learned my addr 172.21.15.123:0/4250280834 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:28.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.718+0000 7f8dd3e00640 1 --2- 172.21.15.123:0/4250280834 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ddc0b41b0 0x7f8ddc15f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:28.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.718+0000 7f8dda800640 1 --2- 172.21.15.123:0/4250280834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ddc06f4b0 0x7f8ddc0cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:28.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.718+0000 7f8ddb200640 1 -- 172.21.15.123:0/4250280834 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ddc0b41b0 msgr2=0x7f8ddc15f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:28.726 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.718+0000 7f8ddb200640 1 --2- 172.21.15.123:0/4250280834 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ddc0b41b0 0x7f8ddc15f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.718+0000 7f8ddb200640 1 -- 172.21.15.123:0/4250280834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ddc06f4b0 msgr2=0x7f8ddc0cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:28.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.718+0000 7f8ddb200640 1 --2- 172.21.15.123:0/4250280834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ddc06f4b0 0x7f8ddc0cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.718+0000 7f8ddb200640 1 -- 172.21.15.123:0/4250280834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ddc0cb7a0 con 0x7f8ddc0b4cd0 2024-04-25T13:43:28.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.722+0000 7f8ddb200640 1 --2- 172.21.15.123:0/4250280834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ddc0b4cd0 0x7f8ddc0c5330 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009d90 tx=0x7f8dd401bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:28.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.722+0000 7f8dd2a00640 1 -- 172.21.15.123:0/4250280834 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd40b4040 con 0x7f8ddc0b4cd0 2024-04-25T13:43:28.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.722+0000 7f8dd2a00640 1 -- 172.21.15.123:0/4250280834 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dd40039a0 con 0x7f8ddc0b4cd0 2024-04-25T13:43:28.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.722+0000 7f8dd2a00640 1 -- 172.21.15.123:0/4250280834 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4009450 con 0x7f8ddc0b4cd0 2024-04-25T13:43:28.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.722+0000 7f8de0a00640 1 -- 172.21.15.123:0/4250280834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ddc15dfd0 con 0x7f8ddc0b4cd0 2024-04-25T13:43:28.727 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.722+0000 7f8de0a00640 1 -- 172.21.15.123:0/4250280834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ddc15e590 con 0x7f8ddc0b4cd0 2024-04-25T13:43:28.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.722+0000 7f8de0a00640 1 -- 172.21.15.123:0/4250280834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ddc15dd40 con 0x7f8ddc0b4cd0 2024-04-25T13:43:28.728 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.722+0000 7f8dd2a00640 1 -- 172.21.15.123:0/4250280834 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8dd4004030 con 0x7f8ddc0b4cd0 2024-04-25T13:43:28.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.722+0000 7f8dd2a00640 1 --2- 172.21.15.123:0/4250280834 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8db806f400 0x7f8db8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:28.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.722+0000 7f8dd2a00640 1 -- 172.21.15.123:0/4250280834 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8dd412cf00 con 0x7f8ddc0b4cd0 2024-04-25T13:43:28.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.722+0000 7f8dda800640 1 --2- 172.21.15.123:0/4250280834 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8db806f400 0x7f8db8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:28.729 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.726+0000 7f8dda800640 1 --2- 172.21.15.123:0/4250280834 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8db806f400 0x7f8db8071910 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0cf8d0 tx=0x7f8dcc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:28.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.726+0000 7f8dd2a00640 1 -- 172.21.15.123:0/4250280834 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8dd4018cb0 con 0x7f8ddc0b4cd0 2024-04-25T13:43:28.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.886+0000 7f8de0a00640 1 -- 172.21.15.123:0/4250280834 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ddc050750 con 0x7f8ddc0b4cd0 2024-04-25T13:43:28.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.886+0000 7f8dd2a00640 1 -- 172.21.15.123:0/4250280834 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16693 (secure 0 0 0) 0x7f8dd4100e20 con 0x7f8ddc0b4cd0 2024-04-25T13:43:28.891 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:28.892 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":34,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:43:03.039428+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-25T13:42:59.250248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-25T13:43:00.396458+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:43:28.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.890+0000 7f8de0a00640 1 -- 172.21.15.123:0/4250280834 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8db806f400 msgr2=0x7f8db8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:28.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.890+0000 7f8de0a00640 1 --2- 172.21.15.123:0/4250280834 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8db806f400 0x7f8db8071910 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0cf8d0 tx=0x7f8dcc009040 comp rx=0 tx=0).stop 2024-04-25T13:43:28.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.890+0000 7f8de0a00640 1 -- 172.21.15.123:0/4250280834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ddc0b4cd0 msgr2=0x7f8ddc0c5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:28.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.890+0000 7f8de0a00640 1 --2- 172.21.15.123:0/4250280834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ddc0b4cd0 0x7f8ddc0c5330 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009d90 tx=0x7f8dd401bef0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.890+0000 7f8de0a00640 1 -- 172.21.15.123:0/4250280834 shutdown_connections 2024-04-25T13:43:28.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.890+0000 7f8de0a00640 1 --2- 172.21.15.123:0/4250280834 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f8db806f400 0x7f8db8071910 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.890+0000 7f8de0a00640 1 --2- 172.21.15.123:0/4250280834 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8ddc0b4cd0 0x7f8ddc0c5330 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.890+0000 7f8de0a00640 1 --2- 172.21.15.123:0/4250280834 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ddc0b41b0 0x7f8ddc15f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.890+0000 7f8de0a00640 1 --2- 172.21.15.123:0/4250280834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ddc06f4b0 0x7f8ddc0cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:28.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.890+0000 7f8de0a00640 1 -- 172.21.15.123:0/4250280834 >> 172.21.15.123:0/4250280834 conn(0x7f8ddc06cca0 msgr2=0x7f8ddc0b1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:28.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.890+0000 7f8de0a00640 1 -- 172.21.15.123:0/4250280834 shutdown_connections 2024-04-25T13:43:28.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:28.890+0000 7f8de0a00640 1 -- 172.21.15.123:0/4250280834 wait complete. 2024-04-25T13:43:28.914 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T13:43:29.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.054+0000 7f4e81800640 1 Processor -- start 2024-04-25T13:43:29.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.054+0000 7f4e81800640 1 -- start start 2024-04-25T13:43:29.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.058+0000 7f4e81800640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4e7c0b50a0 0x7f4e7c0704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:29.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.058+0000 7f4e81800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4e7c070a30 0x7f4e7c073cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:29.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.058+0000 7f4e81800640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e7c16d420 con 0x7f4e7c074200 2024-04-25T13:43:29.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.058+0000 7f4e81800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4e7c070e40 con 0x7f4e7c070a30 2024-04-25T13:43:29.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.058+0000 7f4e81800640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f4e7c0b6090 con 0x7f4e7c0b50a0 2024-04-25T13:43:29.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.058+0000 7f4e73e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4e7c070a30 0x7f4e7c073cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:29.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.058+0000 7f4e7b400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f4e7c074200 0x7f4e7c0cdc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58568/0 (socket says 172.21.15.123:58568) 2024-04-25T13:43:29.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.058+0000 7f4e7b400640 1 -- 172.21.15.123:0/3397099513 learned_addr learned my addr 172.21.15.123:0/3397099513 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:29.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.058+0000 7f4e7aa00640 1 --2- 172.21.15.123:0/3397099513 >> v2:172.21.15.130:3300/0 conn(0x7f4e7c0b50a0 0x7f4e7c0704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:29.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.058+0000 7f4e7a000640 1 -- 172.21.15.123:0/3397099513 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1397664541 0 0) 0x7f4e740014a0 con 0x7f4e7c074200 2024-04-25T13:43:29.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.074+0000 7f4e7a000640 1 -- 172.21.15.123:0/3397099513 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e60003510 con 0x7f4e7c074200 2024-04-25T13:43:29.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.074+0000 7f4e73e00640 1 -- 172.21.15.123:0/3397099513 >> v2:172.21.15.130:3300/0 conn(0x7f4e7c0b50a0 msgr2=0x7f4e7c0704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:29.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.074+0000 7f4e73e00640 1 --2- 172.21.15.123:0/3397099513 >> v2:172.21.15.130:3300/0 conn(0x7f4e7c0b50a0 0x7f4e7c0704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:29.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.074+0000 7f4e73e00640 1 -- 172.21.15.123:0/3397099513 >> v1:172.21.15.123:6789/0 conn(0x7f4e7c074200 legacy=0x7f4e7c0cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:29.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.074+0000 7f4e7a000640 1 -- 172.21.15.123:0/3397099513 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3364952663 0 0) 0x7f4e60003510 con 0x7f4e7c074200 2024-04-25T13:43:29.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.074+0000 7f4e73e00640 1 -- 172.21.15.123:0/3397099513 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7c0b57f0 con 0x7f4e7c070a30 2024-04-25T13:43:29.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.074+0000 7f4e7aa00640 1 --2- 172.21.15.123:0/3397099513 >> v2:172.21.15.130:3300/0 conn(0x7f4e7c0b50a0 0x7f4e7c0704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:29.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.078+0000 7f4e73e00640 1 --2- 172.21.15.123:0/3397099513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e7c070a30 0x7f4e7c073cc0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c0cf230 tx=0x7f4e6401c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0aee50131d27b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:29.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.078+0000 7f4e7a000640 1 -- 172.21.15.123:0/3397099513 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e640ac070 con 0x7f4e7c070a30 2024-04-25T13:43:29.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.078+0000 7f4e7a000640 1 -- 172.21.15.123:0/3397099513 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e640a6460 con 0x7f4e7c070a30 2024-04-25T13:43:29.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.078+0000 7f4e7a000640 1 -- 172.21.15.123:0/3397099513 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e74001bd0 con 0x7f4e7c070a30 2024-04-25T13:43:29.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.078+0000 7f4e81800640 1 -- 172.21.15.123:0/3397099513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e7c070a30 msgr2=0x7f4e7c073cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:29.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.078+0000 7f4e81800640 1 --2- 172.21.15.123:0/3397099513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e7c070a30 0x7f4e7c073cc0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c0cf230 tx=0x7f4e6401c610 comp rx=0 tx=0).stop 2024-04-25T13:43:29.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.078+0000 7f4e81800640 1 -- 172.21.15.123:0/3397099513 shutdown_connections 2024-04-25T13:43:29.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.078+0000 7f4e81800640 1 --2- 172.21.15.123:0/3397099513 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e7c070a30 0x7f4e7c073cc0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:29.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.078+0000 7f4e81800640 1 --2- 172.21.15.123:0/3397099513 >> v2:172.21.15.130:3300/0 conn(0x7f4e7c0b50a0 0x7f4e7c0704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:29.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.078+0000 7f4e81800640 1 -- 172.21.15.123:0/3397099513 >> 172.21.15.123:0/3397099513 conn(0x7f4e7c06eec0 msgr2=0x7f4e7c06f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:29.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.078+0000 7f4e81800640 1 -- 172.21.15.123:0/3397099513 shutdown_connections 2024-04-25T13:43:29.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.078+0000 7f4e81800640 1 -- 172.21.15.123:0/3397099513 wait complete. 2024-04-25T13:43:29.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.082+0000 7f4e81800640 1 Processor -- start 2024-04-25T13:43:29.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.082+0000 7f4e81800640 1 -- start start 2024-04-25T13:43:29.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.082+0000 7f4e81800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e7c070a30 0x7f4e7c15e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:29.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.082+0000 7f4e81800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e7c074200 0x7f4e7c15edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:29.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.082+0000 7f4e81800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e7c0b50a0 0x7f4e7c163840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:29.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.082+0000 7f4e81800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7c074a20 con 0x7f4e7c074200 2024-04-25T13:43:29.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.082+0000 7f4e81800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7c0b54b0 con 0x7f4e7c0b50a0 2024-04-25T13:43:29.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.082+0000 7f4e81800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4e7c16cd80 con 0x7f4e7c070a30 2024-04-25T13:43:29.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.082+0000 7f4e73e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e7c074200 0x7f4e7c15edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:29.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.082+0000 7f4e73e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e7c074200 0x7f4e7c15edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41120/0 (socket says 172.21.15.123:41120) 2024-04-25T13:43:29.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.082+0000 7f4e73e00640 1 -- 172.21.15.123:0/1340387336 learned_addr learned my addr 172.21.15.123:0/1340387336 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:29.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.082+0000 7f4e7b400640 1 --2- 172.21.15.123:0/1340387336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e7c0b50a0 0x7f4e7c163840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:29.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.082+0000 7f4e7aa00640 1 --2- 172.21.15.123:0/1340387336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e7c070a30 0x7f4e7c15e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:29.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.082+0000 7f4e73e00640 1 -- 172.21.15.123:0/1340387336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e7c070a30 msgr2=0x7f4e7c15e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:29.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.082+0000 7f4e73e00640 1 --2- 172.21.15.123:0/1340387336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e7c070a30 0x7f4e7c15e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:29.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.082+0000 7f4e73e00640 1 -- 172.21.15.123:0/1340387336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e7c0b50a0 msgr2=0x7f4e7c163840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:29.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.082+0000 7f4e73e00640 1 --2- 172.21.15.123:0/1340387336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e7c0b50a0 0x7f4e7c163840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:29.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.082+0000 7f4e73e00640 1 -- 172.21.15.123:0/1340387336 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7c0cca90 con 0x7f4e7c074200 2024-04-25T13:43:29.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.082+0000 7f4e7aa00640 1 --2- 172.21.15.123:0/1340387336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e7c070a30 0x7f4e7c15e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:29.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.082+0000 7f4e73e00640 1 --2- 172.21.15.123:0/1340387336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e7c074200 0x7f4e7c15edc0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4e6401acc0 tx=0x7f4e640193b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:29.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.082+0000 7f4e72a00640 1 -- 172.21.15.123:0/1340387336 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e640ac040 con 0x7f4e7c074200 2024-04-25T13:43:29.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.082+0000 7f4e72a00640 1 -- 172.21.15.123:0/1340387336 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e640a6e50 con 0x7f4e7c074200 2024-04-25T13:43:29.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.082+0000 7f4e72a00640 1 -- 172.21.15.123:0/1340387336 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6400b040 con 0x7f4e7c074200 2024-04-25T13:43:29.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.082+0000 7f4e81800640 1 -- 172.21.15.123:0/1340387336 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e7c0ccd70 con 0x7f4e7c074200 2024-04-25T13:43:29.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.082+0000 7f4e81800640 1 -- 172.21.15.123:0/1340387336 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e7c0cfaa0 con 0x7f4e7c074200 2024-04-25T13:43:29.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.086+0000 7f4e81800640 1 -- 172.21.15.123:0/1340387336 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e7c050750 con 0x7f4e7c074200 2024-04-25T13:43:29.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.086+0000 7f4e72a00640 1 -- 172.21.15.123:0/1340387336 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4e640af070 con 0x7f4e7c074200 2024-04-25T13:43:29.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.086+0000 7f4e72a00640 1 --2- 172.21.15.123:0/1340387336 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4e5806f430 0x7f4e58071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:29.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.086+0000 7f4e72a00640 1 -- 172.21.15.123:0/1340387336 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f4e64128d50 con 0x7f4e7c074200 2024-04-25T13:43:29.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.086+0000 7f4e7aa00640 1 --2- 172.21.15.123:0/1340387336 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4e5806f430 0x7f4e58071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:29.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.086+0000 7f4e7aa00640 1 --2- 172.21.15.123:0/1340387336 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4e5806f430 0x7f4e58071940 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c005e40 tx=0x7f4e6c00e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:29.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.090+0000 7f4e72a00640 1 -- 172.21.15.123:0/1340387336 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4e640c0030 con 0x7f4e7c074200 2024-04-25T13:43:29.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.282+0000 7f4e81800640 1 -- 172.21.15.123:0/1340387336 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4e7c169140 con 0x7f4e7c074200 2024-04-25T13:43:29.288 INFO:tasks.ceph.mon.a.smithi123.stderr:2024-04-25T13:43:29.282+0000 7f6025000640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T13:43:29.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.286+0000 7f4e72a00640 1 -- 172.21.15.123:0/1340387336 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) ==== 161+0+0 (secure 0 0 0) 0x7f4e64016230 con 0x7f4e7c074200 2024-04-25T13:43:29.292 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T13:43:29.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.290+0000 7f4e81800640 1 -- 172.21.15.123:0/1340387336 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4e5806f430 msgr2=0x7f4e58071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:29.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.290+0000 7f4e81800640 1 --2- 172.21.15.123:0/1340387336 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4e5806f430 0x7f4e58071940 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c005e40 tx=0x7f4e6c00e040 comp rx=0 tx=0).stop 2024-04-25T13:43:29.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.290+0000 7f4e81800640 1 -- 172.21.15.123:0/1340387336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e7c074200 msgr2=0x7f4e7c15edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:29.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.290+0000 7f4e81800640 1 --2- 172.21.15.123:0/1340387336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e7c074200 0x7f4e7c15edc0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f4e6401acc0 tx=0x7f4e640193b0 comp rx=0 tx=0).stop 2024-04-25T13:43:29.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.290+0000 7f4e81800640 1 -- 172.21.15.123:0/1340387336 shutdown_connections 2024-04-25T13:43:29.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.290+0000 7f4e81800640 1 --2- 172.21.15.123:0/1340387336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e7c0b50a0 0x7f4e7c163840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:29.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.290+0000 7f4e81800640 1 --2- 172.21.15.123:0/1340387336 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4e5806f430 0x7f4e58071940 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:29.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.290+0000 7f4e81800640 1 --2- 172.21.15.123:0/1340387336 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4e7c074200 0x7f4e7c15edc0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:29.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.290+0000 7f4e81800640 1 --2- 172.21.15.123:0/1340387336 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e7c070a30 0x7f4e7c15e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:29.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.290+0000 7f4e81800640 1 -- 172.21.15.123:0/1340387336 >> 172.21.15.123:0/1340387336 conn(0x7f4e7c06eec0 msgr2=0x7f4e7c168470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:29.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.290+0000 7f4e81800640 1 -- 172.21.15.123:0/1340387336 shutdown_connections 2024-04-25T13:43:29.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.290+0000 7f4e81800640 1 -- 172.21.15.123:0/1340387336 wait complete. 2024-04-25T13:43:29.306 INFO:tasks.ceph.mds.c.smithi123.stderr: -6630> 2024-04-25T13:43:04.995+0000 7f4422400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T13:43:29.318 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T13:43:29.426 INFO:tasks.ceph.mds.c.smithi123.stdout:starting mds.c at 2024-04-25T13:43:29.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.466+0000 7fd595a00640 1 Processor -- start 2024-04-25T13:43:29.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.466+0000 7fd595a00640 1 -- start start 2024-04-25T13:43:29.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.470+0000 7fd595a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd5900b3870 0x7fd5900b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:29.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.470+0000 7fd595a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd59015de80 0x7fd59015e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:29.473 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.470+0000 7fd595a00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5900b41c0 con 0x7fd5900ceac0 2024-04-25T13:43:29.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.470+0000 7fd595a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fd5900c7140 con 0x7fd5900b3870 2024-04-25T13:43:29.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.470+0000 7fd595a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fd5900cf060 con 0x7fd59015de80 2024-04-25T13:43:29.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.470+0000 7fd586000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd5900b3870 0x7fd5900b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:29.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.470+0000 7fd586000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fd5900b3870 0x7fd5900b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41150/0 (socket says 172.21.15.123:41150) 2024-04-25T13:43:29.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.470+0000 7fd586000640 1 -- 172.21.15.123:0/3877503940 learned_addr learned my addr 172.21.15.123:0/3877503940 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:29.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.470+0000 7fd58f400640 1 --2- 172.21.15.123:0/3877503940 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd59015de80 0x7fd59015e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:29.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.470+0000 7fd586000640 1 -- 172.21.15.123:0/3877503940 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd59015de80 msgr2=0x7fd59015e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:29.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.470+0000 7fd586000640 1 --2- 172.21.15.123:0/3877503940 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd59015de80 0x7fd59015e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:29.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.470+0000 7fd586000640 1 -- 172.21.15.123:0/3877503940 >> v1:172.21.15.130:6789/0 conn(0x7fd5900ceac0 legacy=0x7fd5900c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:29.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.470+0000 7fd586000640 1 -- 172.21.15.123:0/3877503940 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5900c6810 con 0x7fd5900b3870 2024-04-25T13:43:29.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.470+0000 7fd58e000640 1 -- 172.21.15.123:0/3877503940 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4107005274 0 0) 0x7fd580001120 con 0x7fd5900ceac0 2024-04-25T13:43:29.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.470+0000 7fd586000640 1 --2- 172.21.15.123:0/3877503940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5900b3870 0x7fd5900b3c80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd578009e50 tx=0x7fd57801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a31e51dbaaa9b075 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:29.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.470+0000 7fd58e000640 1 -- 172.21.15.123:0/3877503940 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5780a5830 con 0x7fd5900b3870 2024-04-25T13:43:29.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.474+0000 7fd58e000640 1 -- 172.21.15.123:0/3877503940 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5780a59d0 con 0x7fd5900b3870 2024-04-25T13:43:29.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.474+0000 7fd58e000640 1 -- 172.21.15.123:0/3877503940 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5780a5da0 con 0x7fd5900b3870 2024-04-25T13:43:29.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.474+0000 7fd595a00640 1 -- 172.21.15.123:0/3877503940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5900b3870 msgr2=0x7fd5900b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:29.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.474+0000 7fd595a00640 1 --2- 172.21.15.123:0/3877503940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5900b3870 0x7fd5900b3c80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd578009e50 tx=0x7fd57801c970 comp rx=0 tx=0).stop 2024-04-25T13:43:29.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.474+0000 7fd595a00640 1 -- 172.21.15.123:0/3877503940 shutdown_connections 2024-04-25T13:43:29.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.474+0000 7fd595a00640 1 --2- 172.21.15.123:0/3877503940 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd59015de80 0x7fd59015e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:29.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.474+0000 7fd595a00640 1 --2- 172.21.15.123:0/3877503940 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5900b3870 0x7fd5900b3c80 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:29.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.474+0000 7fd595a00640 1 -- 172.21.15.123:0/3877503940 >> 172.21.15.123:0/3877503940 conn(0x7fd59006ca70 msgr2=0x7fd59006ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:29.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.474+0000 7fd595a00640 1 -- 172.21.15.123:0/3877503940 shutdown_connections 2024-04-25T13:43:29.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.474+0000 7fd595a00640 1 -- 172.21.15.123:0/3877503940 wait complete. 2024-04-25T13:43:29.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.474+0000 7fd595a00640 1 Processor -- start 2024-04-25T13:43:29.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.474+0000 7fd595a00640 1 -- start start 2024-04-25T13:43:29.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.478+0000 7fd595a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5900b3870 0x7fd5900cde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:29.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.478+0000 7fd595a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5900ceac0 0x7fd590154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:29.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.478+0000 7fd595a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd59015de80 0x7fd5901547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:29.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.478+0000 7fd595a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd59016aae0 con 0x7fd5900b3870 2024-04-25T13:43:29.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.478+0000 7fd595a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd59016a960 con 0x7fd59015de80 2024-04-25T13:43:29.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.478+0000 7fd595a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fd59016ac60 con 0x7fd5900ceac0 2024-04-25T13:43:29.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.478+0000 7fd58ea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5900b3870 0x7fd5900cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:29.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.478+0000 7fd58ea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5900b3870 0x7fd5900cde10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41152/0 (socket says 172.21.15.123:41152) 2024-04-25T13:43:29.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.478+0000 7fd58ea00640 1 -- 172.21.15.123:0/3402800032 learned_addr learned my addr 172.21.15.123:0/3402800032 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:29.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.478+0000 7fd586000640 1 --2- 172.21.15.123:0/3402800032 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5900ceac0 0x7fd590154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:29.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.478+0000 7fd58f400640 1 --2- 172.21.15.123:0/3402800032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd59015de80 0x7fd5901547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:29.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.478+0000 7fd58ea00640 1 -- 172.21.15.123:0/3402800032 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5900ceac0 msgr2=0x7fd590154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:29.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.478+0000 7fd58ea00640 1 --2- 172.21.15.123:0/3402800032 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5900ceac0 0x7fd590154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:29.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.478+0000 7fd58ea00640 1 -- 172.21.15.123:0/3402800032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd59015de80 msgr2=0x7fd5901547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:29.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.478+0000 7fd58ea00640 1 --2- 172.21.15.123:0/3402800032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd59015de80 0x7fd5901547d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:29.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.478+0000 7fd58ea00640 1 -- 172.21.15.123:0/3402800032 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd590153510 con 0x7fd5900b3870 2024-04-25T13:43:29.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.478+0000 7fd58ea00640 1 --2- 172.21.15.123:0/3402800032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5900b3870 0x7fd5900cde10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd580001ec0 tx=0x7fd58000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:29.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.478+0000 7fd587400640 1 -- 172.21.15.123:0/3402800032 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd580017070 con 0x7fd5900b3870 2024-04-25T13:43:29.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.478+0000 7fd587400640 1 -- 172.21.15.123:0/3402800032 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd580003600 con 0x7fd5900b3870 2024-04-25T13:43:29.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.478+0000 7fd587400640 1 -- 172.21.15.123:0/3402800032 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5800039f0 con 0x7fd5900b3870 2024-04-25T13:43:29.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.478+0000 7fd595a00640 1 -- 172.21.15.123:0/3402800032 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5900ce350 con 0x7fd5900b3870 2024-04-25T13:43:29.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.478+0000 7fd595a00640 1 -- 172.21.15.123:0/3402800032 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd590153a90 con 0x7fd5900b3870 2024-04-25T13:43:29.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.478+0000 7fd595a00640 1 -- 172.21.15.123:0/3402800032 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd59006d600 con 0x7fd5900b3870 2024-04-25T13:43:29.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.482+0000 7fd587400640 1 -- 172.21.15.123:0/3402800032 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd58001a070 con 0x7fd5900b3870 2024-04-25T13:43:29.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.482+0000 7fd587400640 1 --2- 172.21.15.123:0/3402800032 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd56c06f400 0x7fd56c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:29.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.482+0000 7fd587400640 1 -- 172.21.15.123:0/3402800032 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7fd58008e720 con 0x7fd5900b3870 2024-04-25T13:43:29.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.482+0000 7fd586000640 1 --2- 172.21.15.123:0/3402800032 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd56c06f400 0x7fd56c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:29.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.482+0000 7fd586000640 1 --2- 172.21.15.123:0/3402800032 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd56c06f400 0x7fd56c071910 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd5780ae000 tx=0x7fd5780a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:29.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.486+0000 7fd587400640 1 -- 172.21.15.123:0/3402800032 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd5900b41c0 con 0x7fd5900b3870 2024-04-25T13:43:29.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:29.678+0000 7fd595a00640 1 -- 172.21.15.123:0/3402800032 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd590050750 con 0x7fd5900b3870 2024-04-25T13:43:30.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.294+0000 7fd587400640 1 -- 172.21.15.123:0/3402800032 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7fd58005aec0 con 0x7fd5900b3870 2024-04-25T13:43:30.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.294+0000 7fd595a00640 1 -- 172.21.15.123:0/3402800032 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd56c06f400 msgr2=0x7fd56c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:30.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.294+0000 7fd595a00640 1 --2- 172.21.15.123:0/3402800032 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd56c06f400 0x7fd56c071910 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd5780ae000 tx=0x7fd5780a7070 comp rx=0 tx=0).stop 2024-04-25T13:43:30.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.294+0000 7fd595a00640 1 -- 172.21.15.123:0/3402800032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5900b3870 msgr2=0x7fd5900cde10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:30.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.294+0000 7fd595a00640 1 --2- 172.21.15.123:0/3402800032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5900b3870 0x7fd5900cde10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd580001ec0 tx=0x7fd58000c8e0 comp rx=0 tx=0).stop 2024-04-25T13:43:30.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.294+0000 7fd595a00640 1 -- 172.21.15.123:0/3402800032 shutdown_connections 2024-04-25T13:43:30.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.294+0000 7fd595a00640 1 --2- 172.21.15.123:0/3402800032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd59015de80 0x7fd5901547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:30.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.294+0000 7fd595a00640 1 --2- 172.21.15.123:0/3402800032 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd56c06f400 0x7fd56c071910 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:30.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.294+0000 7fd595a00640 1 --2- 172.21.15.123:0/3402800032 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5900ceac0 0x7fd590154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:30.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.294+0000 7fd595a00640 1 --2- 172.21.15.123:0/3402800032 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd5900b3870 0x7fd5900cde10 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:30.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.294+0000 7fd595a00640 1 -- 172.21.15.123:0/3402800032 >> 172.21.15.123:0/3402800032 conn(0x7fd59006ca70 msgr2=0x7fd5900d00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:30.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.294+0000 7fd595a00640 1 -- 172.21.15.123:0/3402800032 shutdown_connections 2024-04-25T13:43:30.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.294+0000 7fd595a00640 1 -- 172.21.15.123:0/3402800032 wait complete. 2024-04-25T13:43:30.321 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T13:43:30.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.466+0000 7f9a89800640 1 Processor -- start 2024-04-25T13:43:30.472 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.466+0000 7f9a89800640 1 -- start start 2024-04-25T13:43:30.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.470+0000 7f9a89800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a8415cc10 0x7f9a840b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:30.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.470+0000 7f9a89800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9a840b4b70 0x7f9a840b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:30.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.470+0000 7f9a89800640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9a84160790 0x7f9a84160ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:30.475 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.470+0000 7f9a89800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f9a840b6310 con 0x7f9a840b4b70 2024-04-25T13:43:30.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.470+0000 7f9a89800640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f9a840d0d90 con 0x7f9a84160790 2024-04-25T13:43:30.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.470+0000 7f9a89800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9a840b54c0 con 0x7f9a8415cc10 2024-04-25T13:43:30.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.470+0000 7f9a7a000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9a840b4b70 0x7f9a840b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:30.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.470+0000 7f9a7a000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f9a840b4b70 0x7f9a840b4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43748/0 (socket says 172.21.15.123:43748) 2024-04-25T13:43:30.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.470+0000 7f9a7a000640 1 -- 172.21.15.123:0/444739856 learned_addr learned my addr 172.21.15.123:0/444739856 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:30.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.470+0000 7f9a82a00640 1 --2- 172.21.15.123:0/444739856 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a8415cc10 0x7f9a840b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:30.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.470+0000 7f9a7a000640 1 -- 172.21.15.123:0/444739856 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a8415cc10 msgr2=0x7f9a840b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:30.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.470+0000 7f9a83400640 1 --2- 172.21.15.123:0/444739856 >> v2:172.21.15.130:3300/0 conn(0x7f9a84160790 0x7f9a84160ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:30.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.470+0000 7f9a7a000640 1 --2- 172.21.15.123:0/444739856 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a8415cc10 0x7f9a840b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:30.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.470+0000 7f9a7a000640 1 -- 172.21.15.123:0/444739856 >> v2:172.21.15.130:3300/0 conn(0x7f9a84160790 msgr2=0x7f9a84160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:30.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.470+0000 7f9a7a000640 1 --2- 172.21.15.123:0/444739856 >> v2:172.21.15.130:3300/0 conn(0x7f9a84160790 0x7f9a84160ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:30.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.470+0000 7f9a7a000640 1 -- 172.21.15.123:0/444739856 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a8415d020 con 0x7f9a840b4b70 2024-04-25T13:43:30.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.470+0000 7f9a82a00640 1 --2- 172.21.15.123:0/444739856 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a8415cc10 0x7f9a840b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:30.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.470+0000 7f9a83400640 1 --2- 172.21.15.123:0/444739856 >> v2:172.21.15.130:3300/0 conn(0x7f9a84160790 0x7f9a84160ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:30.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.474+0000 7f9a7a000640 1 --2- 172.21.15.123:0/444739856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a840b4b70 0x7f9a840b4f80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9a840d2610 tx=0x7f9a6c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14823e8f13a99906 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:30.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.474+0000 7f9a82000640 1 -- 172.21.15.123:0/444739856 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c0aa610 con 0x7f9a840b4b70 2024-04-25T13:43:30.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.474+0000 7f9a82000640 1 -- 172.21.15.123:0/444739856 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a6c0af070 con 0x7f9a840b4b70 2024-04-25T13:43:30.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.474+0000 7f9a82000640 1 -- 172.21.15.123:0/444739856 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c0aa9d0 con 0x7f9a840b4b70 2024-04-25T13:43:30.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.474+0000 7f9a89800640 1 -- 172.21.15.123:0/444739856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a840b4b70 msgr2=0x7f9a840b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:30.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.474+0000 7f9a89800640 1 --2- 172.21.15.123:0/444739856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a840b4b70 0x7f9a840b4f80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9a840d2610 tx=0x7f9a6c01c4f0 comp rx=0 tx=0).stop 2024-04-25T13:43:30.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.474+0000 7f9a89800640 1 -- 172.21.15.123:0/444739856 shutdown_connections 2024-04-25T13:43:30.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.474+0000 7f9a89800640 1 --2- 172.21.15.123:0/444739856 >> v2:172.21.15.130:3300/0 conn(0x7f9a84160790 0x7f9a84160ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:30.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.474+0000 7f9a89800640 1 --2- 172.21.15.123:0/444739856 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a840b4b70 0x7f9a840b4f80 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:30.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.474+0000 7f9a89800640 1 --2- 172.21.15.123:0/444739856 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a8415cc10 0x7f9a840b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:30.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.474+0000 7f9a89800640 1 -- 172.21.15.123:0/444739856 >> 172.21.15.123:0/444739856 conn(0x7f9a840b38a0 msgr2=0x7f9a840d15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:30.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.474+0000 7f9a89800640 1 -- 172.21.15.123:0/444739856 shutdown_connections 2024-04-25T13:43:30.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.474+0000 7f9a89800640 1 -- 172.21.15.123:0/444739856 wait complete. 2024-04-25T13:43:30.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.474+0000 7f9a89800640 1 Processor -- start 2024-04-25T13:43:30.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.474+0000 7f9a89800640 1 -- start start 2024-04-25T13:43:30.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.478+0000 7f9a89800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a840b4b70 0x7f9a84157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:30.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.478+0000 7f9a89800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a8415cc10 0x7f9a8415d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:30.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.478+0000 7f9a89800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a84160790 0x7f9a841535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:30.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.478+0000 7f9a89800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9a840b5950 con 0x7f9a84160790 2024-04-25T13:43:30.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.478+0000 7f9a89800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9a840d0a20 con 0x7f9a8415cc10 2024-04-25T13:43:30.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.478+0000 7f9a89800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9a841614f0 con 0x7f9a840b4b70 2024-04-25T13:43:30.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.478+0000 7f9a83400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a84160790 0x7f9a841535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:30.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.478+0000 7f9a83400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a84160790 0x7f9a841535f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43758/0 (socket says 172.21.15.123:43758) 2024-04-25T13:43:30.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.478+0000 7f9a83400640 1 -- 172.21.15.123:0/2687795971 learned_addr learned my addr 172.21.15.123:0/2687795971 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:30.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.478+0000 7f9a82a00640 1 --2- 172.21.15.123:0/2687795971 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a840b4b70 0x7f9a84157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:30.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.478+0000 7f9a7a000640 1 --2- 172.21.15.123:0/2687795971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a8415cc10 0x7f9a8415d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:30.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.478+0000 7f9a83400640 1 -- 172.21.15.123:0/2687795971 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a840b4b70 msgr2=0x7f9a84157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:30.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.478+0000 7f9a83400640 1 --2- 172.21.15.123:0/2687795971 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a840b4b70 0x7f9a84157d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:30.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.478+0000 7f9a83400640 1 -- 172.21.15.123:0/2687795971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a8415cc10 msgr2=0x7f9a8415d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:30.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.478+0000 7f9a83400640 1 --2- 172.21.15.123:0/2687795971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a8415cc10 0x7f9a8415d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:30.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.478+0000 7f9a83400640 1 -- 172.21.15.123:0/2687795971 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a8415e060 con 0x7f9a84160790 2024-04-25T13:43:30.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.478+0000 7f9a7a000640 1 --2- 172.21.15.123:0/2687795971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a8415cc10 0x7f9a8415d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:30.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.478+0000 7f9a83400640 1 --2- 172.21.15.123:0/2687795971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a84160790 0x7f9a841535f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c00c820 tx=0x7f9a7c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:30.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.478+0000 7f9a7b400640 1 -- 172.21.15.123:0/2687795971 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c015020 con 0x7f9a84160790 2024-04-25T13:43:30.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.478+0000 7f9a7b400640 1 -- 172.21.15.123:0/2687795971 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a7c004240 con 0x7f9a84160790 2024-04-25T13:43:30.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.478+0000 7f9a7b400640 1 -- 172.21.15.123:0/2687795971 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c003620 con 0x7f9a84160790 2024-04-25T13:43:30.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.478+0000 7f9a89800640 1 -- 172.21.15.123:0/2687795971 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a8415e340 con 0x7f9a84160790 2024-04-25T13:43:30.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.478+0000 7f9a89800640 1 -- 172.21.15.123:0/2687795971 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a8414f150 con 0x7f9a84160790 2024-04-25T13:43:30.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.478+0000 7f9a89800640 1 -- 172.21.15.123:0/2687795971 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a8415ddd0 con 0x7f9a84160790 2024-04-25T13:43:30.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.482+0000 7f9a7b400640 1 -- 172.21.15.123:0/2687795971 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9a7c018020 con 0x7f9a84160790 2024-04-25T13:43:30.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.482+0000 7f9a7b400640 1 --2- 172.21.15.123:0/2687795971 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9a6006f400 0x7f9a60071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:30.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.482+0000 7f9a7b400640 1 -- 172.21.15.123:0/2687795971 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f9a7c08f490 con 0x7f9a84160790 2024-04-25T13:43:30.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.482+0000 7f9a82a00640 1 --2- 172.21.15.123:0/2687795971 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9a6006f400 0x7f9a60071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:30.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.482+0000 7f9a82a00640 1 --2- 172.21.15.123:0/2687795971 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9a6006f400 0x7f9a60071910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9a74007fc0 tx=0x7f9a74007550 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:30.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.486+0000 7f9a7b400640 1 -- 172.21.15.123:0/2687795971 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9a7c01f020 con 0x7f9a84160790 2024-04-25T13:43:30.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:30.646+0000 7f9a89800640 1 -- 172.21.15.123:0/2687795971 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9a8406a210 con 0x7f9a84160790 2024-04-25T13:43:31.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.294+0000 7f9a7b400640 1 -- 172.21.15.123:0/2687795971 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) ==== 181+0+0 (secure 0 0 0) 0x7f9a7c05c280 con 0x7f9a84160790 2024-04-25T13:43:31.300 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2024-04-25T13:43:31.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.298+0000 7f9a89800640 1 -- 172.21.15.123:0/2687795971 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9a6006f400 msgr2=0x7f9a60071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:31.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.298+0000 7f9a89800640 1 --2- 172.21.15.123:0/2687795971 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9a6006f400 0x7f9a60071910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9a74007fc0 tx=0x7f9a74007550 comp rx=0 tx=0).stop 2024-04-25T13:43:31.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.298+0000 7f9a89800640 1 -- 172.21.15.123:0/2687795971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a84160790 msgr2=0x7f9a841535f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:31.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.298+0000 7f9a89800640 1 --2- 172.21.15.123:0/2687795971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a84160790 0x7f9a841535f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c00c820 tx=0x7f9a7c00cce0 comp rx=0 tx=0).stop 2024-04-25T13:43:31.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.298+0000 7f9a89800640 1 -- 172.21.15.123:0/2687795971 shutdown_connections 2024-04-25T13:43:31.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.298+0000 7f9a89800640 1 --2- 172.21.15.123:0/2687795971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a8415cc10 0x7f9a8415d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:31.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.298+0000 7f9a89800640 1 --2- 172.21.15.123:0/2687795971 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9a6006f400 0x7f9a60071910 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:31.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.298+0000 7f9a89800640 1 --2- 172.21.15.123:0/2687795971 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9a84160790 0x7f9a841535f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:31.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.298+0000 7f9a89800640 1 --2- 172.21.15.123:0/2687795971 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a840b4b70 0x7f9a84157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:31.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.298+0000 7f9a89800640 1 -- 172.21.15.123:0/2687795971 >> 172.21.15.123:0/2687795971 conn(0x7f9a840b38a0 msgr2=0x7f9a84156100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:31.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.298+0000 7f9a89800640 1 -- 172.21.15.123:0/2687795971 shutdown_connections 2024-04-25T13:43:31.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.298+0000 7f9a89800640 1 -- 172.21.15.123:0/2687795971 wait complete. 2024-04-25T13:43:31.326 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T13:43:31.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.470+0000 7f3c13200640 1 Processor -- start 2024-04-25T13:43:31.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.474+0000 7f3c13200640 1 -- start start 2024-04-25T13:43:31.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.474+0000 7f3c13200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3c0c0b5280 0x7f3c0c0b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:31.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.474+0000 7f3c13200640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c0c15d020 con 0x7f3c0c06ebe0 2024-04-25T13:43:31.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.474+0000 7f3c13200640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c0c0b6990 con 0x7f3c0c15cc10 2024-04-25T13:43:31.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.474+0000 7f3c13200640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f3c0c0b6310 con 0x7f3c0c0b5280 2024-04-25T13:43:31.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.474+0000 7f3c0b400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f3c0c0b5280 0x7f3c0c0b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:31.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.474+0000 7f3c11200640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f3c0c06ebe0 0x7f3c0c06eff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58206/0 (socket says 172.21.15.123:58206) 2024-04-25T13:43:31.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.474+0000 7f3c11200640 1 -- 172.21.15.123:0/3780977814 learned_addr learned my addr 172.21.15.123:0/3780977814 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:31.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.474+0000 7f3c0b400640 1 -- 172.21.15.123:0/3780977814 >> v1:172.21.15.130:6789/0 conn(0x7f3c0c15cc10 legacy=0x7f3c0c0b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:31.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.474+0000 7f3c0b400640 1 -- 172.21.15.123:0/3780977814 >> v1:172.21.15.123:6789/0 conn(0x7f3c0c06ebe0 legacy=0x7f3c0c06eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:31.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.474+0000 7f3c0b400640 1 -- 172.21.15.123:0/3780977814 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0c0d0460 con 0x7f3c0c0b5280 2024-04-25T13:43:31.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.474+0000 7f3c0aa00640 1 -- 172.21.15.123:0/3780977814 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2831056565 0 0) 0x7f3c0c15d020 con 0x7f3c0c06ebe0 2024-04-25T13:43:31.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.478+0000 7f3c0b400640 1 --2- 172.21.15.123:0/3780977814 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c0c0b5280 0x7f3c0c0b5dd0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80097c0 tx=0x7f3bf801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e410ad607594631 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:31.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.478+0000 7f3c0aa00640 1 -- 172.21.15.123:0/3780977814 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf80b0070 con 0x7f3c0c0b5280 2024-04-25T13:43:31.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.478+0000 7f3c0aa00640 1 -- 172.21.15.123:0/3780977814 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf80ab600 con 0x7f3c0c0b5280 2024-04-25T13:43:31.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.478+0000 7f3c0aa00640 1 -- 172.21.15.123:0/3780977814 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf80ab9d0 con 0x7f3c0c0b5280 2024-04-25T13:43:31.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.478+0000 7f3c13200640 1 -- 172.21.15.123:0/3780977814 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c0c0b5280 msgr2=0x7f3c0c0b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:31.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.478+0000 7f3c13200640 1 --2- 172.21.15.123:0/3780977814 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c0c0b5280 0x7f3c0c0b5dd0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80097c0 tx=0x7f3bf801c3d0 comp rx=0 tx=0).stop 2024-04-25T13:43:31.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.478+0000 7f3c13200640 1 -- 172.21.15.123:0/3780977814 shutdown_connections 2024-04-25T13:43:31.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.478+0000 7f3c13200640 1 --2- 172.21.15.123:0/3780977814 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c0c0b5280 0x7f3c0c0b5dd0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:31.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.478+0000 7f3c13200640 1 -- 172.21.15.123:0/3780977814 >> 172.21.15.123:0/3780977814 conn(0x7f3c0c0b38a0 msgr2=0x7f3c0c0d15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:31.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.478+0000 7f3c13200640 1 -- 172.21.15.123:0/3780977814 shutdown_connections 2024-04-25T13:43:31.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.478+0000 7f3c13200640 1 -- 172.21.15.123:0/3780977814 wait complete. 2024-04-25T13:43:31.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.482+0000 7f3c13200640 1 Processor -- start 2024-04-25T13:43:31.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.482+0000 7f3c13200640 1 -- start start 2024-04-25T13:43:31.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.482+0000 7f3c13200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c0c06ebe0 0x7f3c0c151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:31.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.482+0000 7f3c13200640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c0c15cc10 0x7f3c0c13ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:31.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.482+0000 7f3c13200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c0c152fc0 0x7f3c0c14b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:31.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.482+0000 7f3c13200640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0c0d1220 con 0x7f3c0c06ebe0 2024-04-25T13:43:31.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.482+0000 7f3c13200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0c06fb10 con 0x7f3c0c152fc0 2024-04-25T13:43:31.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.482+0000 7f3c13200640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3c0c13d3c0 con 0x7f3c0c15cc10 2024-04-25T13:43:31.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.482+0000 7f3c0be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c0c06ebe0 0x7f3c0c151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:31.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.482+0000 7f3c0be00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c0c06ebe0 0x7f3c0c151860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43782/0 (socket says 172.21.15.123:43782) 2024-04-25T13:43:31.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.482+0000 7f3c0be00640 1 -- 172.21.15.123:0/2727427206 learned_addr learned my addr 172.21.15.123:0/2727427206 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:31.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.482+0000 7f3c11200640 1 --2- 172.21.15.123:0/2727427206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c0c152fc0 0x7f3c0c14b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:31.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.482+0000 7f3c0b400640 1 --2- 172.21.15.123:0/2727427206 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c0c15cc10 0x7f3c0c13ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:31.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.482+0000 7f3c0be00640 1 -- 172.21.15.123:0/2727427206 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c0c15cc10 msgr2=0x7f3c0c13ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:31.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.482+0000 7f3c0be00640 1 --2- 172.21.15.123:0/2727427206 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c0c15cc10 0x7f3c0c13ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:31.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.482+0000 7f3c0be00640 1 -- 172.21.15.123:0/2727427206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c0c152fc0 msgr2=0x7f3c0c14b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:31.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.482+0000 7f3c0be00640 1 --2- 172.21.15.123:0/2727427206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c0c152fc0 0x7f3c0c14b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:31.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.482+0000 7f3c0be00640 1 -- 172.21.15.123:0/2727427206 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0c14a120 con 0x7f3c0c06ebe0 2024-04-25T13:43:31.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.482+0000 7f3c11200640 1 --2- 172.21.15.123:0/2727427206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c0c152fc0 0x7f3c0c14b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:31.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.482+0000 7f3c0be00640 1 --2- 172.21.15.123:0/2727427206 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c0c06ebe0 0x7f3c0c151860 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc00b3e0 tx=0x7f3bfc00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:31.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.482+0000 7f3c03e00640 1 -- 172.21.15.123:0/2727427206 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc015020 con 0x7f3c0c06ebe0 2024-04-25T13:43:31.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.482+0000 7f3c03e00640 1 -- 172.21.15.123:0/2727427206 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bfc011850 con 0x7f3c0c06ebe0 2024-04-25T13:43:31.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.482+0000 7f3c03e00640 1 -- 172.21.15.123:0/2727427206 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc011c40 con 0x7f3c0c06ebe0 2024-04-25T13:43:31.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.482+0000 7f3c13200640 1 -- 172.21.15.123:0/2727427206 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c0c151f20 con 0x7f3c0c06ebe0 2024-04-25T13:43:31.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.482+0000 7f3c13200640 1 -- 172.21.15.123:0/2727427206 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c0c1524e0 con 0x7f3c0c06ebe0 2024-04-25T13:43:31.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.486+0000 7f3c13200640 1 -- 172.21.15.123:0/2727427206 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c0c06a210 con 0x7f3c0c06ebe0 2024-04-25T13:43:31.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.486+0000 7f3c03e00640 1 -- 172.21.15.123:0/2727427206 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3bfc018020 con 0x7f3c0c06ebe0 2024-04-25T13:43:31.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.486+0000 7f3c03e00640 1 --2- 172.21.15.123:0/2727427206 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3bec06f400 0x7f3bec071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:31.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.486+0000 7f3c03e00640 1 -- 172.21.15.123:0/2727427206 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5357+0+0 (secure 0 0 0) 0x7f3bfc08f1a0 con 0x7f3c0c06ebe0 2024-04-25T13:43:31.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.486+0000 7f3c0b400640 1 --2- 172.21.15.123:0/2727427206 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3bec06f400 0x7f3bec071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:31.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.486+0000 7f3c0b400640 1 --2- 172.21.15.123:0/2727427206 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3bec06f400 0x7f3bec071910 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80ad000 tx=0x7f3bf8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:31.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.490+0000 7f3c03e00640 1 -- 172.21.15.123:0/2727427206 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3bfc01f020 con 0x7f3c0c06ebe0 2024-04-25T13:43:31.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:31.650+0000 7f3c13200640 1 -- 172.21.15.123:0/2727427206 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3c0c0d20f0 con 0x7f3c0c06ebe0 2024-04-25T13:43:32.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.306+0000 7f3c03e00640 1 -- 172.21.15.123:0/2727427206 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) ==== 169+0+0 (secure 0 0 0) 0x7f3c0c14a120 con 0x7f3c0c06ebe0 2024-04-25T13:43:32.308 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2024-04-25T13:43:32.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.306+0000 7f3c13200640 1 -- 172.21.15.123:0/2727427206 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3bec06f400 msgr2=0x7f3bec071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:32.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.306+0000 7f3c13200640 1 --2- 172.21.15.123:0/2727427206 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3bec06f400 0x7f3bec071910 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80ad000 tx=0x7f3bf8008040 comp rx=0 tx=0).stop 2024-04-25T13:43:32.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.306+0000 7f3c13200640 1 -- 172.21.15.123:0/2727427206 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c0c06ebe0 msgr2=0x7f3c0c151860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:32.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.306+0000 7f3c13200640 1 --2- 172.21.15.123:0/2727427206 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c0c06ebe0 0x7f3c0c151860 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc00b3e0 tx=0x7f3bfc00b8a0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.306+0000 7f3c13200640 1 -- 172.21.15.123:0/2727427206 shutdown_connections 2024-04-25T13:43:32.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.306+0000 7f3c13200640 1 --2- 172.21.15.123:0/2727427206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c0c152fc0 0x7f3c0c14b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.306+0000 7f3c13200640 1 --2- 172.21.15.123:0/2727427206 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3bec06f400 0x7f3bec071910 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.306+0000 7f3c13200640 1 --2- 172.21.15.123:0/2727427206 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c0c15cc10 0x7f3c0c13ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.306+0000 7f3c13200640 1 --2- 172.21.15.123:0/2727427206 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c0c06ebe0 0x7f3c0c151860 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.306+0000 7f3c13200640 1 -- 172.21.15.123:0/2727427206 >> 172.21.15.123:0/2727427206 conn(0x7f3c0c0b38a0 msgr2=0x7f3c0c156df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:32.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.310+0000 7f3c13200640 1 -- 172.21.15.123:0/2727427206 shutdown_connections 2024-04-25T13:43:32.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.310+0000 7f3c13200640 1 -- 172.21.15.123:0/2727427206 wait complete. 2024-04-25T13:43:32.337 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T13:43:32.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.486+0000 7f52c0a00640 1 Processor -- start 2024-04-25T13:43:32.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.486+0000 7f52c0a00640 1 -- start start 2024-04-25T13:43:32.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.486+0000 7f52c0a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f52bc0b3870 0x7f52bc0b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:32.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.486+0000 7f52c0a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52bc15de80 0x7f52bc15e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:32.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.486+0000 7f52c0a00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52bc0b41c0 con 0x7f52bc0ceac0 2024-04-25T13:43:32.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.486+0000 7f52c0a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f52bc0c7140 con 0x7f52bc0b3870 2024-04-25T13:43:32.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.486+0000 7f52c0a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f52bc0cf060 con 0x7f52bc15de80 2024-04-25T13:43:32.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.486+0000 7f52b9400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f52bc0b3870 0x7f52bc0b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:32.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.486+0000 7f52b9400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f52bc0b3870 0x7f52bc0b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43798/0 (socket says 172.21.15.123:43798) 2024-04-25T13:43:32.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.486+0000 7f52b9400640 1 -- 172.21.15.123:0/790154821 learned_addr learned my addr 172.21.15.123:0/790154821 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:32.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.486+0000 7f52ba800640 1 --2- 172.21.15.123:0/790154821 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52bc15de80 0x7f52bc15e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:32.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.486+0000 7f52b9400640 1 -- 172.21.15.123:0/790154821 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52bc15de80 msgr2=0x7f52bc15e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:32.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.486+0000 7f52b9400640 1 --2- 172.21.15.123:0/790154821 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52bc15de80 0x7f52bc15e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.486+0000 7f52b9400640 1 -- 172.21.15.123:0/790154821 >> v1:172.21.15.130:6789/0 conn(0x7f52bc0ceac0 legacy=0x7f52bc0c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:32.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.486+0000 7f52b9400640 1 -- 172.21.15.123:0/790154821 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52bc0c6810 con 0x7f52bc0b3870 2024-04-25T13:43:32.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.486+0000 7f52ba800640 1 --2- 172.21.15.123:0/790154821 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52bc15de80 0x7f52bc15e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:32.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.490+0000 7f52b9400640 1 --2- 172.21.15.123:0/790154821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52bc0b3870 0x7f52bc0b3c80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f52a8009870 tx=0x7f52a801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53bd8a6b32a06212 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:32.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.490+0000 7f52b8a00640 1 -- 172.21.15.123:0/790154821 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a80aa600 con 0x7f52bc0b3870 2024-04-25T13:43:32.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.490+0000 7f52b8a00640 1 -- 172.21.15.123:0/790154821 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52a80af070 con 0x7f52bc0b3870 2024-04-25T13:43:32.496 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.490+0000 7f52b8a00640 1 -- 172.21.15.123:0/790154821 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a80aa9c0 con 0x7f52bc0b3870 2024-04-25T13:43:32.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.490+0000 7f52c0a00640 1 -- 172.21.15.123:0/790154821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52bc0b3870 msgr2=0x7f52bc0b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:32.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.490+0000 7f52c0a00640 1 --2- 172.21.15.123:0/790154821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52bc0b3870 0x7f52bc0b3c80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f52a8009870 tx=0x7f52a801c4a0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.490+0000 7f52c0a00640 1 -- 172.21.15.123:0/790154821 shutdown_connections 2024-04-25T13:43:32.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.490+0000 7f52c0a00640 1 --2- 172.21.15.123:0/790154821 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52bc15de80 0x7f52bc15e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.490+0000 7f52c0a00640 1 --2- 172.21.15.123:0/790154821 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52bc0b3870 0x7f52bc0b3c80 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.490+0000 7f52c0a00640 1 -- 172.21.15.123:0/790154821 >> 172.21.15.123:0/790154821 conn(0x7f52bc06ca70 msgr2=0x7f52bc06ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:32.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.490+0000 7f52c0a00640 1 -- 172.21.15.123:0/790154821 shutdown_connections 2024-04-25T13:43:32.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.490+0000 7f52c0a00640 1 -- 172.21.15.123:0/790154821 wait complete. 2024-04-25T13:43:32.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.494+0000 7f52c0a00640 1 Processor -- start 2024-04-25T13:43:32.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.494+0000 7f52c0a00640 1 -- start start 2024-04-25T13:43:32.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.494+0000 7f52c0a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52bc0b3870 0x7f52bc155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:32.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.494+0000 7f52c0a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52bc0ceac0 0x7f52bc159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:32.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.494+0000 7f52c0a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52bc15de80 0x7f52bc159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:32.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.494+0000 7f52c0a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc16aae0 con 0x7f52bc0b3870 2024-04-25T13:43:32.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.494+0000 7f52c0a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f52bc16a960 con 0x7f52bc0ceac0 2024-04-25T13:43:32.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.494+0000 7f52c0a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f52bc16ac60 con 0x7f52bc15de80 2024-04-25T13:43:32.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.494+0000 7f52b9e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52bc0b3870 0x7f52bc155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:32.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.494+0000 7f52b9e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52bc0b3870 0x7f52bc155ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43808/0 (socket says 172.21.15.123:43808) 2024-04-25T13:43:32.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.494+0000 7f52b9e00640 1 -- 172.21.15.123:0/1180279757 learned_addr learned my addr 172.21.15.123:0/1180279757 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:32.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.494+0000 7f52b9400640 1 --2- 172.21.15.123:0/1180279757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52bc0ceac0 0x7f52bc159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:32.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.494+0000 7f52ba800640 1 --2- 172.21.15.123:0/1180279757 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52bc15de80 0x7f52bc159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:32.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.498+0000 7f52b9e00640 1 -- 172.21.15.123:0/1180279757 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52bc15de80 msgr2=0x7f52bc159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:32.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.498+0000 7f52b9e00640 1 --2- 172.21.15.123:0/1180279757 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52bc15de80 0x7f52bc159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.498+0000 7f52b9e00640 1 -- 172.21.15.123:0/1180279757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52bc0ceac0 msgr2=0x7f52bc159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:32.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.498+0000 7f52b9e00640 1 --2- 172.21.15.123:0/1180279757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52bc0ceac0 0x7f52bc159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.498+0000 7f52b9e00640 1 -- 172.21.15.123:0/1180279757 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52bc156580 con 0x7f52bc0b3870 2024-04-25T13:43:32.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.498+0000 7f52b9e00640 1 --2- 172.21.15.123:0/1180279757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52bc0b3870 0x7f52bc155ba0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f52ac00c3f0 tx=0x7f52ac00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:32.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.498+0000 7f52b2000640 1 -- 172.21.15.123:0/1180279757 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac017070 con 0x7f52bc0b3870 2024-04-25T13:43:32.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.498+0000 7f52b2000640 1 -- 172.21.15.123:0/1180279757 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52ac0052d0 con 0x7f52bc0b3870 2024-04-25T13:43:32.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.498+0000 7f52c0a00640 1 -- 172.21.15.123:0/1180279757 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52bc1fcad0 con 0x7f52bc0b3870 2024-04-25T13:43:32.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.498+0000 7f52b2000640 1 -- 172.21.15.123:0/1180279757 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac003840 con 0x7f52bc0b3870 2024-04-25T13:43:32.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.498+0000 7f52c0a00640 1 -- 172.21.15.123:0/1180279757 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52bc1fd090 con 0x7f52bc0b3870 2024-04-25T13:43:32.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.498+0000 7f52c0a00640 1 -- 172.21.15.123:0/1180279757 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52bc06d600 con 0x7f52bc0b3870 2024-04-25T13:43:32.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.498+0000 7f52b2000640 1 -- 172.21.15.123:0/1180279757 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f52ac01a070 con 0x7f52bc0b3870 2024-04-25T13:43:32.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.498+0000 7f52b2000640 1 --2- 172.21.15.123:0/1180279757 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f529c06f400 0x7f529c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:32.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.502+0000 7f52b2000640 1 -- 172.21.15.123:0/1180279757 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f52ac08e2c0 con 0x7f52bc0b3870 2024-04-25T13:43:32.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.502+0000 7f52b9400640 1 --2- 172.21.15.123:0/1180279757 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f529c06f400 0x7f529c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:32.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.502+0000 7f52b9400640 1 --2- 172.21.15.123:0/1180279757 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f529c06f400 0x7f529c071910 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f52a80ae000 tx=0x7f52a80a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:32.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.506+0000 7f52b2000640 1 -- 172.21.15.123:0/1180279757 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f52bc0b41c0 con 0x7f52bc0b3870 2024-04-25T13:43:32.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.670+0000 7f52c0a00640 1 -- 172.21.15.123:0/1180279757 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f52bc050750 con 0x7f52bc0b3870 2024-04-25T13:43:32.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.674+0000 7f52b2000640 1 -- 172.21.15.123:0/1180279757 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f52ac005480 con 0x7f52bc0b3870 2024-04-25T13:43:32.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.678+0000 7f52c0a00640 1 -- 172.21.15.123:0/1180279757 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f529c06f400 msgr2=0x7f529c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:32.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.678+0000 7f52c0a00640 1 --2- 172.21.15.123:0/1180279757 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f529c06f400 0x7f529c071910 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f52a80ae000 tx=0x7f52a80a7000 comp rx=0 tx=0).stop 2024-04-25T13:43:32.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.678+0000 7f52c0a00640 1 -- 172.21.15.123:0/1180279757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52bc0b3870 msgr2=0x7f52bc155ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:32.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.678+0000 7f52c0a00640 1 --2- 172.21.15.123:0/1180279757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52bc0b3870 0x7f52bc155ba0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f52ac00c3f0 tx=0x7f52ac00c8b0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.678+0000 7f52c0a00640 1 -- 172.21.15.123:0/1180279757 shutdown_connections 2024-04-25T13:43:32.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.678+0000 7f52c0a00640 1 --2- 172.21.15.123:0/1180279757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52bc0ceac0 0x7f52bc159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.678+0000 7f52c0a00640 1 --2- 172.21.15.123:0/1180279757 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f529c06f400 0x7f529c071910 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.678+0000 7f52c0a00640 1 --2- 172.21.15.123:0/1180279757 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f52bc15de80 0x7f52bc159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.678+0000 7f52c0a00640 1 --2- 172.21.15.123:0/1180279757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52bc0b3870 0x7f52bc155ba0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.678+0000 7f52c0a00640 1 -- 172.21.15.123:0/1180279757 >> 172.21.15.123:0/1180279757 conn(0x7f52bc06ca70 msgr2=0x7f52bc0cf5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:32.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.678+0000 7f52c0a00640 1 -- 172.21.15.123:0/1180279757 shutdown_connections 2024-04-25T13:43:32.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.678+0000 7f52c0a00640 1 -- 172.21.15.123:0/1180279757 wait complete. 2024-04-25T13:43:32.703 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_flush.TestFlush.test_flush' 2024-04-25T13:43:32.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.842+0000 7f4ba2e00640 1 Processor -- start 2024-04-25T13:43:32.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.842+0000 7f4ba2e00640 1 -- start start 2024-04-25T13:43:32.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.846+0000 7f4ba2e00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4b9c0b32f0 0x7f4b9c0b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:32.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.846+0000 7f4ba2e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4b9c0b5010 0x7f4b9c0b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:32.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.846+0000 7f4ba2e00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b9c0b3c40 con 0x7f4b9c0d0f80 2024-04-25T13:43:32.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.846+0000 7f4ba2e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f4b9c15cfe0 con 0x7f4b9c0b5010 2024-04-25T13:43:32.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.846+0000 7f4ba2e00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f4b9c15d240 con 0x7f4b9c0b32f0 2024-04-25T13:43:32.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.846+0000 7f4ba0e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4b9c0b5010 0x7f4b9c0b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:32.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.846+0000 7f4ba0e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f4b9c0b5010 0x7f4b9c0b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43814/0 (socket says 172.21.15.123:43814) 2024-04-25T13:43:32.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.846+0000 7f4ba0e00640 1 -- 172.21.15.123:0/866016421 learned_addr learned my addr 172.21.15.123:0/866016421 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:32.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.846+0000 7f4b9b400640 1 --2- 172.21.15.123:0/866016421 >> v2:172.21.15.130:3300/0 conn(0x7f4b9c0b32f0 0x7f4b9c0b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:32.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.846+0000 7f4ba0e00640 1 -- 172.21.15.123:0/866016421 >> v2:172.21.15.130:3300/0 conn(0x7f4b9c0b32f0 msgr2=0x7f4b9c0b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:32.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.846+0000 7f4ba0e00640 1 --2- 172.21.15.123:0/866016421 >> v2:172.21.15.130:3300/0 conn(0x7f4b9c0b32f0 0x7f4b9c0b3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.846+0000 7f4ba0e00640 1 -- 172.21.15.123:0/866016421 >> v1:172.21.15.130:6789/0 conn(0x7f4b9c0d0f80 legacy=0x7f4b9c160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:32.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.846+0000 7f4ba0e00640 1 -- 172.21.15.123:0/866016421 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9c15d520 con 0x7f4b9c0b5010 2024-04-25T13:43:32.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.846+0000 7f4b9b400640 1 --2- 172.21.15.123:0/866016421 >> v2:172.21.15.130:3300/0 conn(0x7f4b9c0b32f0 0x7f4b9c0b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:32.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.850+0000 7f4ba0e00640 1 --2- 172.21.15.123:0/866016421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b9c0b5010 0x7f4b9c0b5420 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0b4420 tx=0x7f4b9401e910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7edb4e6ae4bfe2a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:32.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.850+0000 7f4b9aa00640 1 -- 172.21.15.123:0/866016421 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9400b2d0 con 0x7f4b9c0b5010 2024-04-25T13:43:32.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.850+0000 7f4b9aa00640 1 -- 172.21.15.123:0/866016421 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b9400b470 con 0x7f4b9c0b5010 2024-04-25T13:43:32.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.850+0000 7f4b9aa00640 1 -- 172.21.15.123:0/866016421 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b940a7920 con 0x7f4b9c0b5010 2024-04-25T13:43:32.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.850+0000 7f4ba2e00640 1 -- 172.21.15.123:0/866016421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b9c0b5010 msgr2=0x7f4b9c0b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:32.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.850+0000 7f4ba2e00640 1 --2- 172.21.15.123:0/866016421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b9c0b5010 0x7f4b9c0b5420 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0b4420 tx=0x7f4b9401e910 comp rx=0 tx=0).stop 2024-04-25T13:43:32.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.850+0000 7f4ba2e00640 1 -- 172.21.15.123:0/866016421 shutdown_connections 2024-04-25T13:43:32.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.850+0000 7f4ba2e00640 1 --2- 172.21.15.123:0/866016421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b9c0b5010 0x7f4b9c0b5420 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.850+0000 7f4ba2e00640 1 --2- 172.21.15.123:0/866016421 >> v2:172.21.15.130:3300/0 conn(0x7f4b9c0b32f0 0x7f4b9c0b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.850+0000 7f4ba2e00640 1 -- 172.21.15.123:0/866016421 >> 172.21.15.123:0/866016421 conn(0x7f4b9c06d210 msgr2=0x7f4b9c06ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:32.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.850+0000 7f4ba2e00640 1 -- 172.21.15.123:0/866016421 shutdown_connections 2024-04-25T13:43:32.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.850+0000 7f4ba2e00640 1 -- 172.21.15.123:0/866016421 wait complete. 2024-04-25T13:43:32.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.854+0000 7f4ba2e00640 1 Processor -- start 2024-04-25T13:43:32.857 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.854+0000 7f4ba2e00640 1 -- start start 2024-04-25T13:43:32.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.854+0000 7f4ba2e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4b9c0b32f0 0x7f4b9c0b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:32.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.854+0000 7f4ba2e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b9c0b5010 0x7f4b9c15ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.854+0000 7f4ba2e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b9c0d0f80 0x7f4b9c153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.854+0000 7f4ba2e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9c072ad0 con 0x7f4b9c0d0f80 2024-04-25T13:43:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.854+0000 7f4ba2e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9c0b6470 con 0x7f4b9c0b5010 2024-04-25T13:43:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.854+0000 7f4ba2e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f4b9c072c50 con 0x7f4b9c0b32f0 2024-04-25T13:43:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.854+0000 7f4ba0e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b9c0d0f80 0x7f4b9c153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.854+0000 7f4ba0e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b9c0d0f80 0x7f4b9c153670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43826/0 (socket says 172.21.15.123:43826) 2024-04-25T13:43:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.854+0000 7f4ba0e00640 1 -- 172.21.15.123:0/2132505716 learned_addr learned my addr 172.21.15.123:0/2132505716 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.854+0000 7f4b9b400640 1 --2- 172.21.15.123:0/2132505716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b9c0b5010 0x7f4b9c15ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.854+0000 7f4b9be00640 1 --2- 172.21.15.123:0/2132505716 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4b9c0b32f0 0x7f4b9c0b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.854+0000 7f4ba0e00640 1 -- 172.21.15.123:0/2132505716 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4b9c0b32f0 msgr2=0x7f4b9c0b0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.854+0000 7f4ba0e00640 1 --2- 172.21.15.123:0/2132505716 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4b9c0b32f0 0x7f4b9c0b0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.854+0000 7f4ba0e00640 1 -- 172.21.15.123:0/2132505716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b9c0b5010 msgr2=0x7f4b9c15ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.854+0000 7f4ba0e00640 1 --2- 172.21.15.123:0/2132505716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b9c0b5010 0x7f4b9c15ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:32.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.854+0000 7f4ba0e00640 1 -- 172.21.15.123:0/2132505716 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9c15c210 con 0x7f4b9c0d0f80 2024-04-25T13:43:32.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.854+0000 7f4b9b400640 1 --2- 172.21.15.123:0/2132505716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b9c0b5010 0x7f4b9c15ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:32.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.854+0000 7f4ba0e00640 1 --2- 172.21.15.123:0/2132505716 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b9c0d0f80 0x7f4b9c153670 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4b940b1040 tx=0x7f4b9401b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:32.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.854+0000 7f4b93e00640 1 -- 172.21.15.123:0/2132505716 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9400b720 con 0x7f4b9c0d0f80 2024-04-25T13:43:32.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.854+0000 7f4b93e00640 1 -- 172.21.15.123:0/2132505716 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b940be070 con 0x7f4b9c0d0f80 2024-04-25T13:43:32.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.854+0000 7f4ba2e00640 1 -- 172.21.15.123:0/2132505716 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b9c15c4f0 con 0x7f4b9c0d0f80 2024-04-25T13:43:32.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.854+0000 7f4b93e00640 1 -- 172.21.15.123:0/2132505716 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b94009a60 con 0x7f4b9c0d0f80 2024-04-25T13:43:32.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.854+0000 7f4ba2e00640 1 -- 172.21.15.123:0/2132505716 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b9c15cab0 con 0x7f4b9c0d0f80 2024-04-25T13:43:32.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.854+0000 7f4ba2e00640 1 -- 172.21.15.123:0/2132505716 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b9c0507c0 con 0x7f4b9c0d0f80 2024-04-25T13:43:32.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.858+0000 7f4b93e00640 1 -- 172.21.15.123:0/2132505716 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4b940b6070 con 0x7f4b9c0d0f80 2024-04-25T13:43:32.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.858+0000 7f4b93e00640 1 --2- 172.21.15.123:0/2132505716 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4b7c06f430 0x7f4b7c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:32.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.858+0000 7f4b93e00640 1 -- 172.21.15.123:0/2132505716 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f4b94129e70 con 0x7f4b9c0d0f80 2024-04-25T13:43:32.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.858+0000 7f4b9be00640 1 --2- 172.21.15.123:0/2132505716 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4b7c06f430 0x7f4b7c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:32.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.858+0000 7f4b9be00640 1 --2- 172.21.15.123:0/2132505716 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4b7c06f430 0x7f4b7c071940 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c070fa0 tx=0x7f4b8c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:32.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:32.862+0000 7f4b93e00640 1 -- 172.21.15.123:0/2132505716 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4b9c0b3c40 con 0x7f4b9c0d0f80 2024-04-25T13:43:33.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:33.074+0000 7f4ba2e00640 1 -- 172.21.15.123:0/2132505716 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_flush.TestFlush.test_flush"]} v 0) -- 0x7f4b9c0b0910 con 0x7f4b9c0d0f80 2024-04-25T13:43:33.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:33.306+0000 7f4b93e00640 1 -- 172.21.15.123:0/2132505716 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_flush.TestFlush.test_flush"]}]=0 v106) ==== 123+0+0 (secure 0 0 0) 0x7f4b940f7050 con 0x7f4b9c0d0f80 2024-04-25T13:43:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:33.306+0000 7f4ba2e00640 1 -- 172.21.15.123:0/2132505716 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4b7c06f430 msgr2=0x7f4b7c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:33.306+0000 7f4ba2e00640 1 --2- 172.21.15.123:0/2132505716 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4b7c06f430 0x7f4b7c071940 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c070fa0 tx=0x7f4b8c008040 comp rx=0 tx=0).stop 2024-04-25T13:43:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:33.306+0000 7f4ba2e00640 1 -- 172.21.15.123:0/2132505716 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b9c0d0f80 msgr2=0x7f4b9c153670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:33.306+0000 7f4ba2e00640 1 --2- 172.21.15.123:0/2132505716 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b9c0d0f80 0x7f4b9c153670 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4b940b1040 tx=0x7f4b9401b6b0 comp rx=0 tx=0).stop 2024-04-25T13:43:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:33.306+0000 7f4ba2e00640 1 -- 172.21.15.123:0/2132505716 shutdown_connections 2024-04-25T13:43:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:33.306+0000 7f4ba2e00640 1 --2- 172.21.15.123:0/2132505716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b9c0b5010 0x7f4b9c15ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:33.306+0000 7f4ba2e00640 1 --2- 172.21.15.123:0/2132505716 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f4b7c06f430 0x7f4b7c071940 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:33.306+0000 7f4ba2e00640 1 --2- 172.21.15.123:0/2132505716 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4b9c0d0f80 0x7f4b9c153670 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:33.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:33.306+0000 7f4ba2e00640 1 --2- 172.21.15.123:0/2132505716 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4b9c0b32f0 0x7f4b9c0b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:33.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:33.306+0000 7f4ba2e00640 1 -- 172.21.15.123:0/2132505716 >> 172.21.15.123:0/2132505716 conn(0x7f4b9c06d210 msgr2=0x7f4b9c0cfdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:33.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:33.306+0000 7f4ba2e00640 1 -- 172.21.15.123:0/2132505716 shutdown_connections 2024-04-25T13:43:33.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:33.306+0000 7f4ba2e00640 1 -- 172.21.15.123:0/2132505716 wait complete. 2024-04-25T13:43:33.332 INFO:tasks.cephfs_test_runner:test_flush (tasks.cephfs.test_flush.TestFlush) ... ok 2024-04-25T13:43:33.332 INFO:tasks.cephfs_test_runner: 2024-04-25T13:43:33.332 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-25T13:43:33.332 INFO:tasks.cephfs_test_runner:Ran 1 test in 57.557s 2024-04-25T13:43:33.332 INFO:tasks.cephfs_test_runner: 2024-04-25T13:43:33.333 INFO:tasks.cephfs_test_runner:OK 2024-04-25T13:43:33.333 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-25T13:43:33.342 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-25T13:43:33.349 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-25T13:43:33.349 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:43:33.349 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:43:33.358 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8300 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T13:43:33.358 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-04-25T13:43:33.358 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:43:33.408 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350296k,nr_inodes=4087574,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8300 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274988k,nr_inodes=818747,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T13:43:33.408 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:43:33.408 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:43:33.418 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6205 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T13:43:33.418 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-04-25T13:43:33.419 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T13:43:33.472 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350260k,nr_inodes=4087565,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6205 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T13:43:33.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:33.472 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-04-25T13:43:33.480 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T13:43:33.480 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T13:43:33.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:33.481 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T13:43:33.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:33.545 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T13:43:33.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:33.615 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2024-04-25T13:43:33.681 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:43:33.712 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:43:33.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:33.788 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-04-25T13:43:33.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:33.797 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2024-04-25T13:43:33.866 INFO:teuthology.orchestra.run.smithi123.stderr:Cannot find device "ceph-brx" 2024-04-25T13:43:33.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:43:33.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:33.869 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2024-04-25T13:43:33.879 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T13:43:33.879 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-25T13:43:33.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:33.879 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T13:43:33.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:33.946 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T13:43:34.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:34.015 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link delete ceph-brx 2024-04-25T13:43:34.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:34.171 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2024-04-25T13:43:34.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T13:43:34.180 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link delete ceph-brx 2024-04-25T13:43:34.246 INFO:teuthology.orchestra.run.smithi130.stderr:Cannot find device "ceph-brx" 2024-04-25T13:43:34.247 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:43:34.248 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T13:43:34.257 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T13:43:34.258 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:43:34.407 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.402+0000 7fee25c00640 1 Processor -- start 2024-04-25T13:43:34.408 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.402+0000 7fee25c00640 1 -- start start 2024-04-25T13:43:34.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.402+0000 7fee25c00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fee200747a0 0x7fee2015fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:34.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.406+0000 7fee25c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fee200b5670 0x7fee200731e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:34.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.406+0000 7fee25c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee20145d70 con 0x7fee201602e0 2024-04-25T13:43:34.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.406+0000 7fee25c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fee20074290 con 0x7fee200b5670 2024-04-25T13:43:34.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.406+0000 7fee25c00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fee201606f0 con 0x7fee200747a0 2024-04-25T13:43:34.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.406+0000 7fee1e000640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fee201602e0 0x7fee20072ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58216/0 (socket says 172.21.15.123:58216) 2024-04-25T13:43:34.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.406+0000 7fee1e000640 1 -- 172.21.15.123:0/1162945321 learned_addr learned my addr 172.21.15.123:0/1162945321 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:34.410 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.406+0000 7fee1f400640 1 --2- 172.21.15.123:0/1162945321 >> v2:172.21.15.123:3300/0 conn(0x7fee200b5670 0x7fee200731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:34.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.406+0000 7fee1ea00640 1 --2- 172.21.15.123:0/1162945321 >> v2:172.21.15.130:3300/0 conn(0x7fee200747a0 0x7fee2015fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:34.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.406+0000 7fee1f400640 1 -- 172.21.15.123:0/1162945321 >> v2:172.21.15.130:3300/0 conn(0x7fee200747a0 msgr2=0x7fee2015fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:34.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.406+0000 7fee1f400640 1 --2- 172.21.15.123:0/1162945321 >> v2:172.21.15.130:3300/0 conn(0x7fee200747a0 0x7fee2015fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:34.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.406+0000 7fee1f400640 1 -- 172.21.15.123:0/1162945321 >> v1:172.21.15.123:6789/0 conn(0x7fee201602e0 legacy=0x7fee20072ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:34.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.406+0000 7fee1f400640 1 -- 172.21.15.123:0/1162945321 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee20073c80 con 0x7fee200b5670 2024-04-25T13:43:34.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.406+0000 7fee1d600640 1 -- 172.21.15.123:0/1162945321 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 116059322 0 0) 0x7fee10001120 con 0x7fee201602e0 2024-04-25T13:43:34.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.406+0000 7fee1f400640 1 --2- 172.21.15.123:0/1162945321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee200b5670 0x7fee200731e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fee20070e80 tx=0x7fee1801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174790db59d08b7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:34.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.410+0000 7fee1d600640 1 -- 172.21.15.123:0/1162945321 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee180b2070 con 0x7fee200b5670 2024-04-25T13:43:34.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.410+0000 7fee1d600640 1 -- 172.21.15.123:0/1162945321 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee180a5860 con 0x7fee200b5670 2024-04-25T13:43:34.413 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.410+0000 7fee1d600640 1 -- 172.21.15.123:0/1162945321 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee180a5c30 con 0x7fee200b5670 2024-04-25T13:43:34.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.410+0000 7fee25c00640 1 -- 172.21.15.123:0/1162945321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee200b5670 msgr2=0x7fee200731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:34.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.410+0000 7fee25c00640 1 --2- 172.21.15.123:0/1162945321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee200b5670 0x7fee200731e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fee20070e80 tx=0x7fee1801c930 comp rx=0 tx=0).stop 2024-04-25T13:43:34.414 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.410+0000 7fee25c00640 1 -- 172.21.15.123:0/1162945321 shutdown_connections 2024-04-25T13:43:34.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.410+0000 7fee25c00640 1 --2- 172.21.15.123:0/1162945321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee200b5670 0x7fee200731e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:34.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.410+0000 7fee25c00640 1 --2- 172.21.15.123:0/1162945321 >> v2:172.21.15.130:3300/0 conn(0x7fee200747a0 0x7fee2015fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:34.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.410+0000 7fee25c00640 1 -- 172.21.15.123:0/1162945321 >> 172.21.15.123:0/1162945321 conn(0x7fee2006d210 msgr2=0x7fee2006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:34.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.410+0000 7fee25c00640 1 -- 172.21.15.123:0/1162945321 shutdown_connections 2024-04-25T13:43:34.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.410+0000 7fee25c00640 1 -- 172.21.15.123:0/1162945321 wait complete. 2024-04-25T13:43:34.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.410+0000 7fee25c00640 1 Processor -- start 2024-04-25T13:43:34.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.410+0000 7fee25c00640 1 -- start start 2024-04-25T13:43:34.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.414+0000 7fee25c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee200747a0 0x7fee2013c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:34.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.414+0000 7fee25c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee200b5670 0x7fee200d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:34.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.414+0000 7fee25c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee201602e0 0x7fee2015b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:34.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.414+0000 7fee25c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fee200b6380 con 0x7fee200747a0 2024-04-25T13:43:34.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.414+0000 7fee25c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fee20074bb0 con 0x7fee201602e0 2024-04-25T13:43:34.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.414+0000 7fee25c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fee200b6500 con 0x7fee200b5670 2024-04-25T13:43:34.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.414+0000 7fee1ea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee200747a0 0x7fee2013c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:34.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.414+0000 7fee1ea00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee200747a0 0x7fee2013c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43844/0 (socket says 172.21.15.123:43844) 2024-04-25T13:43:34.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.414+0000 7fee1ea00640 1 -- 172.21.15.123:0/1460662741 learned_addr learned my addr 172.21.15.123:0/1460662741 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:34.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.414+0000 7fee1e000640 1 --2- 172.21.15.123:0/1460662741 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee200b5670 0x7fee200d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:34.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.414+0000 7fee1f400640 1 --2- 172.21.15.123:0/1460662741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee201602e0 0x7fee2015b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:34.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.414+0000 7fee1ea00640 1 -- 172.21.15.123:0/1460662741 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee200b5670 msgr2=0x7fee200d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:34.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.414+0000 7fee1ea00640 1 --2- 172.21.15.123:0/1460662741 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee200b5670 0x7fee200d07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:34.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.414+0000 7fee1ea00640 1 -- 172.21.15.123:0/1460662741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee201602e0 msgr2=0x7fee2015b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:34.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.414+0000 7fee1ea00640 1 --2- 172.21.15.123:0/1460662741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee201602e0 0x7fee2015b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:34.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.414+0000 7fee1ea00640 1 -- 172.21.15.123:0/1460662741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee200cf140 con 0x7fee200747a0 2024-04-25T13:43:34.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.414+0000 7fee1f400640 1 --2- 172.21.15.123:0/1460662741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee201602e0 0x7fee2015b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:34.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.414+0000 7fee1e000640 1 --2- 172.21.15.123:0/1460662741 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee200b5670 0x7fee200d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:34.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.414+0000 7fee1ea00640 1 --2- 172.21.15.123:0/1460662741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee200747a0 0x7fee2013c000 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fee0800e870 tx=0x7fee0800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:34.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.414+0000 7fee16a00640 1 -- 172.21.15.123:0/1460662741 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee08017070 con 0x7fee200747a0 2024-04-25T13:43:34.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.414+0000 7fee16a00640 1 -- 172.21.15.123:0/1460662741 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee0800c940 con 0x7fee200747a0 2024-04-25T13:43:34.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.414+0000 7fee16a00640 1 -- 172.21.15.123:0/1460662741 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0800ccf0 con 0x7fee200747a0 2024-04-25T13:43:34.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.414+0000 7fee25c00640 1 -- 172.21.15.123:0/1460662741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee200cf420 con 0x7fee200747a0 2024-04-25T13:43:34.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.414+0000 7fee25c00640 1 -- 172.21.15.123:0/1460662741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee200cf9e0 con 0x7fee200747a0 2024-04-25T13:43:34.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.414+0000 7fee25c00640 1 -- 172.21.15.123:0/1460662741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee200507c0 con 0x7fee200747a0 2024-04-25T13:43:34.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.418+0000 7fee16a00640 1 -- 172.21.15.123:0/1460662741 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fee0801a070 con 0x7fee200747a0 2024-04-25T13:43:34.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.418+0000 7fee16a00640 1 --2- 172.21.15.123:0/1460662741 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fedfc06f430 0x7fedfc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:34.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.418+0000 7fee16a00640 1 -- 172.21.15.123:0/1460662741 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fee0808f1b0 con 0x7fee200747a0 2024-04-25T13:43:34.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.418+0000 7fee1e000640 1 --2- 172.21.15.123:0/1460662741 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fedfc06f430 0x7fedfc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:34.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.418+0000 7fee1e000640 1 --2- 172.21.15.123:0/1460662741 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fedfc06f430 0x7fedfc071940 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fee10007fd0 tx=0x7fee10009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:34.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.422+0000 7fee16a00640 1 -- 172.21.15.123:0/1460662741 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fee0805c420 con 0x7fee200747a0 2024-04-25T13:43:34.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.574+0000 7fee25c00640 1 -- 172.21.15.123:0/1460662741 --> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fee200b2e90 con 0x7fedfc06f430 2024-04-25T13:43:34.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.578+0000 7fee16a00640 1 -- 172.21.15.123:0/1460662741 <== mgr.4107 v2:172.21.15.123:6832/715752891 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13366 (secure 0 0 0) 0x7fee200b2e90 con 0x7fedfc06f430 2024-04-25T13:43:34.582 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:34.582 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-04-25T13:43:34.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.578+0000 7fee25c00640 1 -- 172.21.15.123:0/1460662741 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fedfc06f430 msgr2=0x7fedfc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:34.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.578+0000 7fee25c00640 1 --2- 172.21.15.123:0/1460662741 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fedfc06f430 0x7fedfc071940 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fee10007fd0 tx=0x7fee10009040 comp rx=0 tx=0).stop 2024-04-25T13:43:34.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.578+0000 7fee25c00640 1 -- 172.21.15.123:0/1460662741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee200747a0 msgr2=0x7fee2013c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:34.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.578+0000 7fee25c00640 1 --2- 172.21.15.123:0/1460662741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee200747a0 0x7fee2013c000 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fee0800e870 tx=0x7fee0800ec70 comp rx=0 tx=0).stop 2024-04-25T13:43:34.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.578+0000 7fee25c00640 1 -- 172.21.15.123:0/1460662741 shutdown_connections 2024-04-25T13:43:34.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.578+0000 7fee25c00640 1 --2- 172.21.15.123:0/1460662741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee201602e0 0x7fee2015b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:34.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.578+0000 7fee25c00640 1 --2- 172.21.15.123:0/1460662741 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fedfc06f430 0x7fedfc071940 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:34.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.578+0000 7fee25c00640 1 --2- 172.21.15.123:0/1460662741 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee200b5670 0x7fee200d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:34.584 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.578+0000 7fee25c00640 1 --2- 172.21.15.123:0/1460662741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fee200747a0 0x7fee2013c000 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:34.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.578+0000 7fee25c00640 1 -- 172.21.15.123:0/1460662741 >> 172.21.15.123:0/1460662741 conn(0x7fee2006d210 msgr2=0x7fee2006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:34.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.578+0000 7fee25c00640 1 -- 172.21.15.123:0/1460662741 shutdown_connections 2024-04-25T13:43:34.585 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.578+0000 7fee25c00640 1 -- 172.21.15.123:0/1460662741 wait complete. 2024-04-25T13:43:34.603 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2024-04-25T13:43:33.594463+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220416,"kb_used_data":4288,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754304,"statfs":{"total":773094113280,"available":772868407296,"internally_reserved":0,"allocated":4390912,"data_stored":2449706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-26486,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-17,"num_read_kb":-13,"num_write":-114,"num_write_kb":-66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000864"},"pg_stats":[{"pgid":"1.0","version":"17'72","reported_seq":135,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047968+0000","last_change":"2024-04-25T13:41:56.890628+0000","last_active":"2024-04-25T13:43:03.047968+0000","last_peered":"2024-04-25T13:43:03.047968+0000","last_clean":"2024-04-25T13:43:03.047968+0000","last_became_active":"2024-04-25T13:41:56.889261+0000","last_became_peered":"2024-04-25T13:41:56.889261+0000","last_unstale":"2024-04-25T13:43:03.047968+0000","last_undegraded":"2024-04-25T13:43:03.047968+0000","last_fullsized":"2024-04-25T13:43:03.047968+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:53.940471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:53.940471+0000","last_clean_scrub_stamp":"2024-04-25T13:41:53.940471+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:06.164380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":983040,"data_stored":742123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":393216,"data_stored":152281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":397312,"data_stored":152539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":397312,"data_stored":151971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":425984,"data_stored":178512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":389120,"data_stored":151735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":425984,"data_stored":178512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":978944,"data_stored":742033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:43:34.604 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:43:34.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.746+0000 7f75bf000640 1 Processor -- start 2024-04-25T13:43:34.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.746+0000 7f75bf000640 1 -- start start 2024-04-25T13:43:34.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.746+0000 7f75bf000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75b806dcb0 0x7f75b809caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:34.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.746+0000 7f75bf000640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f75b806e800 0x7f75b80b75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:34.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.746+0000 7f75bf000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75b80d2eb0 con 0x7f75b806e3f0 2024-04-25T13:43:34.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.746+0000 7f75bf000640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f75b809cfe0 con 0x7f75b806e800 2024-04-25T13:43:34.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.746+0000 7f75bf000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f75b80b91b0 con 0x7f75b806dcb0 2024-04-25T13:43:34.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.746+0000 7f75bd200640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f75b806e3f0 0x7f75b80b6ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58230/0 (socket says 172.21.15.123:58230) 2024-04-25T13:43:34.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.746+0000 7f75bd200640 1 -- 172.21.15.123:0/156925344 learned_addr learned my addr 172.21.15.123:0/156925344 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:34.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.746+0000 7f75bdc00640 1 --2- 172.21.15.123:0/156925344 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75b806dcb0 0x7f75b809caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:34.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.746+0000 7f75be600640 1 --2- 172.21.15.123:0/156925344 >> v2:172.21.15.130:3300/0 conn(0x7f75b806e800 0x7f75b80b75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:34.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.746+0000 7f75b7e00640 1 -- 172.21.15.123:0/156925344 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2841527969 0 0) 0x7f75b80d2eb0 con 0x7f75b806e3f0 2024-04-25T13:43:34.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.746+0000 7f75b7e00640 1 -- 172.21.15.123:0/156925344 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75a0003530 con 0x7f75b806e3f0 2024-04-25T13:43:34.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.746+0000 7f75bdc00640 1 -- 172.21.15.123:0/156925344 >> v2:172.21.15.130:3300/0 conn(0x7f75b806e800 msgr2=0x7f75b80b75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:34.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.746+0000 7f75bdc00640 1 --2- 172.21.15.123:0/156925344 >> v2:172.21.15.130:3300/0 conn(0x7f75b806e800 0x7f75b80b75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:34.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.746+0000 7f75bdc00640 1 -- 172.21.15.123:0/156925344 >> v1:172.21.15.123:6789/0 conn(0x7f75b806e3f0 legacy=0x7f75b80b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:34.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.746+0000 7f75bdc00640 1 -- 172.21.15.123:0/156925344 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b80b8a70 con 0x7f75b806dcb0 2024-04-25T13:43:34.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.750+0000 7f75bdc00640 1 --2- 172.21.15.123:0/156925344 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75b806dcb0 0x7f75b809caa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0097a0 tx=0x7f75ac01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=783095f69aca4048 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:34.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.750+0000 7f75b7e00640 1 -- 172.21.15.123:0/156925344 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ac0b0070 con 0x7f75b806dcb0 2024-04-25T13:43:34.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.750+0000 7f75b7e00640 1 -- 172.21.15.123:0/156925344 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75ac0ab600 con 0x7f75b806dcb0 2024-04-25T13:43:34.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.750+0000 7f75b7e00640 1 -- 172.21.15.123:0/156925344 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ac0ab9b0 con 0x7f75b806dcb0 2024-04-25T13:43:34.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.750+0000 7f75bf000640 1 -- 172.21.15.123:0/156925344 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75b806dcb0 msgr2=0x7f75b809caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:34.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.750+0000 7f75bf000640 1 --2- 172.21.15.123:0/156925344 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75b806dcb0 0x7f75b809caa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0097a0 tx=0x7f75ac01c3f0 comp rx=0 tx=0).stop 2024-04-25T13:43:34.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.750+0000 7f75bf000640 1 -- 172.21.15.123:0/156925344 shutdown_connections 2024-04-25T13:43:34.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.750+0000 7f75bf000640 1 --2- 172.21.15.123:0/156925344 >> v2:172.21.15.130:3300/0 conn(0x7f75b806e800 0x7f75b80b75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:34.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.750+0000 7f75bf000640 1 --2- 172.21.15.123:0/156925344 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75b806dcb0 0x7f75b809caa0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:34.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.750+0000 7f75bf000640 1 -- 172.21.15.123:0/156925344 >> 172.21.15.123:0/156925344 conn(0x7f75b80d00c0 msgr2=0x7f75b80d04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:34.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.750+0000 7f75bf000640 1 -- 172.21.15.123:0/156925344 shutdown_connections 2024-04-25T13:43:34.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.750+0000 7f75bf000640 1 -- 172.21.15.123:0/156925344 wait complete. 2024-04-25T13:43:34.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.754+0000 7f75bf000640 1 Processor -- start 2024-04-25T13:43:34.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.754+0000 7f75bf000640 1 -- start start 2024-04-25T13:43:34.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.754+0000 7f75bf000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75b806dcb0 0x7f75b815fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:34.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.754+0000 7f75bf000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75b806e3f0 0x7f75b814fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:34.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.754+0000 7f75bf000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75b806e800 0x7f75b8071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:34.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.754+0000 7f75bf000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f75b80d2230 con 0x7f75b806e800 2024-04-25T13:43:34.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.754+0000 7f75bf000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f75b80b7af0 con 0x7f75b806dcb0 2024-04-25T13:43:34.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.754+0000 7f75bf000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f75b80d23b0 con 0x7f75b806e3f0 2024-04-25T13:43:34.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.754+0000 7f75be600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75b806e800 0x7f75b8071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:34.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.754+0000 7f75be600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75b806e800 0x7f75b8071490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43852/0 (socket says 172.21.15.123:43852) 2024-04-25T13:43:34.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.754+0000 7f75be600640 1 -- 172.21.15.123:0/3597382905 learned_addr learned my addr 172.21.15.123:0/3597382905 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:34.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.754+0000 7f75bd200640 1 --2- 172.21.15.123:0/3597382905 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75b806e3f0 0x7f75b814fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:34.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.754+0000 7f75bdc00640 1 --2- 172.21.15.123:0/3597382905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75b806dcb0 0x7f75b815fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:34.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.754+0000 7f75be600640 1 -- 172.21.15.123:0/3597382905 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75b806e3f0 msgr2=0x7f75b814fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:34.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.754+0000 7f75be600640 1 --2- 172.21.15.123:0/3597382905 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75b806e3f0 0x7f75b814fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:34.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.754+0000 7f75be600640 1 -- 172.21.15.123:0/3597382905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75b806dcb0 msgr2=0x7f75b815fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:34.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.754+0000 7f75be600640 1 --2- 172.21.15.123:0/3597382905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75b806dcb0 0x7f75b815fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:34.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.754+0000 7f75be600640 1 -- 172.21.15.123:0/3597382905 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b8161430 con 0x7f75b806e800 2024-04-25T13:43:34.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.758+0000 7f75be600640 1 --2- 172.21.15.123:0/3597382905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75b806e800 0x7f75b8071490 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f75b0009cb0 tx=0x7f75b000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:34.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.758+0000 7f75b5600640 1 -- 172.21.15.123:0/3597382905 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b0018020 con 0x7f75b806e800 2024-04-25T13:43:34.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.758+0000 7f75b5600640 1 -- 172.21.15.123:0/3597382905 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75b0014480 con 0x7f75b806e800 2024-04-25T13:43:34.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.758+0000 7f75bf000640 1 -- 172.21.15.123:0/3597382905 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75b8160420 con 0x7f75b806e800 2024-04-25T13:43:34.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.758+0000 7f75b5600640 1 -- 172.21.15.123:0/3597382905 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b0014870 con 0x7f75b806e800 2024-04-25T13:43:34.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.758+0000 7f75bf000640 1 -- 172.21.15.123:0/3597382905 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75b8160e70 con 0x7f75b806e800 2024-04-25T13:43:34.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.758+0000 7f75bf000640 1 -- 172.21.15.123:0/3597382905 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75b8050750 con 0x7f75b806e800 2024-04-25T13:43:34.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.758+0000 7f75b5600640 1 -- 172.21.15.123:0/3597382905 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f75b001b020 con 0x7f75b806e800 2024-04-25T13:43:34.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.758+0000 7f75b5600640 1 --2- 172.21.15.123:0/3597382905 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f759806f430 0x7f7598071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:34.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.762+0000 7f75b5600640 1 -- 172.21.15.123:0/3597382905 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f75b0090250 con 0x7f75b806e800 2024-04-25T13:43:34.765 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.762+0000 7f75bdc00640 1 --2- 172.21.15.123:0/3597382905 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f759806f430 0x7f7598071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:34.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.762+0000 7f75bdc00640 1 --2- 172.21.15.123:0/3597382905 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f759806f430 0x7f7598071940 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0ad000 tx=0x7f75ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:34.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.762+0000 7f75b5600640 1 -- 172.21.15.123:0/3597382905 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f75b0022030 con 0x7f75b806e800 2024-04-25T13:43:34.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.918+0000 7f75bf000640 1 -- 172.21.15.123:0/3597382905 --> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f75b8069df0 con 0x7f759806f430 2024-04-25T13:43:34.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.918+0000 7f75b5600640 1 -- 172.21.15.123:0/3597382905 <== mgr.4107 v2:172.21.15.123:6832/715752891 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13366 (secure 0 0 0) 0x7f75ac0be450 con 0x7f759806f430 2024-04-25T13:43:34.923 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:34.923 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-04-25T13:43:34.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.918+0000 7f75bf000640 1 -- 172.21.15.123:0/3597382905 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f759806f430 msgr2=0x7f7598071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:34.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.918+0000 7f75bf000640 1 --2- 172.21.15.123:0/3597382905 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f759806f430 0x7f7598071940 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0ad000 tx=0x7f75ac008040 comp rx=0 tx=0).stop 2024-04-25T13:43:34.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.918+0000 7f75bf000640 1 -- 172.21.15.123:0/3597382905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75b806e800 msgr2=0x7f75b8071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:34.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.918+0000 7f75bf000640 1 --2- 172.21.15.123:0/3597382905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75b806e800 0x7f75b8071490 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f75b0009cb0 tx=0x7f75b000c490 comp rx=0 tx=0).stop 2024-04-25T13:43:34.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.918+0000 7f75bf000640 1 -- 172.21.15.123:0/3597382905 shutdown_connections 2024-04-25T13:43:34.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.918+0000 7f75bf000640 1 --2- 172.21.15.123:0/3597382905 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f759806f430 0x7f7598071940 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:34.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.918+0000 7f75bf000640 1 --2- 172.21.15.123:0/3597382905 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f75b806e800 0x7f75b8071490 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:34.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.918+0000 7f75bf000640 1 --2- 172.21.15.123:0/3597382905 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75b806e3f0 0x7f75b814fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:34.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.918+0000 7f75bf000640 1 --2- 172.21.15.123:0/3597382905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75b806dcb0 0x7f75b815fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:34.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.918+0000 7f75bf000640 1 -- 172.21.15.123:0/3597382905 >> 172.21.15.123:0/3597382905 conn(0x7f75b80d00c0 msgr2=0x7f75b80d04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:34.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.922+0000 7f75bf000640 1 -- 172.21.15.123:0/3597382905 shutdown_connections 2024-04-25T13:43:34.927 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:34.922+0000 7f75bf000640 1 -- 172.21.15.123:0/3597382905 wait complete. 2024-04-25T13:43:34.945 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2024-04-25T13:43:33.594463+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220416,"kb_used_data":4288,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754304,"statfs":{"total":773094113280,"available":772868407296,"internally_reserved":0,"allocated":4390912,"data_stored":2449706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-26486,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-17,"num_read_kb":-13,"num_write":-114,"num_write_kb":-66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000864"},"pg_stats":[{"pgid":"1.0","version":"17'72","reported_seq":135,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047968+0000","last_change":"2024-04-25T13:41:56.890628+0000","last_active":"2024-04-25T13:43:03.047968+0000","last_peered":"2024-04-25T13:43:03.047968+0000","last_clean":"2024-04-25T13:43:03.047968+0000","last_became_active":"2024-04-25T13:41:56.889261+0000","last_became_peered":"2024-04-25T13:41:56.889261+0000","last_unstale":"2024-04-25T13:43:03.047968+0000","last_undegraded":"2024-04-25T13:43:03.047968+0000","last_fullsized":"2024-04-25T13:43:03.047968+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:53.940471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:53.940471+0000","last_clean_scrub_stamp":"2024-04-25T13:41:53.940471+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:06.164380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":983040,"data_stored":742123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":393216,"data_stored":152281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":397312,"data_stored":152539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":397312,"data_stored":151971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":425984,"data_stored":178512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":389120,"data_stored":151735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":425984,"data_stored":178512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":978944,"data_stored":742033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:43:34.945 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T13:43:34.945 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:43:35.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.086+0000 7f59e4a00640 1 Processor -- start 2024-04-25T13:43:35.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.086+0000 7f59e4a00640 1 -- start start 2024-04-25T13:43:35.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.090+0000 7f59e4a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59e01474f0 0x7f59e015eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:35.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.090+0000 7f59e4a00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f59e00cd8e0 0x7f59e00cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:35.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.090+0000 7f59e4a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59e015f0d0 con 0x7f59e00b6970 2024-04-25T13:43:35.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.090+0000 7f59e4a00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f59e00d0d10 con 0x7f59e00cd8e0 2024-04-25T13:43:35.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.090+0000 7f59e4a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f59e0073400 con 0x7f59e01474f0 2024-04-25T13:43:35.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.090+0000 7f59de800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f59e00cd8e0 0x7f59e00cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:35.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.090+0000 7f59d5400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f59e00b6970 0x7f59e00b6d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58238/0 (socket says 172.21.15.123:58238) 2024-04-25T13:43:35.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.090+0000 7f59de800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f59e00cd8e0 0x7f59e00cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43868/0 (socket says 172.21.15.123:43868) 2024-04-25T13:43:35.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.090+0000 7f59d5400640 1 -- 172.21.15.123:0/19817258 learned_addr learned my addr 172.21.15.123:0/19817258 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:35.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.090+0000 7f59dde00640 1 --2- 172.21.15.123:0/19817258 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59e01474f0 0x7f59e015eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:35.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.090+0000 7f59de800640 1 -- 172.21.15.123:0/19817258 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59e01474f0 msgr2=0x7f59e015eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:35.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.090+0000 7f59de800640 1 --2- 172.21.15.123:0/19817258 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59e01474f0 0x7f59e015eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:35.095 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.090+0000 7f59de800640 1 -- 172.21.15.123:0/19817258 >> v1:172.21.15.123:6789/0 conn(0x7f59e00b6970 legacy=0x7f59e00b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:35.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.090+0000 7f59de800640 1 -- 172.21.15.123:0/19817258 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e00736e0 con 0x7f59e00cd8e0 2024-04-25T13:43:35.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.094+0000 7f59de800640 1 --2- 172.21.15.123:0/19817258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59e00cd8e0 0x7f59e00cdcf0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f59d8009d90 tx=0x7f59d801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a57ea7d1a6a6aa4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:35.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.094+0000 7f59dd400640 1 -- 172.21.15.123:0/19817258 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d80b2070 con 0x7f59e00cd8e0 2024-04-25T13:43:35.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.094+0000 7f59dd400640 1 -- 172.21.15.123:0/19817258 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d80a59a0 con 0x7f59e00cd8e0 2024-04-25T13:43:35.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.094+0000 7f59dd400640 1 -- 172.21.15.123:0/19817258 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d80a5d70 con 0x7f59e00cd8e0 2024-04-25T13:43:35.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.094+0000 7f59e4a00640 1 -- 172.21.15.123:0/19817258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59e00cd8e0 msgr2=0x7f59e00cdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:35.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.094+0000 7f59e4a00640 1 --2- 172.21.15.123:0/19817258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59e00cd8e0 0x7f59e00cdcf0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f59d8009d90 tx=0x7f59d801c8e0 comp rx=0 tx=0).stop 2024-04-25T13:43:35.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.094+0000 7f59e4a00640 1 -- 172.21.15.123:0/19817258 shutdown_connections 2024-04-25T13:43:35.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.094+0000 7f59e4a00640 1 --2- 172.21.15.123:0/19817258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59e00cd8e0 0x7f59e00cdcf0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:35.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.094+0000 7f59e4a00640 1 --2- 172.21.15.123:0/19817258 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59e01474f0 0x7f59e015eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:35.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.094+0000 7f59e4a00640 1 -- 172.21.15.123:0/19817258 >> 172.21.15.123:0/19817258 conn(0x7f59e006d210 msgr2=0x7f59e006ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:35.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.094+0000 7f59e4a00640 1 -- 172.21.15.123:0/19817258 shutdown_connections 2024-04-25T13:43:35.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.094+0000 7f59e4a00640 1 -- 172.21.15.123:0/19817258 wait complete. 2024-04-25T13:43:35.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.094+0000 7f59e4a00640 1 Processor -- start 2024-04-25T13:43:35.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.094+0000 7f59e4a00640 1 -- start start 2024-04-25T13:43:35.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.098+0000 7f59e4a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59e00b6970 0x7f59e0140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:35.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.098+0000 7f59e4a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f59e00cd8e0 0x7f59e013f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:35.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.098+0000 7f59e4a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59e01474f0 0x7f59e013fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:35.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.098+0000 7f59e4a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f59e016a750 con 0x7f59e01474f0 2024-04-25T13:43:35.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.098+0000 7f59e4a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f59e00744a0 con 0x7f59e00cd8e0 2024-04-25T13:43:35.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.098+0000 7f59e4a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f59e016a8d0 con 0x7f59e00b6970 2024-04-25T13:43:35.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.098+0000 7f59de800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59e01474f0 0x7f59e013fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:35.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.098+0000 7f59de800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59e01474f0 0x7f59e013fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43884/0 (socket says 172.21.15.123:43884) 2024-04-25T13:43:35.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.098+0000 7f59de800640 1 -- 172.21.15.123:0/3947258533 learned_addr learned my addr 172.21.15.123:0/3947258533 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:35.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.098+0000 7f59d5400640 1 --2- 172.21.15.123:0/3947258533 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f59e00cd8e0 0x7f59e013f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:35.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.098+0000 7f59dde00640 1 --2- 172.21.15.123:0/3947258533 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59e00b6970 0x7f59e0140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:35.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.098+0000 7f59de800640 1 -- 172.21.15.123:0/3947258533 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59e00b6970 msgr2=0x7f59e0140ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:35.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.098+0000 7f59de800640 1 --2- 172.21.15.123:0/3947258533 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59e00b6970 0x7f59e0140ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:35.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.098+0000 7f59de800640 1 -- 172.21.15.123:0/3947258533 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f59e00cd8e0 msgr2=0x7f59e013f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:35.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.098+0000 7f59de800640 1 --2- 172.21.15.123:0/3947258533 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f59e00cd8e0 0x7f59e013f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:35.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.098+0000 7f59de800640 1 -- 172.21.15.123:0/3947258533 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e00b4560 con 0x7f59e01474f0 2024-04-25T13:43:35.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.098+0000 7f59de800640 1 --2- 172.21.15.123:0/3947258533 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59e01474f0 0x7f59e013fd40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f59d8009d90 tx=0x7f59d80196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:35.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.098+0000 7f59d6a00640 1 -- 172.21.15.123:0/3947258533 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d80b2050 con 0x7f59e01474f0 2024-04-25T13:43:35.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.098+0000 7f59d6a00640 1 -- 172.21.15.123:0/3947258533 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d80be070 con 0x7f59e01474f0 2024-04-25T13:43:35.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.098+0000 7f59d6a00640 1 -- 172.21.15.123:0/3947258533 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d80ada70 con 0x7f59e01474f0 2024-04-25T13:43:35.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.098+0000 7f59e4a00640 1 -- 172.21.15.123:0/3947258533 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59e01419a0 con 0x7f59e01474f0 2024-04-25T13:43:35.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.098+0000 7f59e4a00640 1 -- 172.21.15.123:0/3947258533 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59e00b4ae0 con 0x7f59e01474f0 2024-04-25T13:43:35.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.098+0000 7f59e4a00640 1 -- 172.21.15.123:0/3947258533 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59e0141710 con 0x7f59e01474f0 2024-04-25T13:43:35.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.102+0000 7f59d6a00640 1 -- 172.21.15.123:0/3947258533 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f59d80adc10 con 0x7f59e01474f0 2024-04-25T13:43:35.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.102+0000 7f59d6a00640 1 --2- 172.21.15.123:0/3947258533 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f59bc06f430 0x7f59bc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:35.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.102+0000 7f59d6a00640 1 -- 172.21.15.123:0/3947258533 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f59d812ac00 con 0x7f59e01474f0 2024-04-25T13:43:35.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.102+0000 7f59dde00640 1 --2- 172.21.15.123:0/3947258533 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f59bc06f430 0x7f59bc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:35.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.102+0000 7f59dde00640 1 --2- 172.21.15.123:0/3947258533 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f59bc06f430 0x7f59bc071940 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f59d00079c0 tx=0x7f59d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:35.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.106+0000 7f59d6a00640 1 -- 172.21.15.123:0/3947258533 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f59d8016560 con 0x7f59e01474f0 2024-04-25T13:43:35.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.258+0000 7f59e4a00640 1 -- 172.21.15.123:0/3947258533 --> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f59e0145830 con 0x7f59bc06f430 2024-04-25T13:43:35.262 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.258+0000 7f59d6a00640 1 -- 172.21.15.123:0/3947258533 <== mgr.4107 v2:172.21.15.123:6832/715752891 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13366 (secure 0 0 0) 0x7f59e0145830 con 0x7f59bc06f430 2024-04-25T13:43:35.263 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:35.263 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-04-25T13:43:35.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.258+0000 7f59e4a00640 1 -- 172.21.15.123:0/3947258533 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f59bc06f430 msgr2=0x7f59bc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:35.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.258+0000 7f59e4a00640 1 --2- 172.21.15.123:0/3947258533 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f59bc06f430 0x7f59bc071940 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f59d00079c0 tx=0x7f59d0008040 comp rx=0 tx=0).stop 2024-04-25T13:43:35.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.258+0000 7f59e4a00640 1 -- 172.21.15.123:0/3947258533 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59e01474f0 msgr2=0x7f59e013fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:35.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.258+0000 7f59e4a00640 1 --2- 172.21.15.123:0/3947258533 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59e01474f0 0x7f59e013fd40 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f59d8009d90 tx=0x7f59d80196e0 comp rx=0 tx=0).stop 2024-04-25T13:43:35.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.258+0000 7f59e4a00640 1 -- 172.21.15.123:0/3947258533 shutdown_connections 2024-04-25T13:43:35.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.258+0000 7f59e4a00640 1 --2- 172.21.15.123:0/3947258533 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f59e00cd8e0 0x7f59e013f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:35.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.258+0000 7f59e4a00640 1 --2- 172.21.15.123:0/3947258533 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f59bc06f430 0x7f59bc071940 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:35.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.258+0000 7f59e4a00640 1 --2- 172.21.15.123:0/3947258533 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59e01474f0 0x7f59e013fd40 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:35.265 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.258+0000 7f59e4a00640 1 --2- 172.21.15.123:0/3947258533 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59e00b6970 0x7f59e0140ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:35.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.258+0000 7f59e4a00640 1 -- 172.21.15.123:0/3947258533 >> 172.21.15.123:0/3947258533 conn(0x7f59e006d210 msgr2=0x7f59e0145120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:35.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.258+0000 7f59e4a00640 1 -- 172.21.15.123:0/3947258533 shutdown_connections 2024-04-25T13:43:35.266 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.258+0000 7f59e4a00640 1 -- 172.21.15.123:0/3947258533 wait complete. 2024-04-25T13:43:35.284 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2024-04-25T13:43:33.594463+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220416,"kb_used_data":4288,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754304,"statfs":{"total":773094113280,"available":772868407296,"internally_reserved":0,"allocated":4390912,"data_stored":2449706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-26486,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":-17,"num_read_kb":-13,"num_write":-114,"num_write_kb":-66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000864"},"pg_stats":[{"pgid":"1.0","version":"17'72","reported_seq":135,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-25T13:43:03.047968+0000","last_change":"2024-04-25T13:41:56.890628+0000","last_active":"2024-04-25T13:43:03.047968+0000","last_peered":"2024-04-25T13:43:03.047968+0000","last_clean":"2024-04-25T13:43:03.047968+0000","last_became_active":"2024-04-25T13:41:56.889261+0000","last_became_peered":"2024-04-25T13:41:56.889261+0000","last_unstale":"2024-04-25T13:43:03.047968+0000","last_undegraded":"2024-04-25T13:43:03.047968+0000","last_fullsized":"2024-04-25T13:43:03.047968+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:53.940471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:53.940471+0000","last_clean_scrub_stamp":"2024-04-25T13:41:53.940471+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:06.164380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":983040,"data_stored":742123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":393216,"data_stored":152281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":397312,"data_stored":152539,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":397312,"data_stored":151971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":425984,"data_stored":178512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":389120,"data_stored":151735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":425984,"data_stored":178512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":978944,"data_stored":742033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:43:35.285 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T13:43:35.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.426+0000 7fd368c00640 1 Processor -- start 2024-04-25T13:43:35.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.426+0000 7fd368c00640 1 -- start start 2024-04-25T13:43:35.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.426+0000 7fd368c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3640b6970 0x7fd3640b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:35.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.426+0000 7fd368c00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd3640cd8e0 0x7fd3640cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:35.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.426+0000 7fd368c00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3640b72c0 con 0x7fd3641474f0 2024-04-25T13:43:35.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.426+0000 7fd368c00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fd3640d0d10 con 0x7fd3640cd8e0 2024-04-25T13:43:35.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.426+0000 7fd368c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fd364073400 con 0x7fd3640b6970 2024-04-25T13:43:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.430+0000 7fd361400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3640b6970 0x7fd3640b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.430+0000 7fd362800640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd3640cd8e0 0x7fd3640cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.430+0000 7fd361400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3640b6970 0x7fd3640b6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:58972/0 (socket says 172.21.15.123:58972) 2024-04-25T13:43:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.430+0000 7fd362800640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd3640cd8e0 0x7fd3640cdcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:58028/0 (socket says 172.21.15.123:58028) 2024-04-25T13:43:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.430+0000 7fd361400640 1 -- 172.21.15.123:0/2888969405 learned_addr learned my addr 172.21.15.123:0/2888969405 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.430+0000 7fd361e00640 1 --1- 172.21.15.123:0/2888969405 >> v1:172.21.15.130:6789/0 conn(0x7fd3641474f0 0x7fd36415eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.123:44890/0 (socket says 172.21.15.123:44890) 2024-04-25T13:43:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.430+0000 7fd361400640 1 -- 172.21.15.123:0/2888969405 >> v2:172.21.15.130:3300/0 conn(0x7fd3640cd8e0 msgr2=0x7fd3640cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.430+0000 7fd361400640 1 --2- 172.21.15.123:0/2888969405 >> v2:172.21.15.130:3300/0 conn(0x7fd3640cd8e0 0x7fd3640cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.430+0000 7fd361400640 1 -- 172.21.15.123:0/2888969405 >> v1:172.21.15.130:6789/0 conn(0x7fd3641474f0 legacy=0x7fd36415eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.430+0000 7fd361400640 1 -- 172.21.15.123:0/2888969405 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3640736e0 con 0x7fd3640b6970 2024-04-25T13:43:35.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.430+0000 7fd360a00640 1 -- 172.21.15.123:0/2888969405 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3382189026 0 0) 0x7fd354001120 con 0x7fd3641474f0 2024-04-25T13:43:35.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.430+0000 7fd361400640 1 --2- 172.21.15.123:0/2888969405 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3640b6970 0x7fd3640b6d80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd350009870 tx=0x7fd35001c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46616a6c319f5602 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:35.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.430+0000 7fd360a00640 1 -- 172.21.15.123:0/2888969405 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3500aa430 con 0x7fd3640b6970 2024-04-25T13:43:35.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.430+0000 7fd360a00640 1 -- 172.21.15.123:0/2888969405 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3500af070 con 0x7fd3640b6970 2024-04-25T13:43:35.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.430+0000 7fd360a00640 1 -- 172.21.15.123:0/2888969405 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3500aa7f0 con 0x7fd3640b6970 2024-04-25T13:43:35.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.434+0000 7fd368c00640 1 -- 172.21.15.123:0/2888969405 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3640b6970 msgr2=0x7fd3640b6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:35.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.434+0000 7fd368c00640 1 --2- 172.21.15.123:0/2888969405 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3640b6970 0x7fd3640b6d80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd350009870 tx=0x7fd35001c4d0 comp rx=0 tx=0).stop 2024-04-25T13:43:35.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.434+0000 7fd368c00640 1 -- 172.21.15.123:0/2888969405 shutdown_connections 2024-04-25T13:43:35.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.434+0000 7fd368c00640 1 --2- 172.21.15.123:0/2888969405 >> v2:172.21.15.130:3300/0 conn(0x7fd3640cd8e0 0x7fd3640cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:35.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.434+0000 7fd368c00640 1 --2- 172.21.15.123:0/2888969405 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3640b6970 0x7fd3640b6d80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:35.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.434+0000 7fd368c00640 1 -- 172.21.15.123:0/2888969405 >> 172.21.15.123:0/2888969405 conn(0x7fd36406d210 msgr2=0x7fd36406ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:35.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.434+0000 7fd368c00640 1 -- 172.21.15.123:0/2888969405 shutdown_connections 2024-04-25T13:43:35.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.434+0000 7fd368c00640 1 -- 172.21.15.123:0/2888969405 wait complete. 2024-04-25T13:43:35.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.434+0000 7fd368c00640 1 Processor -- start 2024-04-25T13:43:35.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.434+0000 7fd368c00640 1 -- start start 2024-04-25T13:43:35.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.438+0000 7fd368c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3640b6970 0x7fd36415b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:35.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.438+0000 7fd368c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3640cd8e0 0x7fd3640b4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:35.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.438+0000 7fd368c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd3641474f0 0x7fd3640b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:35.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.438+0000 7fd368c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fd36416a750 con 0x7fd3640cd8e0 2024-04-25T13:43:35.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.438+0000 7fd368c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd3640744a0 con 0x7fd3641474f0 2024-04-25T13:43:35.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.438+0000 7fd368c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fd36416a8d0 con 0x7fd3640b6970 2024-04-25T13:43:35.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.438+0000 7fd361400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3640cd8e0 0x7fd3640b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:35.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.438+0000 7fd361400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3640cd8e0 0x7fd3640b4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43892/0 (socket says 172.21.15.123:43892) 2024-04-25T13:43:35.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.438+0000 7fd361400640 1 -- 172.21.15.123:0/883446712 learned_addr learned my addr 172.21.15.123:0/883446712 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:35.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.438+0000 7fd361e00640 1 --2- 172.21.15.123:0/883446712 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3640b6970 0x7fd36415b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:35.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.438+0000 7fd362800640 1 --2- 172.21.15.123:0/883446712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd3641474f0 0x7fd3640b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:35.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.438+0000 7fd361400640 1 -- 172.21.15.123:0/883446712 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3640b6970 msgr2=0x7fd36415b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:35.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.438+0000 7fd361400640 1 --2- 172.21.15.123:0/883446712 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3640b6970 0x7fd36415b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:35.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.438+0000 7fd361400640 1 -- 172.21.15.123:0/883446712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd3641474f0 msgr2=0x7fd3640b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:35.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.438+0000 7fd361400640 1 --2- 172.21.15.123:0/883446712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd3641474f0 0x7fd3640b4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:35.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.438+0000 7fd361400640 1 -- 172.21.15.123:0/883446712 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3640b2ef0 con 0x7fd3640cd8e0 2024-04-25T13:43:35.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.438+0000 7fd361400640 1 --2- 172.21.15.123:0/883446712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3640cd8e0 0x7fd3640b4760 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd35001a160 tx=0x7fd35001ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:35.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.438+0000 7fd35a000640 1 -- 172.21.15.123:0/883446712 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3500bd5f0 con 0x7fd3640cd8e0 2024-04-25T13:43:35.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.438+0000 7fd35a000640 1 -- 172.21.15.123:0/883446712 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3500bd790 con 0x7fd3640cd8e0 2024-04-25T13:43:35.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.438+0000 7fd35a000640 1 -- 172.21.15.123:0/883446712 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3500bdb80 con 0x7fd3640cd8e0 2024-04-25T13:43:35.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.438+0000 7fd368c00640 1 -- 172.21.15.123:0/883446712 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3640b2130 con 0x7fd3640cd8e0 2024-04-25T13:43:35.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.438+0000 7fd368c00640 1 -- 172.21.15.123:0/883446712 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3640b26f0 con 0x7fd3640cd8e0 2024-04-25T13:43:35.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.438+0000 7fd368c00640 1 -- 172.21.15.123:0/883446712 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3640507c0 con 0x7fd3640cd8e0 2024-04-25T13:43:35.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.442+0000 7fd35a000640 1 -- 172.21.15.123:0/883446712 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd3500b33f0 con 0x7fd3640cd8e0 2024-04-25T13:43:35.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.442+0000 7fd35a000640 1 --2- 172.21.15.123:0/883446712 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd34406f430 0x7fd344071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:35.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.442+0000 7fd35a000640 1 -- 172.21.15.123:0/883446712 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fd350129620 con 0x7fd3640cd8e0 2024-04-25T13:43:35.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.442+0000 7fd361e00640 1 --2- 172.21.15.123:0/883446712 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd34406f430 0x7fd344071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:35.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.442+0000 7fd361e00640 1 --2- 172.21.15.123:0/883446712 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd34406f430 0x7fd344071940 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd354000f70 tx=0x7fd354007c10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:35.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.446+0000 7fd35a000640 1 -- 172.21.15.123:0/883446712 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd350016150 con 0x7fd3640cd8e0 2024-04-25T13:43:35.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.606+0000 7fd368c00640 1 -- 172.21.15.123:0/883446712 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd36415b970 con 0x7fd3640cd8e0 2024-04-25T13:43:35.612 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.606+0000 7fd35a000640 1 -- 172.21.15.123:0/883446712 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+13044 (secure 0 0 0) 0x7fd3500f6120 con 0x7fd3640cd8e0 2024-04-25T13:43:35.613 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:35.613 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":37,"fsid":"95274ccf-6ec8-480a-933e-b3986da91a7e","created":"2024-04-25T13:41:40.510269+0000","modified":"2024-04-25T13:43:32.301097+0000","last_up_change":"2024-04-25T13:41:52.937510+0000","last_in_change":"2024-04-25T13:41:43.121218+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T13:41:53.602480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4406d5d-054f-41e8-b66f-76fdbb8e3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6809","nonce":2208828636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6811","nonce":2208828636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6815","nonce":2208828636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":2208828636},{"type":"v1","addr":"172.21.15.123:6813","nonce":2208828636}]},"public_addr":"172.21.15.123:6809/2208828636","cluster_addr":"172.21.15.123:6811/2208828636","heartbeat_back_addr":"172.21.15.123:6815/2208828636","heartbeat_front_addr":"172.21.15.123:6813/2208828636","state":["exists","up"]},{"osd":1,"uuid":"dbc93b1f-fd04-49c6-9c4d-1834d2b64b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6801","nonce":477459895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6803","nonce":477459895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6807","nonce":477459895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":477459895},{"type":"v1","addr":"172.21.15.123:6805","nonce":477459895}]},"public_addr":"172.21.15.123:6801/477459895","cluster_addr":"172.21.15.123:6803/477459895","heartbeat_back_addr":"172.21.15.123:6807/477459895","heartbeat_front_addr":"172.21.15.123:6805/477459895","state":["exists","up"]},{"osd":2,"uuid":"3115b481-a0c8-4c65-a010-56a30eb0c9b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6825","nonce":1411373789}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6827","nonce":1411373789}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6831","nonce":1411373789}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":1411373789},{"type":"v1","addr":"172.21.15.123:6829","nonce":1411373789}]},"public_addr":"172.21.15.123:6825/1411373789","cluster_addr":"172.21.15.123:6827/1411373789","heartbeat_back_addr":"172.21.15.123:6831/1411373789","heartbeat_front_addr":"172.21.15.123:6829/1411373789","state":["exists","up"]},{"osd":3,"uuid":"f55746b8-e797-4bbf-afa5-9a160ab4678c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6817","nonce":898268961}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6819","nonce":898268961}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6823","nonce":898268961}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":898268961},{"type":"v1","addr":"172.21.15.123:6821","nonce":898268961}]},"public_addr":"172.21.15.123:6817/898268961","cluster_addr":"172.21.15.123:6819/898268961","heartbeat_back_addr":"172.21.15.123:6823/898268961","heartbeat_front_addr":"172.21.15.123:6821/898268961","state":["exists","up"]},{"osd":4,"uuid":"634fe1b1-3507-437a-a936-4eeee37d72b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6821","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6823","nonce":1535108655}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6825","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6827","nonce":1535108655}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6831","nonce":1535108655}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":1535108655},{"type":"v1","addr":"172.21.15.130:6829","nonce":1535108655}]},"public_addr":"172.21.15.130:6823/1535108655","cluster_addr":"172.21.15.130:6827/1535108655","heartbeat_back_addr":"172.21.15.130:6831/1535108655","heartbeat_front_addr":"172.21.15.130:6829/1535108655","state":["exists","up"]},{"osd":5,"uuid":"6155b831-3bd9-4215-8cf0-8984cb006819","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6802","nonce":2763000783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6806","nonce":2763000783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6811","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6813","nonce":2763000783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":2763000783},{"type":"v1","addr":"172.21.15.130:6809","nonce":2763000783}]},"public_addr":"172.21.15.130:6802/2763000783","cluster_addr":"172.21.15.130:6806/2763000783","heartbeat_back_addr":"172.21.15.130:6813/2763000783","heartbeat_front_addr":"172.21.15.130:6809/2763000783","state":["exists","up"]},{"osd":6,"uuid":"080c6ed4-1240-4af2-8628-ba91344bc1c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6801","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6803","nonce":3650490477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6805","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6807","nonce":3650490477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6815","nonce":3650490477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3650490477},{"type":"v1","addr":"172.21.15.130:6812","nonce":3650490477}]},"public_addr":"172.21.15.130:6803/3650490477","cluster_addr":"172.21.15.130:6807/3650490477","heartbeat_back_addr":"172.21.15.130:6815/3650490477","heartbeat_front_addr":"172.21.15.130:6812/3650490477","state":["exists","up"]},{"osd":7,"uuid":"34f0d920-69ff-49f0-8124-590397369d4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6817","nonce":940897425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6819","nonce":940897425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6826","nonce":940897425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":940897425},{"type":"v1","addr":"172.21.15.130:6822","nonce":940897425}]},"public_addr":"172.21.15.130:6817/940897425","cluster_addr":"172.21.15.130:6819/940897425","heartbeat_back_addr":"172.21.15.130:6826/940897425","heartbeat_front_addr":"172.21.15.130:6822/940897425","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.748992+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.692096+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.789743+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.938957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.208419+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.114003+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:48.824634+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T13:41:49.001284+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:6836/499623122":"2024-04-26T13:43:29.289195+0000","172.21.15.123:6834/499623122":"2024-04-26T13:43:29.289195+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T13:43:35.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.610+0000 7fd368c00640 1 -- 172.21.15.123:0/883446712 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd34406f430 msgr2=0x7fd344071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:35.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.610+0000 7fd368c00640 1 --2- 172.21.15.123:0/883446712 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd34406f430 0x7fd344071940 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd354000f70 tx=0x7fd354007c10 comp rx=0 tx=0).stop 2024-04-25T13:43:35.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.610+0000 7fd368c00640 1 -- 172.21.15.123:0/883446712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3640cd8e0 msgr2=0x7fd3640b4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:35.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.610+0000 7fd368c00640 1 --2- 172.21.15.123:0/883446712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3640cd8e0 0x7fd3640b4760 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd35001a160 tx=0x7fd35001ad70 comp rx=0 tx=0).stop 2024-04-25T13:43:35.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.610+0000 7fd368c00640 1 -- 172.21.15.123:0/883446712 shutdown_connections 2024-04-25T13:43:35.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.610+0000 7fd368c00640 1 --2- 172.21.15.123:0/883446712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd3641474f0 0x7fd3640b4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:35.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.610+0000 7fd368c00640 1 --2- 172.21.15.123:0/883446712 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fd34406f430 0x7fd344071940 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:35.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.610+0000 7fd368c00640 1 --2- 172.21.15.123:0/883446712 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3640cd8e0 0x7fd3640b4760 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:35.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.610+0000 7fd368c00640 1 --2- 172.21.15.123:0/883446712 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3640b6970 0x7fd36415b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:35.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.610+0000 7fd368c00640 1 -- 172.21.15.123:0/883446712 >> 172.21.15.123:0/883446712 conn(0x7fd36406d210 msgr2=0x7fd3641415f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:35.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.610+0000 7fd368c00640 1 -- 172.21.15.123:0/883446712 shutdown_connections 2024-04-25T13:43:35.616 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:35.610+0000 7fd368c00640 1 -- 172.21.15.123:0/883446712 wait complete. 2024-04-25T13:43:36.635 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T13:43:36.636 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:43:36.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.790+0000 7ffa19400640 1 Processor -- start 2024-04-25T13:43:36.797 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.794+0000 7ffa19400640 1 -- start start 2024-04-25T13:43:36.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.794+0000 7ffa19400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa140b0be0 0x7ffa140d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:36.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.794+0000 7ffa19400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffa1406ef10 0x7ffa1406f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:36.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.794+0000 7ffa19400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa14073670 con 0x7ffa140cdfc0 2024-04-25T13:43:36.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.794+0000 7ffa19400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ffa14072b80 con 0x7ffa1406ef10 2024-04-25T13:43:36.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.794+0000 7ffa19400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ffa140b0ff0 con 0x7ffa140b0be0 2024-04-25T13:43:36.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.794+0000 7ffa13200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffa1406ef10 0x7ffa1406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:36.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.794+0000 7ffa13200640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ffa1406ef10 0x7ffa1406f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43908/0 (socket says 172.21.15.123:43908) 2024-04-25T13:43:36.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.794+0000 7ffa13200640 1 -- 172.21.15.123:0/685794977 learned_addr learned my addr 172.21.15.123:0/685794977 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:36.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.794+0000 7ffa12800640 1 --2- 172.21.15.123:0/685794977 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa140b0be0 0x7ffa140d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:36.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.794+0000 7ffa13200640 1 -- 172.21.15.123:0/685794977 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa140b0be0 msgr2=0x7ffa140d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:36.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.794+0000 7ffa13200640 1 --2- 172.21.15.123:0/685794977 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa140b0be0 0x7ffa140d0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:36.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.794+0000 7ffa13200640 1 -- 172.21.15.123:0/685794977 >> v1:172.21.15.130:6789/0 conn(0x7ffa140cdfc0 legacy=0x7ffa140ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:36.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.794+0000 7ffa13200640 1 -- 172.21.15.123:0/685794977 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa14072dd0 con 0x7ffa1406ef10 2024-04-25T13:43:36.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.798+0000 7ffa13200640 1 --2- 172.21.15.123:0/685794977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1406ef10 0x7ffa1406f320 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c009870 tx=0x7ffa0c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d770865edb4ce1f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:36.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.798+0000 7ffa11e00640 1 -- 172.21.15.123:0/685794977 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c0aa600 con 0x7ffa1406ef10 2024-04-25T13:43:36.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.798+0000 7ffa11e00640 1 -- 172.21.15.123:0/685794977 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa0c0af070 con 0x7ffa1406ef10 2024-04-25T13:43:36.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.798+0000 7ffa11e00640 1 -- 172.21.15.123:0/685794977 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c0aa9c0 con 0x7ffa1406ef10 2024-04-25T13:43:36.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.798+0000 7ffa19400640 1 -- 172.21.15.123:0/685794977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1406ef10 msgr2=0x7ffa1406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:36.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.798+0000 7ffa19400640 1 --2- 172.21.15.123:0/685794977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1406ef10 0x7ffa1406f320 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c009870 tx=0x7ffa0c01c4a0 comp rx=0 tx=0).stop 2024-04-25T13:43:36.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.798+0000 7ffa19400640 1 -- 172.21.15.123:0/685794977 shutdown_connections 2024-04-25T13:43:36.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.798+0000 7ffa19400640 1 --2- 172.21.15.123:0/685794977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1406ef10 0x7ffa1406f320 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:36.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.798+0000 7ffa19400640 1 --2- 172.21.15.123:0/685794977 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa140b0be0 0x7ffa140d0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:36.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.798+0000 7ffa19400640 1 -- 172.21.15.123:0/685794977 >> 172.21.15.123:0/685794977 conn(0x7ffa140b38a0 msgr2=0x7ffa140d15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:36.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.798+0000 7ffa19400640 1 -- 172.21.15.123:0/685794977 shutdown_connections 2024-04-25T13:43:36.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.798+0000 7ffa19400640 1 -- 172.21.15.123:0/685794977 wait complete. 2024-04-25T13:43:36.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.802+0000 7ffa19400640 1 Processor -- start 2024-04-25T13:43:36.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.802+0000 7ffa19400640 1 -- start start 2024-04-25T13:43:36.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.802+0000 7ffa19400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1406ef10 0x7ffa141430f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:36.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.802+0000 7ffa19400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa140b0be0 0x7ffa1415d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:36.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.802+0000 7ffa19400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa140cdfc0 0x7ffa141604a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:36.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.802+0000 7ffa19400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1416aab0 con 0x7ffa1406ef10 2024-04-25T13:43:36.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.802+0000 7ffa19400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ffa140d12c0 con 0x7ffa140cdfc0 2024-04-25T13:43:36.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.802+0000 7ffa19400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ffa1416ac30 con 0x7ffa140b0be0 2024-04-25T13:43:36.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.802+0000 7ffa12800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1406ef10 0x7ffa141430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:36.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.802+0000 7ffa12800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1406ef10 0x7ffa141430f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43922/0 (socket says 172.21.15.123:43922) 2024-04-25T13:43:36.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.802+0000 7ffa12800640 1 -- 172.21.15.123:0/2098834321 learned_addr learned my addr 172.21.15.123:0/2098834321 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:36.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.802+0000 7ffa13200640 1 --2- 172.21.15.123:0/2098834321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa140cdfc0 0x7ffa141604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:36.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.802+0000 7ffa09e00640 1 --2- 172.21.15.123:0/2098834321 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa140b0be0 0x7ffa1415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:36.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.802+0000 7ffa12800640 1 -- 172.21.15.123:0/2098834321 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa140b0be0 msgr2=0x7ffa1415d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:36.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.802+0000 7ffa12800640 1 --2- 172.21.15.123:0/2098834321 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffa140b0be0 0x7ffa1415d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:36.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.802+0000 7ffa12800640 1 -- 172.21.15.123:0/2098834321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa140cdfc0 msgr2=0x7ffa141604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:36.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.802+0000 7ffa12800640 1 --2- 172.21.15.123:0/2098834321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffa140cdfc0 0x7ffa141604a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:36.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.802+0000 7ffa12800640 1 -- 172.21.15.123:0/2098834321 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa14141e80 con 0x7ffa1406ef10 2024-04-25T13:43:36.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.802+0000 7ffa12800640 1 --2- 172.21.15.123:0/2098834321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1406ef10 0x7ffa141430f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ffa04007e90 tx=0x7ffa0400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:36.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.806+0000 7ffa0b400640 1 -- 172.21.15.123:0/2098834321 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0401a070 con 0x7ffa1406ef10 2024-04-25T13:43:36.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.806+0000 7ffa0b400640 1 -- 172.21.15.123:0/2098834321 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa04003ba0 con 0x7ffa1406ef10 2024-04-25T13:43:36.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.806+0000 7ffa0b400640 1 -- 172.21.15.123:0/2098834321 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0400ee70 con 0x7ffa1406ef10 2024-04-25T13:43:36.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.806+0000 7ffa19400640 1 -- 172.21.15.123:0/2098834321 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa1415f9c0 con 0x7ffa1406ef10 2024-04-25T13:43:36.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.806+0000 7ffa19400640 1 -- 172.21.15.123:0/2098834321 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa1415ff80 con 0x7ffa1406ef10 2024-04-25T13:43:36.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.806+0000 7ffa19400640 1 -- 172.21.15.123:0/2098834321 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffa14076de0 con 0x7ffa1406ef10 2024-04-25T13:43:36.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.806+0000 7ffa0b400640 1 -- 172.21.15.123:0/2098834321 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ffa0401d070 con 0x7ffa1406ef10 2024-04-25T13:43:36.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.806+0000 7ffa0b400640 1 --2- 172.21.15.123:0/2098834321 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff9f006f400 0x7ff9f0071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:36.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.806+0000 7ffa0b400640 1 -- 172.21.15.123:0/2098834321 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7ffa0408fc80 con 0x7ffa1406ef10 2024-04-25T13:43:36.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.806+0000 7ffa0b400640 1 --2- 172.21.15.123:0/2098834321 >> [v2:172.21.15.123:6808/2208828636,v1:172.21.15.123:6809/2208828636] conn(0x7ff9f0075310 0x7ff9f0077760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:36.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.806+0000 7ffa0b400640 1 -- 172.21.15.123:0/2098834321 --> [v2:172.21.15.123:6808/2208828636,v1:172.21.15.123:6809/2208828636] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9f0077e30 con 0x7ff9f0075310 2024-04-25T13:43:36.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.806+0000 7ffa0b400640 1 -- 172.21.15.123:0/2098834321 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ffa04090030 con 0x7ffa1406ef10 2024-04-25T13:43:36.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.806+0000 7ffa09e00640 1 --2- 172.21.15.123:0/2098834321 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff9f006f400 0x7ff9f0071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:36.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.806+0000 7ffa13200640 1 --2- 172.21.15.123:0/2098834321 >> [v2:172.21.15.123:6808/2208828636,v1:172.21.15.123:6809/2208828636] conn(0x7ff9f0075310 0x7ff9f0077760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:36.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.810+0000 7ffa09e00640 1 --2- 172.21.15.123:0/2098834321 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff9f006f400 0x7ff9f0071910 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ffa14140bf0 tx=0x7ff9fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:36.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.810+0000 7ffa13200640 1 --2- 172.21.15.123:0/2098834321 >> [v2:172.21.15.123:6808/2208828636,v1:172.21.15.123:6809/2208828636] conn(0x7ff9f0075310 0x7ff9f0077760 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:36.814 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.810+0000 7ffa0b400640 1 -- 172.21.15.123:0/2098834321 <== osd.0 v2:172.21.15.123:6808/2208828636 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff9f0077e30 con 0x7ff9f0075310 2024-04-25T13:43:36.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.822+0000 7ffa19400640 1 -- 172.21.15.123:0/2098834321 --> [v2:172.21.15.123:6808/2208828636,v1:172.21.15.123:6809/2208828636] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ffa1406a210 con 0x7ff9f0075310 2024-04-25T13:43:36.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.822+0000 7ffa0b400640 1 -- 172.21.15.123:0/2098834321 <== osd.0 v2:172.21.15.123:6808/2208828636 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ffa1406a210 con 0x7ff9f0075310 2024-04-25T13:43:36.827 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-04-25T13:43:36.827 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:43:36.828 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-04-25T13:43:36.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.822+0000 7ffa19400640 1 -- 172.21.15.123:0/2098834321 >> [v2:172.21.15.123:6808/2208828636,v1:172.21.15.123:6809/2208828636] conn(0x7ff9f0075310 msgr2=0x7ff9f0077760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:36.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.822+0000 7ffa19400640 1 --2- 172.21.15.123:0/2098834321 >> [v2:172.21.15.123:6808/2208828636,v1:172.21.15.123:6809/2208828636] conn(0x7ff9f0075310 0x7ff9f0077760 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:36.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.822+0000 7ffa19400640 1 -- 172.21.15.123:0/2098834321 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff9f006f400 msgr2=0x7ff9f0071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:36.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.822+0000 7ffa19400640 1 --2- 172.21.15.123:0/2098834321 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff9f006f400 0x7ff9f0071910 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ffa14140bf0 tx=0x7ff9fc009040 comp rx=0 tx=0).stop 2024-04-25T13:43:36.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.822+0000 7ffa19400640 1 -- 172.21.15.123:0/2098834321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1406ef10 msgr2=0x7ffa141430f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:36.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.822+0000 7ffa19400640 1 --2- 172.21.15.123:0/2098834321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffa1406ef10 0x7ffa141430f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ffa04007e90 tx=0x7ffa0400e4b0 comp rx=0 tx=0).stop 2024-04-25T13:43:36.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.822+0000 7ffa13200640 1 -- 172.21.15.123:0/2098834321 reap_dead start 2024-04-25T13:43:36.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.822+0000 7ffa19400640 1 -- 172.21.15.123:0/2098834321 shutdown_connections 2024-04-25T13:43:36.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.822+0000 7ffa19400640 1 -- 172.21.15.123:0/2098834321 >> 172.21.15.123:0/2098834321 conn(0x7ffa140b38a0 msgr2=0x7ffa140d1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:36.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.822+0000 7ffa19400640 1 -- 172.21.15.123:0/2098834321 shutdown_connections 2024-04-25T13:43:36.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.822+0000 7ffa19400640 1 -- 172.21.15.123:0/2098834321 wait complete. 2024-04-25T13:43:36.846 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T13:43:36.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.990+0000 7f5b02a00640 1 Processor -- start 2024-04-25T13:43:36.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.990+0000 7f5b02a00640 1 -- start start 2024-04-25T13:43:36.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.990+0000 7f5b02a00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5afc0b4770 0x7f5afc0b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:36.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.990+0000 7f5b02a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5afc1604d0 con 0x7f5afc0b3870 2024-04-25T13:43:36.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.990+0000 7f5b02a00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5afc0b5210 con 0x7f5afc073c00 2024-04-25T13:43:36.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.990+0000 7f5b02a00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f5afc160790 con 0x7f5afc0b4770 2024-04-25T13:43:36.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.990+0000 7f5af3400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f5afc0b3870 0x7f5afc0b3c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58248/0 (socket says 172.21.15.123:58248) 2024-04-25T13:43:36.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.990+0000 7f5af3400640 1 -- 172.21.15.123:0/1727572183 learned_addr learned my addr 172.21.15.123:0/1727572183 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:36.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.990+0000 7f5afbe00640 1 --2- 172.21.15.123:0/1727572183 >> v2:172.21.15.130:3300/0 conn(0x7f5afc0b4770 0x7f5afc0b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:36.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.990+0000 7f5afb400640 1 -- 172.21.15.123:0/1727572183 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 524660719 0 0) 0x7f5afc1604d0 con 0x7f5afc0b3870 2024-04-25T13:43:36.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.994+0000 7f5afb400640 1 -- 172.21.15.123:0/1727572183 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ae0003530 con 0x7f5afc0b3870 2024-04-25T13:43:36.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.994+0000 7f5afb400640 1 -- 172.21.15.123:0/1727572183 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2681271927 0 0) 0x7f5ae0003530 con 0x7f5afc0b3870 2024-04-25T13:43:36.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.994+0000 7f5afbe00640 1 -- 172.21.15.123:0/1727572183 >> v1:172.21.15.130:6789/0 conn(0x7f5afc073c00 legacy=0x7f5afc074010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:36.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.994+0000 7f5afbe00640 1 -- 172.21.15.123:0/1727572183 >> v1:172.21.15.123:6789/0 conn(0x7f5afc0b3870 legacy=0x7f5afc0b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:36.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.994+0000 7f5afbe00640 1 -- 172.21.15.123:0/1727572183 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5afc160a70 con 0x7f5afc0b4770 2024-04-25T13:43:37.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.994+0000 7f5afbe00640 1 --2- 172.21.15.123:0/1727572183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5afc0b4770 0x7f5afc0b4b80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0097f0 tx=0x7f5aec01c300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0b7ab5d11cbe8ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:37.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.994+0000 7f5afb400640 1 -- 172.21.15.123:0/1727572183 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aec0b0070 con 0x7f5afc0b4770 2024-04-25T13:43:37.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.994+0000 7f5afb400640 1 -- 172.21.15.123:0/1727572183 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5aec0ab400 con 0x7f5afc0b4770 2024-04-25T13:43:37.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.994+0000 7f5afb400640 1 -- 172.21.15.123:0/1727572183 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aec0a4e60 con 0x7f5afc0b4770 2024-04-25T13:43:37.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.998+0000 7f5b02a00640 1 -- 172.21.15.123:0/1727572183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5afc0b4770 msgr2=0x7f5afc0b4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.998+0000 7f5b02a00640 1 --2- 172.21.15.123:0/1727572183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5afc0b4770 0x7f5afc0b4b80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0097f0 tx=0x7f5aec01c300 comp rx=0 tx=0).stop 2024-04-25T13:43:37.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.998+0000 7f5b02a00640 1 -- 172.21.15.123:0/1727572183 shutdown_connections 2024-04-25T13:43:37.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.998+0000 7f5b02a00640 1 --2- 172.21.15.123:0/1727572183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5afc0b4770 0x7f5afc0b4b80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.998+0000 7f5b02a00640 1 -- 172.21.15.123:0/1727572183 >> 172.21.15.123:0/1727572183 conn(0x7f5afc06ca70 msgr2=0x7f5afc06ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:37.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.998+0000 7f5b02a00640 1 -- 172.21.15.123:0/1727572183 shutdown_connections 2024-04-25T13:43:37.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.998+0000 7f5b02a00640 1 -- 172.21.15.123:0/1727572183 wait complete. 2024-04-25T13:43:37.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.998+0000 7f5b02a00640 1 Processor -- start 2024-04-25T13:43:37.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:36.998+0000 7f5b02a00640 1 -- start start 2024-04-25T13:43:37.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.002+0000 7f5b02a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5afc073c00 0x7f5afc14d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.002+0000 7f5b02a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5afc0b3870 0x7f5afc15e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.002+0000 7f5b02a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5afc0b4770 0x7f5afc15ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.002+0000 7f5b02a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f5afc1613f0 con 0x7f5afc0b4770 2024-04-25T13:43:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.002+0000 7f5b02a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5afc161270 con 0x7f5afc073c00 2024-04-25T13:43:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.002+0000 7f5b02a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f5afc16e7f0 con 0x7f5afc0b3870 2024-04-25T13:43:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.002+0000 7f5b00a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5afc0b4770 0x7f5afc15ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.002+0000 7f5b00a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5afc0b4770 0x7f5afc15ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43928/0 (socket says 172.21.15.123:43928) 2024-04-25T13:43:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.002+0000 7f5afbe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5afc073c00 0x7f5afc14d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.002+0000 7f5af3400640 1 --2- 172.21.15.123:0/4097998236 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5afc0b3870 0x7f5afc15e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.002+0000 7f5b00a00640 1 -- 172.21.15.123:0/4097998236 learned_addr learned my addr 172.21.15.123:0/4097998236 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.002+0000 7f5b00a00640 1 -- 172.21.15.123:0/4097998236 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5afc0b3870 msgr2=0x7f5afc15e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.002+0000 7f5b00a00640 1 --2- 172.21.15.123:0/4097998236 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5afc0b3870 0x7f5afc15e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.002+0000 7f5b00a00640 1 -- 172.21.15.123:0/4097998236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5afc073c00 msgr2=0x7f5afc14d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.002+0000 7f5b00a00640 1 --2- 172.21.15.123:0/4097998236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5afc073c00 0x7f5afc14d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.002+0000 7f5b00a00640 1 -- 172.21.15.123:0/4097998236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5afc14bfe0 con 0x7f5afc0b4770 2024-04-25T13:43:37.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.002+0000 7f5b00a00640 1 --2- 172.21.15.123:0/4097998236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5afc0b4770 0x7f5afc15ed30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5af400c760 tx=0x7f5af400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:37.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.002+0000 7f5af8c00640 1 -- 172.21.15.123:0/4097998236 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af4003b80 con 0x7f5afc0b4770 2024-04-25T13:43:37.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.002+0000 7f5af8c00640 1 -- 172.21.15.123:0/4097998236 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5af4003d20 con 0x7f5afc0b4770 2024-04-25T13:43:37.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.002+0000 7f5af8c00640 1 -- 172.21.15.123:0/4097998236 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af400aa90 con 0x7f5afc0b4770 2024-04-25T13:43:37.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.002+0000 7f5b02a00640 1 -- 172.21.15.123:0/4097998236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5afc14c2c0 con 0x7f5afc0b4770 2024-04-25T13:43:37.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.002+0000 7f5b02a00640 1 -- 172.21.15.123:0/4097998236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5afc14c880 con 0x7f5afc0b4770 2024-04-25T13:43:37.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.002+0000 7f5b02a00640 1 -- 172.21.15.123:0/4097998236 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5afc06d600 con 0x7f5afc0b4770 2024-04-25T13:43:37.009 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.006+0000 7f5af8c00640 1 -- 172.21.15.123:0/4097998236 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5af400ac30 con 0x7f5afc0b4770 2024-04-25T13:43:37.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.006+0000 7f5af8c00640 1 --2- 172.21.15.123:0/4097998236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5ad806f400 0x7f5ad8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.006+0000 7f5af8c00640 1 -- 172.21.15.123:0/4097998236 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f5af408ed50 con 0x7f5afc0b4770 2024-04-25T13:43:37.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.006+0000 7f5afbe00640 1 --2- 172.21.15.123:0/4097998236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5ad806f400 0x7f5ad8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.006+0000 7f5afbe00640 1 --2- 172.21.15.123:0/4097998236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5ad806f400 0x7f5ad8071910 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0ad000 tx=0x7f5aec0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:37.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.010+0000 7f5af8c00640 1 -- 172.21.15.123:0/4097998236 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5af405b850 con 0x7f5afc0b4770 2024-04-25T13:43:37.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.166+0000 7f5b02a00640 1 -- 172.21.15.123:0/4097998236 --> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f5afc0ce980 con 0x7f5ad806f400 2024-04-25T13:43:37.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.166+0000 7f5af8c00640 1 -- 172.21.15.123:0/4097998236 <== mgr.4107 v2:172.21.15.123:6832/715752891 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5afc0ce980 con 0x7f5ad806f400 2024-04-25T13:43:37.174 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T13:43:37.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.170+0000 7f5b02a00640 1 -- 172.21.15.123:0/4097998236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5ad806f400 msgr2=0x7f5ad8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.170+0000 7f5b02a00640 1 --2- 172.21.15.123:0/4097998236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5ad806f400 0x7f5ad8071910 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5aec0ad000 tx=0x7f5aec0a6000 comp rx=0 tx=0).stop 2024-04-25T13:43:37.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.170+0000 7f5b02a00640 1 -- 172.21.15.123:0/4097998236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5afc0b4770 msgr2=0x7f5afc15ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.170+0000 7f5b02a00640 1 --2- 172.21.15.123:0/4097998236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5afc0b4770 0x7f5afc15ed30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5af400c760 tx=0x7f5af400cc20 comp rx=0 tx=0).stop 2024-04-25T13:43:37.176 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.170+0000 7f5b02a00640 1 -- 172.21.15.123:0/4097998236 shutdown_connections 2024-04-25T13:43:37.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.170+0000 7f5b02a00640 1 --2- 172.21.15.123:0/4097998236 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f5ad806f400 0x7f5ad8071910 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.170+0000 7f5b02a00640 1 --2- 172.21.15.123:0/4097998236 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5afc0b4770 0x7f5afc15ed30 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.170+0000 7f5b02a00640 1 --2- 172.21.15.123:0/4097998236 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5afc0b3870 0x7f5afc15e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.170+0000 7f5b02a00640 1 --2- 172.21.15.123:0/4097998236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5afc073c00 0x7f5afc14d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.170+0000 7f5b02a00640 1 -- 172.21.15.123:0/4097998236 >> 172.21.15.123:0/4097998236 conn(0x7f5afc06ca70 msgr2=0x7f5afc151930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:37.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.170+0000 7f5b02a00640 1 -- 172.21.15.123:0/4097998236 shutdown_connections 2024-04-25T13:43:37.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.170+0000 7f5b02a00640 1 -- 172.21.15.123:0/4097998236 wait complete. 2024-04-25T13:43:37.195 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T13:43:37.195 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:43:37.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.338+0000 7f721ec00640 1 Processor -- start 2024-04-25T13:43:37.345 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.342+0000 7f721ec00640 1 -- start start 2024-04-25T13:43:37.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.342+0000 7f721ec00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f72180cdfc0 0x7f72180ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.342+0000 7f721ec00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f721806ef10 0x7f721806f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.347 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.342+0000 7f721ec00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72180ce910 con 0x7f72180b0be0 2024-04-25T13:43:37.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.342+0000 7f721ec00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f7218072b80 con 0x7f721806ef10 2024-04-25T13:43:37.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.342+0000 7f721ec00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f7218073670 con 0x7f72180cdfc0 2024-04-25T13:43:37.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.342+0000 7f721cc00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f721806ef10 0x7f721806f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.342+0000 7f721cc00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f721806ef10 0x7f721806f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43938/0 (socket says 172.21.15.123:43938) 2024-04-25T13:43:37.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.342+0000 7f721cc00640 1 -- 172.21.15.123:0/3284746221 learned_addr learned my addr 172.21.15.123:0/3284746221 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:37.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.342+0000 7f720fe00640 1 --2- 172.21.15.123:0/3284746221 >> v2:172.21.15.130:3300/0 conn(0x7f72180cdfc0 0x7f72180ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.342+0000 7f721cc00640 1 -- 172.21.15.123:0/3284746221 >> v2:172.21.15.130:3300/0 conn(0x7f72180cdfc0 msgr2=0x7f72180ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:37.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.342+0000 7f721cc00640 1 --2- 172.21.15.123:0/3284746221 >> v2:172.21.15.130:3300/0 conn(0x7f72180cdfc0 0x7f72180ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.342+0000 7f721cc00640 1 -- 172.21.15.123:0/3284746221 >> v1:172.21.15.130:6789/0 conn(0x7f72180b0be0 legacy=0x7f72180d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.342+0000 7f721cc00640 1 -- 172.21.15.123:0/3284746221 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72180b0ff0 con 0x7f721806ef10 2024-04-25T13:43:37.348 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.342+0000 7f720fe00640 1 --2- 172.21.15.123:0/3284746221 >> v2:172.21.15.130:3300/0 conn(0x7f72180cdfc0 0x7f72180ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:37.350 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.346+0000 7f721cc00640 1 --2- 172.21.15.123:0/3284746221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f721806ef10 0x7f721806f320 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f721806d7a0 tx=0x7f721001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893c8a2726343c96 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:37.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.346+0000 7f7217400640 1 -- 172.21.15.123:0/3284746221 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72100a5800 con 0x7f721806ef10 2024-04-25T13:43:37.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.346+0000 7f7217400640 1 -- 172.21.15.123:0/3284746221 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72100a59a0 con 0x7f721806ef10 2024-04-25T13:43:37.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.346+0000 7f7217400640 1 -- 172.21.15.123:0/3284746221 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72100a5d70 con 0x7f721806ef10 2024-04-25T13:43:37.351 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.346+0000 7f721ec00640 1 -- 172.21.15.123:0/3284746221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f721806ef10 msgr2=0x7f721806f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.346+0000 7f721ec00640 1 --2- 172.21.15.123:0/3284746221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f721806ef10 0x7f721806f320 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f721806d7a0 tx=0x7f721001c940 comp rx=0 tx=0).stop 2024-04-25T13:43:37.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.346+0000 7f721ec00640 1 -- 172.21.15.123:0/3284746221 shutdown_connections 2024-04-25T13:43:37.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.346+0000 7f721ec00640 1 --2- 172.21.15.123:0/3284746221 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f721806ef10 0x7f721806f320 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.346+0000 7f721ec00640 1 --2- 172.21.15.123:0/3284746221 >> v2:172.21.15.130:3300/0 conn(0x7f72180cdfc0 0x7f72180ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.346+0000 7f721ec00640 1 -- 172.21.15.123:0/3284746221 >> 172.21.15.123:0/3284746221 conn(0x7f72180b38a0 msgr2=0x7f72180d15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:37.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.346+0000 7f721ec00640 1 -- 172.21.15.123:0/3284746221 shutdown_connections 2024-04-25T13:43:37.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.346+0000 7f721ec00640 1 -- 172.21.15.123:0/3284746221 wait complete. 2024-04-25T13:43:37.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.350+0000 7f721ec00640 1 Processor -- start 2024-04-25T13:43:37.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.350+0000 7f721ec00640 1 -- start start 2024-04-25T13:43:37.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.350+0000 7f721ec00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f721806ef10 0x7f721815d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.350+0000 7f721ec00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72180b0be0 0x7f72181fd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.350+0000 7f721ec00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72180cdfc0 0x7f7218166e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.350+0000 7f721ec00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f721816aab0 con 0x7f72180b0be0 2024-04-25T13:43:37.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.350+0000 7f721ec00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7218073390 con 0x7f72180cdfc0 2024-04-25T13:43:37.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.350+0000 7f721ec00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f721816ac30 con 0x7f721806ef10 2024-04-25T13:43:37.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.350+0000 7f720fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72180b0be0 0x7f72181fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.350+0000 7f720fe00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72180b0be0 0x7f72181fd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43944/0 (socket says 172.21.15.123:43944) 2024-04-25T13:43:37.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.350+0000 7f720fe00640 1 -- 172.21.15.123:0/4294143339 learned_addr learned my addr 172.21.15.123:0/4294143339 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:37.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.350+0000 7f7217e00640 1 --2- 172.21.15.123:0/4294143339 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f721806ef10 0x7f721815d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.350+0000 7f721cc00640 1 --2- 172.21.15.123:0/4294143339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72180cdfc0 0x7f7218166e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.350+0000 7f720fe00640 1 -- 172.21.15.123:0/4294143339 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f721806ef10 msgr2=0x7f721815d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.350+0000 7f720fe00640 1 --2- 172.21.15.123:0/4294143339 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f721806ef10 0x7f721815d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.350+0000 7f720fe00640 1 -- 172.21.15.123:0/4294143339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72180cdfc0 msgr2=0x7f7218166e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.350+0000 7f720fe00640 1 --2- 172.21.15.123:0/4294143339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72180cdfc0 0x7f7218166e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.350+0000 7f720fe00640 1 -- 172.21.15.123:0/4294143339 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7218146670 con 0x7f72180b0be0 2024-04-25T13:43:37.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.350+0000 7f720fe00640 1 --2- 172.21.15.123:0/4294143339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72180b0be0 0x7f72181fd100 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f720000d830 tx=0x7f720000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:37.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.350+0000 7f7214c00640 1 -- 172.21.15.123:0/4294143339 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7200018020 con 0x7f72180b0be0 2024-04-25T13:43:37.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.350+0000 7f7214c00640 1 -- 172.21.15.123:0/4294143339 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72000096c0 con 0x7f72180b0be0 2024-04-25T13:43:37.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.350+0000 7f7214c00640 1 -- 172.21.15.123:0/4294143339 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7200009ab0 con 0x7f72180b0be0 2024-04-25T13:43:37.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.350+0000 7f721ec00640 1 -- 172.21.15.123:0/4294143339 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72181fd640 con 0x7f72180b0be0 2024-04-25T13:43:37.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.350+0000 7f721ec00640 1 -- 172.21.15.123:0/4294143339 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7218146c60 con 0x7f72180b0be0 2024-04-25T13:43:37.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.354+0000 7f721ec00640 1 -- 172.21.15.123:0/4294143339 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7218146ea0 con 0x7f72180b0be0 2024-04-25T13:43:37.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.354+0000 7f7214c00640 1 -- 172.21.15.123:0/4294143339 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f720001b020 con 0x7f72180b0be0 2024-04-25T13:43:37.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.354+0000 7f7214c00640 1 --2- 172.21.15.123:0/4294143339 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f71f406f400 0x7f71f4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.354+0000 7f7214c00640 1 -- 172.21.15.123:0/4294143339 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f720008fe10 con 0x7f72180b0be0 2024-04-25T13:43:37.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.354+0000 7f7214c00640 1 --2- 172.21.15.123:0/4294143339 >> [v2:172.21.15.123:6800/477459895,v1:172.21.15.123:6801/477459895] conn(0x7f71f4075310 0x7f71f4077760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.354+0000 7f7217e00640 1 --2- 172.21.15.123:0/4294143339 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f71f406f400 0x7f71f4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.354+0000 7f7214c00640 1 -- 172.21.15.123:0/4294143339 --> [v2:172.21.15.123:6800/477459895,v1:172.21.15.123:6801/477459895] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7200019ec0 con 0x7f71f4075310 2024-04-25T13:43:37.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.354+0000 7f7214c00640 1 -- 172.21.15.123:0/4294143339 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f72000901c0 con 0x7f72180b0be0 2024-04-25T13:43:37.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.354+0000 7f721cc00640 1 --2- 172.21.15.123:0/4294143339 >> [v2:172.21.15.123:6800/477459895,v1:172.21.15.123:6801/477459895] conn(0x7f71f4075310 0x7f71f4077760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.354+0000 7f7217e00640 1 --2- 172.21.15.123:0/4294143339 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f71f406f400 0x7f71f4071910 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7218072070 tx=0x7f7208009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:37.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.354+0000 7f721cc00640 1 --2- 172.21.15.123:0/4294143339 >> [v2:172.21.15.123:6800/477459895,v1:172.21.15.123:6801/477459895] conn(0x7f71f4075310 0x7f71f4077760 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:37.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.358+0000 7f7214c00640 1 -- 172.21.15.123:0/4294143339 <== osd.1 v2:172.21.15.123:6800/477459895 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7200019ec0 con 0x7f71f4075310 2024-04-25T13:43:37.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.370+0000 7f721ec00640 1 -- 172.21.15.123:0/4294143339 --> [v2:172.21.15.123:6800/477459895,v1:172.21.15.123:6801/477459895] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7218146420 con 0x7f71f4075310 2024-04-25T13:43:37.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.370+0000 7f7214c00640 1 -- 172.21.15.123:0/4294143339 <== osd.1 v2:172.21.15.123:6800/477459895 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7218146420 con 0x7f71f4075310 2024-04-25T13:43:37.375 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-04-25T13:43:37.375 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:43:37.375 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-04-25T13:43:37.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.370+0000 7f721ec00640 1 -- 172.21.15.123:0/4294143339 >> [v2:172.21.15.123:6800/477459895,v1:172.21.15.123:6801/477459895] conn(0x7f71f4075310 msgr2=0x7f71f4077760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.370+0000 7f721ec00640 1 --2- 172.21.15.123:0/4294143339 >> [v2:172.21.15.123:6800/477459895,v1:172.21.15.123:6801/477459895] conn(0x7f71f4075310 0x7f71f4077760 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.370+0000 7f721ec00640 1 -- 172.21.15.123:0/4294143339 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f71f406f400 msgr2=0x7f71f4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.370+0000 7f721ec00640 1 --2- 172.21.15.123:0/4294143339 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f71f406f400 0x7f71f4071910 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7218072070 tx=0x7f7208009040 comp rx=0 tx=0).stop 2024-04-25T13:43:37.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.370+0000 7f721ec00640 1 -- 172.21.15.123:0/4294143339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72180b0be0 msgr2=0x7f72181fd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.370+0000 7f721ec00640 1 --2- 172.21.15.123:0/4294143339 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72180b0be0 0x7f72181fd100 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f720000d830 tx=0x7f720000dcf0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.370+0000 7f721cc00640 1 -- 172.21.15.123:0/4294143339 reap_dead start 2024-04-25T13:43:37.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.370+0000 7f721ec00640 1 -- 172.21.15.123:0/4294143339 shutdown_connections 2024-04-25T13:43:37.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.370+0000 7f721ec00640 1 -- 172.21.15.123:0/4294143339 >> 172.21.15.123:0/4294143339 conn(0x7f72180b38a0 msgr2=0x7f72180d0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:37.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.370+0000 7f721ec00640 1 -- 172.21.15.123:0/4294143339 shutdown_connections 2024-04-25T13:43:37.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.370+0000 7f721ec00640 1 -- 172.21.15.123:0/4294143339 wait complete. 2024-04-25T13:43:37.394 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T13:43:37.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.538+0000 7fe9b9000640 1 Processor -- start 2024-04-25T13:43:37.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.538+0000 7fe9b9000640 1 -- start start 2024-04-25T13:43:37.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.538+0000 7fe9b9000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe9b41571b0 0x7fe9b40cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.538+0000 7fe9b9000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe9b4072af0 0x7fe9b4072f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.538+0000 7fe9b9000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9b40cdee0 con 0x7fe9b40b3870 2024-04-25T13:43:37.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.538+0000 7fe9b9000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fe9b415d570 con 0x7fe9b4072af0 2024-04-25T13:43:37.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.538+0000 7fe9b9000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe9b415d850 con 0x7fe9b41571b0 2024-04-25T13:43:37.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.538+0000 7fe9b2800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fe9b4072af0 0x7fe9b4072f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.538+0000 7fe9b1400640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fe9b40b3870 0x7fe9b40b3c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58254/0 (socket says 172.21.15.123:58254) 2024-04-25T13:43:37.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.538+0000 7fe9b1400640 1 -- 172.21.15.123:0/3093778490 learned_addr learned my addr 172.21.15.123:0/3093778490 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:37.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.538+0000 7fe9b1e00640 1 --2- 172.21.15.123:0/3093778490 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe9b41571b0 0x7fe9b40cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.538+0000 7fe9b2800640 1 -- 172.21.15.123:0/3093778490 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe9b41571b0 msgr2=0x7fe9b40cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:37.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.538+0000 7fe9b2800640 1 --2- 172.21.15.123:0/3093778490 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe9b41571b0 0x7fe9b40cd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.538+0000 7fe9b2800640 1 -- 172.21.15.123:0/3093778490 >> v1:172.21.15.123:6789/0 conn(0x7fe9b40b3870 legacy=0x7fe9b40b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.538+0000 7fe9b2800640 1 -- 172.21.15.123:0/3093778490 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9b415db30 con 0x7fe9b4072af0 2024-04-25T13:43:37.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.538+0000 7fe9b0a00640 1 -- 172.21.15.123:0/3093778490 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1358971341 0 0) 0x7fe9b40cdee0 con 0x7fe9b40b3870 2024-04-25T13:43:37.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.542+0000 7fe9b2800640 1 --2- 172.21.15.123:0/3093778490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9b4072af0 0x7fe9b4072f00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac0097f0 tx=0x7fe9ac01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5671b8ae2e620d36 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:37.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.542+0000 7fe9b0a00640 1 -- 172.21.15.123:0/3093778490 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac0ab430 con 0x7fe9b4072af0 2024-04-25T13:43:37.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.542+0000 7fe9b0a00640 1 -- 172.21.15.123:0/3093778490 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9ac0b0070 con 0x7fe9b4072af0 2024-04-25T13:43:37.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.542+0000 7fe9b0a00640 1 -- 172.21.15.123:0/3093778490 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac0ab7f0 con 0x7fe9b4072af0 2024-04-25T13:43:37.548 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.542+0000 7fe9b9000640 1 -- 172.21.15.123:0/3093778490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9b4072af0 msgr2=0x7fe9b4072f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.542+0000 7fe9b9000640 1 --2- 172.21.15.123:0/3093778490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9b4072af0 0x7fe9b4072f00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac0097f0 tx=0x7fe9ac01c3d0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.542+0000 7fe9b9000640 1 -- 172.21.15.123:0/3093778490 shutdown_connections 2024-04-25T13:43:37.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.542+0000 7fe9b9000640 1 --2- 172.21.15.123:0/3093778490 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9b4072af0 0x7fe9b4072f00 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.542+0000 7fe9b9000640 1 --2- 172.21.15.123:0/3093778490 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe9b41571b0 0x7fe9b40cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.542+0000 7fe9b9000640 1 -- 172.21.15.123:0/3093778490 >> 172.21.15.123:0/3093778490 conn(0x7fe9b406ca70 msgr2=0x7fe9b406ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:37.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.542+0000 7fe9b9000640 1 -- 172.21.15.123:0/3093778490 shutdown_connections 2024-04-25T13:43:37.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.542+0000 7fe9b9000640 1 -- 172.21.15.123:0/3093778490 wait complete. 2024-04-25T13:43:37.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.546+0000 7fe9b9000640 1 Processor -- start 2024-04-25T13:43:37.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.546+0000 7fe9b9000640 1 -- start start 2024-04-25T13:43:37.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.546+0000 7fe9b9000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe9b4072af0 0x7fe9b414c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.546+0000 7fe9b9000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9b40b3870 0x7fe9b40c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.546+0000 7fe9b9000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9b41571b0 0x7fe9b4152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.546+0000 7fe9b9000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b4157740 con 0x7fe9b41571b0 2024-04-25T13:43:37.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.546+0000 7fe9b9000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe9b41575c0 con 0x7fe9b40b3870 2024-04-25T13:43:37.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.546+0000 7fe9b9000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe9b4073850 con 0x7fe9b4072af0 2024-04-25T13:43:37.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.546+0000 7fe9b2800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9b41571b0 0x7fe9b4152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.546+0000 7fe9b2800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9b41571b0 0x7fe9b4152c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43966/0 (socket says 172.21.15.123:43966) 2024-04-25T13:43:37.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.546+0000 7fe9b2800640 1 -- 172.21.15.123:0/1469288321 learned_addr learned my addr 172.21.15.123:0/1469288321 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:37.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.546+0000 7fe9b1e00640 1 --2- 172.21.15.123:0/1469288321 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe9b4072af0 0x7fe9b414c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.546+0000 7fe9b1400640 1 --2- 172.21.15.123:0/1469288321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9b40b3870 0x7fe9b40c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.546+0000 7fe9b2800640 1 -- 172.21.15.123:0/1469288321 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe9b4072af0 msgr2=0x7fe9b414c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.546+0000 7fe9b2800640 1 --2- 172.21.15.123:0/1469288321 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe9b4072af0 0x7fe9b414c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.546+0000 7fe9b2800640 1 -- 172.21.15.123:0/1469288321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9b40b3870 msgr2=0x7fe9b40c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.546+0000 7fe9b2800640 1 --2- 172.21.15.123:0/1469288321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9b40b3870 0x7fe9b40c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.546+0000 7fe9b2800640 1 -- 172.21.15.123:0/1469288321 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9b40c91c0 con 0x7fe9b41571b0 2024-04-25T13:43:37.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.550+0000 7fe9b2800640 1 --2- 172.21.15.123:0/1469288321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9b41571b0 0x7fe9b4152c80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac0ad040 tx=0x7fe9ac019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:37.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.550+0000 7fe9aa000640 1 -- 172.21.15.123:0/1469288321 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac0b43f0 con 0x7fe9b41571b0 2024-04-25T13:43:37.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.550+0000 7fe9aa000640 1 -- 172.21.15.123:0/1469288321 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9ac0bc070 con 0x7fe9b41571b0 2024-04-25T13:43:37.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.550+0000 7fe9aa000640 1 -- 172.21.15.123:0/1469288321 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac0b47b0 con 0x7fe9b41571b0 2024-04-25T13:43:37.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.550+0000 7fe9b9000640 1 -- 172.21.15.123:0/1469288321 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9b40c94a0 con 0x7fe9b41571b0 2024-04-25T13:43:37.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.550+0000 7fe9b9000640 1 -- 172.21.15.123:0/1469288321 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9b40c9a60 con 0x7fe9b41571b0 2024-04-25T13:43:37.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.550+0000 7fe9b9000640 1 -- 172.21.15.123:0/1469288321 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9b4050750 con 0x7fe9b41571b0 2024-04-25T13:43:37.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.550+0000 7fe9aa000640 1 -- 172.21.15.123:0/1469288321 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe9ac0b4950 con 0x7fe9b41571b0 2024-04-25T13:43:37.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.550+0000 7fe9aa000640 1 --2- 172.21.15.123:0/1469288321 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe99406f450 0x7fe994071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.550+0000 7fe9aa000640 1 -- 172.21.15.123:0/1469288321 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fe9ac128e80 con 0x7fe9b41571b0 2024-04-25T13:43:37.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.550+0000 7fe9b1e00640 1 --2- 172.21.15.123:0/1469288321 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe99406f450 0x7fe994071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.554+0000 7fe9b1e00640 1 --2- 172.21.15.123:0/1469288321 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe99406f450 0x7fe994071960 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4070f70 tx=0x7fe9a4009830 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:37.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.558+0000 7fe9aa000640 1 -- 172.21.15.123:0/1469288321 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe9ac016050 con 0x7fe9b41571b0 2024-04-25T13:43:37.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.714+0000 7fe9b9000640 1 -- 172.21.15.123:0/1469288321 --> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fe9b4074cc0 con 0x7fe99406f450 2024-04-25T13:43:37.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.714+0000 7fe9aa000640 1 -- 172.21.15.123:0/1469288321 <== mgr.4107 v2:172.21.15.123:6832/715752891 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe9b4074cc0 con 0x7fe99406f450 2024-04-25T13:43:37.720 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T13:43:37.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.718+0000 7fe9b9000640 1 -- 172.21.15.123:0/1469288321 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe99406f450 msgr2=0x7fe994071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.718+0000 7fe9b9000640 1 --2- 172.21.15.123:0/1469288321 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe99406f450 0x7fe994071960 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4070f70 tx=0x7fe9a4009830 comp rx=0 tx=0).stop 2024-04-25T13:43:37.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.718+0000 7fe9b9000640 1 -- 172.21.15.123:0/1469288321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9b41571b0 msgr2=0x7fe9b4152c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.718+0000 7fe9b9000640 1 --2- 172.21.15.123:0/1469288321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9b41571b0 0x7fe9b4152c80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac0ad040 tx=0x7fe9ac019170 comp rx=0 tx=0).stop 2024-04-25T13:43:37.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.718+0000 7fe9b9000640 1 -- 172.21.15.123:0/1469288321 shutdown_connections 2024-04-25T13:43:37.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.718+0000 7fe9b9000640 1 --2- 172.21.15.123:0/1469288321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9b40b3870 0x7fe9b40c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.718+0000 7fe9b9000640 1 --2- 172.21.15.123:0/1469288321 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe99406f450 0x7fe994071960 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.718+0000 7fe9b9000640 1 --2- 172.21.15.123:0/1469288321 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe9b41571b0 0x7fe9b4152c80 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.718+0000 7fe9b9000640 1 --2- 172.21.15.123:0/1469288321 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe9b4072af0 0x7fe9b414c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.718+0000 7fe9b9000640 1 -- 172.21.15.123:0/1469288321 >> 172.21.15.123:0/1469288321 conn(0x7fe9b406ca70 msgr2=0x7fe9b40ce1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:37.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.718+0000 7fe9b9000640 1 -- 172.21.15.123:0/1469288321 shutdown_connections 2024-04-25T13:43:37.723 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.718+0000 7fe9b9000640 1 -- 172.21.15.123:0/1469288321 wait complete. 2024-04-25T13:43:37.742 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T13:43:37.742 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:43:37.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.886+0000 7ff53dc00640 1 Processor -- start 2024-04-25T13:43:37.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.886+0000 7ff53dc00640 1 -- start start 2024-04-25T13:43:37.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.890+0000 7ff53dc00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff5380b0be0 0x7ff5380d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.890+0000 7ff53dc00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff5380cdfc0 0x7ff5380ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.890+0000 7ff53dc00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff538161920 0x7ff538161d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.890+0000 7ff53dc00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff538072b80 con 0x7ff538161920 2024-04-25T13:43:37.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.890+0000 7ff53dc00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7ff5380ce910 con 0x7ff5380cdfc0 2024-04-25T13:43:37.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.890+0000 7ff53dc00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff538073670 con 0x7ff5380b0be0 2024-04-25T13:43:37.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.890+0000 7ff537400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff538161920 0x7ff538161d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.890+0000 7ff537400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff538161920 0x7ff538161d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43968/0 (socket says 172.21.15.123:43968) 2024-04-25T13:43:37.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.890+0000 7ff537400640 1 -- 172.21.15.123:0/601367390 learned_addr learned my addr 172.21.15.123:0/601367390 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:37.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.890+0000 7ff52e000640 1 --2- 172.21.15.123:0/601367390 >> v2:172.21.15.130:3300/0 conn(0x7ff5380cdfc0 0x7ff5380ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.890+0000 7ff536a00640 1 --2- 172.21.15.123:0/601367390 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff5380b0be0 0x7ff5380d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.890+0000 7ff537400640 1 -- 172.21.15.123:0/601367390 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff5380b0be0 msgr2=0x7ff5380d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:37.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.890+0000 7ff537400640 1 --2- 172.21.15.123:0/601367390 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff5380b0be0 0x7ff5380d0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.890+0000 7ff537400640 1 -- 172.21.15.123:0/601367390 >> v2:172.21.15.130:3300/0 conn(0x7ff5380cdfc0 msgr2=0x7ff5380ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:37.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.890+0000 7ff537400640 1 --2- 172.21.15.123:0/601367390 >> v2:172.21.15.130:3300/0 conn(0x7ff5380cdfc0 0x7ff5380ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.890+0000 7ff537400640 1 -- 172.21.15.123:0/601367390 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5380b0ff0 con 0x7ff538161920 2024-04-25T13:43:37.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.894+0000 7ff537400640 1 --2- 172.21.15.123:0/601367390 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff538161920 0x7ff538161d30 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff5380b4260 tx=0x7ff53001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e5aaf378e1d654 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:37.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.894+0000 7ff536000640 1 -- 172.21.15.123:0/601367390 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5300ab620 con 0x7ff538161920 2024-04-25T13:43:37.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.894+0000 7ff536000640 1 -- 172.21.15.123:0/601367390 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5300b0070 con 0x7ff538161920 2024-04-25T13:43:37.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.894+0000 7ff536000640 1 -- 172.21.15.123:0/601367390 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5300ab9e0 con 0x7ff538161920 2024-04-25T13:43:37.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.894+0000 7ff53dc00640 1 -- 172.21.15.123:0/601367390 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff538161920 msgr2=0x7ff538161d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.894+0000 7ff53dc00640 1 --2- 172.21.15.123:0/601367390 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff538161920 0x7ff538161d30 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff5380b4260 tx=0x7ff53001c460 comp rx=0 tx=0).stop 2024-04-25T13:43:37.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.894+0000 7ff53dc00640 1 -- 172.21.15.123:0/601367390 shutdown_connections 2024-04-25T13:43:37.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.894+0000 7ff53dc00640 1 --2- 172.21.15.123:0/601367390 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff538161920 0x7ff538161d30 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.894+0000 7ff53dc00640 1 --2- 172.21.15.123:0/601367390 >> v2:172.21.15.130:3300/0 conn(0x7ff5380cdfc0 0x7ff5380ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.894+0000 7ff53dc00640 1 --2- 172.21.15.123:0/601367390 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff5380b0be0 0x7ff5380d0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.894+0000 7ff53dc00640 1 -- 172.21.15.123:0/601367390 >> 172.21.15.123:0/601367390 conn(0x7ff5380b38a0 msgr2=0x7ff5380d15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:37.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.894+0000 7ff53dc00640 1 -- 172.21.15.123:0/601367390 shutdown_connections 2024-04-25T13:43:37.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.894+0000 7ff53dc00640 1 -- 172.21.15.123:0/601367390 wait complete. 2024-04-25T13:43:37.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.898+0000 7ff53dc00640 1 Processor -- start 2024-04-25T13:43:37.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.898+0000 7ff53dc00640 1 -- start start 2024-04-25T13:43:37.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.898+0000 7ff53dc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5380b0be0 0x7ff53815c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.898+0000 7ff53dc00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff5380cdfc0 0x7ff538162a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.898+0000 7ff53dc00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff538161920 0x7ff538162f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.898+0000 7ff53dc00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff5380d1070 con 0x7ff538161920 2024-04-25T13:43:37.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.898+0000 7ff53dc00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff538162680 con 0x7ff5380b0be0 2024-04-25T13:43:37.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.898+0000 7ff53dc00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff5380d11f0 con 0x7ff5380cdfc0 2024-04-25T13:43:37.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.898+0000 7ff537400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff538161920 0x7ff538162f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.898+0000 7ff537400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff538161920 0x7ff538162f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43970/0 (socket says 172.21.15.123:43970) 2024-04-25T13:43:37.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.898+0000 7ff537400640 1 -- 172.21.15.123:0/2029166470 learned_addr learned my addr 172.21.15.123:0/2029166470 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:37.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.898+0000 7ff52e000640 1 --2- 172.21.15.123:0/2029166470 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff5380cdfc0 0x7ff538162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.898+0000 7ff536a00640 1 --2- 172.21.15.123:0/2029166470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5380b0be0 0x7ff53815c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.898+0000 7ff537400640 1 -- 172.21.15.123:0/2029166470 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff5380cdfc0 msgr2=0x7ff538162a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.898+0000 7ff537400640 1 --2- 172.21.15.123:0/2029166470 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff5380cdfc0 0x7ff538162a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.898+0000 7ff537400640 1 -- 172.21.15.123:0/2029166470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5380b0be0 msgr2=0x7ff53815c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.898+0000 7ff537400640 1 --2- 172.21.15.123:0/2029166470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5380b0be0 0x7ff53815c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.898+0000 7ff537400640 1 -- 172.21.15.123:0/2029166470 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff538167920 con 0x7ff538161920 2024-04-25T13:43:37.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.898+0000 7ff52e000640 1 --2- 172.21.15.123:0/2029166470 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff5380cdfc0 0x7ff538162a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:37.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.898+0000 7ff536a00640 1 --2- 172.21.15.123:0/2029166470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5380b0be0 0x7ff53815c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:37.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.898+0000 7ff537400640 1 --2- 172.21.15.123:0/2029166470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff538161920 0x7ff538162f90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ff5300ad040 tx=0x7ff530019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:37.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.898+0000 7ff52f400640 1 -- 172.21.15.123:0/2029166470 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5300abbb0 con 0x7ff538161920 2024-04-25T13:43:37.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.898+0000 7ff52f400640 1 -- 172.21.15.123:0/2029166470 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5300bb070 con 0x7ff538161920 2024-04-25T13:43:37.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.898+0000 7ff52f400640 1 -- 172.21.15.123:0/2029166470 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5300b5400 con 0x7ff538161920 2024-04-25T13:43:37.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.898+0000 7ff53dc00640 1 -- 172.21.15.123:0/2029166470 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff53815eb90 con 0x7ff538161920 2024-04-25T13:43:37.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.898+0000 7ff53dc00640 1 -- 172.21.15.123:0/2029166470 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5381606f0 con 0x7ff538161920 2024-04-25T13:43:37.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.902+0000 7ff53dc00640 1 -- 172.21.15.123:0/2029166470 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff53815d900 con 0x7ff538161920 2024-04-25T13:43:37.906 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.902+0000 7ff52f400640 1 -- 172.21.15.123:0/2029166470 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff5300b55a0 con 0x7ff538161920 2024-04-25T13:43:37.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.902+0000 7ff52f400640 1 --2- 172.21.15.123:0/2029166470 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff51406f430 0x7ff514071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.902+0000 7ff52f400640 1 -- 172.21.15.123:0/2029166470 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7ff530129220 con 0x7ff538161920 2024-04-25T13:43:37.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.902+0000 7ff52f400640 1 --2- 172.21.15.123:0/2029166470 >> [v2:172.21.15.123:6824/1411373789,v1:172.21.15.123:6825/1411373789] conn(0x7ff514075340 0x7ff514077790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:37.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.902+0000 7ff536a00640 1 --2- 172.21.15.123:0/2029166470 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff51406f430 0x7ff514071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.902+0000 7ff52f400640 1 -- 172.21.15.123:0/2029166470 --> [v2:172.21.15.123:6824/1411373789,v1:172.21.15.123:6825/1411373789] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff5300bce50 con 0x7ff514075340 2024-04-25T13:43:37.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.902+0000 7ff52f400640 1 -- 172.21.15.123:0/2029166470 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ff530130050 con 0x7ff538161920 2024-04-25T13:43:37.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.902+0000 7ff52e000640 1 --2- 172.21.15.123:0/2029166470 >> [v2:172.21.15.123:6824/1411373789,v1:172.21.15.123:6825/1411373789] conn(0x7ff514075340 0x7ff514077790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:37.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.902+0000 7ff536a00640 1 --2- 172.21.15.123:0/2029166470 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff51406f430 0x7ff514071940 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff538072070 tx=0x7ff52800d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:37.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.902+0000 7ff52e000640 1 --2- 172.21.15.123:0/2029166470 >> [v2:172.21.15.123:6824/1411373789,v1:172.21.15.123:6825/1411373789] conn(0x7ff514075340 0x7ff514077790 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:37.909 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.906+0000 7ff52f400640 1 -- 172.21.15.123:0/2029166470 <== osd.2 v2:172.21.15.123:6824/1411373789 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff5300bce50 con 0x7ff514075340 2024-04-25T13:43:37.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.918+0000 7ff53dc00640 1 -- 172.21.15.123:0/2029166470 --> [v2:172.21.15.123:6824/1411373789,v1:172.21.15.123:6825/1411373789] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff538160920 con 0x7ff514075340 2024-04-25T13:43:37.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.918+0000 7ff52f400640 1 -- 172.21.15.123:0/2029166470 <== osd.2 v2:172.21.15.123:6824/1411373789 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff538160920 con 0x7ff514075340 2024-04-25T13:43:37.923 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-04-25T13:43:37.923 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:43:37.923 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-04-25T13:43:37.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.918+0000 7ff53dc00640 1 -- 172.21.15.123:0/2029166470 >> [v2:172.21.15.123:6824/1411373789,v1:172.21.15.123:6825/1411373789] conn(0x7ff514075340 msgr2=0x7ff514077790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.918+0000 7ff53dc00640 1 --2- 172.21.15.123:0/2029166470 >> [v2:172.21.15.123:6824/1411373789,v1:172.21.15.123:6825/1411373789] conn(0x7ff514075340 0x7ff514077790 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:37.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.918+0000 7ff53dc00640 1 -- 172.21.15.123:0/2029166470 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff51406f430 msgr2=0x7ff514071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.918+0000 7ff53dc00640 1 --2- 172.21.15.123:0/2029166470 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff51406f430 0x7ff514071940 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff538072070 tx=0x7ff52800d040 comp rx=0 tx=0).stop 2024-04-25T13:43:37.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.918+0000 7ff53dc00640 1 -- 172.21.15.123:0/2029166470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff538161920 msgr2=0x7ff538162f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:37.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.918+0000 7ff53dc00640 1 --2- 172.21.15.123:0/2029166470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff538161920 0x7ff538162f90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ff5300ad040 tx=0x7ff530019200 comp rx=0 tx=0).stop 2024-04-25T13:43:37.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.918+0000 7ff537400640 1 -- 172.21.15.123:0/2029166470 reap_dead start 2024-04-25T13:43:37.924 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.918+0000 7ff53dc00640 1 -- 172.21.15.123:0/2029166470 shutdown_connections 2024-04-25T13:43:37.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.918+0000 7ff53dc00640 1 -- 172.21.15.123:0/2029166470 >> 172.21.15.123:0/2029166470 conn(0x7ff5380b38a0 msgr2=0x7ff5380702e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:37.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.918+0000 7ff53dc00640 1 -- 172.21.15.123:0/2029166470 shutdown_connections 2024-04-25T13:43:37.925 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:37.918+0000 7ff53dc00640 1 -- 172.21.15.123:0/2029166470 wait complete. 2024-04-25T13:43:37.943 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T13:43:38.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.086+0000 7f2647800640 1 Processor -- start 2024-04-25T13:43:38.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.086+0000 7f2647800640 1 -- start start 2024-04-25T13:43:38.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.086+0000 7f2647800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26400d0670 0x7f26400b4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:38.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.086+0000 7f2647800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f26400d1b50 0x7f26400b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:38.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.086+0000 7f2647800640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26400d20e0 con 0x7f264006df70 2024-04-25T13:43:38.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.086+0000 7f2647800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f26400ced40 con 0x7f26400d1b50 2024-04-25T13:43:38.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.086+0000 7f2647800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f26400d23c0 con 0x7f26400d0670 2024-04-25T13:43:38.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.086+0000 7f2645800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f26400d1b50 0x7f26400b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:38.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.090+0000 7f2645800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f26400d1b50 0x7f26400b48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43982/0 (socket says 172.21.15.123:43982) 2024-04-25T13:43:38.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.090+0000 7f2645800640 1 -- 172.21.15.123:0/3461341198 learned_addr learned my addr 172.21.15.123:0/3461341198 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:38.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.090+0000 7f2637e00640 1 --2- 172.21.15.123:0/3461341198 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26400d0670 0x7f26400b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:38.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.090+0000 7f2645800640 1 -- 172.21.15.123:0/3461341198 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26400d0670 msgr2=0x7f26400b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:38.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.090+0000 7f2645800640 1 --2- 172.21.15.123:0/3461341198 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26400d0670 0x7f26400b4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.090+0000 7f2645800640 1 -- 172.21.15.123:0/3461341198 >> v1:172.21.15.130:6789/0 conn(0x7f264006df70 legacy=0x7f26400cff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:38.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.090+0000 7f2645800640 1 -- 172.21.15.123:0/3461341198 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26400d26a0 con 0x7f26400d1b50 2024-04-25T13:43:38.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.090+0000 7f2645800640 1 --2- 172.21.15.123:0/3461341198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26400d1b50 0x7f26400b48b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2638009e50 tx=0x7f263801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d61720cd387c0fff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:38.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.090+0000 7f263fe00640 1 -- 172.21.15.123:0/3461341198 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26380a5810 con 0x7f26400d1b50 2024-04-25T13:43:38.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.094+0000 7f263fe00640 1 -- 172.21.15.123:0/3461341198 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26380a59b0 con 0x7f26400d1b50 2024-04-25T13:43:38.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.094+0000 7f263fe00640 1 -- 172.21.15.123:0/3461341198 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26380a5d80 con 0x7f26400d1b50 2024-04-25T13:43:38.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.094+0000 7f2647800640 1 -- 172.21.15.123:0/3461341198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26400d1b50 msgr2=0x7f26400b48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:38.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.094+0000 7f2647800640 1 --2- 172.21.15.123:0/3461341198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26400d1b50 0x7f26400b48b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2638009e50 tx=0x7f263801ca30 comp rx=0 tx=0).stop 2024-04-25T13:43:38.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.094+0000 7f2647800640 1 -- 172.21.15.123:0/3461341198 shutdown_connections 2024-04-25T13:43:38.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.094+0000 7f2647800640 1 --2- 172.21.15.123:0/3461341198 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f26400d1b50 0x7f26400b48b0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.094+0000 7f2647800640 1 --2- 172.21.15.123:0/3461341198 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26400d0670 0x7f26400b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.094+0000 7f2647800640 1 -- 172.21.15.123:0/3461341198 >> 172.21.15.123:0/3461341198 conn(0x7f26400d36e0 msgr2=0x7f26400d3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:38.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.094+0000 7f2647800640 1 -- 172.21.15.123:0/3461341198 shutdown_connections 2024-04-25T13:43:38.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.094+0000 7f2647800640 1 -- 172.21.15.123:0/3461341198 wait complete. 2024-04-25T13:43:38.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.094+0000 7f2647800640 1 Processor -- start 2024-04-25T13:43:38.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.094+0000 7f2647800640 1 -- start start 2024-04-25T13:43:38.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.098+0000 7f2647800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f264006df70 0x7f2640158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:38.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.098+0000 7f2647800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26400d1b50 0x7f264015e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:38.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.098+0000 7f2647800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26400cd8d0 0x7f264015edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:38.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.098+0000 7f2647800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f26400b4f70 con 0x7f264006df70 2024-04-25T13:43:38.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.098+0000 7f2647800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f26400b4df0 con 0x7f26400d1b50 2024-04-25T13:43:38.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.098+0000 7f2647800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f26400ce540 con 0x7f26400cd8d0 2024-04-25T13:43:38.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.098+0000 7f2644e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f264006df70 0x7f2640158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:38.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.098+0000 7f2644e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f264006df70 0x7f2640158cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43992/0 (socket says 172.21.15.123:43992) 2024-04-25T13:43:38.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.098+0000 7f2644e00640 1 -- 172.21.15.123:0/159919757 learned_addr learned my addr 172.21.15.123:0/159919757 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:38.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.098+0000 7f2637e00640 1 --2- 172.21.15.123:0/159919757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26400d1b50 0x7f264015e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:38.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.098+0000 7f2645800640 1 --2- 172.21.15.123:0/159919757 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26400cd8d0 0x7f264015edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:38.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.098+0000 7f2644e00640 1 -- 172.21.15.123:0/159919757 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26400cd8d0 msgr2=0x7f264015edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:38.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.098+0000 7f2644e00640 1 --2- 172.21.15.123:0/159919757 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26400cd8d0 0x7f264015edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.098+0000 7f2644e00640 1 -- 172.21.15.123:0/159919757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26400d1b50 msgr2=0x7f264015e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:38.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.098+0000 7f2644e00640 1 --2- 172.21.15.123:0/159919757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26400d1b50 0x7f264015e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.098+0000 7f2644e00640 1 -- 172.21.15.123:0/159919757 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2640163770 con 0x7f264006df70 2024-04-25T13:43:38.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.098+0000 7f2637e00640 1 --2- 172.21.15.123:0/159919757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26400d1b50 0x7f264015e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:38.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.098+0000 7f2644e00640 1 --2- 172.21.15.123:0/159919757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f264006df70 0x7f2640158cd0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f263000c3f0 tx=0x7f263000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:38.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.098+0000 7f263d600640 1 -- 172.21.15.123:0/159919757 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26300052d0 con 0x7f264006df70 2024-04-25T13:43:38.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.098+0000 7f263d600640 1 -- 172.21.15.123:0/159919757 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26300054b0 con 0x7f264006df70 2024-04-25T13:43:38.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.098+0000 7f2647800640 1 -- 172.21.15.123:0/159919757 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26400cafa0 con 0x7f264006df70 2024-04-25T13:43:38.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.098+0000 7f263d600640 1 -- 172.21.15.123:0/159919757 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2630006a70 con 0x7f264006df70 2024-04-25T13:43:38.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.098+0000 7f2647800640 1 -- 172.21.15.123:0/159919757 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26400cacc0 con 0x7f264006df70 2024-04-25T13:43:38.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.098+0000 7f2647800640 1 -- 172.21.15.123:0/159919757 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2640050750 con 0x7f264006df70 2024-04-25T13:43:38.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.102+0000 7f263d600640 1 -- 172.21.15.123:0/159919757 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2630006c10 con 0x7f264006df70 2024-04-25T13:43:38.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.102+0000 7f263d600640 1 --2- 172.21.15.123:0/159919757 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f261c06f430 0x7f261c071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:38.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.102+0000 7f263d600640 1 -- 172.21.15.123:0/159919757 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f263008e400 con 0x7f264006df70 2024-04-25T13:43:38.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.102+0000 7f2637e00640 1 --2- 172.21.15.123:0/159919757 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f261c06f430 0x7f261c071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:38.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.102+0000 7f2637e00640 1 --2- 172.21.15.123:0/159919757 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f261c06f430 0x7f261c071940 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f264015ae20 tx=0x7f2628008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:38.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.106+0000 7f263d600640 1 -- 172.21.15.123:0/159919757 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f263005b670 con 0x7f264006df70 2024-04-25T13:43:38.269 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.262+0000 7f2647800640 1 -- 172.21.15.123:0/159919757 --> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f26400b9210 con 0x7f261c06f430 2024-04-25T13:43:38.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.266+0000 7f263d600640 1 -- 172.21.15.123:0/159919757 <== mgr.4107 v2:172.21.15.123:6832/715752891 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f26400b9210 con 0x7f261c06f430 2024-04-25T13:43:38.270 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T13:43:38.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.266+0000 7f2647800640 1 -- 172.21.15.123:0/159919757 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f261c06f430 msgr2=0x7f261c071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:38.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.266+0000 7f2647800640 1 --2- 172.21.15.123:0/159919757 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f261c06f430 0x7f261c071940 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f264015ae20 tx=0x7f2628008040 comp rx=0 tx=0).stop 2024-04-25T13:43:38.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.266+0000 7f2647800640 1 -- 172.21.15.123:0/159919757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f264006df70 msgr2=0x7f2640158cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:38.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.266+0000 7f2647800640 1 --2- 172.21.15.123:0/159919757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f264006df70 0x7f2640158cd0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f263000c3f0 tx=0x7f263000c8b0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.266+0000 7f2647800640 1 -- 172.21.15.123:0/159919757 shutdown_connections 2024-04-25T13:43:38.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.266+0000 7f2647800640 1 --2- 172.21.15.123:0/159919757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26400d1b50 0x7f264015e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.266+0000 7f2647800640 1 --2- 172.21.15.123:0/159919757 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f261c06f430 0x7f261c071940 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.266+0000 7f2647800640 1 --2- 172.21.15.123:0/159919757 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26400cd8d0 0x7f264015edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.266+0000 7f2647800640 1 --2- 172.21.15.123:0/159919757 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f264006df70 0x7f2640158cd0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.266+0000 7f2647800640 1 -- 172.21.15.123:0/159919757 >> 172.21.15.123:0/159919757 conn(0x7f26400d36e0 msgr2=0x7f2640072480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:38.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.266+0000 7f2647800640 1 -- 172.21.15.123:0/159919757 shutdown_connections 2024-04-25T13:43:38.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.266+0000 7f2647800640 1 -- 172.21.15.123:0/159919757 wait complete. 2024-04-25T13:43:38.291 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T13:43:38.291 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:43:38.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.438+0000 7fc027000640 1 Processor -- start 2024-04-25T13:43:38.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.438+0000 7fc027000640 1 -- start start 2024-04-25T13:43:38.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.442+0000 7fc027000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc02015cc10 0x7fc0200b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:38.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.442+0000 7fc027000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc02006ebe0 0x7fc02006eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:38.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.442+0000 7fc027000640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc02015d020 con 0x7fc0200b4b70 2024-04-25T13:43:38.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.442+0000 7fc027000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fc0200b6310 con 0x7fc02006ebe0 2024-04-25T13:43:38.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.442+0000 7fc027000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc0200d0d90 con 0x7fc02015cc10 2024-04-25T13:43:38.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.442+0000 7fc025000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc02006ebe0 0x7fc02006eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:38.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.442+0000 7fc025000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fc02006ebe0 0x7fc02006eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44004/0 (socket says 172.21.15.123:44004) 2024-04-25T13:43:38.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.442+0000 7fc025000640 1 -- 172.21.15.123:0/528780693 learned_addr learned my addr 172.21.15.123:0/528780693 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:38.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.442+0000 7fc01fe00640 1 --2- 172.21.15.123:0/528780693 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc02015cc10 0x7fc0200b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:38.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.442+0000 7fc025000640 1 -- 172.21.15.123:0/528780693 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc02015cc10 msgr2=0x7fc0200b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:38.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.442+0000 7fc025000640 1 --2- 172.21.15.123:0/528780693 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc02015cc10 0x7fc0200b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.442+0000 7fc025000640 1 -- 172.21.15.123:0/528780693 >> v1:172.21.15.130:6789/0 conn(0x7fc0200b4b70 legacy=0x7fc0200b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:38.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.442+0000 7fc025000640 1 -- 172.21.15.123:0/528780693 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0200b6990 con 0x7fc02006ebe0 2024-04-25T13:43:38.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.446+0000 7fc025000640 1 --2- 172.21.15.123:0/528780693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc02006ebe0 0x7fc02006eff0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fc018009e50 tx=0x7fc01801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e191e560de0bf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:38.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.446+0000 7fc01f400640 1 -- 172.21.15.123:0/528780693 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0180a5860 con 0x7fc02006ebe0 2024-04-25T13:43:38.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.446+0000 7fc01f400640 1 -- 172.21.15.123:0/528780693 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0180a5a00 con 0x7fc02006ebe0 2024-04-25T13:43:38.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.446+0000 7fc01f400640 1 -- 172.21.15.123:0/528780693 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0180a5dd0 con 0x7fc02006ebe0 2024-04-25T13:43:38.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.446+0000 7fc027000640 1 -- 172.21.15.123:0/528780693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc02006ebe0 msgr2=0x7fc02006eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:38.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.446+0000 7fc027000640 1 --2- 172.21.15.123:0/528780693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc02006ebe0 0x7fc02006eff0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fc018009e50 tx=0x7fc01801c9a0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.446+0000 7fc027000640 1 -- 172.21.15.123:0/528780693 shutdown_connections 2024-04-25T13:43:38.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.446+0000 7fc027000640 1 --2- 172.21.15.123:0/528780693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc02006ebe0 0x7fc02006eff0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.446+0000 7fc027000640 1 --2- 172.21.15.123:0/528780693 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc02015cc10 0x7fc0200b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.446+0000 7fc027000640 1 -- 172.21.15.123:0/528780693 >> 172.21.15.123:0/528780693 conn(0x7fc0200b38a0 msgr2=0x7fc0200d15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:38.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.446+0000 7fc027000640 1 -- 172.21.15.123:0/528780693 shutdown_connections 2024-04-25T13:43:38.452 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.446+0000 7fc027000640 1 -- 172.21.15.123:0/528780693 wait complete. 2024-04-25T13:43:38.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.450+0000 7fc027000640 1 Processor -- start 2024-04-25T13:43:38.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.450+0000 7fc027000640 1 -- start start 2024-04-25T13:43:38.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.450+0000 7fc027000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc02006ebe0 0x7fc02015b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:38.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.450+0000 7fc027000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc0200b4b70 0x7fc0200b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:38.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.450+0000 7fc027000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc02015cc10 0x7fc0201f9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:38.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.450+0000 7fc027000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fc0200d1220 con 0x7fc02015cc10 2024-04-25T13:43:38.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.450+0000 7fc027000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc0200b5950 con 0x7fc02006ebe0 2024-04-25T13:43:38.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.450+0000 7fc027000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fc0201f89c0 con 0x7fc0200b4b70 2024-04-25T13:43:38.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.450+0000 7fc025000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc02015cc10 0x7fc0201f9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:38.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.450+0000 7fc025000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc02015cc10 0x7fc0201f9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44008/0 (socket says 172.21.15.123:44008) 2024-04-25T13:43:38.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.450+0000 7fc025000640 1 -- 172.21.15.123:0/2896364315 learned_addr learned my addr 172.21.15.123:0/2896364315 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:38.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.450+0000 7fc01fe00640 1 --2- 172.21.15.123:0/2896364315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc02006ebe0 0x7fc02015b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:38.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.450+0000 7fc017400640 1 --2- 172.21.15.123:0/2896364315 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc0200b4b70 0x7fc0200b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:38.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.450+0000 7fc025000640 1 -- 172.21.15.123:0/2896364315 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc0200b4b70 msgr2=0x7fc0200b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:38.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.450+0000 7fc025000640 1 --2- 172.21.15.123:0/2896364315 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc0200b4b70 0x7fc0200b25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.450+0000 7fc025000640 1 -- 172.21.15.123:0/2896364315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc02006ebe0 msgr2=0x7fc02015b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:38.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.450+0000 7fc025000640 1 --2- 172.21.15.123:0/2896364315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc02006ebe0 0x7fc02015b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.450+0000 7fc025000640 1 -- 172.21.15.123:0/2896364315 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc020141b90 con 0x7fc02015cc10 2024-04-25T13:43:38.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.450+0000 7fc025000640 1 --2- 172.21.15.123:0/2896364315 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc02015cc10 0x7fc0201f9e20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc018009e50 tx=0x7fc0180197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:38.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.450+0000 7fc01cc00640 1 -- 172.21.15.123:0/2896364315 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0180b8680 con 0x7fc02015cc10 2024-04-25T13:43:38.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.450+0000 7fc01cc00640 1 -- 172.21.15.123:0/2896364315 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0180b8820 con 0x7fc02015cc10 2024-04-25T13:43:38.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.450+0000 7fc01cc00640 1 -- 172.21.15.123:0/2896364315 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0180b8bf0 con 0x7fc02015cc10 2024-04-25T13:43:38.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.450+0000 7fc027000640 1 -- 172.21.15.123:0/2896364315 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc020141e70 con 0x7fc02015cc10 2024-04-25T13:43:38.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.450+0000 7fc027000640 1 -- 172.21.15.123:0/2896364315 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc020142430 con 0x7fc02015cc10 2024-04-25T13:43:38.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.454+0000 7fc027000640 1 -- 172.21.15.123:0/2896364315 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc020076de0 con 0x7fc02015cc10 2024-04-25T13:43:38.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.454+0000 7fc01cc00640 1 -- 172.21.15.123:0/2896364315 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc0180c0020 con 0x7fc02015cc10 2024-04-25T13:43:38.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.454+0000 7fc01cc00640 1 --2- 172.21.15.123:0/2896364315 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fbffc06f430 0x7fbffc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:38.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.454+0000 7fc01cc00640 1 -- 172.21.15.123:0/2896364315 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fc018129f80 con 0x7fc02015cc10 2024-04-25T13:43:38.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.454+0000 7fc01cc00640 1 --2- 172.21.15.123:0/2896364315 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x7fbffc075340 0x7fbffc077790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:38.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.454+0000 7fc01fe00640 1 --2- 172.21.15.123:0/2896364315 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fbffc06f430 0x7fbffc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:38.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.454+0000 7fc01cc00640 1 -- 172.21.15.123:0/2896364315 --> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc0180b7e50 con 0x7fbffc075340 2024-04-25T13:43:38.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.454+0000 7fc01cc00640 1 -- 172.21.15.123:0/2896364315 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fc01812a330 con 0x7fc02015cc10 2024-04-25T13:43:38.460 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.454+0000 7fc017400640 1 --2- 172.21.15.123:0/2896364315 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x7fbffc075340 0x7fbffc077790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:38.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.454+0000 7fc01fe00640 1 --2- 172.21.15.123:0/2896364315 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fbffc06f430 0x7fbffc071940 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc0100079c0 tx=0x7fc010008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:38.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.454+0000 7fc017400640 1 --2- 172.21.15.123:0/2896364315 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x7fbffc075340 0x7fbffc077790 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:38.461 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.458+0000 7fc01cc00640 1 -- 172.21.15.123:0/2896364315 <== osd.3 v2:172.21.15.123:6816/898268961 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc0180b7e50 con 0x7fbffc075340 2024-04-25T13:43:38.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.470+0000 7fc027000640 1 -- 172.21.15.123:0/2896364315 --> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc020141940 con 0x7fbffc075340 2024-04-25T13:43:38.474 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.470+0000 7fc01cc00640 1 -- 172.21.15.123:0/2896364315 <== osd.3 v2:172.21.15.123:6816/898268961 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc020141940 con 0x7fbffc075340 2024-04-25T13:43:38.475 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-04-25T13:43:38.475 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:43:38.475 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-04-25T13:43:38.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.470+0000 7fc027000640 1 -- 172.21.15.123:0/2896364315 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x7fbffc075340 msgr2=0x7fbffc077790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:38.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.470+0000 7fc027000640 1 --2- 172.21.15.123:0/2896364315 >> [v2:172.21.15.123:6816/898268961,v1:172.21.15.123:6817/898268961] conn(0x7fbffc075340 0x7fbffc077790 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.470+0000 7fc027000640 1 -- 172.21.15.123:0/2896364315 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fbffc06f430 msgr2=0x7fbffc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:38.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.470+0000 7fc027000640 1 --2- 172.21.15.123:0/2896364315 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fbffc06f430 0x7fbffc071940 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc0100079c0 tx=0x7fc010008040 comp rx=0 tx=0).stop 2024-04-25T13:43:38.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.470+0000 7fc027000640 1 -- 172.21.15.123:0/2896364315 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc02015cc10 msgr2=0x7fc0201f9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:38.476 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.470+0000 7fc027000640 1 --2- 172.21.15.123:0/2896364315 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc02015cc10 0x7fc0201f9e20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fc018009e50 tx=0x7fc0180197a0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.470+0000 7fc025000640 1 -- 172.21.15.123:0/2896364315 reap_dead start 2024-04-25T13:43:38.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.470+0000 7fc027000640 1 -- 172.21.15.123:0/2896364315 shutdown_connections 2024-04-25T13:43:38.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.470+0000 7fc027000640 1 -- 172.21.15.123:0/2896364315 >> 172.21.15.123:0/2896364315 conn(0x7fc0200b38a0 msgr2=0x7fc0201564e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:38.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.470+0000 7fc027000640 1 -- 172.21.15.123:0/2896364315 shutdown_connections 2024-04-25T13:43:38.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.470+0000 7fc027000640 1 -- 172.21.15.123:0/2896364315 wait complete. 2024-04-25T13:43:38.494 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T13:43:38.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.638+0000 7f3a59000640 1 Processor -- start 2024-04-25T13:43:38.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.638+0000 7f3a59000640 1 -- start start 2024-04-25T13:43:38.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.638+0000 7f3a59000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a540b3870 0x7f3a540b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:38.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.638+0000 7f3a59000640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3a54072af0 0x7f3a54072f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:38.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.638+0000 7f3a59000640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a540b41c0 con 0x7f3a541571b0 2024-04-25T13:43:38.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.638+0000 7f3a59000640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f3a540cdee0 con 0x7f3a54072af0 2024-04-25T13:43:38.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.638+0000 7f3a59000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3a5415d570 con 0x7f3a540b3870 2024-04-25T13:43:38.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.638+0000 7f3a51400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a540b3870 0x7f3a540b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:38.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.638+0000 7f3a52800640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3a54072af0 0x7f3a54072f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:38.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.638+0000 7f3a51e00640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f3a541571b0 0x7f3a540cd6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.123:44946/0 (socket says 172.21.15.123:44946) 2024-04-25T13:43:38.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.638+0000 7f3a51e00640 1 -- 172.21.15.123:0/2674661470 learned_addr learned my addr 172.21.15.123:0/2674661470 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:38.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.638+0000 7f3a52800640 1 -- 172.21.15.123:0/2674661470 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a540b3870 msgr2=0x7f3a540b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:38.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.638+0000 7f3a52800640 1 --2- 172.21.15.123:0/2674661470 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a540b3870 0x7f3a540b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.638+0000 7f3a52800640 1 -- 172.21.15.123:0/2674661470 >> v1:172.21.15.130:6789/0 conn(0x7f3a541571b0 legacy=0x7f3a540cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:38.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.638+0000 7f3a52800640 1 -- 172.21.15.123:0/2674661470 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a5415d850 con 0x7f3a54072af0 2024-04-25T13:43:38.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.638+0000 7f3a50a00640 1 -- 172.21.15.123:0/2674661470 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3819883925 0 0) 0x7f3a44001120 con 0x7f3a541571b0 2024-04-25T13:43:38.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.642+0000 7f3a52800640 1 --2- 172.21.15.123:0/2674661470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a54072af0 0x7f3a54072f00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c009d90 tx=0x7f3a4c01c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22fe58e245048f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:38.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.642+0000 7f3a50a00640 1 -- 172.21.15.123:0/2674661470 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c0b2070 con 0x7f3a54072af0 2024-04-25T13:43:38.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.642+0000 7f3a50a00640 1 -- 172.21.15.123:0/2674661470 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a4c0a5a20 con 0x7f3a54072af0 2024-04-25T13:43:38.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.642+0000 7f3a50a00640 1 -- 172.21.15.123:0/2674661470 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c0a5df0 con 0x7f3a54072af0 2024-04-25T13:43:38.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.642+0000 7f3a59000640 1 -- 172.21.15.123:0/2674661470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a54072af0 msgr2=0x7f3a54072f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:38.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.642+0000 7f3a59000640 1 --2- 172.21.15.123:0/2674661470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a54072af0 0x7f3a54072f00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c009d90 tx=0x7f3a4c01c940 comp rx=0 tx=0).stop 2024-04-25T13:43:38.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.642+0000 7f3a59000640 1 -- 172.21.15.123:0/2674661470 shutdown_connections 2024-04-25T13:43:38.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.642+0000 7f3a59000640 1 --2- 172.21.15.123:0/2674661470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a54072af0 0x7f3a54072f00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.642+0000 7f3a59000640 1 --2- 172.21.15.123:0/2674661470 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a540b3870 0x7f3a540b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.642+0000 7f3a59000640 1 -- 172.21.15.123:0/2674661470 >> 172.21.15.123:0/2674661470 conn(0x7f3a5406ca70 msgr2=0x7f3a5406ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:38.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.642+0000 7f3a59000640 1 -- 172.21.15.123:0/2674661470 shutdown_connections 2024-04-25T13:43:38.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.642+0000 7f3a59000640 1 -- 172.21.15.123:0/2674661470 wait complete. 2024-04-25T13:43:38.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.646+0000 7f3a59000640 1 Processor -- start 2024-04-25T13:43:38.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.646+0000 7f3a59000640 1 -- start start 2024-04-25T13:43:38.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.646+0000 7f3a59000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a54072af0 0x7f3a54153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:38.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.646+0000 7f3a59000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a540b3870 0x7f3a541565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:38.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.646+0000 7f3a59000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a541571b0 0x7f3a5414bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:38.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.646+0000 7f3a59000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f3a54157740 con 0x7f3a54072af0 2024-04-25T13:43:38.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.646+0000 7f3a59000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3a541575c0 con 0x7f3a541571b0 2024-04-25T13:43:38.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.646+0000 7f3a59000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f3a54073850 con 0x7f3a540b3870 2024-04-25T13:43:38.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.646+0000 7f3a51e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a54072af0 0x7f3a54153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:38.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.646+0000 7f3a51e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a54072af0 0x7f3a54153200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44014/0 (socket says 172.21.15.123:44014) 2024-04-25T13:43:38.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.646+0000 7f3a51e00640 1 -- 172.21.15.123:0/3200465009 learned_addr learned my addr 172.21.15.123:0/3200465009 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:38.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.646+0000 7f3a52800640 1 --2- 172.21.15.123:0/3200465009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a541571b0 0x7f3a5414bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:38.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.646+0000 7f3a51400640 1 --2- 172.21.15.123:0/3200465009 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a540b3870 0x7f3a541565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:38.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.650+0000 7f3a51e00640 1 -- 172.21.15.123:0/3200465009 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a540b3870 msgr2=0x7f3a541565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:38.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.650+0000 7f3a51e00640 1 --2- 172.21.15.123:0/3200465009 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a540b3870 0x7f3a541565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.650+0000 7f3a51e00640 1 -- 172.21.15.123:0/3200465009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a541571b0 msgr2=0x7f3a5414bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:38.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.650+0000 7f3a51e00640 1 --2- 172.21.15.123:0/3200465009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a541571b0 0x7f3a5414bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.650+0000 7f3a51e00640 1 -- 172.21.15.123:0/3200465009 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a54153a50 con 0x7f3a54072af0 2024-04-25T13:43:38.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.650+0000 7f3a51e00640 1 --2- 172.21.15.123:0/3200465009 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a54072af0 0x7f3a54153200 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400c450 tx=0x7f3a4400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:38.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.650+0000 7f3a4a000640 1 -- 172.21.15.123:0/3200465009 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a44018070 con 0x7f3a54072af0 2024-04-25T13:43:38.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.650+0000 7f3a4a000640 1 -- 172.21.15.123:0/3200465009 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a440074e0 con 0x7f3a54072af0 2024-04-25T13:43:38.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.650+0000 7f3a4a000640 1 -- 172.21.15.123:0/3200465009 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a440049f0 con 0x7f3a54072af0 2024-04-25T13:43:38.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.650+0000 7f3a59000640 1 -- 172.21.15.123:0/3200465009 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a54153d30 con 0x7f3a54072af0 2024-04-25T13:43:38.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.650+0000 7f3a59000640 1 -- 172.21.15.123:0/3200465009 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a5414d160 con 0x7f3a54072af0 2024-04-25T13:43:38.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.650+0000 7f3a59000640 1 -- 172.21.15.123:0/3200465009 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a54050750 con 0x7f3a54072af0 2024-04-25T13:43:38.656 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.650+0000 7f3a4a000640 1 -- 172.21.15.123:0/3200465009 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3a44004b90 con 0x7f3a54072af0 2024-04-25T13:43:38.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.654+0000 7f3a4a000640 1 --2- 172.21.15.123:0/3200465009 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3a3406f430 0x7f3a34071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:38.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.654+0000 7f3a4a000640 1 -- 172.21.15.123:0/3200465009 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f3a4408e370 con 0x7f3a54072af0 2024-04-25T13:43:38.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.654+0000 7f3a51400640 1 --2- 172.21.15.123:0/3200465009 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3a3406f430 0x7f3a34071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:38.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.654+0000 7f3a51400640 1 --2- 172.21.15.123:0/3200465009 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3a3406f430 0x7f3a34071940 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3a5415c9e0 tx=0x7f3a40008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:38.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.658+0000 7f3a4a000640 1 -- 172.21.15.123:0/3200465009 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3a540b41c0 con 0x7f3a54072af0 2024-04-25T13:43:38.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.814+0000 7f3a59000640 1 -- 172.21.15.123:0/3200465009 --> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f3a54074cc0 con 0x7f3a3406f430 2024-04-25T13:43:38.820 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.814+0000 7f3a4a000640 1 -- 172.21.15.123:0/3200465009 <== mgr.4107 v2:172.21.15.123:6832/715752891 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3a54074cc0 con 0x7f3a3406f430 2024-04-25T13:43:38.820 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T13:43:38.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.818+0000 7f3a59000640 1 -- 172.21.15.123:0/3200465009 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3a3406f430 msgr2=0x7f3a34071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:38.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.818+0000 7f3a59000640 1 --2- 172.21.15.123:0/3200465009 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3a3406f430 0x7f3a34071940 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3a5415c9e0 tx=0x7f3a40008040 comp rx=0 tx=0).stop 2024-04-25T13:43:38.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.818+0000 7f3a59000640 1 -- 172.21.15.123:0/3200465009 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a54072af0 msgr2=0x7f3a54153200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:38.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.818+0000 7f3a59000640 1 --2- 172.21.15.123:0/3200465009 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a54072af0 0x7f3a54153200 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400c450 tx=0x7f3a4400c910 comp rx=0 tx=0).stop 2024-04-25T13:43:38.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.818+0000 7f3a59000640 1 -- 172.21.15.123:0/3200465009 shutdown_connections 2024-04-25T13:43:38.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.818+0000 7f3a59000640 1 --2- 172.21.15.123:0/3200465009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3a541571b0 0x7f3a5414bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.818+0000 7f3a59000640 1 --2- 172.21.15.123:0/3200465009 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f3a3406f430 0x7f3a34071940 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.818+0000 7f3a59000640 1 --2- 172.21.15.123:0/3200465009 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3a540b3870 0x7f3a541565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.818+0000 7f3a59000640 1 --2- 172.21.15.123:0/3200465009 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a54072af0 0x7f3a54153200 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.818+0000 7f3a59000640 1 -- 172.21.15.123:0/3200465009 >> 172.21.15.123:0/3200465009 conn(0x7f3a5406ca70 msgr2=0x7f3a5415e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:38.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.818+0000 7f3a59000640 1 -- 172.21.15.123:0/3200465009 shutdown_connections 2024-04-25T13:43:38.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.818+0000 7f3a59000640 1 -- 172.21.15.123:0/3200465009 wait complete. 2024-04-25T13:43:38.842 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T13:43:38.842 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:43:38.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.986+0000 7f2c98800640 1 Processor -- start 2024-04-25T13:43:38.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.986+0000 7f2c98800640 1 -- start start 2024-04-25T13:43:38.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.990+0000 7f2c98800640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2c900b5280 0x7f2c900b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:38.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.990+0000 7f2c98800640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c9015d020 con 0x7f2c9006ebe0 2024-04-25T13:43:38.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.990+0000 7f2c98800640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c900b6990 con 0x7f2c9015cc10 2024-04-25T13:43:38.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.990+0000 7f2c98800640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f2c900b6310 con 0x7f2c900b5280 2024-04-25T13:43:38.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.990+0000 7f2c95400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f2c900b5280 0x7f2c900b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:38.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.990+0000 7f2c96800640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f2c9006ebe0 0x7f2c9006eff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58266/0 (socket says 172.21.15.123:58266) 2024-04-25T13:43:38.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.990+0000 7f2c96800640 1 -- 172.21.15.123:0/1067557693 learned_addr learned my addr 172.21.15.123:0/1067557693 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:38.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.990+0000 7f2c95400640 1 -- 172.21.15.123:0/1067557693 >> v1:172.21.15.130:6789/0 conn(0x7f2c9015cc10 legacy=0x7f2c900b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:38.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.990+0000 7f2c95400640 1 -- 172.21.15.123:0/1067557693 >> v1:172.21.15.123:6789/0 conn(0x7f2c9006ebe0 legacy=0x7f2c9006eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:38.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.990+0000 7f2c95400640 1 -- 172.21.15.123:0/1067557693 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c900d0460 con 0x7f2c900b5280 2024-04-25T13:43:38.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.990+0000 7f2c94a00640 1 -- 172.21.15.123:0/1067557693 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3965391545 0 0) 0x7f2c9015d020 con 0x7f2c9006ebe0 2024-04-25T13:43:38.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.994+0000 7f2c95400640 1 --2- 172.21.15.123:0/1067557693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c900b5280 0x7f2c900b5dd0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2c800097c0 tx=0x7f2c8001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=577f46016b9e6148 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:38.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.994+0000 7f2c94a00640 1 -- 172.21.15.123:0/1067557693 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c800b0070 con 0x7f2c900b5280 2024-04-25T13:43:38.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.994+0000 7f2c94a00640 1 -- 172.21.15.123:0/1067557693 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c800ab600 con 0x7f2c900b5280 2024-04-25T13:43:38.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.994+0000 7f2c94a00640 1 -- 172.21.15.123:0/1067557693 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c800ab9d0 con 0x7f2c900b5280 2024-04-25T13:43:38.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.994+0000 7f2c98800640 1 -- 172.21.15.123:0/1067557693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c900b5280 msgr2=0x7f2c900b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:38.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.994+0000 7f2c98800640 1 --2- 172.21.15.123:0/1067557693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c900b5280 0x7f2c900b5dd0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2c800097c0 tx=0x7f2c8001c3d0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.994+0000 7f2c98800640 1 -- 172.21.15.123:0/1067557693 shutdown_connections 2024-04-25T13:43:38.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.994+0000 7f2c98800640 1 --2- 172.21.15.123:0/1067557693 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c900b5280 0x7f2c900b5dd0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:38.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.994+0000 7f2c98800640 1 -- 172.21.15.123:0/1067557693 >> 172.21.15.123:0/1067557693 conn(0x7f2c900b38a0 msgr2=0x7f2c900d15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:38.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.994+0000 7f2c98800640 1 -- 172.21.15.123:0/1067557693 shutdown_connections 2024-04-25T13:43:39.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.994+0000 7f2c98800640 1 -- 172.21.15.123:0/1067557693 wait complete. 2024-04-25T13:43:39.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.994+0000 7f2c98800640 1 Processor -- start 2024-04-25T13:43:39.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.998+0000 7f2c98800640 1 -- start start 2024-04-25T13:43:39.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.998+0000 7f2c98800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2c9006ebe0 0x7f2c9014e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.998+0000 7f2c98800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c9015cc10 0x7f2c901fde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.005 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.998+0000 7f2c98800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c9013aa40 0x7f2c90138760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.998+0000 7f2c98800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f2c900d1220 con 0x7f2c9013aa40 2024-04-25T13:43:39.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.998+0000 7f2c98800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9006fb10 con 0x7f2c9015cc10 2024-04-25T13:43:39.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.998+0000 7f2c98800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f2c90139410 con 0x7f2c9006ebe0 2024-04-25T13:43:39.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.998+0000 7f2c96800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c9013aa40 0x7f2c90138760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:39.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.998+0000 7f2c96800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c9013aa40 0x7f2c90138760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44022/0 (socket says 172.21.15.123:44022) 2024-04-25T13:43:39.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.998+0000 7f2c96800640 1 -- 172.21.15.123:0/2153017413 learned_addr learned my addr 172.21.15.123:0/2153017413 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:39.006 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.998+0000 7f2c96800640 1 -- 172.21.15.123:0/2153017413 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2c9006ebe0 msgr2=0x7f2c9014e960 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T13:43:39.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.998+0000 7f2c96800640 1 --2- 172.21.15.123:0/2153017413 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2c9006ebe0 0x7f2c9014e960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.998+0000 7f2c96800640 1 -- 172.21.15.123:0/2153017413 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c9015cc10 msgr2=0x7f2c901fde30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T13:43:39.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.998+0000 7f2c96800640 1 --2- 172.21.15.123:0/2153017413 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2c9015cc10 0x7f2c901fde30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.998+0000 7f2c96800640 1 -- 172.21.15.123:0/2153017413 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c901fe370 con 0x7f2c9013aa40 2024-04-25T13:43:39.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.998+0000 7f2c96800640 1 --2- 172.21.15.123:0/2153017413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c9013aa40 0x7f2c90138760 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c00c6d0 tx=0x7f2c8c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:39.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.998+0000 7f2c8a000640 1 -- 172.21.15.123:0/2153017413 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c018070 con 0x7f2c9013aa40 2024-04-25T13:43:39.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.998+0000 7f2c8a000640 1 -- 172.21.15.123:0/2153017413 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c8c004d70 con 0x7f2c9013aa40 2024-04-25T13:43:39.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.998+0000 7f2c98800640 1 -- 172.21.15.123:0/2153017413 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c9014d8c0 con 0x7f2c9013aa40 2024-04-25T13:43:39.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.998+0000 7f2c8a000640 1 -- 172.21.15.123:0/2153017413 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c00a880 con 0x7f2c9013aa40 2024-04-25T13:43:39.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.998+0000 7f2c98800640 1 -- 172.21.15.123:0/2153017413 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c9014de80 con 0x7f2c9013aa40 2024-04-25T13:43:39.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:38.998+0000 7f2c98800640 1 -- 172.21.15.123:0/2153017413 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2c90076de0 con 0x7f2c9013aa40 2024-04-25T13:43:39.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.002+0000 7f2c8a000640 1 -- 172.21.15.123:0/2153017413 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2c8c00ac30 con 0x7f2c9013aa40 2024-04-25T13:43:39.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.002+0000 7f2c8a000640 1 --2- 172.21.15.123:0/2153017413 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f2c7406f400 0x7f2c74071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.002+0000 7f2c8a000640 1 -- 172.21.15.123:0/2153017413 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f2c8c08ed40 con 0x7f2c9013aa40 2024-04-25T13:43:39.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.002+0000 7f2c95e00640 1 --2- 172.21.15.123:0/2153017413 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f2c7406f400 0x7f2c74071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:39.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.002+0000 7f2c8a000640 1 --2- 172.21.15.123:0/2153017413 >> [v2:172.21.15.130:6821/1535108655,v1:172.21.15.130:6823/1535108655] conn(0x7f2c74075310 0x7f2c74077760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.002+0000 7f2c8a000640 1 -- 172.21.15.123:0/2153017413 --> [v2:172.21.15.130:6821/1535108655,v1:172.21.15.130:6823/1535108655] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2c8c017ec0 con 0x7f2c74075310 2024-04-25T13:43:39.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.002+0000 7f2c8a000640 1 -- 172.21.15.123:0/2153017413 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f2c8c08f1d0 con 0x7f2c9013aa40 2024-04-25T13:43:39.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.002+0000 7f2c95e00640 1 --2- 172.21.15.123:0/2153017413 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f2c7406f400 0x7f2c74071910 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2c84009690 tx=0x7f2c84006b60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:39.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.002+0000 7f2c95400640 1 --2- 172.21.15.123:0/2153017413 >> [v2:172.21.15.130:6821/1535108655,v1:172.21.15.130:6823/1535108655] conn(0x7f2c74075310 0x7f2c74077760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:39.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.002+0000 7f2c95400640 1 --2- 172.21.15.123:0/2153017413 >> [v2:172.21.15.130:6821/1535108655,v1:172.21.15.130:6823/1535108655] conn(0x7f2c74075310 0x7f2c74077760 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:39.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.006+0000 7f2c8a000640 1 -- 172.21.15.123:0/2153017413 <== osd.4 v2:172.21.15.130:6821/1535108655 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2c8c017ec0 con 0x7f2c74075310 2024-04-25T13:43:39.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.018+0000 7f2c98800640 1 -- 172.21.15.123:0/2153017413 --> [v2:172.21.15.130:6821/1535108655,v1:172.21.15.130:6823/1535108655] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2c9006a210 con 0x7f2c74075310 2024-04-25T13:43:39.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.018+0000 7f2c8a000640 1 -- 172.21.15.123:0/2153017413 <== osd.4 v2:172.21.15.130:6821/1535108655 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2c9006a210 con 0x7f2c74075310 2024-04-25T13:43:39.024 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-04-25T13:43:39.024 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:43:39.024 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-04-25T13:43:39.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.018+0000 7f2c98800640 1 -- 172.21.15.123:0/2153017413 >> [v2:172.21.15.130:6821/1535108655,v1:172.21.15.130:6823/1535108655] conn(0x7f2c74075310 msgr2=0x7f2c74077760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.018+0000 7f2c98800640 1 --2- 172.21.15.123:0/2153017413 >> [v2:172.21.15.130:6821/1535108655,v1:172.21.15.130:6823/1535108655] conn(0x7f2c74075310 0x7f2c74077760 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.018+0000 7f2c98800640 1 -- 172.21.15.123:0/2153017413 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f2c7406f400 msgr2=0x7f2c74071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.018+0000 7f2c98800640 1 --2- 172.21.15.123:0/2153017413 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f2c7406f400 0x7f2c74071910 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2c84009690 tx=0x7f2c84006b60 comp rx=0 tx=0).stop 2024-04-25T13:43:39.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.018+0000 7f2c98800640 1 -- 172.21.15.123:0/2153017413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c9013aa40 msgr2=0x7f2c90138760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.018+0000 7f2c98800640 1 --2- 172.21.15.123:0/2153017413 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2c9013aa40 0x7f2c90138760 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c00c6d0 tx=0x7f2c8c00cb90 comp rx=0 tx=0).stop 2024-04-25T13:43:39.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.018+0000 7f2c96800640 1 -- 172.21.15.123:0/2153017413 reap_dead start 2024-04-25T13:43:39.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.018+0000 7f2c98800640 1 -- 172.21.15.123:0/2153017413 shutdown_connections 2024-04-25T13:43:39.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.018+0000 7f2c98800640 1 -- 172.21.15.123:0/2153017413 >> 172.21.15.123:0/2153017413 conn(0x7f2c900b38a0 msgr2=0x7f2c900afab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:39.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.018+0000 7f2c98800640 1 -- 172.21.15.123:0/2153017413 shutdown_connections 2024-04-25T13:43:39.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.018+0000 7f2c98800640 1 -- 172.21.15.123:0/2153017413 wait complete. 2024-04-25T13:43:39.043 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T13:43:39.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.186+0000 7f5098e00640 1 Processor -- start 2024-04-25T13:43:39.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.186+0000 7f5098e00640 1 -- start start 2024-04-25T13:43:39.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.186+0000 7f5098e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f50940d0720 0x7f50940d4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.186+0000 7f5098e00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50940cec40 con 0x7f50940712b0 2024-04-25T13:43:39.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.186+0000 7f5098e00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50940cef20 con 0x7f50940b8d00 2024-04-25T13:43:39.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.186+0000 7f5098e00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f5094070e20 con 0x7f50940d0720 2024-04-25T13:43:39.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.186+0000 7f508aa00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f50940d0720 0x7f50940d4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:39.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.186+0000 7f5093e00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f50940712b0 0x7f50940716c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58278/0 (socket says 172.21.15.123:58278) 2024-04-25T13:43:39.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.186+0000 7f5093e00640 1 -- 172.21.15.123:0/3054284765 learned_addr learned my addr 172.21.15.123:0/3054284765 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:39.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.190+0000 7f508aa00640 1 -- 172.21.15.123:0/3054284765 >> v1:172.21.15.130:6789/0 conn(0x7f50940b8d00 legacy=0x7f50940d0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:39.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.190+0000 7f5092a00640 1 -- 172.21.15.123:0/3054284765 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 158984441 0 0) 0x7f50940cec40 con 0x7f50940712b0 2024-04-25T13:43:39.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.190+0000 7f508aa00640 1 -- 172.21.15.123:0/3054284765 >> v1:172.21.15.123:6789/0 conn(0x7f50940712b0 legacy=0x7f50940716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.190+0000 7f508aa00640 1 -- 172.21.15.123:0/3054284765 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50940cf200 con 0x7f50940d0720 2024-04-25T13:43:39.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.190+0000 7f508aa00640 1 --2- 172.21.15.123:0/3054284765 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50940d0720 0x7f50940d4140 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f507c0097c0 tx=0x7f507c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad7fe324986c311 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:39.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.190+0000 7f5092a00640 1 -- 172.21.15.123:0/3054284765 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507c0b0070 con 0x7f50940d0720 2024-04-25T13:43:39.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.190+0000 7f5092a00640 1 -- 172.21.15.123:0/3054284765 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f507c0ab600 con 0x7f50940d0720 2024-04-25T13:43:39.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.190+0000 7f5092a00640 1 -- 172.21.15.123:0/3054284765 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50940725e0 con 0x7f50940d0720 2024-04-25T13:43:39.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.194+0000 7f5098e00640 1 -- 172.21.15.123:0/3054284765 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50940d0720 msgr2=0x7f50940d4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.194+0000 7f5098e00640 1 --2- 172.21.15.123:0/3054284765 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50940d0720 0x7f50940d4140 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f507c0097c0 tx=0x7f507c01c460 comp rx=0 tx=0).stop 2024-04-25T13:43:39.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.194+0000 7f5098e00640 1 -- 172.21.15.123:0/3054284765 shutdown_connections 2024-04-25T13:43:39.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.194+0000 7f5098e00640 1 --2- 172.21.15.123:0/3054284765 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50940d0720 0x7f50940d4140 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.194+0000 7f5098e00640 1 -- 172.21.15.123:0/3054284765 >> 172.21.15.123:0/3054284765 conn(0x7f50940d3620 msgr2=0x7f50940d3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:39.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.194+0000 7f5098e00640 1 -- 172.21.15.123:0/3054284765 shutdown_connections 2024-04-25T13:43:39.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.194+0000 7f5098e00640 1 -- 172.21.15.123:0/3054284765 wait complete. 2024-04-25T13:43:39.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.194+0000 7f5098e00640 1 Processor -- start 2024-04-25T13:43:39.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.194+0000 7f5098e00640 1 -- start start 2024-04-25T13:43:39.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.194+0000 7f5098e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50940712b0 0x7f509415b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.194+0000 7f5098e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50940b8d00 0x7f509415b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.194+0000 7f5098e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50940b50f0 0x7f50941577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.194+0000 7f5098e00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f509416c600 con 0x7f50940b50f0 2024-04-25T13:43:39.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.194+0000 7f5098e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f509416c480 con 0x7f50940712b0 2024-04-25T13:43:39.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.194+0000 7f5098e00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f509416c780 con 0x7f50940b8d00 2024-04-25T13:43:39.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.198+0000 7f5093e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50940b50f0 0x7f50941577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:39.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.198+0000 7f5093e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50940b50f0 0x7f50941577d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44046/0 (socket says 172.21.15.123:44046) 2024-04-25T13:43:39.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.198+0000 7f5093e00640 1 -- 172.21.15.123:0/2699362420 learned_addr learned my addr 172.21.15.123:0/2699362420 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:39.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.198+0000 7f5093e00640 1 -- 172.21.15.123:0/2699362420 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50940b8d00 msgr2=0x7f509415b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.198+0000 7f5093e00640 1 --2- 172.21.15.123:0/2699362420 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50940b8d00 0x7f509415b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.198+0000 7f5093e00640 1 -- 172.21.15.123:0/2699362420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50940712b0 msgr2=0x7f509415b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.198+0000 7f5093e00640 1 --2- 172.21.15.123:0/2699362420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50940712b0 0x7f509415b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.198+0000 7f5093e00640 1 -- 172.21.15.123:0/2699362420 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5094157150 con 0x7f50940b50f0 2024-04-25T13:43:39.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.198+0000 7f5093e00640 1 --2- 172.21.15.123:0/2699362420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50940b50f0 0x7f50941577d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f508c00c700 tx=0x7f508c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:39.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.198+0000 7f508be00640 1 -- 172.21.15.123:0/2699362420 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c018070 con 0x7f50940b50f0 2024-04-25T13:43:39.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.198+0000 7f508be00640 1 -- 172.21.15.123:0/2699362420 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f508c00ce10 con 0x7f50940b50f0 2024-04-25T13:43:39.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.198+0000 7f508be00640 1 -- 172.21.15.123:0/2699362420 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c00a860 con 0x7f50940b50f0 2024-04-25T13:43:39.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.198+0000 7f5098e00640 1 -- 172.21.15.123:0/2699362420 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f509415a670 con 0x7f50940b50f0 2024-04-25T13:43:39.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.198+0000 7f5098e00640 1 -- 172.21.15.123:0/2699362420 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f509415ac30 con 0x7f50940b50f0 2024-04-25T13:43:39.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.198+0000 7f5098e00640 1 -- 172.21.15.123:0/2699362420 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5094157320 con 0x7f50940b50f0 2024-04-25T13:43:39.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.198+0000 7f508be00640 1 -- 172.21.15.123:0/2699362420 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f508c00aa00 con 0x7f50940b50f0 2024-04-25T13:43:39.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.202+0000 7f508be00640 1 --2- 172.21.15.123:0/2699362420 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f507006f430 0x7f5070071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.202+0000 7f508be00640 1 -- 172.21.15.123:0/2699362420 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f508c08e4e0 con 0x7f50940b50f0 2024-04-25T13:43:39.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.202+0000 7f5093400640 1 --2- 172.21.15.123:0/2699362420 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f507006f430 0x7f5070071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:39.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.202+0000 7f5093400640 1 --2- 172.21.15.123:0/2699362420 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f507006f430 0x7f5070071940 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5094070b70 tx=0x7f5084006bd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:39.210 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.206+0000 7f508be00640 1 -- 172.21.15.123:0/2699362420 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5094157320 con 0x7f50940b50f0 2024-04-25T13:43:39.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.362+0000 7f5098e00640 1 -- 172.21.15.123:0/2699362420 --> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f50941575c0 con 0x7f507006f430 2024-04-25T13:43:39.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.362+0000 7f508be00640 1 -- 172.21.15.123:0/2699362420 <== mgr.4107 v2:172.21.15.123:6832/715752891 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f50941575c0 con 0x7f507006f430 2024-04-25T13:43:39.367 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T13:43:39.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.362+0000 7f5098e00640 1 -- 172.21.15.123:0/2699362420 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f507006f430 msgr2=0x7f5070071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.362+0000 7f5098e00640 1 --2- 172.21.15.123:0/2699362420 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f507006f430 0x7f5070071940 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5094070b70 tx=0x7f5084006bd0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.362+0000 7f5098e00640 1 -- 172.21.15.123:0/2699362420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50940b50f0 msgr2=0x7f50941577d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.369 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.362+0000 7f5098e00640 1 --2- 172.21.15.123:0/2699362420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50940b50f0 0x7f50941577d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f508c00c700 tx=0x7f508c00cbc0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.362+0000 7f5098e00640 1 -- 172.21.15.123:0/2699362420 shutdown_connections 2024-04-25T13:43:39.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.362+0000 7f5098e00640 1 --2- 172.21.15.123:0/2699362420 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f507006f430 0x7f5070071940 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.362+0000 7f5098e00640 1 --2- 172.21.15.123:0/2699362420 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f50940b50f0 0x7f50941577d0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.362+0000 7f5098e00640 1 --2- 172.21.15.123:0/2699362420 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f50940b8d00 0x7f509415b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.362+0000 7f5098e00640 1 --2- 172.21.15.123:0/2699362420 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50940712b0 0x7f509415b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.362+0000 7f5098e00640 1 -- 172.21.15.123:0/2699362420 >> 172.21.15.123:0/2699362420 conn(0x7f50940d3620 msgr2=0x7f50940716c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:39.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.366+0000 7f5098e00640 1 -- 172.21.15.123:0/2699362420 shutdown_connections 2024-04-25T13:43:39.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.366+0000 7f5098e00640 1 -- 172.21.15.123:0/2699362420 wait complete. 2024-04-25T13:43:39.388 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T13:43:39.388 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:43:39.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.534+0000 7fde8e400640 1 Processor -- start 2024-04-25T13:43:39.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.534+0000 7fde8e400640 1 -- start start 2024-04-25T13:43:39.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.534+0000 7fde8e400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fde880af020 0x7fde881633b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.534+0000 7fde8e400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde88070640 0x7fde881639b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.534+0000 7fde8e400640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde8806c670 con 0x7fde8806fb20 2024-04-25T13:43:39.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.534+0000 7fde8e400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fde880b5b50 con 0x7fde880af020 2024-04-25T13:43:39.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.534+0000 7fde8e400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fde880b5e30 con 0x7fde88070640 2024-04-25T13:43:39.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.534+0000 7fde87400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fde880af020 0x7fde881633b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:39.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.534+0000 7fde7ea00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7fde8806fb20 0x7fde8806ff30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:58290/0 (socket says 172.21.15.123:58290) 2024-04-25T13:43:39.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.534+0000 7fde7ea00640 1 -- 172.21.15.123:0/1138642604 learned_addr learned my addr 172.21.15.123:0/1138642604 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:39.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.534+0000 7fde87e00640 1 --2- 172.21.15.123:0/1138642604 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde88070640 0x7fde881639b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:39.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.538+0000 7fde87400640 1 -- 172.21.15.123:0/1138642604 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde88070640 msgr2=0x7fde881639b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:39.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.538+0000 7fde87400640 1 --2- 172.21.15.123:0/1138642604 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde88070640 0x7fde881639b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.538+0000 7fde87400640 1 -- 172.21.15.123:0/1138642604 >> v1:172.21.15.123:6789/0 conn(0x7fde8806fb20 legacy=0x7fde8806ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.538+0000 7fde87400640 1 -- 172.21.15.123:0/1138642604 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8806c930 con 0x7fde880af020 2024-04-25T13:43:39.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.538+0000 7fde87400640 1 --2- 172.21.15.123:0/1138642604 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde880af020 0x7fde881633b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fde78009d90 tx=0x7fde7801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275405addd32184a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:39.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.538+0000 7fde86a00640 1 -- 172.21.15.123:0/1138642604 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde780b2070 con 0x7fde880af020 2024-04-25T13:43:39.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.538+0000 7fde86a00640 1 -- 172.21.15.123:0/1138642604 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde780a5940 con 0x7fde880af020 2024-04-25T13:43:39.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.538+0000 7fde86a00640 1 -- 172.21.15.123:0/1138642604 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde780a5d10 con 0x7fde880af020 2024-04-25T13:43:39.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.538+0000 7fde8e400640 1 -- 172.21.15.123:0/1138642604 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde880af020 msgr2=0x7fde881633b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.538+0000 7fde8e400640 1 --2- 172.21.15.123:0/1138642604 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde880af020 0x7fde881633b0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fde78009d90 tx=0x7fde7801c970 comp rx=0 tx=0).stop 2024-04-25T13:43:39.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.542+0000 7fde8e400640 1 -- 172.21.15.123:0/1138642604 shutdown_connections 2024-04-25T13:43:39.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.542+0000 7fde8e400640 1 --2- 172.21.15.123:0/1138642604 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde88070640 0x7fde881639b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.542+0000 7fde8e400640 1 --2- 172.21.15.123:0/1138642604 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde880af020 0x7fde881633b0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.542+0000 7fde8e400640 1 -- 172.21.15.123:0/1138642604 >> 172.21.15.123:0/1138642604 conn(0x7fde880d1fa0 msgr2=0x7fde880d23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:39.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.542+0000 7fde8e400640 1 -- 172.21.15.123:0/1138642604 shutdown_connections 2024-04-25T13:43:39.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.542+0000 7fde8e400640 1 -- 172.21.15.123:0/1138642604 wait complete. 2024-04-25T13:43:39.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.542+0000 7fde8e400640 1 Processor -- start 2024-04-25T13:43:39.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.542+0000 7fde8e400640 1 -- start start 2024-04-25T13:43:39.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.542+0000 7fde8e400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde8806fb20 0x7fde88150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.542+0000 7fde8e400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde88070640 0x7fde8815cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.542+0000 7fde8e400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde880af020 0x7fde880d0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.542+0000 7fde8e400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fde8816d0e0 con 0x7fde8806fb20 2024-04-25T13:43:39.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.542+0000 7fde8e400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fde8816cf60 con 0x7fde88070640 2024-04-25T13:43:39.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.542+0000 7fde8e400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fde8816d260 con 0x7fde880af020 2024-04-25T13:43:39.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.546+0000 7fde87400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde8806fb20 0x7fde88150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:39.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.546+0000 7fde87400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde8806fb20 0x7fde88150df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:44066/0 (socket says 172.21.15.123:44066) 2024-04-25T13:43:39.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.546+0000 7fde87400640 1 -- 172.21.15.123:0/1798608710 learned_addr learned my addr 172.21.15.123:0/1798608710 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:39.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.546+0000 7fde7ea00640 1 --2- 172.21.15.123:0/1798608710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde88070640 0x7fde8815cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:39.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.546+0000 7fde87e00640 1 --2- 172.21.15.123:0/1798608710 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde880af020 0x7fde880d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:39.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.546+0000 7fde87400640 1 -- 172.21.15.123:0/1798608710 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde880af020 msgr2=0x7fde880d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.546+0000 7fde87400640 1 --2- 172.21.15.123:0/1798608710 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde880af020 0x7fde880d0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.546+0000 7fde87400640 1 -- 172.21.15.123:0/1798608710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde88070640 msgr2=0x7fde8815cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.546+0000 7fde87400640 1 --2- 172.21.15.123:0/1798608710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde88070640 0x7fde8815cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.546+0000 7fde87400640 1 -- 172.21.15.123:0/1798608710 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde88161560 con 0x7fde8806fb20 2024-04-25T13:43:39.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.546+0000 7fde87400640 1 --2- 172.21.15.123:0/1798608710 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde8806fb20 0x7fde88150df0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fde7801a5a0 tx=0x7fde78019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:39.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.546+0000 7fde7fe00640 1 -- 172.21.15.123:0/1798608710 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde780b2040 con 0x7fde8806fb20 2024-04-25T13:43:39.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.546+0000 7fde7fe00640 1 -- 172.21.15.123:0/1798608710 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde780bf070 con 0x7fde8806fb20 2024-04-25T13:43:39.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.546+0000 7fde8e400640 1 -- 172.21.15.123:0/1798608710 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde88161840 con 0x7fde8806fb20 2024-04-25T13:43:39.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.546+0000 7fde7fe00640 1 -- 172.21.15.123:0/1798608710 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde780b88b0 con 0x7fde8806fb20 2024-04-25T13:43:39.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.546+0000 7fde8e400640 1 -- 172.21.15.123:0/1798608710 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde88161e00 con 0x7fde8806fb20 2024-04-25T13:43:39.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.546+0000 7fde8e400640 1 -- 172.21.15.123:0/1798608710 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fde88076de0 con 0x7fde8806fb20 2024-04-25T13:43:39.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.546+0000 7fde7fe00640 1 -- 172.21.15.123:0/1798608710 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fde780b8a50 con 0x7fde8806fb20 2024-04-25T13:43:39.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.550+0000 7fde7fe00640 1 --2- 172.21.15.123:0/1798608710 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fde6406f400 0x7fde64071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.550+0000 7fde7fe00640 1 -- 172.21.15.123:0/1798608710 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fde7812a960 con 0x7fde8806fb20 2024-04-25T13:43:39.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.550+0000 7fde7fe00640 1 --2- 172.21.15.123:0/1798608710 >> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] conn(0x7fde64075310 0x7fde64077760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.550+0000 7fde7ea00640 1 --2- 172.21.15.123:0/1798608710 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fde6406f400 0x7fde64071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:39.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.550+0000 7fde7fe00640 1 -- 172.21.15.123:0/1798608710 --> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fde64077e30 con 0x7fde64075310 2024-04-25T13:43:39.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.550+0000 7fde7fe00640 1 -- 172.21.15.123:0/1798608710 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fde7812adf0 con 0x7fde8806fb20 2024-04-25T13:43:39.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.550+0000 7fde87e00640 1 --2- 172.21.15.123:0/1798608710 >> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] conn(0x7fde64075310 0x7fde64077760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:39.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.550+0000 7fde7ea00640 1 --2- 172.21.15.123:0/1798608710 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fde6406f400 0x7fde64071910 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fde880b1c00 tx=0x7fde70007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:39.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.550+0000 7fde87e00640 1 --2- 172.21.15.123:0/1798608710 >> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] conn(0x7fde64075310 0x7fde64077760 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:39.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.550+0000 7fde7fe00640 1 -- 172.21.15.123:0/1798608710 <== osd.5 v2:172.21.15.130:6800/2763000783 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fde64077e30 con 0x7fde64075310 2024-04-25T13:43:39.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.562+0000 7fde8e400640 1 -- 172.21.15.123:0/1798608710 --> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fde8806a210 con 0x7fde64075310 2024-04-25T13:43:39.569 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.566+0000 7fde7fe00640 1 -- 172.21.15.123:0/1798608710 <== osd.5 v2:172.21.15.130:6800/2763000783 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fde8806a210 con 0x7fde64075310 2024-04-25T13:43:39.570 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-04-25T13:43:39.570 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:43:39.570 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-04-25T13:43:39.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.566+0000 7fde8e400640 1 -- 172.21.15.123:0/1798608710 >> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] conn(0x7fde64075310 msgr2=0x7fde64077760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.566+0000 7fde8e400640 1 --2- 172.21.15.123:0/1798608710 >> [v2:172.21.15.130:6800/2763000783,v1:172.21.15.130:6802/2763000783] conn(0x7fde64075310 0x7fde64077760 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.566+0000 7fde8e400640 1 -- 172.21.15.123:0/1798608710 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fde6406f400 msgr2=0x7fde64071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.566+0000 7fde8e400640 1 --2- 172.21.15.123:0/1798608710 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fde6406f400 0x7fde64071910 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fde880b1c00 tx=0x7fde70007e90 comp rx=0 tx=0).stop 2024-04-25T13:43:39.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.566+0000 7fde8e400640 1 -- 172.21.15.123:0/1798608710 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde8806fb20 msgr2=0x7fde88150df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.566+0000 7fde8e400640 1 --2- 172.21.15.123:0/1798608710 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fde8806fb20 0x7fde88150df0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fde7801a5a0 tx=0x7fde78019710 comp rx=0 tx=0).stop 2024-04-25T13:43:39.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.566+0000 7fde87e00640 1 -- 172.21.15.123:0/1798608710 reap_dead start 2024-04-25T13:43:39.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.566+0000 7fde8e400640 1 -- 172.21.15.123:0/1798608710 shutdown_connections 2024-04-25T13:43:39.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.566+0000 7fde8e400640 1 -- 172.21.15.123:0/1798608710 >> 172.21.15.123:0/1798608710 conn(0x7fde880d1fa0 msgr2=0x7fde8806ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:39.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.566+0000 7fde8e400640 1 -- 172.21.15.123:0/1798608710 shutdown_connections 2024-04-25T13:43:39.572 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.566+0000 7fde8e400640 1 -- 172.21.15.123:0/1798608710 wait complete. 2024-04-25T13:43:39.590 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T13:43:39.737 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94b0a00640 1 Processor -- start 2024-04-25T13:43:39.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94b0a00640 1 -- start start 2024-04-25T13:43:39.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94b0a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94ac0b4b80 0x7f94ac074310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94b0a00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94ac0b4f90 con 0x7f94ac0b4770 2024-04-25T13:43:39.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94b0a00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94ac1604d0 con 0x7f94ac0b3f80 2024-04-25T13:43:39.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94b0a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f94ac0b5210 con 0x7f94ac0b4b80 2024-04-25T13:43:39.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94a9e00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f94ac0b4770 0x7f94ac0b3870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:45810/0 (socket says 172.21.15.123:45810) 2024-04-25T13:43:39.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94a9e00640 1 -- 172.21.15.123:0/1642701827 learned_addr learned my addr 172.21.15.123:0/1642701827 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:39.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94aa800640 1 --2- 172.21.15.123:0/1642701827 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94ac0b4b80 0x7f94ac074310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:39.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94a8a00640 1 -- 172.21.15.123:0/1642701827 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 154057532 0 0) 0x7f949c001120 con 0x7f94ac0b4770 2024-04-25T13:43:39.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94a8a00640 1 -- 172.21.15.123:0/1642701827 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9490003530 con 0x7f94ac0b4770 2024-04-25T13:43:39.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94a8a00640 1 -- 172.21.15.123:0/1642701827 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 94030330 0 0) 0x7f94ac1604d0 con 0x7f94ac0b3f80 2024-04-25T13:43:39.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94a8a00640 1 -- 172.21.15.123:0/1642701827 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f949c001120 con 0x7f94ac0b3f80 2024-04-25T13:43:39.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94a8a00640 1 -- 172.21.15.123:0/1642701827 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 704851438 0 0) 0x7f9490003530 con 0x7f94ac0b4770 2024-04-25T13:43:39.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94a8a00640 1 -- 172.21.15.123:0/1642701827 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94ac0b4b80 msgr2=0x7f94ac074310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:39.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94a8a00640 1 --2- 172.21.15.123:0/1642701827 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94ac0b4b80 0x7f94ac074310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94a8a00640 1 -- 172.21.15.123:0/1642701827 >> v1:172.21.15.130:6789/0 conn(0x7f94ac0b3f80 legacy=0x7f94ac073c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94a8a00640 1 -- 172.21.15.123:0/1642701827 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94ac160790 con 0x7f94ac0b4770 2024-04-25T13:43:39.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94a8a00640 1 -- 172.21.15.123:0/1642701827 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7f949c001850 con 0x7f94ac0b4770 2024-04-25T13:43:39.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94aa800640 1 --2- 172.21.15.123:0/1642701827 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94ac0b4b80 0x7f94ac074310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:43:39.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94a8a00640 1 -- 172.21.15.123:0/1642701827 >> v1:172.21.15.123:6789/0 conn(0x7f94ac0b4770 legacy=0x7f94ac0b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94a8a00640 1 --2- 172.21.15.123:0/1642701827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9490003c60 0x7f9490004090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94a8a00640 1 --2- 172.21.15.123:0/1642701827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9490004810 0x7f9490004c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94a8a00640 1 --2- 172.21.15.123:0/1642701827 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94ac0b4b80 0x7f94900052b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94a8a00640 1 -- 172.21.15.123:0/1642701827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f94ac0b5210 con 0x7f9490003c60 2024-04-25T13:43:39.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94a8a00640 1 -- 172.21.15.123:0/1642701827 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f949000bbe0 con 0x7f9490004810 2024-04-25T13:43:39.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94a8a00640 1 -- 172.21.15.123:0/1642701827 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f949000bde0 con 0x7f94ac0b4b80 2024-04-25T13:43:39.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.734+0000 7f94a9e00640 1 --2- 172.21.15.123:0/1642701827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9490003c60 0x7f9490004090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:39.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.738+0000 7f94aa800640 1 --2- 172.21.15.123:0/1642701827 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94ac0b4b80 0x7f94900052b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:39.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.738+0000 7f94a9400640 1 --2- 172.21.15.123:0/1642701827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9490004810 0x7f9490004c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:39.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.738+0000 7f94a9e00640 1 -- 172.21.15.123:0/1642701827 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94ac0b4b80 msgr2=0x7f94900052b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:39.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.738+0000 7f94a9e00640 1 --2- 172.21.15.123:0/1642701827 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94ac0b4b80 0x7f94900052b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.738+0000 7f94a9e00640 1 -- 172.21.15.123:0/1642701827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9490004810 msgr2=0x7f9490004c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:39.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.738+0000 7f94a9e00640 1 --2- 172.21.15.123:0/1642701827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9490004810 0x7f9490004c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.738+0000 7f94a9e00640 1 -- 172.21.15.123:0/1642701827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9490003530 con 0x7f9490003c60 2024-04-25T13:43:39.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.738+0000 7f94a9400640 1 --2- 172.21.15.123:0/1642701827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9490004810 0x7f9490004c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:39.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.738+0000 7f94a9e00640 1 --2- 172.21.15.123:0/1642701827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9490003c60 0x7f9490004090 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f949c005260 tx=0x7f949c01d250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72cd222027c6cd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:39.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.738+0000 7f94a8a00640 1 -- 172.21.15.123:0/1642701827 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c004e30 con 0x7f9490003c60 2024-04-25T13:43:39.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.738+0000 7f94a8a00640 1 -- 172.21.15.123:0/1642701827 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f949c0058e0 con 0x7f9490003c60 2024-04-25T13:43:39.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.738+0000 7f94a8a00640 1 -- 172.21.15.123:0/1642701827 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c005cb0 con 0x7f9490003c60 2024-04-25T13:43:39.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.738+0000 7f94b0a00640 1 -- 172.21.15.123:0/1642701827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9490003c60 msgr2=0x7f9490004090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.738+0000 7f94b0a00640 1 --2- 172.21.15.123:0/1642701827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9490003c60 0x7f9490004090 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f949c005260 tx=0x7f949c01d250 comp rx=0 tx=0).stop 2024-04-25T13:43:39.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.742+0000 7f94aa800640 1 -- 172.21.15.123:0/1642701827 reap_dead start 2024-04-25T13:43:39.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.742+0000 7f94b0a00640 1 -- 172.21.15.123:0/1642701827 shutdown_connections 2024-04-25T13:43:39.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.742+0000 7f94b0a00640 1 -- 172.21.15.123:0/1642701827 >> 172.21.15.123:0/1642701827 conn(0x7f94ac06ca70 msgr2=0x7f94ac06ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:39.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.742+0000 7f94b0a00640 1 -- 172.21.15.123:0/1642701827 shutdown_connections 2024-04-25T13:43:39.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.742+0000 7f94b0a00640 1 -- 172.21.15.123:0/1642701827 wait complete. 2024-04-25T13:43:39.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.742+0000 7f94b0a00640 1 Processor -- start 2024-04-25T13:43:39.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.742+0000 7f94b0a00640 1 -- start start 2024-04-25T13:43:39.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.742+0000 7f94b0a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9490003c60 0x7f94ac158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.742+0000 7f94b0a00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94ac151830 0x7f94ac0cff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.742+0000 7f94b0a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f94ac0d04d0 0x7f94ac162740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.742+0000 7f94b0a00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f94ac15df40 con 0x7f9490003c60 2024-04-25T13:43:39.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.742+0000 7f94b0a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f94ac15ddc0 con 0x7f94ac0d04d0 2024-04-25T13:43:39.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.742+0000 7f94b0a00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f94ac161270 con 0x7f94ac151830 2024-04-25T13:43:39.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.746+0000 7f94a9e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9490003c60 0x7f94ac158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:39.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.746+0000 7f94a9e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9490003c60 0x7f94ac158800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39534/0 (socket says 172.21.15.123:39534) 2024-04-25T13:43:39.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.746+0000 7f94a9e00640 1 -- 172.21.15.123:0/1561376954 learned_addr learned my addr 172.21.15.123:0/1561376954 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:39.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.746+0000 7f94a9400640 1 --2- 172.21.15.123:0/1561376954 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94ac151830 0x7f94ac0cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:39.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.746+0000 7f94aa800640 1 --2- 172.21.15.123:0/1561376954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f94ac0d04d0 0x7f94ac162740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:39.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.746+0000 7f94a9e00640 1 -- 172.21.15.123:0/1561376954 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94ac151830 msgr2=0x7f94ac0cff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.746+0000 7f94a9e00640 1 --2- 172.21.15.123:0/1561376954 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94ac151830 0x7f94ac0cff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.746+0000 7f94a9e00640 1 -- 172.21.15.123:0/1561376954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f94ac0d04d0 msgr2=0x7f94ac162740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.746+0000 7f94a9e00640 1 --2- 172.21.15.123:0/1561376954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f94ac0d04d0 0x7f94ac162740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.746+0000 7f94a9e00640 1 -- 172.21.15.123:0/1561376954 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94ac15d0c0 con 0x7f9490003c60 2024-04-25T13:43:39.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.746+0000 7f94aa800640 1 --2- 172.21.15.123:0/1561376954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f94ac0d04d0 0x7f94ac162740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:39.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.746+0000 7f94a9e00640 1 --2- 172.21.15.123:0/1561376954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9490003c60 0x7f94ac158800 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f949c005260 tx=0x7f949c019ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:39.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.746+0000 7f94a2000640 1 -- 172.21.15.123:0/1561376954 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c001b00 con 0x7f9490003c60 2024-04-25T13:43:39.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.746+0000 7f94a2000640 1 -- 172.21.15.123:0/1561376954 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f949c001650 con 0x7f9490003c60 2024-04-25T13:43:39.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.746+0000 7f94a2000640 1 -- 172.21.15.123:0/1561376954 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949c0047f0 con 0x7f9490003c60 2024-04-25T13:43:39.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.746+0000 7f94b0a00640 1 -- 172.21.15.123:0/1561376954 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94ac15cde0 con 0x7f9490003c60 2024-04-25T13:43:39.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.746+0000 7f94b0a00640 1 -- 172.21.15.123:0/1561376954 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94ac1618f0 con 0x7f9490003c60 2024-04-25T13:43:39.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.746+0000 7f94b0a00640 1 -- 172.21.15.123:0/1561376954 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94ac06d600 con 0x7f9490003c60 2024-04-25T13:43:39.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.746+0000 7f94a2000640 1 -- 172.21.15.123:0/1561376954 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f949c0b7030 con 0x7f9490003c60 2024-04-25T13:43:39.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.750+0000 7f94a2000640 1 --2- 172.21.15.123:0/1561376954 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f948c06f400 0x7f948c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:39.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.750+0000 7f94a2000640 1 -- 172.21.15.123:0/1561376954 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f949c1280d0 con 0x7f9490003c60 2024-04-25T13:43:39.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.750+0000 7f94a9400640 1 --2- 172.21.15.123:0/1561376954 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f948c06f400 0x7f948c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:39.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.750+0000 7f94a9400640 1 --2- 172.21.15.123:0/1561376954 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f948c06f400 0x7f948c071910 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0b40c0 tx=0x7f9498009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:39.757 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.754+0000 7f94a2000640 1 -- 172.21.15.123:0/1561376954 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f94ac0b4f90 con 0x7f9490003c60 2024-04-25T13:43:39.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.910+0000 7f94b0a00640 1 -- 172.21.15.123:0/1561376954 --> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f94ac050750 con 0x7f948c06f400 2024-04-25T13:43:39.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.910+0000 7f94a2000640 1 -- 172.21.15.123:0/1561376954 <== mgr.4107 v2:172.21.15.123:6832/715752891 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f94ac050750 con 0x7f948c06f400 2024-04-25T13:43:39.915 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T13:43:39.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.910+0000 7f94b0a00640 1 -- 172.21.15.123:0/1561376954 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f948c06f400 msgr2=0x7f948c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.910+0000 7f94b0a00640 1 --2- 172.21.15.123:0/1561376954 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f948c06f400 0x7f948c071910 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0b40c0 tx=0x7f9498009040 comp rx=0 tx=0).stop 2024-04-25T13:43:39.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.910+0000 7f94b0a00640 1 -- 172.21.15.123:0/1561376954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9490003c60 msgr2=0x7f94ac158800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:39.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.910+0000 7f94b0a00640 1 --2- 172.21.15.123:0/1561376954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9490003c60 0x7f94ac158800 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f949c005260 tx=0x7f949c019ff0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.910+0000 7f94b0a00640 1 -- 172.21.15.123:0/1561376954 shutdown_connections 2024-04-25T13:43:39.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.910+0000 7f94b0a00640 1 --2- 172.21.15.123:0/1561376954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f94ac0d04d0 0x7f94ac162740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.910+0000 7f94b0a00640 1 --2- 172.21.15.123:0/1561376954 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f948c06f400 0x7f948c071910 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.910+0000 7f94b0a00640 1 --2- 172.21.15.123:0/1561376954 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f94ac151830 0x7f94ac0cff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.910+0000 7f94b0a00640 1 --2- 172.21.15.123:0/1561376954 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9490003c60 0x7f94ac158800 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:39.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.910+0000 7f94b0a00640 1 -- 172.21.15.123:0/1561376954 >> 172.21.15.123:0/1561376954 conn(0x7f94ac06ca70 msgr2=0x7f94ac0d0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:39.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.910+0000 7f94b0a00640 1 -- 172.21.15.123:0/1561376954 shutdown_connections 2024-04-25T13:43:39.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:39.910+0000 7f94b0a00640 1 -- 172.21.15.123:0/1561376954 wait complete. 2024-04-25T13:43:39.937 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T13:43:39.937 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:43:40.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.086+0000 7fe53a800640 1 Processor -- start 2024-04-25T13:43:40.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.086+0000 7fe53a800640 1 -- start start 2024-04-25T13:43:40.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.086+0000 7fe53a800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe53406dd70 0x7fe534164450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.086+0000 7fe53a800640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe5340d29c0 0x7fe534164da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.086+0000 7fe53a800640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5340b9030 con 0x7fe534164990 2024-04-25T13:43:40.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.086+0000 7fe53a800640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fe5341652e0 con 0x7fe5340d29c0 2024-04-25T13:43:40.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.086+0000 7fe53a800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe5340b8de0 con 0x7fe53406dd70 2024-04-25T13:43:40.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.086+0000 7fe539e00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe5340d29c0 0x7fe534164da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:40.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.086+0000 7fe539400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe53406dd70 0x7fe534164450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:40.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.086+0000 7fe538a00640 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe534164990 0x7fe5340b2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.123:38762/0 (socket says 172.21.15.123:38762) 2024-04-25T13:43:40.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.086+0000 7fe538a00640 1 -- 172.21.15.123:0/3197606883 learned_addr learned my addr 172.21.15.123:0/3197606883 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:40.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.086+0000 7fe533e00640 1 -- 172.21.15.123:0/3197606883 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1156990956 0 0) 0x7fe5340b9030 con 0x7fe534164990 2024-04-25T13:43:40.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.086+0000 7fe533e00640 1 -- 172.21.15.123:0/3197606883 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe51c003530 con 0x7fe534164990 2024-04-25T13:43:40.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.086+0000 7fe539e00640 1 -- 172.21.15.123:0/3197606883 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe53406dd70 msgr2=0x7fe534164450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:40.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.086+0000 7fe539e00640 1 --2- 172.21.15.123:0/3197606883 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe53406dd70 0x7fe534164450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.086+0000 7fe539e00640 1 -- 172.21.15.123:0/3197606883 >> v1:172.21.15.130:6789/0 conn(0x7fe534164990 legacy=0x7fe5340b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:40.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.086+0000 7fe539e00640 1 -- 172.21.15.123:0/3197606883 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5340d0e30 con 0x7fe5340d29c0 2024-04-25T13:43:40.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.086+0000 7fe539400640 1 --2- 172.21.15.123:0/3197606883 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe53406dd70 0x7fe534164450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T13:43:40.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.090+0000 7fe539e00640 1 --2- 172.21.15.123:0/3197606883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5340d29c0 0x7fe534164da0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009d90 tx=0x7fe52c01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68d16b48f67111dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:40.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.090+0000 7fe533e00640 1 -- 172.21.15.123:0/3197606883 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52c0b2070 con 0x7fe5340d29c0 2024-04-25T13:43:40.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.090+0000 7fe533e00640 1 -- 172.21.15.123:0/3197606883 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe52c0a5830 con 0x7fe5340d29c0 2024-04-25T13:43:40.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.090+0000 7fe533e00640 1 -- 172.21.15.123:0/3197606883 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52c0a5c00 con 0x7fe5340d29c0 2024-04-25T13:43:40.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.090+0000 7fe53a800640 1 -- 172.21.15.123:0/3197606883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5340d29c0 msgr2=0x7fe534164da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:40.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.090+0000 7fe53a800640 1 --2- 172.21.15.123:0/3197606883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5340d29c0 0x7fe534164da0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009d90 tx=0x7fe52c01c970 comp rx=0 tx=0).stop 2024-04-25T13:43:40.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.090+0000 7fe53a800640 1 -- 172.21.15.123:0/3197606883 shutdown_connections 2024-04-25T13:43:40.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.090+0000 7fe53a800640 1 --2- 172.21.15.123:0/3197606883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5340d29c0 0x7fe534164da0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.090+0000 7fe53a800640 1 --2- 172.21.15.123:0/3197606883 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe53406dd70 0x7fe534164450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.090+0000 7fe53a800640 1 -- 172.21.15.123:0/3197606883 >> 172.21.15.123:0/3197606883 conn(0x7fe5340d00c0 msgr2=0x7fe5340d04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:40.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.090+0000 7fe53a800640 1 -- 172.21.15.123:0/3197606883 shutdown_connections 2024-04-25T13:43:40.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.090+0000 7fe53a800640 1 -- 172.21.15.123:0/3197606883 wait complete. 2024-04-25T13:43:40.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.094+0000 7fe53a800640 1 Processor -- start 2024-04-25T13:43:40.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.094+0000 7fe53a800640 1 -- start start 2024-04-25T13:43:40.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.094+0000 7fe53a800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe53406dd70 0x7fe534150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.094+0000 7fe53a800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5340d29c0 0x7fe534162540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.094+0000 7fe53a800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe534164990 0x7fe534162a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.094+0000 7fe53a800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fe53409ca10 con 0x7fe5340d29c0 2024-04-25T13:43:40.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.094+0000 7fe53a800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe5340b29e0 con 0x7fe53406dd70 2024-04-25T13:43:40.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.094+0000 7fe53a800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fe5340d2dd0 con 0x7fe534164990 2024-04-25T13:43:40.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.098+0000 7fe538a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5340d29c0 0x7fe534162540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:40.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.098+0000 7fe538a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5340d29c0 0x7fe534162540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39550/0 (socket says 172.21.15.123:39550) 2024-04-25T13:43:40.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.098+0000 7fe538a00640 1 -- 172.21.15.123:0/3802361129 learned_addr learned my addr 172.21.15.123:0/3802361129 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:40.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.098+0000 7fe539e00640 1 --2- 172.21.15.123:0/3802361129 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe534164990 0x7fe534162a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:40.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.098+0000 7fe539400640 1 --2- 172.21.15.123:0/3802361129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe53406dd70 0x7fe534150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:40.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.098+0000 7fe538a00640 1 -- 172.21.15.123:0/3802361129 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe534164990 msgr2=0x7fe534162a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:40.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.098+0000 7fe538a00640 1 --2- 172.21.15.123:0/3802361129 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe534164990 0x7fe534162a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.098+0000 7fe538a00640 1 -- 172.21.15.123:0/3802361129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe53406dd70 msgr2=0x7fe534150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:40.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.098+0000 7fe538a00640 1 --2- 172.21.15.123:0/3802361129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe53406dd70 0x7fe534150a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.098+0000 7fe538a00640 1 -- 172.21.15.123:0/3802361129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5340cfef0 con 0x7fe5340d29c0 2024-04-25T13:43:40.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.098+0000 7fe538a00640 1 --2- 172.21.15.123:0/3802361129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5340d29c0 0x7fe534162540 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe52000c400 tx=0x7fe52000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:40.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.098+0000 7fe531600640 1 -- 172.21.15.123:0/3802361129 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe520017070 con 0x7fe5340d29c0 2024-04-25T13:43:40.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.098+0000 7fe531600640 1 -- 172.21.15.123:0/3802361129 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe520005cf0 con 0x7fe5340d29c0 2024-04-25T13:43:40.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.098+0000 7fe531600640 1 -- 172.21.15.123:0/3802361129 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5200072d0 con 0x7fe5340d29c0 2024-04-25T13:43:40.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.098+0000 7fe53a800640 1 -- 172.21.15.123:0/3802361129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5340ca760 con 0x7fe5340d29c0 2024-04-25T13:43:40.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.098+0000 7fe53a800640 1 -- 172.21.15.123:0/3802361129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5340cace0 con 0x7fe5340d29c0 2024-04-25T13:43:40.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.098+0000 7fe53a800640 1 -- 172.21.15.123:0/3802361129 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe534050750 con 0x7fe5340d29c0 2024-04-25T13:43:40.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.098+0000 7fe531600640 1 -- 172.21.15.123:0/3802361129 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe52001a070 con 0x7fe5340d29c0 2024-04-25T13:43:40.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.102+0000 7fe531600640 1 --2- 172.21.15.123:0/3802361129 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe51406f400 0x7fe514071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.102+0000 7fe531600640 1 -- 172.21.15.123:0/3802361129 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fe52008ebd0 con 0x7fe5340d29c0 2024-04-25T13:43:40.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.102+0000 7fe539400640 1 --2- 172.21.15.123:0/3802361129 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe51406f400 0x7fe514071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:40.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.102+0000 7fe531600640 1 --2- 172.21.15.123:0/3802361129 >> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] conn(0x7fe514075310 0x7fe514077760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.102+0000 7fe531600640 1 -- 172.21.15.123:0/3802361129 --> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe514077e30 con 0x7fe514075310 2024-04-25T13:43:40.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.102+0000 7fe531600640 1 -- 172.21.15.123:0/3802361129 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fe52008ef80 con 0x7fe5340d29c0 2024-04-25T13:43:40.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.102+0000 7fe539e00640 1 --2- 172.21.15.123:0/3802361129 >> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] conn(0x7fe514075310 0x7fe514077760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:40.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.102+0000 7fe539400640 1 --2- 172.21.15.123:0/3802361129 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe51406f400 0x7fe514071910 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe528009510 tx=0x7fe528008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:40.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.102+0000 7fe539e00640 1 --2- 172.21.15.123:0/3802361129 >> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] conn(0x7fe514075310 0x7fe514077760 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:40.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.102+0000 7fe531600640 1 -- 172.21.15.123:0/3802361129 <== osd.6 v2:172.21.15.130:6801/3650490477 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe514077e30 con 0x7fe514075310 2024-04-25T13:43:40.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.114+0000 7fe53a800640 1 -- 172.21.15.123:0/3802361129 --> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe53415fcd0 con 0x7fe514075310 2024-04-25T13:43:40.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.114+0000 7fe531600640 1 -- 172.21.15.123:0/3802361129 <== osd.6 v2:172.21.15.130:6801/3650490477 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe53415fcd0 con 0x7fe514075310 2024-04-25T13:43:40.121 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-04-25T13:43:40.121 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:43:40.121 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-04-25T13:43:40.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.118+0000 7fe53a800640 1 -- 172.21.15.123:0/3802361129 >> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] conn(0x7fe514075310 msgr2=0x7fe514077760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:40.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.118+0000 7fe53a800640 1 --2- 172.21.15.123:0/3802361129 >> [v2:172.21.15.130:6801/3650490477,v1:172.21.15.130:6803/3650490477] conn(0x7fe514075310 0x7fe514077760 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.118+0000 7fe53a800640 1 -- 172.21.15.123:0/3802361129 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe51406f400 msgr2=0x7fe514071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:40.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.118+0000 7fe53a800640 1 --2- 172.21.15.123:0/3802361129 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fe51406f400 0x7fe514071910 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe528009510 tx=0x7fe528008040 comp rx=0 tx=0).stop 2024-04-25T13:43:40.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.118+0000 7fe53a800640 1 -- 172.21.15.123:0/3802361129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5340d29c0 msgr2=0x7fe534162540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:40.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.118+0000 7fe53a800640 1 --2- 172.21.15.123:0/3802361129 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5340d29c0 0x7fe534162540 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe52000c400 tx=0x7fe52000c8c0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.118+0000 7fe539e00640 1 -- 172.21.15.123:0/3802361129 reap_dead start 2024-04-25T13:43:40.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.118+0000 7fe53a800640 1 -- 172.21.15.123:0/3802361129 shutdown_connections 2024-04-25T13:43:40.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.118+0000 7fe53a800640 1 -- 172.21.15.123:0/3802361129 >> 172.21.15.123:0/3802361129 conn(0x7fe5340d00c0 msgr2=0x7fe5341608a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:40.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.118+0000 7fe53a800640 1 -- 172.21.15.123:0/3802361129 shutdown_connections 2024-04-25T13:43:40.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.118+0000 7fe53a800640 1 -- 172.21.15.123:0/3802361129 wait complete. 2024-04-25T13:43:40.141 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T13:43:40.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.282+0000 7fb13ba00640 1 Processor -- start 2024-04-25T13:43:40.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.282+0000 7fb13ba00640 1 -- start start 2024-04-25T13:43:40.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.286+0000 7fb13ba00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb1340b7dc0 0x7fb13406c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.286+0000 7fb13ba00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb13406cbb0 0x7fb13406cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.286+0000 7fb13ba00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1340b3610 con 0x7fb1340cefd0 2024-04-25T13:43:40.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.286+0000 7fb13ba00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7fb13406d500 con 0x7fb13406cbb0 2024-04-25T13:43:40.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.286+0000 7fb13ba00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7fb1340ccfe0 con 0x7fb1340b7dc0 2024-04-25T13:43:40.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.286+0000 7fb12be00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb13406cbb0 0x7fb13406cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:40.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.286+0000 7fb12be00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7fb13406cbb0 0x7fb13406cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39560/0 (socket says 172.21.15.123:39560) 2024-04-25T13:43:40.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.286+0000 7fb12be00640 1 -- 172.21.15.123:0/3289584025 learned_addr learned my addr 172.21.15.123:0/3289584025 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:40.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.286+0000 7fb139000640 1 --2- 172.21.15.123:0/3289584025 >> v2:172.21.15.130:3300/0 conn(0x7fb1340b7dc0 0x7fb13406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:40.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.286+0000 7fb12be00640 1 -- 172.21.15.123:0/3289584025 >> v2:172.21.15.130:3300/0 conn(0x7fb1340b7dc0 msgr2=0x7fb13406c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:40.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.286+0000 7fb12be00640 1 --2- 172.21.15.123:0/3289584025 >> v2:172.21.15.130:3300/0 conn(0x7fb1340b7dc0 0x7fb13406c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.286+0000 7fb12be00640 1 -- 172.21.15.123:0/3289584025 >> v1:172.21.15.130:6789/0 conn(0x7fb1340cefd0 legacy=0x7fb1340cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:40.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.286+0000 7fb12be00640 1 -- 172.21.15.123:0/3289584025 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1340cccb0 con 0x7fb13406cbb0 2024-04-25T13:43:40.292 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.286+0000 7fb139000640 1 --2- 172.21.15.123:0/3289584025 >> v2:172.21.15.130:3300/0 conn(0x7fb1340b7dc0 0x7fb13406c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:40.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.290+0000 7fb12be00640 1 --2- 172.21.15.123:0/3289584025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb13406cbb0 0x7fb13406cfc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb1340b5150 tx=0x7fb11c01c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ca5137de0ce448 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:40.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.290+0000 7fb133e00640 1 -- 172.21.15.123:0/3289584025 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11c0b0070 con 0x7fb13406cbb0 2024-04-25T13:43:40.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.290+0000 7fb133e00640 1 -- 172.21.15.123:0/3289584025 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb11c0ab600 con 0x7fb13406cbb0 2024-04-25T13:43:40.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.290+0000 7fb133e00640 1 -- 172.21.15.123:0/3289584025 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11c0ab9d0 con 0x7fb13406cbb0 2024-04-25T13:43:40.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.290+0000 7fb13ba00640 1 -- 172.21.15.123:0/3289584025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb13406cbb0 msgr2=0x7fb13406cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:40.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.290+0000 7fb13ba00640 1 --2- 172.21.15.123:0/3289584025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb13406cbb0 0x7fb13406cfc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb1340b5150 tx=0x7fb11c01c300 comp rx=0 tx=0).stop 2024-04-25T13:43:40.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.290+0000 7fb13ba00640 1 -- 172.21.15.123:0/3289584025 shutdown_connections 2024-04-25T13:43:40.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.290+0000 7fb13ba00640 1 --2- 172.21.15.123:0/3289584025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb13406cbb0 0x7fb13406cfc0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.290+0000 7fb13ba00640 1 --2- 172.21.15.123:0/3289584025 >> v2:172.21.15.130:3300/0 conn(0x7fb1340b7dc0 0x7fb13406c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.290+0000 7fb13ba00640 1 -- 172.21.15.123:0/3289584025 >> 172.21.15.123:0/3289584025 conn(0x7fb1340d25c0 msgr2=0x7fb1340d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:40.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.290+0000 7fb13ba00640 1 -- 172.21.15.123:0/3289584025 shutdown_connections 2024-04-25T13:43:40.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.290+0000 7fb13ba00640 1 -- 172.21.15.123:0/3289584025 wait complete. 2024-04-25T13:43:40.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.290+0000 7fb13ba00640 1 Processor -- start 2024-04-25T13:43:40.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.290+0000 7fb13ba00640 1 -- start start 2024-04-25T13:43:40.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.294+0000 7fb13ba00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb13406cbb0 0x7fb13414e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.294+0000 7fb13ba00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1340b7dc0 0x7fb13414f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.294+0000 7fb13ba00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1340cefd0 0x7fb134157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.294+0000 7fb13ba00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7fb13416d590 con 0x7fb1340cefd0 2024-04-25T13:43:40.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.294+0000 7fb13ba00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb13416d410 con 0x7fb1340b7dc0 2024-04-25T13:43:40.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.294+0000 7fb13ba00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7fb13416d710 con 0x7fb13406cbb0 2024-04-25T13:43:40.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.294+0000 7fb139a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1340cefd0 0x7fb134157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:40.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.294+0000 7fb139a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1340cefd0 0x7fb134157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39570/0 (socket says 172.21.15.123:39570) 2024-04-25T13:43:40.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.294+0000 7fb139a00640 1 -- 172.21.15.123:0/1784437090 learned_addr learned my addr 172.21.15.123:0/1784437090 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:40.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.294+0000 7fb12be00640 1 --2- 172.21.15.123:0/1784437090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1340b7dc0 0x7fb13414f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:40.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.294+0000 7fb139000640 1 --2- 172.21.15.123:0/1784437090 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb13406cbb0 0x7fb13414e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:40.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.294+0000 7fb139a00640 1 -- 172.21.15.123:0/1784437090 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb13406cbb0 msgr2=0x7fb13414e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:40.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.294+0000 7fb139a00640 1 --2- 172.21.15.123:0/1784437090 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb13406cbb0 0x7fb13414e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.294+0000 7fb139a00640 1 -- 172.21.15.123:0/1784437090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1340b7dc0 msgr2=0x7fb13414f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:40.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.294+0000 7fb139a00640 1 --2- 172.21.15.123:0/1784437090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1340b7dc0 0x7fb13414f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.294+0000 7fb139a00640 1 -- 172.21.15.123:0/1784437090 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb13415f5e0 con 0x7fb1340cefd0 2024-04-25T13:43:40.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.294+0000 7fb139000640 1 --2- 172.21.15.123:0/1784437090 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb13406cbb0 0x7fb13414e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:40.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.294+0000 7fb139a00640 1 --2- 172.21.15.123:0/1784437090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1340cefd0 0x7fb134157f30 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb12c00b930 tx=0x7fb12c00bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:40.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.294+0000 7fb131600640 1 -- 172.21.15.123:0/1784437090 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c019070 con 0x7fb1340cefd0 2024-04-25T13:43:40.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.294+0000 7fb131600640 1 -- 172.21.15.123:0/1784437090 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb12c00cb60 con 0x7fb1340cefd0 2024-04-25T13:43:40.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.294+0000 7fb13ba00640 1 -- 172.21.15.123:0/1784437090 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1340c61b0 con 0x7fb1340cefd0 2024-04-25T13:43:40.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.294+0000 7fb131600640 1 -- 172.21.15.123:0/1784437090 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb12c014440 con 0x7fb1340cefd0 2024-04-25T13:43:40.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.294+0000 7fb13ba00640 1 -- 172.21.15.123:0/1784437090 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1340c6770 con 0x7fb1340cefd0 2024-04-25T13:43:40.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.294+0000 7fb13ba00640 1 -- 172.21.15.123:0/1784437090 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb134160de0 con 0x7fb1340cefd0 2024-04-25T13:43:40.302 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.298+0000 7fb131600640 1 -- 172.21.15.123:0/1784437090 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb12c01c070 con 0x7fb1340cefd0 2024-04-25T13:43:40.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.298+0000 7fb131600640 1 --2- 172.21.15.123:0/1784437090 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb11006f430 0x7fb110071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.298+0000 7fb131600640 1 -- 172.21.15.123:0/1784437090 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fb12c08ec30 con 0x7fb1340cefd0 2024-04-25T13:43:40.303 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.298+0000 7fb139000640 1 --2- 172.21.15.123:0/1784437090 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb11006f430 0x7fb110071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:40.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.298+0000 7fb139000640 1 --2- 172.21.15.123:0/1784437090 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb11006f430 0x7fb110071940 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb124006fd0 tx=0x7fb124008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:40.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.302+0000 7fb131600640 1 -- 172.21.15.123:0/1784437090 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb134160de0 con 0x7fb1340cefd0 2024-04-25T13:43:40.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.462+0000 7fb13ba00640 1 -- 172.21.15.123:0/1784437090 --> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fb13414ea70 con 0x7fb11006f430 2024-04-25T13:43:40.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.462+0000 7fb131600640 1 -- 172.21.15.123:0/1784437090 <== mgr.4107 v2:172.21.15.123:6832/715752891 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb13414ea70 con 0x7fb11006f430 2024-04-25T13:43:40.467 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T13:43:40.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.462+0000 7fb13ba00640 1 -- 172.21.15.123:0/1784437090 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb11006f430 msgr2=0x7fb110071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:40.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.462+0000 7fb13ba00640 1 --2- 172.21.15.123:0/1784437090 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb11006f430 0x7fb110071940 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb124006fd0 tx=0x7fb124008040 comp rx=0 tx=0).stop 2024-04-25T13:43:40.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.462+0000 7fb13ba00640 1 -- 172.21.15.123:0/1784437090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1340cefd0 msgr2=0x7fb134157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:40.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.462+0000 7fb13ba00640 1 --2- 172.21.15.123:0/1784437090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1340cefd0 0x7fb134157f30 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb12c00b930 tx=0x7fb12c00bdf0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.469 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.462+0000 7fb13ba00640 1 -- 172.21.15.123:0/1784437090 shutdown_connections 2024-04-25T13:43:40.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.462+0000 7fb13ba00640 1 --2- 172.21.15.123:0/1784437090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1340b7dc0 0x7fb13414f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.462+0000 7fb13ba00640 1 --2- 172.21.15.123:0/1784437090 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7fb11006f430 0x7fb110071940 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.462+0000 7fb13ba00640 1 --2- 172.21.15.123:0/1784437090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1340cefd0 0x7fb134157f30 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.462+0000 7fb13ba00640 1 --2- 172.21.15.123:0/1784437090 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb13406cbb0 0x7fb13414e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.466+0000 7fb13ba00640 1 -- 172.21.15.123:0/1784437090 >> 172.21.15.123:0/1784437090 conn(0x7fb1340d25c0 msgr2=0x7fb134070e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:40.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.466+0000 7fb13ba00640 1 -- 172.21.15.123:0/1784437090 shutdown_connections 2024-04-25T13:43:40.470 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.466+0000 7fb13ba00640 1 -- 172.21.15.123:0/1784437090 wait complete. 2024-04-25T13:43:40.489 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T13:43:40.489 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T13:43:40.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.634+0000 7f39ca400640 1 Processor -- start 2024-04-25T13:43:40.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.634+0000 7f39ca400640 1 -- start start 2024-04-25T13:43:40.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.634+0000 7f39ca400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f39c415cc10 0x7f39c40b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.634+0000 7f39ca400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f39c406ebe0 0x7f39c406eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.634+0000 7f39ca400640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39c415d020 con 0x7f39c40b4b70 2024-04-25T13:43:40.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.634+0000 7f39ca400640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f39c40b6310 con 0x7f39c406ebe0 2024-04-25T13:43:40.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.634+0000 7f39ca400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f39c40d0d90 con 0x7f39c415cc10 2024-04-25T13:43:40.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.634+0000 7f39c3e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f39c406ebe0 0x7f39c406eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:40.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.634+0000 7f39c3e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f39c406ebe0 0x7f39c406eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39586/0 (socket says 172.21.15.123:39586) 2024-04-25T13:43:40.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.634+0000 7f39c3e00640 1 -- 172.21.15.123:0/1732769740 learned_addr learned my addr 172.21.15.123:0/1732769740 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:40.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.634+0000 7f39c3400640 1 --2- 172.21.15.123:0/1732769740 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f39c415cc10 0x7f39c40b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:40.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.638+0000 7f39c3e00640 1 -- 172.21.15.123:0/1732769740 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f39c415cc10 msgr2=0x7f39c40b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:40.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.638+0000 7f39c3e00640 1 --2- 172.21.15.123:0/1732769740 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f39c415cc10 0x7f39c40b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.638+0000 7f39c3e00640 1 -- 172.21.15.123:0/1732769740 >> v1:172.21.15.130:6789/0 conn(0x7f39c40b4b70 legacy=0x7f39c40b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:40.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.638+0000 7f39c3e00640 1 -- 172.21.15.123:0/1732769740 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c40b6990 con 0x7f39c406ebe0 2024-04-25T13:43:40.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.638+0000 7f39c2000640 1 -- 172.21.15.123:0/1732769740 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 394796099 0 0) 0x7f39c415d020 con 0x7f39c40b4b70 2024-04-25T13:43:40.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.638+0000 7f39c3e00640 1 --2- 172.21.15.123:0/1732769740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39c406ebe0 0x7f39c406eff0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009870 tx=0x7f39bc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c50b1a47a62e6f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:40.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.638+0000 7f39c2000640 1 -- 172.21.15.123:0/1732769740 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc0aa430 con 0x7f39c406ebe0 2024-04-25T13:43:40.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.638+0000 7f39c2000640 1 -- 172.21.15.123:0/1732769740 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39bc0af070 con 0x7f39c406ebe0 2024-04-25T13:43:40.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.638+0000 7f39c2000640 1 -- 172.21.15.123:0/1732769740 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39bc0aa7f0 con 0x7f39c406ebe0 2024-04-25T13:43:40.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.642+0000 7f39ca400640 1 -- 172.21.15.123:0/1732769740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39c406ebe0 msgr2=0x7f39c406eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:40.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.642+0000 7f39ca400640 1 --2- 172.21.15.123:0/1732769740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39c406ebe0 0x7f39c406eff0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009870 tx=0x7f39bc01c4d0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.642+0000 7f39ca400640 1 -- 172.21.15.123:0/1732769740 shutdown_connections 2024-04-25T13:43:40.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.642+0000 7f39ca400640 1 --2- 172.21.15.123:0/1732769740 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39c406ebe0 0x7f39c406eff0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.642+0000 7f39ca400640 1 --2- 172.21.15.123:0/1732769740 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f39c415cc10 0x7f39c40b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.642+0000 7f39ca400640 1 -- 172.21.15.123:0/1732769740 >> 172.21.15.123:0/1732769740 conn(0x7f39c40b38a0 msgr2=0x7f39c40d15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:40.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.642+0000 7f39ca400640 1 -- 172.21.15.123:0/1732769740 shutdown_connections 2024-04-25T13:43:40.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.642+0000 7f39ca400640 1 -- 172.21.15.123:0/1732769740 wait complete. 2024-04-25T13:43:40.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.642+0000 7f39ca400640 1 Processor -- start 2024-04-25T13:43:40.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.642+0000 7f39ca400640 1 -- start start 2024-04-25T13:43:40.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.646+0000 7f39ca400640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f39c406ebe0 0x7f39c413fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.646+0000 7f39ca400640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39c40b4b70 0x7f39c415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.646+0000 7f39ca400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f39c415cc10 0x7f39c40b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.646+0000 7f39ca400640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f39c40d1220 con 0x7f39c40b4b70 2024-04-25T13:43:40.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.646+0000 7f39ca400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f39c40b5950 con 0x7f39c415cc10 2024-04-25T13:43:40.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.646+0000 7f39ca400640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f39c4141b50 con 0x7f39c406ebe0 2024-04-25T13:43:40.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.646+0000 7f39c2a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39c40b4b70 0x7f39c415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:40.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.646+0000 7f39c2a00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39c40b4b70 0x7f39c415a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39592/0 (socket says 172.21.15.123:39592) 2024-04-25T13:43:40.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.646+0000 7f39c2a00640 1 -- 172.21.15.123:0/3993535257 learned_addr learned my addr 172.21.15.123:0/3993535257 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:40.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.646+0000 7f39c3400640 1 --2- 172.21.15.123:0/3993535257 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f39c406ebe0 0x7f39c413fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:40.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.646+0000 7f39c3e00640 1 --2- 172.21.15.123:0/3993535257 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f39c415cc10 0x7f39c40b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:40.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.646+0000 7f39c2a00640 1 -- 172.21.15.123:0/3993535257 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f39c406ebe0 msgr2=0x7f39c413fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:40.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.646+0000 7f39c2a00640 1 --2- 172.21.15.123:0/3993535257 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f39c406ebe0 0x7f39c413fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.646+0000 7f39c2a00640 1 -- 172.21.15.123:0/3993535257 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f39c415cc10 msgr2=0x7f39c40b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:40.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.646+0000 7f39c2a00640 1 --2- 172.21.15.123:0/3993535257 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f39c415cc10 0x7f39c40b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.646+0000 7f39c2a00640 1 -- 172.21.15.123:0/3993535257 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c415a730 con 0x7f39c40b4b70 2024-04-25T13:43:40.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.646+0000 7f39c3e00640 1 --2- 172.21.15.123:0/3993535257 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f39c415cc10 0x7f39c40b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T13:43:40.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.646+0000 7f39c2a00640 1 --2- 172.21.15.123:0/3993535257 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39c40b4b70 0x7f39c415a1f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f39b000c420 tx=0x7f39b000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:40.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.646+0000 7f39bb400640 1 -- 172.21.15.123:0/3993535257 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b0017070 con 0x7f39c40b4b70 2024-04-25T13:43:40.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.646+0000 7f39bb400640 1 -- 172.21.15.123:0/3993535257 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b0003600 con 0x7f39c40b4b70 2024-04-25T13:43:40.654 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.646+0000 7f39bb400640 1 -- 172.21.15.123:0/3993535257 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b00039f0 con 0x7f39c40b4b70 2024-04-25T13:43:40.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.646+0000 7f39ca400640 1 -- 172.21.15.123:0/3993535257 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c415ac40 con 0x7f39c40b4b70 2024-04-25T13:43:40.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.646+0000 7f39ca400640 1 -- 172.21.15.123:0/3993535257 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c415b200 con 0x7f39c40b4b70 2024-04-25T13:43:40.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.646+0000 7f39ca400640 1 -- 172.21.15.123:0/3993535257 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f39c4076de0 con 0x7f39c40b4b70 2024-04-25T13:43:40.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.646+0000 7f39bb400640 1 -- 172.21.15.123:0/3993535257 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f39b001a070 con 0x7f39c40b4b70 2024-04-25T13:43:40.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.650+0000 7f39bb400640 1 --2- 172.21.15.123:0/3993535257 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f39a406f400 0x7f39a4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.650+0000 7f39bb400640 1 -- 172.21.15.123:0/3993535257 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f39b008ea20 con 0x7f39c40b4b70 2024-04-25T13:43:40.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.650+0000 7f39c3400640 1 --2- 172.21.15.123:0/3993535257 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f39a406f400 0x7f39a4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:40.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.650+0000 7f39bb400640 1 --2- 172.21.15.123:0/3993535257 >> [v2:172.21.15.130:6816/940897425,v1:172.21.15.130:6817/940897425] conn(0x7f39a4075310 0x7f39a4077760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.650+0000 7f39bb400640 1 -- 172.21.15.123:0/3993535257 --> [v2:172.21.15.130:6816/940897425,v1:172.21.15.130:6817/940897425] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f39a4077e30 con 0x7f39a4075310 2024-04-25T13:43:40.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.650+0000 7f39bb400640 1 -- 172.21.15.123:0/3993535257 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f39b008edd0 con 0x7f39c40b4b70 2024-04-25T13:43:40.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.650+0000 7f39c3e00640 1 --2- 172.21.15.123:0/3993535257 >> [v2:172.21.15.130:6816/940897425,v1:172.21.15.130:6817/940897425] conn(0x7f39a4075310 0x7f39a4077760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:40.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.650+0000 7f39c3400640 1 --2- 172.21.15.123:0/3993535257 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f39a406f400 0x7f39a4071910 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f39b4011340 tx=0x7f39b400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:40.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.650+0000 7f39c3e00640 1 --2- 172.21.15.123:0/3993535257 >> [v2:172.21.15.130:6816/940897425,v1:172.21.15.130:6817/940897425] conn(0x7f39a4075310 0x7f39a4077760 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:40.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.650+0000 7f39bb400640 1 -- 172.21.15.123:0/3993535257 <== osd.7 v2:172.21.15.130:6816/940897425 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f39a4077e30 con 0x7f39a4075310 2024-04-25T13:43:40.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.662+0000 7f39ca400640 1 -- 172.21.15.123:0/3993535257 --> [v2:172.21.15.130:6816/940897425,v1:172.21.15.130:6817/940897425] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f39c4140450 con 0x7f39a4075310 2024-04-25T13:43:40.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.666+0000 7f39bb400640 1 -- 172.21.15.123:0/3993535257 <== osd.7 v2:172.21.15.130:6816/940897425 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f39c4140450 con 0x7f39a4075310 2024-04-25T13:43:40.670 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-04-25T13:43:40.670 INFO:teuthology.orchestra.run.smithi123.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T13:43:40.670 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-04-25T13:43:40.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.666+0000 7f39ca400640 1 -- 172.21.15.123:0/3993535257 >> [v2:172.21.15.130:6816/940897425,v1:172.21.15.130:6817/940897425] conn(0x7f39a4075310 msgr2=0x7f39a4077760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:40.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.666+0000 7f39ca400640 1 --2- 172.21.15.123:0/3993535257 >> [v2:172.21.15.130:6816/940897425,v1:172.21.15.130:6817/940897425] conn(0x7f39a4075310 0x7f39a4077760 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.666+0000 7f39ca400640 1 -- 172.21.15.123:0/3993535257 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f39a406f400 msgr2=0x7f39a4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:40.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.666+0000 7f39ca400640 1 --2- 172.21.15.123:0/3993535257 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f39a406f400 0x7f39a4071910 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f39b4011340 tx=0x7f39b400b040 comp rx=0 tx=0).stop 2024-04-25T13:43:40.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.666+0000 7f39ca400640 1 -- 172.21.15.123:0/3993535257 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39c40b4b70 msgr2=0x7f39c415a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:40.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.666+0000 7f39ca400640 1 --2- 172.21.15.123:0/3993535257 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f39c40b4b70 0x7f39c415a1f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f39b000c420 tx=0x7f39b000c8e0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.666+0000 7f39c3e00640 1 -- 172.21.15.123:0/3993535257 reap_dead start 2024-04-25T13:43:40.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.666+0000 7f39ca400640 1 -- 172.21.15.123:0/3993535257 shutdown_connections 2024-04-25T13:43:40.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.666+0000 7f39ca400640 1 -- 172.21.15.123:0/3993535257 >> 172.21.15.123:0/3993535257 conn(0x7f39c40b38a0 msgr2=0x7f39c41606f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:40.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.666+0000 7f39ca400640 1 -- 172.21.15.123:0/3993535257 shutdown_connections 2024-04-25T13:43:40.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.666+0000 7f39ca400640 1 -- 172.21.15.123:0/3993535257 wait complete. 2024-04-25T13:43:40.689 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T13:43:40.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.830+0000 7f9c0c000640 1 Processor -- start 2024-04-25T13:43:40.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.830+0000 7f9c0c000640 1 -- start start 2024-04-25T13:43:40.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c0c000640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9c040b3870 0x7f9c040b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c0c000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c040b41c0 con 0x7f9c041571b0 2024-04-25T13:43:40.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c0c000640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c040cdee0 con 0x7f9c04072af0 2024-04-25T13:43:40.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c0c000640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f9c0415d570 con 0x7f9c040b3870 2024-04-25T13:43:40.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c09600640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f9c041571b0 0x7f9c040cd6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:45824/0 (socket says 172.21.15.123:45824) 2024-04-25T13:43:40.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c09600640 1 -- 172.21.15.123:0/616543128 learned_addr learned my addr 172.21.15.123:0/616543128 (peer_addr_for_me v1:172.21.15.123:0/0) 2024-04-25T13:43:40.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c08c00640 1 --2- 172.21.15.123:0/616543128 >> v2:172.21.15.130:3300/0 conn(0x7f9c040b3870 0x7f9c040b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:40.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c03e00640 1 -- 172.21.15.123:0/616543128 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2722504473 0 0) 0x7f9bf8001120 con 0x7f9c041571b0 2024-04-25T13:43:40.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c03e00640 1 -- 172.21.15.123:0/616543128 --> v1:172.21.15.123:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bec005740 con 0x7f9c041571b0 2024-04-25T13:43:40.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c03e00640 1 -- 172.21.15.123:0/616543128 <== mon.0 v1:172.21.15.123:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 731125459 0 0) 0x7f9bec005740 con 0x7f9c041571b0 2024-04-25T13:43:40.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c03e00640 1 -- 172.21.15.123:0/616543128 >> v2:172.21.15.130:3300/0 conn(0x7f9c040b3870 msgr2=0x7f9c040b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:40.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c03e00640 1 --2- 172.21.15.123:0/616543128 >> v2:172.21.15.130:3300/0 conn(0x7f9c040b3870 0x7f9c040b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c03e00640 1 -- 172.21.15.123:0/616543128 >> v1:172.21.15.130:6789/0 conn(0x7f9c04072af0 legacy=0x7f9c04072f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:40.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c03e00640 1 -- 172.21.15.123:0/616543128 --> v1:172.21.15.123:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c0415d850 con 0x7f9c041571b0 2024-04-25T13:43:40.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c03e00640 1 -- 172.21.15.123:0/616543128 <== mon.0 v1:172.21.15.123:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1617213173 0 0) 0x7f9bf8001850 con 0x7f9c041571b0 2024-04-25T13:43:40.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c03e00640 1 -- 172.21.15.123:0/616543128 >> v1:172.21.15.123:6789/0 conn(0x7f9c041571b0 legacy=0x7f9c040cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:40.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c03e00640 1 --2- 172.21.15.123:0/616543128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9bec005ce0 0x7f9bec006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c03e00640 1 --2- 172.21.15.123:0/616543128 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9bec006a20 0x7f9bec006e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c03e00640 1 --2- 172.21.15.123:0/616543128 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bec0075c0 0x7f9bec00dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c03e00640 1 -- 172.21.15.123:0/616543128 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0415d570 con 0x7f9bec0075c0 2024-04-25T13:43:40.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c03e00640 1 -- 172.21.15.123:0/616543128 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec00e520 con 0x7f9bec005ce0 2024-04-25T13:43:40.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c03e00640 1 -- 172.21.15.123:0/616543128 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9bec00e720 con 0x7f9bec006a20 2024-04-25T13:43:40.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c0a000640 1 --2- 172.21.15.123:0/616543128 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bec0075c0 0x7f9bec00dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:40.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c08c00640 1 --2- 172.21.15.123:0/616543128 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9bec006a20 0x7f9bec006e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:40.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c09600640 1 --2- 172.21.15.123:0/616543128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9bec005ce0 0x7f9bec006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:40.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c0a000640 1 -- 172.21.15.123:0/616543128 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9bec006a20 msgr2=0x7f9bec006e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:40.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c0a000640 1 --2- 172.21.15.123:0/616543128 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9bec006a20 0x7f9bec006e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c0a000640 1 -- 172.21.15.123:0/616543128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9bec005ce0 msgr2=0x7f9bec006150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:40.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c0a000640 1 --2- 172.21.15.123:0/616543128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9bec005ce0 0x7f9bec006150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.834+0000 7f9c0a000640 1 -- 172.21.15.123:0/616543128 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bec005740 con 0x7f9bec0075c0 2024-04-25T13:43:40.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.838+0000 7f9c0a000640 1 -- 172.21.15.123:0/616543128 reap_dead start 2024-04-25T13:43:40.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.838+0000 7f9c0a000640 1 --2- 172.21.15.123:0/616543128 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bec0075c0 0x7f9bec00dc40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc001e40 tx=0x7f9bfc01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ef141e0e687901 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:40.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.838+0000 7f9c03e00640 1 -- 172.21.15.123:0/616543128 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc001a90 con 0x7f9bec0075c0 2024-04-25T13:43:40.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.838+0000 7f9c03e00640 1 -- 172.21.15.123:0/616543128 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bfc003b80 con 0x7f9bec0075c0 2024-04-25T13:43:40.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.838+0000 7f9c03e00640 1 -- 172.21.15.123:0/616543128 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc005020 con 0x7f9bec0075c0 2024-04-25T13:43:40.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.838+0000 7f9c0c000640 1 -- 172.21.15.123:0/616543128 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bec0075c0 msgr2=0x7f9bec00dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:40.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.838+0000 7f9c0c000640 1 --2- 172.21.15.123:0/616543128 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bec0075c0 0x7f9bec00dc40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc001e40 tx=0x7f9bfc01c760 comp rx=0 tx=0).stop 2024-04-25T13:43:40.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.838+0000 7f9c0c000640 1 -- 172.21.15.123:0/616543128 shutdown_connections 2024-04-25T13:43:40.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.838+0000 7f9c0c000640 1 --2- 172.21.15.123:0/616543128 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9bec0075c0 0x7f9bec00dc40 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.838+0000 7f9c0c000640 1 -- 172.21.15.123:0/616543128 >> 172.21.15.123:0/616543128 conn(0x7f9c0406ca70 msgr2=0x7f9c0406ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:40.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.838+0000 7f9c0c000640 1 -- 172.21.15.123:0/616543128 shutdown_connections 2024-04-25T13:43:40.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.838+0000 7f9c0c000640 1 -- 172.21.15.123:0/616543128 wait complete. 2024-04-25T13:43:40.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.842+0000 7f9c0c000640 1 Processor -- start 2024-04-25T13:43:40.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.842+0000 7f9c0c000640 1 -- start start 2024-04-25T13:43:40.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.842+0000 7f9c0c000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9bec0075c0 0x7f9c04142930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.842+0000 7f9c0c000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c0415bcc0 0x7f9c0415c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.842+0000 7f9c0c000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c0413f260 0x7f9c0413f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.842+0000 7f9c0c000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0415e050 con 0x7f9c0415bcc0 2024-04-25T13:43:40.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.842+0000 7f9c0c000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0415d220 con 0x7f9c0413f260 2024-04-25T13:43:40.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.842+0000 7f9c0c000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f9c04140110 con 0x7f9bec0075c0 2024-04-25T13:43:40.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.842+0000 7f9c08c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c0415bcc0 0x7f9c0415c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:40.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.842+0000 7f9c08c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c0415bcc0 0x7f9c0415c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39602/0 (socket says 172.21.15.123:39602) 2024-04-25T13:43:40.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.842+0000 7f9c08c00640 1 -- 172.21.15.123:0/646605406 learned_addr learned my addr 172.21.15.123:0/646605406 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:40.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.842+0000 7f9c0a000640 1 --2- 172.21.15.123:0/646605406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c0413f260 0x7f9c0413f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:40.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.842+0000 7f9c08c00640 1 -- 172.21.15.123:0/646605406 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9bec0075c0 msgr2=0x7f9c04142930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:40.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.842+0000 7f9c08c00640 1 --2- 172.21.15.123:0/646605406 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9bec0075c0 0x7f9c04142930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.842+0000 7f9c08c00640 1 -- 172.21.15.123:0/646605406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c0413f260 msgr2=0x7f9c0413f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:40.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.842+0000 7f9c08c00640 1 --2- 172.21.15.123:0/646605406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c0413f260 0x7f9c0413f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:40.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.842+0000 7f9c08c00640 1 -- 172.21.15.123:0/646605406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c04142e70 con 0x7f9c0415bcc0 2024-04-25T13:43:40.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.846+0000 7f9c08c00640 1 --2- 172.21.15.123:0/646605406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c0415bcc0 0x7f9c0415c0d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0011960 tx=0x7f9bf0011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:40.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.846+0000 7f9c01600640 1 -- 172.21.15.123:0/646605406 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0019070 con 0x7f9c0415bcc0 2024-04-25T13:43:40.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.846+0000 7f9c01600640 1 -- 172.21.15.123:0/646605406 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bf0004240 con 0x7f9c0415bcc0 2024-04-25T13:43:40.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.846+0000 7f9c01600640 1 -- 172.21.15.123:0/646605406 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf000f8e0 con 0x7f9c0415bcc0 2024-04-25T13:43:40.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.846+0000 7f9c0c000640 1 -- 172.21.15.123:0/646605406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c0413fbb0 con 0x7f9c0415bcc0 2024-04-25T13:43:40.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.846+0000 7f9c0c000640 1 -- 172.21.15.123:0/646605406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c04151260 con 0x7f9c0415bcc0 2024-04-25T13:43:40.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.846+0000 7f9c0c000640 1 -- 172.21.15.123:0/646605406 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c04151980 con 0x7f9c0415bcc0 2024-04-25T13:43:40.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.846+0000 7f9c01600640 1 -- 172.21.15.123:0/646605406 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9bf001c070 con 0x7f9c0415bcc0 2024-04-25T13:43:40.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.846+0000 7f9c01600640 1 --2- 172.21.15.123:0/646605406 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9be406f400 0x7f9be4071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:40.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.846+0000 7f9c01600640 1 -- 172.21.15.123:0/646605406 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f9bf008f370 con 0x7f9c0415bcc0 2024-04-25T13:43:40.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.846+0000 7f9c09600640 1 --2- 172.21.15.123:0/646605406 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9be406f400 0x7f9be4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:40.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.850+0000 7f9c09600640 1 --2- 172.21.15.123:0/646605406 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9be406f400 0x7f9be4071910 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8001060 tx=0x7f9bf8001cd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:40.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:40.850+0000 7f9c01600640 1 -- 172.21.15.123:0/646605406 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9c0413fbb0 con 0x7f9c0415bcc0 2024-04-25T13:43:41.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.010+0000 7f9c0c000640 1 -- 172.21.15.123:0/646605406 --> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f9c0414f370 con 0x7f9be406f400 2024-04-25T13:43:41.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.010+0000 7f9c01600640 1 -- 172.21.15.123:0/646605406 <== mgr.4107 v2:172.21.15.123:6832/715752891 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9c0414f370 con 0x7f9be406f400 2024-04-25T13:43:41.014 INFO:teuthology.orchestra.run.smithi123.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T13:43:41.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.010+0000 7f9c0c000640 1 -- 172.21.15.123:0/646605406 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9be406f400 msgr2=0x7f9be4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:41.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.010+0000 7f9c0c000640 1 --2- 172.21.15.123:0/646605406 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9be406f400 0x7f9be4071910 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8001060 tx=0x7f9bf8001cd0 comp rx=0 tx=0).stop 2024-04-25T13:43:41.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.010+0000 7f9c0c000640 1 -- 172.21.15.123:0/646605406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c0415bcc0 msgr2=0x7f9c0415c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:41.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.010+0000 7f9c0c000640 1 --2- 172.21.15.123:0/646605406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c0415bcc0 0x7f9c0415c0d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0011960 tx=0x7f9bf0011e20 comp rx=0 tx=0).stop 2024-04-25T13:43:41.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.010+0000 7f9c0c000640 1 -- 172.21.15.123:0/646605406 shutdown_connections 2024-04-25T13:43:41.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.010+0000 7f9c0c000640 1 --2- 172.21.15.123:0/646605406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c0413f260 0x7f9c0413f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:41.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.010+0000 7f9c0c000640 1 --2- 172.21.15.123:0/646605406 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f9be406f400 0x7f9be4071910 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:41.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.010+0000 7f9c0c000640 1 --2- 172.21.15.123:0/646605406 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9c0415bcc0 0x7f9c0415c0d0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:41.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.010+0000 7f9c0c000640 1 --2- 172.21.15.123:0/646605406 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9bec0075c0 0x7f9c04142930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:41.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.010+0000 7f9c0c000640 1 -- 172.21.15.123:0/646605406 >> 172.21.15.123:0/646605406 conn(0x7f9c0406ca70 msgr2=0x7f9c0414b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:41.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.010+0000 7f9c0c000640 1 -- 172.21.15.123:0/646605406 shutdown_connections 2024-04-25T13:43:41.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.010+0000 7f9c0c000640 1 -- 172.21.15.123:0/646605406 wait complete. 2024-04-25T13:43:41.035 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:43:41.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.174+0000 7f7fb4800640 1 Processor -- start 2024-04-25T13:43:41.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.174+0000 7f7fb4800640 1 -- start start 2024-04-25T13:43:41.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.178+0000 7f7fb4800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7fac0d0f80 0x7f7fac160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:41.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.178+0000 7f7fb4800640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7fac0b5010 0x7f7fac0b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:41.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.178+0000 7f7fb4800640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fac161520 con 0x7f7fac0b32f0 2024-04-25T13:43:41.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.178+0000 7f7fb4800640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f7fac15cfe0 con 0x7f7fac0b5010 2024-04-25T13:43:41.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.178+0000 7f7fb4800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7fac15d240 con 0x7f7fac0d0f80 2024-04-25T13:43:41.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.178+0000 7f7fb2800640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7fac0b5010 0x7f7fac0b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:41.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.178+0000 7f7fb1e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7fac0d0f80 0x7f7fac160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:41.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.178+0000 7f7fb1e00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7fac0d0f80 0x7f7fac160fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.123:49056/0 (socket says 172.21.15.123:49056) 2024-04-25T13:43:41.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.178+0000 7f7fb1e00640 1 -- 172.21.15.123:0/1071224926 learned_addr learned my addr 172.21.15.123:0/1071224926 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:41.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.178+0000 7f7fb2800640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7fac0b5010 0x7f7fac0b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.123:57466/0 (socket says 172.21.15.123:57466) 2024-04-25T13:43:41.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.178+0000 7f7fb1400640 1 --1- 172.21.15.123:0/1071224926 >> v1:172.21.15.130:6789/0 conn(0x7f7fac0b32f0 0x7f7fac0b3700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.123:38784/0 (socket says 172.21.15.123:38784) 2024-04-25T13:43:41.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.178+0000 7f7fb1e00640 1 -- 172.21.15.123:0/1071224926 >> v2:172.21.15.130:3300/0 conn(0x7f7fac0b5010 msgr2=0x7f7fac0b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:43:41.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.178+0000 7f7fb1e00640 1 --2- 172.21.15.123:0/1071224926 >> v2:172.21.15.130:3300/0 conn(0x7f7fac0b5010 0x7f7fac0b5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:41.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.178+0000 7f7fb1e00640 1 -- 172.21.15.123:0/1071224926 >> v1:172.21.15.130:6789/0 conn(0x7f7fac0b32f0 legacy=0x7f7fac0b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:41.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.178+0000 7f7fb1e00640 1 -- 172.21.15.123:0/1071224926 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fac15d520 con 0x7f7fac0d0f80 2024-04-25T13:43:41.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.182+0000 7f7fb1e00640 1 --2- 172.21.15.123:0/1071224926 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7fac0d0f80 0x7f7fac160fe0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0009870 tx=0x7f7fa001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b6b977ffba2b5f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:41.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.182+0000 7f7fb0a00640 1 -- 172.21.15.123:0/1071224926 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa00b1070 con 0x7f7fac0d0f80 2024-04-25T13:43:41.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.182+0000 7f7fb0a00640 1 -- 172.21.15.123:0/1071224926 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa00ac620 con 0x7f7fac0d0f80 2024-04-25T13:43:41.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.182+0000 7f7fb0a00640 1 -- 172.21.15.123:0/1071224926 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa00ac9f0 con 0x7f7fac0d0f80 2024-04-25T13:43:41.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.182+0000 7f7fb4800640 1 -- 172.21.15.123:0/1071224926 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7fac0d0f80 msgr2=0x7f7fac160fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:41.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.182+0000 7f7fb4800640 1 --2- 172.21.15.123:0/1071224926 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7fac0d0f80 0x7f7fac160fe0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0009870 tx=0x7f7fa001c4a0 comp rx=0 tx=0).stop 2024-04-25T13:43:41.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.182+0000 7f7fb4800640 1 -- 172.21.15.123:0/1071224926 shutdown_connections 2024-04-25T13:43:41.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.182+0000 7f7fb4800640 1 --2- 172.21.15.123:0/1071224926 >> v2:172.21.15.130:3300/0 conn(0x7f7fac0b5010 0x7f7fac0b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:41.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.182+0000 7f7fb4800640 1 --2- 172.21.15.123:0/1071224926 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7fac0d0f80 0x7f7fac160fe0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:41.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.182+0000 7f7fb4800640 1 -- 172.21.15.123:0/1071224926 >> 172.21.15.123:0/1071224926 conn(0x7f7fac06d210 msgr2=0x7f7fac06ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:41.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.182+0000 7f7fb4800640 1 -- 172.21.15.123:0/1071224926 shutdown_connections 2024-04-25T13:43:41.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.182+0000 7f7fb4800640 1 -- 172.21.15.123:0/1071224926 wait complete. 2024-04-25T13:43:41.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.186+0000 7f7fb4800640 1 Processor -- start 2024-04-25T13:43:41.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.186+0000 7f7fb4800640 1 -- start start 2024-04-25T13:43:41.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.186+0000 7f7fb4800640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fac0b32f0 0x7f7fac161750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:41.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.186+0000 7f7fb4800640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7fac0b5010 0x7f7fac165e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:41.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.186+0000 7f7fb4800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fac0d0f80 0x7f7fac073ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:41.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.186+0000 7f7fb4800640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f7fac072ad0 con 0x7f7fac0b32f0 2024-04-25T13:43:41.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.186+0000 7f7fb4800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7fac0b6470 con 0x7f7fac0d0f80 2024-04-25T13:43:41.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.186+0000 7f7fb4800640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7fac072c50 con 0x7f7fac0b5010 2024-04-25T13:43:41.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.186+0000 7f7fb1e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fac0b32f0 0x7f7fac161750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:41.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.186+0000 7f7fb1e00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fac0b32f0 0x7f7fac161750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39618/0 (socket says 172.21.15.123:39618) 2024-04-25T13:43:41.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.186+0000 7f7fb1e00640 1 -- 172.21.15.123:0/310103148 learned_addr learned my addr 172.21.15.123:0/310103148 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:43:41.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.186+0000 7f7fb1400640 1 --2- 172.21.15.123:0/310103148 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7fac0b5010 0x7f7fac165e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:41.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.186+0000 7f7fb1e00640 1 -- 172.21.15.123:0/310103148 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7fac0b5010 msgr2=0x7f7fac165e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:41.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.186+0000 7f7fb2800640 1 --2- 172.21.15.123:0/310103148 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fac0d0f80 0x7f7fac073ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:41.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.186+0000 7f7fb1e00640 1 --2- 172.21.15.123:0/310103148 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7fac0b5010 0x7f7fac165e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:41.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.186+0000 7f7fb1e00640 1 -- 172.21.15.123:0/310103148 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fac0d0f80 msgr2=0x7f7fac073ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:41.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.186+0000 7f7fb1e00640 1 --2- 172.21.15.123:0/310103148 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fac0d0f80 0x7f7fac073ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:41.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.186+0000 7f7fb1e00640 1 -- 172.21.15.123:0/310103148 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fac164da0 con 0x7f7fac0b32f0 2024-04-25T13:43:41.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.186+0000 7f7fb2800640 1 --2- 172.21.15.123:0/310103148 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fac0d0f80 0x7f7fac073ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:41.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.186+0000 7f7fb1400640 1 --2- 172.21.15.123:0/310103148 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7fac0b5010 0x7f7fac165e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T13:43:41.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.186+0000 7f7fb1e00640 1 --2- 172.21.15.123:0/310103148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fac0b32f0 0x7f7fac161750 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00af040 tx=0x7f7fa0019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:41.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.186+0000 7f7fa6000640 1 -- 172.21.15.123:0/310103148 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa00bb020 con 0x7f7fac0b32f0 2024-04-25T13:43:41.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.186+0000 7f7fa6000640 1 -- 172.21.15.123:0/310103148 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa00b7420 con 0x7f7fac0b32f0 2024-04-25T13:43:41.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.186+0000 7f7fb4800640 1 -- 172.21.15.123:0/310103148 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fac165080 con 0x7f7fac0b32f0 2024-04-25T13:43:41.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.186+0000 7f7fa6000640 1 -- 172.21.15.123:0/310103148 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa00b1040 con 0x7f7fac0b32f0 2024-04-25T13:43:41.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.186+0000 7f7fb4800640 1 -- 172.21.15.123:0/310103148 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fac165640 con 0x7f7fac0b32f0 2024-04-25T13:43:41.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.190+0000 7f7fb4800640 1 -- 172.21.15.123:0/310103148 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fac0507c0 con 0x7f7fac0b32f0 2024-04-25T13:43:41.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.190+0000 7f7fa6000640 1 -- 172.21.15.123:0/310103148 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7fa00be020 con 0x7f7fac0b32f0 2024-04-25T13:43:41.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.190+0000 7f7fa6000640 1 --2- 172.21.15.123:0/310103148 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f7f9006f430 0x7f7f90071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:43:41.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.190+0000 7f7fa6000640 1 -- 172.21.15.123:0/310103148 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f7fa0128f30 con 0x7f7fac0b32f0 2024-04-25T13:43:41.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.190+0000 7f7fb1400640 1 --2- 172.21.15.123:0/310103148 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f7f9006f430 0x7f7f90071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:43:41.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.190+0000 7f7fb1400640 1 --2- 172.21.15.123:0/310103148 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f7f9006f430 0x7f7f90071940 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7fac0cdc20 tx=0x7f7f9c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:43:41.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.194+0000 7f7fa6000640 1 -- 172.21.15.123:0/310103148 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7fa00c5070 con 0x7f7fac0b32f0 2024-04-25T13:43:41.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.346+0000 7f7fb4800640 1 -- 172.21.15.123:0/310103148 --> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7fac0cdc70 con 0x7f7f9006f430 2024-04-25T13:43:41.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.350+0000 7f7fa6000640 1 -- 172.21.15.123:0/310103148 <== mgr.4107 v2:172.21.15.123:6832/715752891 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13341 (secure 0 0 0) 0x7f7fac0cdc70 con 0x7f7f9006f430 2024-04-25T13:43:41.353 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:43:41.354 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-04-25T13:43:41.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.350+0000 7f7fb4800640 1 -- 172.21.15.123:0/310103148 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f7f9006f430 msgr2=0x7f7f90071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:41.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.350+0000 7f7fb4800640 1 --2- 172.21.15.123:0/310103148 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f7f9006f430 0x7f7f90071940 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7fac0cdc20 tx=0x7f7f9c009040 comp rx=0 tx=0).stop 2024-04-25T13:43:41.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.350+0000 7f7fb4800640 1 -- 172.21.15.123:0/310103148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fac0b32f0 msgr2=0x7f7fac161750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:43:41.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.350+0000 7f7fb4800640 1 --2- 172.21.15.123:0/310103148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fac0b32f0 0x7f7fac161750 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00af040 tx=0x7f7fa0019240 comp rx=0 tx=0).stop 2024-04-25T13:43:41.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.350+0000 7f7fb4800640 1 -- 172.21.15.123:0/310103148 shutdown_connections 2024-04-25T13:43:41.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.350+0000 7f7fb4800640 1 --2- 172.21.15.123:0/310103148 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fac0d0f80 0x7f7fac073ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:41.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.350+0000 7f7fb4800640 1 --2- 172.21.15.123:0/310103148 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f7f9006f430 0x7f7f90071940 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:41.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.350+0000 7f7fb4800640 1 --2- 172.21.15.123:0/310103148 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7fac0b5010 0x7f7fac165e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:41.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.350+0000 7f7fb4800640 1 --2- 172.21.15.123:0/310103148 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fac0b32f0 0x7f7fac161750 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:43:41.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.350+0000 7f7fb4800640 1 -- 172.21.15.123:0/310103148 >> 172.21.15.123:0/310103148 conn(0x7f7fac06d210 msgr2=0x7f7fac166d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:43:41.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.350+0000 7f7fb4800640 1 -- 172.21.15.123:0/310103148 shutdown_connections 2024-04-25T13:43:41.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:43:41.350+0000 7f7fb4800640 1 -- 172.21.15.123:0/310103148 wait complete. 2024-04-25T13:43:41.375 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2024-04-25T13:43:39.595358+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220716,"kb_used_data":4520,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754004,"statfs":{"total":773094113280,"available":772868100096,"internally_reserved":0,"allocated":4628480,"data_stored":2535248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.294006"},"pg_stats":[{"pgid":"1.0","version":"17'72","reported_seq":141,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T13:43:32.587588+0000","last_change":"2024-04-25T13:41:56.890628+0000","last_active":"2024-04-25T13:43:32.587588+0000","last_peered":"2024-04-25T13:43:32.587588+0000","last_clean":"2024-04-25T13:43:32.587588+0000","last_became_active":"2024-04-25T13:41:56.889261+0000","last_became_peered":"2024-04-25T13:41:56.889261+0000","last_unstale":"2024-04-25T13:43:32.587588+0000","last_undegraded":"2024-04-25T13:43:32.587588+0000","last_fullsized":"2024-04-25T13:43:32.587588+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T13:41:53.940471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T13:41:53.940471+0000","last_clean_scrub_stamp":"2024-04-25T13:41:53.940471+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:06.164380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1024000,"data_stored":759682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":169314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1024000,"data_stored":759682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:43:41.378 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T13:41:53.940471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=41, tm_sec=53, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=13, tm_min=43, tm_sec=35, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T13:43:41.378 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T13:44:01.380 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T13:44:01.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.538+0000 7f119de00640 1 Processor -- start 2024-04-25T13:44:01.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.538+0000 7f119de00640 1 -- start start 2024-04-25T13:44:01.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.538+0000 7f119de00640 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1198163650 0x7f11980ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:01.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.538+0000 7f119de00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f11980d1f70 0x7f11980cf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:01.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.538+0000 7f119de00640 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11980b3eb0 con 0x7f11980d30b0 2024-04-25T13:44:01.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.538+0000 7f119de00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f11980cef60 con 0x7f11980d1f70 2024-04-25T13:44:01.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.538+0000 7f119de00640 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 -- 0x7f11980b3bd0 con 0x7f1198163650 2024-04-25T13:44:01.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.538+0000 7f1197400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f11980d1f70 0x7f11980cf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:01.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.538+0000 7f1197400640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f11980d1f70 0x7f11980cf3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53202/0 (socket says 172.21.15.123:53202) 2024-04-25T13:44:01.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.538+0000 7f1197400640 1 -- 172.21.15.123:0/1476038423 learned_addr learned my addr 172.21.15.123:0/1476038423 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:44:01.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.538+0000 7f1196a00640 1 --2- 172.21.15.123:0/1476038423 >> v2:172.21.15.130:3300/0 conn(0x7f1198163650 0x7f11980ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:01.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.542+0000 7f1197400640 1 -- 172.21.15.123:0/1476038423 >> v2:172.21.15.130:3300/0 conn(0x7f1198163650 msgr2=0x7f11980ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:01.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.542+0000 7f1197400640 1 --2- 172.21.15.123:0/1476038423 >> v2:172.21.15.130:3300/0 conn(0x7f1198163650 0x7f11980ccbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:01.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.542+0000 7f1197400640 1 -- 172.21.15.123:0/1476038423 >> v1:172.21.15.130:6789/0 conn(0x7f11980d30b0 legacy=0x7f11980d1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:01.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.542+0000 7f1197400640 1 -- 172.21.15.123:0/1476038423 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11980ce910 con 0x7f11980d1f70 2024-04-25T13:44:01.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.542+0000 7f1197400640 1 --2- 172.21.15.123:0/1476038423 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11980d1f70 0x7f11980cf3f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f11980b5180 tx=0x7f119001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76bb33009d37c1ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:01.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.542+0000 7f1195600640 1 -- 172.21.15.123:0/1476038423 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11900ab430 con 0x7f11980d1f70 2024-04-25T13:44:01.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.542+0000 7f1195600640 1 -- 172.21.15.123:0/1476038423 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11900b0070 con 0x7f11980d1f70 2024-04-25T13:44:01.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.542+0000 7f1195600640 1 -- 172.21.15.123:0/1476038423 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11900ab7f0 con 0x7f11980d1f70 2024-04-25T13:44:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.542+0000 7f119de00640 1 -- 172.21.15.123:0/1476038423 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11980d1f70 msgr2=0x7f11980cf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.542+0000 7f119de00640 1 --2- 172.21.15.123:0/1476038423 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11980d1f70 0x7f11980cf3f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f11980b5180 tx=0x7f119001c520 comp rx=0 tx=0).stop 2024-04-25T13:44:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.546+0000 7f119de00640 1 -- 172.21.15.123:0/1476038423 shutdown_connections 2024-04-25T13:44:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.546+0000 7f119de00640 1 --2- 172.21.15.123:0/1476038423 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11980d1f70 0x7f11980cf3f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.546+0000 7f119de00640 1 --2- 172.21.15.123:0/1476038423 >> v2:172.21.15.130:3300/0 conn(0x7f1198163650 0x7f11980ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:01.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.546+0000 7f119de00640 1 -- 172.21.15.123:0/1476038423 >> 172.21.15.123:0/1476038423 conn(0x7f11980d2590 msgr2=0x7f11980d29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:01.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.546+0000 7f119de00640 1 -- 172.21.15.123:0/1476038423 shutdown_connections 2024-04-25T13:44:01.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.546+0000 7f119de00640 1 -- 172.21.15.123:0/1476038423 wait complete. 2024-04-25T13:44:01.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.546+0000 7f119de00640 1 Processor -- start 2024-04-25T13:44:01.547 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.546+0000 7f119de00640 1 -- start start 2024-04-25T13:44:01.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.546+0000 7f119de00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11980d1f70 0x7f11980b62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:01.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.546+0000 7f119de00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11980d30b0 0x7f119815ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:01.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.550+0000 7f119de00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1198163650 0x7f1198161850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:01.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.550+0000 7f119de00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f11980cd2a0 con 0x7f11980d30b0 2024-04-25T13:44:01.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.550+0000 7f119de00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f11980cd120 con 0x7f1198163650 2024-04-25T13:44:01.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.550+0000 7f119de00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f119816d3e0 con 0x7f11980d1f70 2024-04-25T13:44:01.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.550+0000 7f1196000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11980d30b0 0x7f119815ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:01.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.550+0000 7f1196000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11980d30b0 0x7f119815ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53216/0 (socket says 172.21.15.123:53216) 2024-04-25T13:44:01.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.550+0000 7f1196000640 1 -- 172.21.15.123:0/1823393818 learned_addr learned my addr 172.21.15.123:0/1823393818 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:44:01.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.550+0000 7f1196a00640 1 --2- 172.21.15.123:0/1823393818 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11980d1f70 0x7f11980b62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:01.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.550+0000 7f1197400640 1 --2- 172.21.15.123:0/1823393818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1198163650 0x7f1198161850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:01.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.550+0000 7f1196000640 1 -- 172.21.15.123:0/1823393818 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11980d1f70 msgr2=0x7f11980b62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:01.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.550+0000 7f1196000640 1 --2- 172.21.15.123:0/1823393818 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11980d1f70 0x7f11980b62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:01.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.550+0000 7f1196000640 1 -- 172.21.15.123:0/1823393818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1198163650 msgr2=0x7f1198161850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:01.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.550+0000 7f1196000640 1 --2- 172.21.15.123:0/1823393818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1198163650 0x7f1198161850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:01.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.550+0000 7f1196000640 1 -- 172.21.15.123:0/1823393818 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119815b250 con 0x7f11980d30b0 2024-04-25T13:44:01.551 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.550+0000 7f1196000640 1 --2- 172.21.15.123:0/1823393818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11980d30b0 0x7f119815ad10 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f118000c730 tx=0x7f118000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:01.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.550+0000 7f118f400640 1 -- 172.21.15.123:0/1823393818 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1180016020 con 0x7f11980d30b0 2024-04-25T13:44:01.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.550+0000 7f118f400640 1 -- 172.21.15.123:0/1823393818 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1180006d60 con 0x7f11980d30b0 2024-04-25T13:44:01.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.550+0000 7f119de00640 1 -- 172.21.15.123:0/1823393818 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11980b6b40 con 0x7f11980d30b0 2024-04-25T13:44:01.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.550+0000 7f118f400640 1 -- 172.21.15.123:0/1823393818 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1180003bc0 con 0x7f11980d30b0 2024-04-25T13:44:01.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.550+0000 7f119de00640 1 -- 172.21.15.123:0/1823393818 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11980b5500 con 0x7f11980d30b0 2024-04-25T13:44:01.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.550+0000 7f119de00640 1 -- 172.21.15.123:0/1823393818 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11980b68b0 con 0x7f11980d30b0 2024-04-25T13:44:01.552 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.550+0000 7f118f400640 1 -- 172.21.15.123:0/1823393818 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f118000a850 con 0x7f11980d30b0 2024-04-25T13:44:01.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.554+0000 7f118f400640 1 --2- 172.21.15.123:0/1823393818 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f117406f430 0x7f1174071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:01.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.554+0000 7f118f400640 1 -- 172.21.15.123:0/1823393818 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f118008eaa0 con 0x7f11980d30b0 2024-04-25T13:44:01.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.554+0000 7f1196a00640 1 --2- 172.21.15.123:0/1823393818 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f117406f430 0x7f1174071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:01.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.554+0000 7f1196a00640 1 --2- 172.21.15.123:0/1823393818 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f117406f430 0x7f1174071940 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f11980736b0 tx=0x7f1188009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:01.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.558+0000 7f118f400640 1 -- 172.21.15.123:0/1823393818 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1180020020 con 0x7f11980d30b0 2024-04-25T13:44:01.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.714+0000 7f119de00640 1 -- 172.21.15.123:0/1823393818 --> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f11980507c0 con 0x7f117406f430 2024-04-25T13:44:01.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.714+0000 7f118f400640 1 -- 172.21.15.123:0/1823393818 <== mgr.4107 v2:172.21.15.123:6832/715752891 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13343 (secure 0 0 0) 0x7f11980507c0 con 0x7f117406f430 2024-04-25T13:44:01.714 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:44:01.715 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-04-25T13:44:01.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.714+0000 7f119de00640 1 -- 172.21.15.123:0/1823393818 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f117406f430 msgr2=0x7f1174071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:01.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.714+0000 7f119de00640 1 --2- 172.21.15.123:0/1823393818 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f117406f430 0x7f1174071940 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f11980736b0 tx=0x7f1188009190 comp rx=0 tx=0).stop 2024-04-25T13:44:01.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.714+0000 7f119de00640 1 -- 172.21.15.123:0/1823393818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11980d30b0 msgr2=0x7f119815ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:01.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.714+0000 7f119de00640 1 --2- 172.21.15.123:0/1823393818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11980d30b0 0x7f119815ad10 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f118000c730 tx=0x7f118000cbf0 comp rx=0 tx=0).stop 2024-04-25T13:44:01.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.714+0000 7f119de00640 1 -- 172.21.15.123:0/1823393818 shutdown_connections 2024-04-25T13:44:01.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.714+0000 7f119de00640 1 --2- 172.21.15.123:0/1823393818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1198163650 0x7f1198161850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:01.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.714+0000 7f119de00640 1 --2- 172.21.15.123:0/1823393818 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f117406f430 0x7f1174071940 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:01.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.714+0000 7f119de00640 1 --2- 172.21.15.123:0/1823393818 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f11980d30b0 0x7f119815ad10 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:01.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.714+0000 7f119de00640 1 --2- 172.21.15.123:0/1823393818 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11980d1f70 0x7f11980b62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:01.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.714+0000 7f119de00640 1 -- 172.21.15.123:0/1823393818 >> 172.21.15.123:0/1823393818 conn(0x7f11980d2590 msgr2=0x7f119815f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:01.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.714+0000 7f119de00640 1 -- 172.21.15.123:0/1823393818 shutdown_connections 2024-04-25T13:44:01.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.714+0000 7f119de00640 1 -- 172.21.15.123:0/1823393818 wait complete. 2024-04-25T13:44:01.736 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2024-04-25T13:44:01.600543+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220700,"kb_used_data":4520,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754020,"statfs":{"total":773094113280,"available":772868116480,"internally_reserved":0,"allocated":4628480,"data_stored":2535248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002735"},"pg_stats":[{"pgid":"1.0","version":"37'74","reported_seq":153,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T13:43:41.668355+0000","last_change":"2024-04-25T13:43:41.668355+0000","last_active":"2024-04-25T13:43:41.668355+0000","last_peered":"2024-04-25T13:43:41.668355+0000","last_clean":"2024-04-25T13:43:41.668355+0000","last_became_active":"2024-04-25T13:41:56.889261+0000","last_became_peered":"2024-04-25T13:41:56.889261+0000","last_unstale":"2024-04-25T13:43:41.668355+0000","last_undegraded":"2024-04-25T13:43:41.668355+0000","last_fullsized":"2024-04-25T13:43:41.668355+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'74","last_scrub_stamp":"2024-04-25T13:43:41.668190+0000","last_deep_scrub":"37'74","last_deep_scrub_stamp":"2024-04-25T13:43:41.668190+0000","last_clean_scrub_stamp":"2024-04-25T13:43:41.668190+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:46.794606+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1024000,"data_stored":759682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":169314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":169314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1024000,"data_stored":759682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T13:44:01.737 DEBUG:teuthology.orchestra.run.smithi123:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T13:44:01.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.882+0000 7f7277c00640 1 Processor -- start 2024-04-25T13:44:01.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.882+0000 7f7277c00640 1 -- start start 2024-04-25T13:44:01.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.882+0000 7f7277c00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f72700b3f80 0x7f72700b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:01.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.882+0000 7f7277c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7270073c00 0x7f7270074010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:01.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.882+0000 7f7277c00640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72701604d0 con 0x7f72700b4770 2024-04-25T13:44:01.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.882+0000 7f7277c00640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7f72700b5210 con 0x7f72700b3f80 2024-04-25T13:44:01.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.882+0000 7f7277c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7270160790 con 0x7f7270073c00 2024-04-25T13:44:01.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.882+0000 7f7267e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f72700b3f80 0x7f72700b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:01.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.882+0000 7f7267e00640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7f72700b3f80 0x7f72700b4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53220/0 (socket says 172.21.15.123:53220) 2024-04-25T13:44:01.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.882+0000 7f7275200640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7f72700b4770 0x7f72700b3870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43152/0 (socket says 172.21.15.123:43152) 2024-04-25T13:44:01.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.882+0000 7f7267e00640 1 -- 172.21.15.123:0/382557666 learned_addr learned my addr 172.21.15.123:0/382557666 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:44:01.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.882+0000 7f7275c00640 1 --2- 172.21.15.123:0/382557666 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7270073c00 0x7f7270074010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:01.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.882+0000 7f7267e00640 1 -- 172.21.15.123:0/382557666 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7270073c00 msgr2=0x7f7270074010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:01.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.882+0000 7f7267e00640 1 --2- 172.21.15.123:0/382557666 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7270073c00 0x7f7270074010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:01.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.882+0000 7f7267e00640 1 -- 172.21.15.123:0/382557666 >> v1:172.21.15.123:6789/0 conn(0x7f72700b4770 legacy=0x7f72700b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:01.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.882+0000 7f7267e00640 1 -- 172.21.15.123:0/382557666 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7270160a70 con 0x7f72700b3f80 2024-04-25T13:44:01.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.886+0000 7f7267e00640 1 --2- 172.21.15.123:0/382557666 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72700b3f80 0x7f72700b4b80 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f72580098a0 tx=0x7f725801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4d1ed89b17c9a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:01.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.886+0000 7f726fe00640 1 -- 172.21.15.123:0/382557666 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72580ab610 con 0x7f72700b3f80 2024-04-25T13:44:01.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.886+0000 7f726fe00640 1 -- 172.21.15.123:0/382557666 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72580b0070 con 0x7f72700b3f80 2024-04-25T13:44:01.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.886+0000 7f726fe00640 1 -- 172.21.15.123:0/382557666 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72580ab9d0 con 0x7f72700b3f80 2024-04-25T13:44:01.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.886+0000 7f7277c00640 1 -- 172.21.15.123:0/382557666 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72700b3f80 msgr2=0x7f72700b4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:01.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.886+0000 7f7277c00640 1 --2- 172.21.15.123:0/382557666 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72700b3f80 0x7f72700b4b80 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f72580098a0 tx=0x7f725801c480 comp rx=0 tx=0).stop 2024-04-25T13:44:01.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.886+0000 7f7277c00640 1 -- 172.21.15.123:0/382557666 shutdown_connections 2024-04-25T13:44:01.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.886+0000 7f7277c00640 1 --2- 172.21.15.123:0/382557666 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7270073c00 0x7f7270074010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:01.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.886+0000 7f7277c00640 1 --2- 172.21.15.123:0/382557666 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72700b3f80 0x7f72700b4b80 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:01.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.886+0000 7f7277c00640 1 -- 172.21.15.123:0/382557666 >> 172.21.15.123:0/382557666 conn(0x7f727006ca70 msgr2=0x7f727006ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:01.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.886+0000 7f7277c00640 1 -- 172.21.15.123:0/382557666 shutdown_connections 2024-04-25T13:44:01.888 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.886+0000 7f7277c00640 1 -- 172.21.15.123:0/382557666 wait complete. 2024-04-25T13:44:01.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.890+0000 7f7277c00640 1 Processor -- start 2024-04-25T13:44:01.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.890+0000 7f7277c00640 1 -- start start 2024-04-25T13:44:01.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.890+0000 7f7277c00640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7270073c00 0x7f7270146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:01.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.890+0000 7f7277c00640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72700b4770 0x7f72701571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:01.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.890+0000 7f7277c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7270162610 0x7f7270162a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:01.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.890+0000 7f7277c00640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7f72701613f0 con 0x7f7270073c00 2024-04-25T13:44:01.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.890+0000 7f7277c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7270161270 con 0x7f7270162610 2024-04-25T13:44:01.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.890+0000 7f7277c00640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7f7270074960 con 0x7f72700b4770 2024-04-25T13:44:01.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.890+0000 7f7275200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7270073c00 0x7f7270146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:01.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.890+0000 7f7275200640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7270073c00 0x7f7270146d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53230/0 (socket says 172.21.15.123:53230) 2024-04-25T13:44:01.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.890+0000 7f7275200640 1 -- 172.21.15.123:0/1450973124 learned_addr learned my addr 172.21.15.123:0/1450973124 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:44:01.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.890+0000 7f7275200640 1 -- 172.21.15.123:0/1450973124 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72700b4770 msgr2=0x7f72701571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:01.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.890+0000 7f7275200640 1 --2- 172.21.15.123:0/1450973124 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72700b4770 0x7f72701571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:01.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.890+0000 7f7275200640 1 -- 172.21.15.123:0/1450973124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7270162610 msgr2=0x7f7270162a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:01.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.890+0000 7f7275200640 1 --2- 172.21.15.123:0/1450973124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7270162610 0x7f7270162a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:01.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.890+0000 7f7275200640 1 -- 172.21.15.123:0/1450973124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7270162f60 con 0x7f7270073c00 2024-04-25T13:44:01.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.890+0000 7f7275200640 1 --2- 172.21.15.123:0/1450973124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7270073c00 0x7f7270146d90 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f726000c3a0 tx=0x7f726000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:01.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.890+0000 7f726d600640 1 -- 172.21.15.123:0/1450973124 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72600074e0 con 0x7f7270073c00 2024-04-25T13:44:01.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.890+0000 7f726d600640 1 -- 172.21.15.123:0/1450973124 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7260007680 con 0x7f7270073c00 2024-04-25T13:44:01.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.890+0000 7f726d600640 1 -- 172.21.15.123:0/1450973124 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260004a30 con 0x7f7270073c00 2024-04-25T13:44:01.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.890+0000 7f7277c00640 1 -- 172.21.15.123:0/1450973124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72700ccd30 con 0x7f7270073c00 2024-04-25T13:44:01.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.890+0000 7f7277c00640 1 -- 172.21.15.123:0/1450973124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f727015b3b0 con 0x7f7270073c00 2024-04-25T13:44:01.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.894+0000 7f7277c00640 1 -- 172.21.15.123:0/1450973124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f727006d600 con 0x7f7270073c00 2024-04-25T13:44:01.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.894+0000 7f726d600640 1 -- 172.21.15.123:0/1450973124 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f726001a020 con 0x7f7270073c00 2024-04-25T13:44:01.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.894+0000 7f726d600640 1 --2- 172.21.15.123:0/1450973124 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f724c06f400 0x7f724c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:01.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.894+0000 7f726d600640 1 -- 172.21.15.123:0/1450973124 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f726008e7b0 con 0x7f7270073c00 2024-04-25T13:44:01.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.894+0000 7f7267e00640 1 --2- 172.21.15.123:0/1450973124 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f724c06f400 0x7f724c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:01.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.894+0000 7f7267e00640 1 --2- 172.21.15.123:0/1450973124 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f724c06f400 0x7f724c071910 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f72580af000 tx=0x7f7258004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:01.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:01.898+0000 7f726d600640 1 -- 172.21.15.123:0/1450973124 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7270162f60 con 0x7f7270073c00 2024-04-25T13:44:02.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.054+0000 7f7277c00640 1 -- 172.21.15.123:0/1450973124 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f7270050750 con 0x7f7270073c00 2024-04-25T13:44:02.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.058+0000 7f726d600640 1 -- 172.21.15.123:0/1450973124 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7f726005b900 con 0x7f7270073c00 2024-04-25T13:44:02.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.062+0000 7f726d600640 1 -- 172.21.15.123:0/1450973124 <== mon.0 v2:172.21.15.123:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f726005ad10 con 0x7f7270073c00 2024-04-25T13:44:02.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.062+0000 7f7277c00640 1 -- 172.21.15.123:0/1450973124 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f724c06f400 msgr2=0x7f724c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:02.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.062+0000 7f7277c00640 1 --2- 172.21.15.123:0/1450973124 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f724c06f400 0x7f724c071910 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f72580af000 tx=0x7f7258004740 comp rx=0 tx=0).stop 2024-04-25T13:44:02.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.062+0000 7f7277c00640 1 -- 172.21.15.123:0/1450973124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7270073c00 msgr2=0x7f7270146d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:02.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.062+0000 7f7277c00640 1 --2- 172.21.15.123:0/1450973124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7270073c00 0x7f7270146d90 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f726000c3a0 tx=0x7f726000c860 comp rx=0 tx=0).stop 2024-04-25T13:44:02.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.062+0000 7f7277c00640 1 -- 172.21.15.123:0/1450973124 shutdown_connections 2024-04-25T13:44:02.064 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.062+0000 7f7277c00640 1 --2- 172.21.15.123:0/1450973124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7270162610 0x7f7270162a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:02.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.062+0000 7f7277c00640 1 --2- 172.21.15.123:0/1450973124 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7f724c06f400 0x7f724c071910 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:02.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.062+0000 7f7277c00640 1 --2- 172.21.15.123:0/1450973124 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72700b4770 0x7f72701571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:02.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.062+0000 7f7277c00640 1 --2- 172.21.15.123:0/1450973124 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7270073c00 0x7f7270146d90 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:02.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.062+0000 7f7277c00640 1 -- 172.21.15.123:0/1450973124 >> 172.21.15.123:0/1450973124 conn(0x7f727006ca70 msgr2=0x7f72700d0310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:02.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.062+0000 7f7277c00640 1 -- 172.21.15.123:0/1450973124 shutdown_connections 2024-04-25T13:44:02.065 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.062+0000 7f7277c00640 1 -- 172.21.15.123:0/1450973124 wait complete. 2024-04-25T13:44:02.085 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T13:44:02.086 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T13:44:02.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.234+0000 7ff770000640 1 Processor -- start 2024-04-25T13:44:02.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.234+0000 7ff770000640 1 -- start start 2024-04-25T13:44:02.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.234+0000 7ff770000640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff7680747a0 0x7ff76815fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:02.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.234+0000 7ff770000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7680b5670 0x7ff7680731e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:02.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.234+0000 7ff770000640 1 -- --> v1:172.21.15.123:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff768145d70 con 0x7ff7681602e0 2024-04-25T13:44:02.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.234+0000 7ff770000640 1 -- --> v2:172.21.15.123:3300/0 -- mon_getmap magic: 0 -- 0x7ff768074290 con 0x7ff7680747a0 2024-04-25T13:44:02.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.234+0000 7ff770000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff7681606f0 con 0x7ff7680b5670 2024-04-25T13:44:02.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.234+0000 7ff76d600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff7680747a0 0x7ff76815fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:02.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.234+0000 7ff76d600640 1 --2- >> v2:172.21.15.123:3300/0 conn(0x7ff7680747a0 0x7ff76815fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53246/0 (socket says 172.21.15.123:53246) 2024-04-25T13:44:02.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.234+0000 7ff76cc00640 1 --1- >> v1:172.21.15.123:6789/0 conn(0x7ff7681602e0 0x7ff768072ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.123:6789/0 says I am v1:172.21.15.123:43154/0 (socket says 172.21.15.123:43154) 2024-04-25T13:44:02.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.234+0000 7ff76d600640 1 -- 172.21.15.123:0/247332978 learned_addr learned my addr 172.21.15.123:0/247332978 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:44:02.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.234+0000 7ff76e000640 1 --2- 172.21.15.123:0/247332978 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7680b5670 0x7ff7680731e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:02.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.234+0000 7ff76d600640 1 -- 172.21.15.123:0/247332978 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7680b5670 msgr2=0x7ff7680731e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T13:44:02.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.234+0000 7ff76d600640 1 --2- 172.21.15.123:0/247332978 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7680b5670 0x7ff7680731e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:02.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.234+0000 7ff76d600640 1 -- 172.21.15.123:0/247332978 >> v1:172.21.15.123:6789/0 conn(0x7ff7681602e0 legacy=0x7ff768072ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:02.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.234+0000 7ff76d600640 1 -- 172.21.15.123:0/247332978 --> v2:172.21.15.123:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff768073c80 con 0x7ff7680747a0 2024-04-25T13:44:02.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.234+0000 7ff767e00640 1 -- 172.21.15.123:0/247332978 <== mon.0 v1:172.21.15.123:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 704810207 0 0) 0x7ff754001120 con 0x7ff7681602e0 2024-04-25T13:44:02.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.238+0000 7ff76d600640 1 --2- 172.21.15.123:0/247332978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7680747a0 0x7ff76815fda0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff75c009870 tx=0x7ff75c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303eb7818a0904b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:02.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.238+0000 7ff767e00640 1 -- 172.21.15.123:0/247332978 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c0ab650 con 0x7ff7680747a0 2024-04-25T13:44:02.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.238+0000 7ff767e00640 1 -- 172.21.15.123:0/247332978 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff75c0b0070 con 0x7ff7680747a0 2024-04-25T13:44:02.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.238+0000 7ff767e00640 1 -- 172.21.15.123:0/247332978 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c0aba30 con 0x7ff7680747a0 2024-04-25T13:44:02.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.238+0000 7ff770000640 1 -- 172.21.15.123:0/247332978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7680747a0 msgr2=0x7ff76815fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:02.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.238+0000 7ff770000640 1 --2- 172.21.15.123:0/247332978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7680747a0 0x7ff76815fda0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff75c009870 tx=0x7ff75c01c560 comp rx=0 tx=0).stop 2024-04-25T13:44:02.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.238+0000 7ff770000640 1 -- 172.21.15.123:0/247332978 shutdown_connections 2024-04-25T13:44:02.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.238+0000 7ff770000640 1 --2- 172.21.15.123:0/247332978 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7680b5670 0x7ff7680731e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:02.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.238+0000 7ff770000640 1 --2- 172.21.15.123:0/247332978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7680747a0 0x7ff76815fda0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:02.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.238+0000 7ff770000640 1 -- 172.21.15.123:0/247332978 >> 172.21.15.123:0/247332978 conn(0x7ff76806d210 msgr2=0x7ff76806ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:02.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.238+0000 7ff770000640 1 -- 172.21.15.123:0/247332978 shutdown_connections 2024-04-25T13:44:02.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.238+0000 7ff770000640 1 -- 172.21.15.123:0/247332978 wait complete. 2024-04-25T13:44:02.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.242+0000 7ff770000640 1 Processor -- start 2024-04-25T13:44:02.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.242+0000 7ff770000640 1 -- start start 2024-04-25T13:44:02.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.242+0000 7ff770000640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7680747a0 0x7ff76815b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:02.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.242+0000 7ff770000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7680b5670 0x7ff76813f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:02.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.242+0000 7ff770000640 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7681602e0 0x7ff7681449d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:02.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.242+0000 7ff770000640 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 -- 0x7ff7680b6380 con 0x7ff7680747a0 2024-04-25T13:44:02.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.242+0000 7ff770000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff768074bb0 con 0x7ff7680b5670 2024-04-25T13:44:02.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.242+0000 7ff770000640 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 -- 0x7ff7680b6500 con 0x7ff7681602e0 2024-04-25T13:44:02.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.242+0000 7ff76d600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7680747a0 0x7ff76815b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:02.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.242+0000 7ff76d600640 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7680747a0 0x7ff76815b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53254/0 (socket says 172.21.15.123:53254) 2024-04-25T13:44:02.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.242+0000 7ff76d600640 1 -- 172.21.15.123:0/2093998085 learned_addr learned my addr 172.21.15.123:0/2093998085 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-04-25T13:44:02.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.242+0000 7ff76cc00640 1 --2- 172.21.15.123:0/2093998085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7680b5670 0x7ff76813f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:02.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.242+0000 7ff76e000640 1 --2- 172.21.15.123:0/2093998085 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7681602e0 0x7ff7681449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:02.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.242+0000 7ff76d600640 1 -- 172.21.15.123:0/2093998085 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7681602e0 msgr2=0x7ff7681449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:02.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.242+0000 7ff76d600640 1 --2- 172.21.15.123:0/2093998085 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7681602e0 0x7ff7681449d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:02.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.242+0000 7ff76d600640 1 -- 172.21.15.123:0/2093998085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7680b5670 msgr2=0x7ff76813f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:02.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.242+0000 7ff76d600640 1 --2- 172.21.15.123:0/2093998085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7680b5670 0x7ff76813f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:02.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.242+0000 7ff76d600640 1 -- 172.21.15.123:0/2093998085 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff768143390 con 0x7ff7680747a0 2024-04-25T13:44:02.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.242+0000 7ff76d600640 1 --2- 172.21.15.123:0/2093998085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7680747a0 0x7ff76815b910 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff75c0ad040 tx=0x7ff75c01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:02.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.246+0000 7ff765600640 1 -- 172.21.15.123:0/2093998085 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c0b48c0 con 0x7ff7680747a0 2024-04-25T13:44:02.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.246+0000 7ff765600640 1 -- 172.21.15.123:0/2093998085 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff75c0b4aa0 con 0x7ff7680747a0 2024-04-25T13:44:02.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.246+0000 7ff765600640 1 -- 172.21.15.123:0/2093998085 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75c0be3f0 con 0x7ff7680747a0 2024-04-25T13:44:02.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.246+0000 7ff770000640 1 -- 172.21.15.123:0/2093998085 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff768143670 con 0x7ff7680747a0 2024-04-25T13:44:02.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.246+0000 7ff770000640 1 -- 172.21.15.123:0/2093998085 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff768143c30 con 0x7ff7680747a0 2024-04-25T13:44:02.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.246+0000 7ff770000640 1 -- 172.21.15.123:0/2093998085 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7680507c0 con 0x7ff7680747a0 2024-04-25T13:44:02.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.246+0000 7ff765600640 1 -- 172.21.15.123:0/2093998085 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff75c0be590 con 0x7ff7680747a0 2024-04-25T13:44:02.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.246+0000 7ff765600640 1 --2- 172.21.15.123:0/2093998085 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff74806f430 0x7ff748071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T13:44:02.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.246+0000 7ff765600640 1 -- 172.21.15.123:0/2093998085 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7ff75c129ae0 con 0x7ff7680747a0 2024-04-25T13:44:02.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.246+0000 7ff76cc00640 1 --2- 172.21.15.123:0/2093998085 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff74806f430 0x7ff748071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T13:44:02.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.246+0000 7ff76cc00640 1 --2- 172.21.15.123:0/2093998085 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff74806f430 0x7ff748071940 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff76815fce0 tx=0x7ff754007df0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T13:44:02.252 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.250+0000 7ff765600640 1 -- 172.21.15.123:0/2093998085 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff75c016150 con 0x7ff7680747a0 2024-04-25T13:44:02.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.442+0000 7ff770000640 1 -- 172.21.15.123:0/2093998085 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff768166f10 con 0x7ff7680747a0 2024-04-25T13:44:02.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.442+0000 7ff765600640 1 -- 172.21.15.123:0/2093998085 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+3875 (secure 0 0 0) 0x7ff75c0f65e0 con 0x7ff7680747a0 2024-04-25T13:44:02.444 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-04-25T13:44:02.444 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3582988979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":3582988979},{"type":"v1","addr":"172.21.15.130:6835","nonce":3582988979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4978,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/173287078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6835","nonce":173287078},{"type":"v1","addr":"172.21.15.123:6837","nonce":173287078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4987,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/4025543653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":4025543653},{"type":"v1","addr":"172.21.15.130:6834","nonce":4025543653}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6836/198245450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":198245450},{"type":"v1","addr":"172.21.15.123:6836","nonce":198245450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[]} 2024-04-25T13:44:02.444 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 19 2024-04-25T13:44:02.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.446+0000 7ff770000640 1 -- 172.21.15.123:0/2093998085 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff74806f430 msgr2=0x7ff748071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:02.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.446+0000 7ff770000640 1 --2- 172.21.15.123:0/2093998085 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff74806f430 0x7ff748071940 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff76815fce0 tx=0x7ff754007df0 comp rx=0 tx=0).stop 2024-04-25T13:44:02.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.446+0000 7ff770000640 1 -- 172.21.15.123:0/2093998085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7680747a0 msgr2=0x7ff76815b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T13:44:02.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.446+0000 7ff770000640 1 --2- 172.21.15.123:0/2093998085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7680747a0 0x7ff76815b910 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff75c0ad040 tx=0x7ff75c01ada0 comp rx=0 tx=0).stop 2024-04-25T13:44:02.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.446+0000 7ff770000640 1 -- 172.21.15.123:0/2093998085 shutdown_connections 2024-04-25T13:44:02.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.446+0000 7ff770000640 1 --2- 172.21.15.123:0/2093998085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7680b5670 0x7ff76813f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:02.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.446+0000 7ff770000640 1 --2- 172.21.15.123:0/2093998085 >> [v2:172.21.15.123:6832/715752891,v1:172.21.15.123:6833/715752891] conn(0x7ff74806f430 0x7ff748071940 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:02.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.446+0000 7ff770000640 1 --2- 172.21.15.123:0/2093998085 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7681602e0 0x7ff7681449d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:02.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.446+0000 7ff770000640 1 --2- 172.21.15.123:0/2093998085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff7680747a0 0x7ff76815b910 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T13:44:02.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.446+0000 7ff770000640 1 -- 172.21.15.123:0/2093998085 >> 172.21.15.123:0/2093998085 conn(0x7ff76806d210 msgr2=0x7ff76813c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T13:44:02.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.446+0000 7ff770000640 1 -- 172.21.15.123:0/2093998085 shutdown_connections 2024-04-25T13:44:02.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-04-25T13:44:02.446+0000 7ff770000640 1 -- 172.21.15.123:0/2093998085 wait complete. 2024-04-25T13:44:02.466 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-25T13:44:02.466 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T13:44:02.466 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T13:44:02.467 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:44:02.481 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T13:44:02.481 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T13:44:02.481 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:44:02.540 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T13:44:02.540 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T13:44:02.540 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:44:02.556 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T13:44:02.557 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T13:44:02.557 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:44:02.615 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T13:44:02.616 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T13:44:02.616 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T13:44:02.616 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:44:02.712 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T13:44:02.713 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T13:44:02.713 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:44:02.803 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T13:44:02.803 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T13:44:02.803 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:44:03.928 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:44:03.932 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:44:06.055 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-25T13:44:08.904 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T13:44:08.905 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T13:44:08.905 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:44:09.006 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T13:44:09.006 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T13:44:09.006 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:44:09.104 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T13:44:09.105 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T13:44:09.105 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:44:09.201 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T13:44:09.201 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T13:44:09.201 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:44:11.660 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-25T13:44:11.660 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-25T13:44:15.302 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T13:44:15.303 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T13:44:15.303 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:44:15.365 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T13:44:15.365 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T13:44:15.366 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T13:44:15.366 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:44:15.425 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T13:44:15.426 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T13:44:15.426 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:44:15.482 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T13:44:15.482 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T13:44:15.483 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T13:44:15.483 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:44:15.502 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T13:44:15.503 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T13:44:15.503 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:44:15.520 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T13:44:15.521 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T13:44:15.521 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T13:44:15.583 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T13:44:15.584 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T13:44:15.584 DEBUG:teuthology.orchestra.run.smithi123:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-25T13:44:15.618 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi123.front.sepia.ceph.com 2024-04-25T13:44:15.618 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T13:44:15.914 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi123.front.sepia.ceph.com 2024-04-25T13:44:15.915 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T13:44:16.085 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi123.front.sepia.ceph.com 2024-04-25T13:44:16.086 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T13:44:16.279 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi123.front.sepia.ceph.com 2024-04-25T13:44:16.280 DEBUG:teuthology.orchestra.run.smithi123:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T13:44:16.453 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi130.front.sepia.ceph.com 2024-04-25T13:44:16.453 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T13:44:16.661 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-25T13:44:16.670 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi130.front.sepia.ceph.com 2024-04-25T13:44:16.671 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T13:44:16.816 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi130.front.sepia.ceph.com 2024-04-25T13:44:16.816 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T13:44:16.960 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi130.front.sepia.ceph.com 2024-04-25T13:44:16.960 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T13:44:17.117 INFO:tasks.ceph:Archiving mon data... 2024-04-25T13:44:17.118 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673164/data/mon.a.tgz 2024-04-25T13:44:17.118 DEBUG:teuthology.orchestra.run.smithi123:> mktemp 2024-04-25T13:44:17.126 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/tmp.FlInOy4wXS 2024-04-25T13:44:17.127 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.FlInOy4wXS 2024-04-25T13:44:17.247 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0666 /tmp/tmp.FlInOy4wXS 2024-04-25T13:44:17.325 DEBUG:teuthology.orchestra.remote:smithi123:/tmp/tmp.FlInOy4wXS is 289KB 2024-04-25T13:44:17.387 DEBUG:teuthology.orchestra.run.smithi123:> rm -fr /tmp/tmp.FlInOy4wXS 2024-04-25T13:44:17.394 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673164/data/mon.b.tgz 2024-04-25T13:44:17.395 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2024-04-25T13:44:17.403 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.jw641lQ8mi 2024-04-25T13:44:17.404 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.jw641lQ8mi 2024-04-25T13:44:17.542 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.jw641lQ8mi 2024-04-25T13:44:17.616 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.jw641lQ8mi is 389KB 2024-04-25T13:44:17.678 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.jw641lQ8mi 2024-04-25T13:44:17.686 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673164/data/mon.c.tgz 2024-04-25T13:44:17.687 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2024-04-25T13:44:17.735 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.7JDWZxaSTn 2024-04-25T13:44:17.735 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.7JDWZxaSTn 2024-04-25T13:44:17.872 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.7JDWZxaSTn 2024-04-25T13:44:17.943 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.7JDWZxaSTn is 389KB 2024-04-25T13:44:18.006 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.7JDWZxaSTn 2024-04-25T13:44:18.014 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T13:44:18.014 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T13:44:18.018 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T13:44:18.088 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T13:44:18.123 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T13:44:18.123 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T13:44:18.125 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673164/remote/smithi123/crash 2024-04-25T13:44:18.125 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T13:44:18.156 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673164/remote/smithi130/crash 2024-04-25T13:44:18.157 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T13:44:18.181 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T13:44:18.181 DEBUG:teuthology.orchestra.run.smithi123:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:44:18.207 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T13:44:18.274 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T13:44:18.294 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T13:44:18.313 INFO:tasks.ceph:Compressing logs... 2024-04-25T13:44:18.313 DEBUG:teuthology.orchestra.run.smithi123:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T13:44:18.339 DEBUG:teuthology.orchestra.run.smithi130:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T13:44:18.361 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35894.log 2024-04-25T13:44:18.362 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34529.log 2024-04-25T13:44:18.363 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36344.log 2024-04-25T13:44:18.363 INFO:teuthology.orchestra.run.smithi123.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35894.log.gz 2024-04-25T13:44:18.364 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.34529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37268.log 2024-04-25T13:44:18.364 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34529.log.gz 2024-04-25T13:44:18.365 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39140.log 2024-04-25T13:44:18.365 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36344.log.gz 2024-04-25T13:44:18.365 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38286.log 2024-04-25T13:44:18.366 INFO:teuthology.orchestra.run.smithi123.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.37268.log.gz 2024-04-25T13:44:18.366 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.39140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33437.log 2024-04-25T13:44:18.366 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39140.log.gz 2024-04-25T13:44:18.368 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36937.log 2024-04-25T13:44:18.368 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38286.log.gz 2024-04-25T13:44:18.368 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33437.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T13:44:18.369 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33437.log.gz 2024-04-25T13:44:18.369 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34934.log 2024-04-25T13:44:18.369 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36937.log.gz 2024-04-25T13:44:18.369 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37648.log 2024-04-25T13:44:18.370 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.34934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34139.log 2024-04-25T13:44:18.371 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.34934.log.gz 2024-04-25T13:44:18.371 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34477.log 2024-04-25T13:44:18.371 INFO:teuthology.orchestra.run.smithi123.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.37648.log.gz 2024-04-25T13:44:18.372 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.34139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34737.log 2024-04-25T13:44:18.373 INFO:teuthology.orchestra.run.smithi123.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34139.log.gz 2024-04-25T13:44:18.373 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.34477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37138.log 2024-04-25T13:44:18.373 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34477.log.gz 2024-04-25T13:44:18.374 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.34737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38416.log 2024-04-25T13:44:18.375 INFO:teuthology.orchestra.run.smithi123.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.34737.log.gz 2024-04-25T13:44:18.375 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35203.log 2024-04-25T13:44:18.376 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37138.log.gz 2024-04-25T13:44:18.376 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39244.log 2024-04-25T13:44:18.376 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38416.log.gz 2024-04-25T13:44:18.377 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37525.log 2024-04-25T13:44:18.377 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35203.log.gz 2024-04-25T13:44:18.377 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.39244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37621.log 2024-04-25T13:44:18.378 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39244.log.gz 2024-04-25T13:44:18.379 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37525.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T13:44:18.379 INFO:teuthology.orchestra.run.smithi123.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37525.log.gz 2024-04-25T13:44:18.380 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36728.log 2024-04-25T13:44:18.380 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37621.log.gz 2024-04-25T13:44:18.380 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27839.log 2024-04-25T13:44:18.381 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36422.log 2024-04-25T13:44:18.384 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33737.log 2024-04-25T13:44:18.384 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36728.log.gz 2024-04-25T13:44:18.384 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38932.log 2024-04-25T13:44:18.384 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36422.log.gz 2024-04-25T13:44:18.384 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35975.log 2024-04-25T13:44:18.384 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33737.log.gz 2024-04-25T13:44:18.385 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27743.log 2024-04-25T13:44:18.385 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.27839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27767.log 2024-04-25T13:44:18.385 INFO:teuthology.orchestra.run.smithi130.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.27839.log.gz 2024-04-25T13:44:18.385 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.27743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33701.log 2024-04-25T13:44:18.385 INFO:teuthology.orchestra.run.smithi130.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27743.log.gz 2024-04-25T13:44:18.385 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.27767.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T13:44:18.385 INFO:teuthology.orchestra.run.smithi130.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27767.log.gz 2024-04-25T13:44:18.385 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.3.33701.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T13:44:18.386 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.33701.log.gz 2024-04-25T13:44:18.386 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33696.log 2024-04-25T13:44:18.389 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33612.log 2024-04-25T13:44:18.389 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.3.33696.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T13:44:18.389 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.33696.log.gz 2024-04-25T13:44:18.389 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.1.33612.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T13:44:18.389 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33612.log.gz 2024-04-25T13:44:18.389 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33594.log 2024-04-25T13:44:18.391 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33750.log 2024-04-25T13:44:18.391 INFO:teuthology.orchestra.run.smithi123.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38932.log.gz 2024-04-25T13:44:18.391 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35543.log 2024-04-25T13:44:18.391 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35975.log.gz 2024-04-25T13:44:18.391 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38176.log 2024-04-25T13:44:18.391 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33750.log.gz 2024-04-25T13:44:18.391 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37421.log 2024-04-25T13:44:18.391 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35543.log.gz 2024-04-25T13:44:18.391 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27841.log 2024-04-25T13:44:18.391 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38176.log.gz 2024-04-25T13:44:18.391 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35333.log 2024-04-25T13:44:18.392 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37421.log.gz 2024-04-25T13:44:18.392 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.27841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33098.log 2024-04-25T13:44:18.392 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27841.log.gz 2024-04-25T13:44:18.392 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36188.log 2024-04-25T13:44:18.392 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35333.log.gz 2024-04-25T13:44:18.396 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T13:44:18.396 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.1.33594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27719.log 2024-04-25T13:44:18.396 INFO:teuthology.orchestra.run.smithi130.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33594.log.gz 2024-04-25T13:44:18.396 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T13:44:18.396 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.27719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27815.log 2024-04-25T13:44:18.397 INFO:teuthology.orchestra.run.smithi130.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T13:44:18.397 INFO:teuthology.orchestra.run.smithi130.stderr: 91.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T13:44:18.397 INFO:teuthology.orchestra.run.smithi130.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.27719.log.gz 2024-04-25T13:44:18.397 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27695.log 2024-04-25T13:44:18.397 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.27815.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.27815.log.gz 2024-04-25T13:44:18.397 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T13:44:18.397 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.27695.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-25T13:44:18.397 INFO:teuthology.orchestra.run.smithi130.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.27695.log.gz 2024-04-25T13:44:18.401 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35842.log 2024-04-25T13:44:18.401 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33098.log.gz 2024-04-25T13:44:18.401 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34685.log 2024-04-25T13:44:18.401 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36188.log.gz 2024-04-25T13:44:18.401 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38494.log 2024-04-25T13:44:18.401 INFO:teuthology.orchestra.run.smithi123.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35842.log.gz 2024-04-25T13:44:18.401 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.34685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37552.log 2024-04-25T13:44:18.401 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34685.log.gz 2024-04-25T13:44:18.401 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33567.log 2024-04-25T13:44:18.401 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38494.log.gz 2024-04-25T13:44:18.401 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39114.log 2024-04-25T13:44:18.401 INFO:teuthology.orchestra.run.smithi123.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.37552.log.gz 2024-04-25T13:44:18.402 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33567.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33567.log.gz 2024-04-25T13:44:18.402 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37931.log 2024-04-25T13:44:18.402 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.39114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37832.log 2024-04-25T13:44:18.402 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39114.log.gz 2024-04-25T13:44:18.402 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36552.log 2024-04-25T13:44:18.402 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37931.log.gz 2024-04-25T13:44:18.402 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37862.log 2024-04-25T13:44:18.402 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37832.log.gz 2024-04-25T13:44:18.402 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T13:44:18.402 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T13:44:18.402 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-mds.b.log: 93.8% 92.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-25T13:44:18.402 INFO:teuthology.orchestra.run.smithi130.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T13:44:18.402 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27791.log 2024-04-25T13:44:18.403 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T13:44:18.404 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.27791.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.27791.log.gz 2024-04-25T13:44:18.404 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27863.log 2024-04-25T13:44:18.406 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37242.log 2024-04-25T13:44:18.406 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36552.log.gz 2024-04-25T13:44:18.406 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38776.log 2024-04-25T13:44:18.406 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37862.log.gz 2024-04-25T13:44:18.406 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37028.log 2024-04-25T13:44:18.406 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37242.log.gz 2024-04-25T13:44:18.406 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38776.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T13:44:18.407 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38776.log.gz 2024-04-25T13:44:18.407 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37028.log: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T13:44:18.407 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38338.log 2024-04-25T13:44:18.407 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37028.log.gz 2024-04-25T13:44:18.407 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37802.log 2024-04-25T13:44:18.408 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/ceph-client.admin.27863.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27863.log.gz 2024-04-25T13:44:18.408 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37715.log 2024-04-25T13:44:18.409 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38338.log.gz 2024-04-25T13:44:18.409 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38202.log 2024-04-25T13:44:18.409 INFO:teuthology.orchestra.run.smithi123.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.37802.log.gz 2024-04-25T13:44:18.409 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33953.log 2024-04-25T13:44:18.409 INFO:teuthology.orchestra.run.smithi123.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.37715.log.gz 2024-04-25T13:44:18.410 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39166.log 2024-04-25T13:44:18.410 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38202.log.gz 2024-04-25T13:44:18.410 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34425.log 2024-04-25T13:44:18.411 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33953.log.gz 2024-04-25T13:44:18.411 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.39166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35099.log 2024-04-25T13:44:18.411 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39166.log.gz 2024-04-25T13:44:18.412 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.34425.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T13:44:18.412 INFO:teuthology.orchestra.run.smithi123.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.34425.log.gz 2024-04-25T13:44:18.413 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36136.log 2024-04-25T13:44:18.413 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35099.log.gz 2024-04-25T13:44:18.414 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36526.log 2024-04-25T13:44:18.415 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35733.log 2024-04-25T13:44:18.416 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36136.log.gz 2024-04-25T13:44:18.417 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36526.log: 88.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.36526.log.gz 2024-04-25T13:44:18.417 INFO:teuthology.orchestra.run.smithi123.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36266.log 2024-04-25T13:44:18.418 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36675.log 2024-04-25T13:44:18.418 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36266.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35733.log.gz 2024-04-25T13:44:18.419 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38724.log 2024-04-25T13:44:18.419 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36266.log.gz 2024-04-25T13:44:18.420 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36675.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36675.log.gzgzip 2024-04-25T13:44:18.420 INFO:teuthology.orchestra.run.smithi123.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34152.log 2024-04-25T13:44:18.421 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33249.log 2024-04-25T13:44:18.421 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.34152.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38724.log.gz 2024-04-25T13:44:18.422 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33196.log 2024-04-25T13:44:18.422 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34152.log.gz 2024-04-25T13:44:18.423 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33515.log 2024-04-25T13:44:18.423 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33249.log.gz 2024-04-25T13:44:18.424 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.33196.log: -- /var/log/ceph/ceph-client.admin.34503.log 2024-04-25T13:44:18.425 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33515.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33196.log.gz 2024-04-25T13:44:18.425 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37396.log 2024-04-25T13:44:18.425 INFO:teuthology.orchestra.run.smithi123.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33515.log.gz 2024-04-25T13:44:18.426 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.34503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38591.log 2024-04-25T13:44:18.426 INFO:teuthology.orchestra.run.smithi123.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.34503.log.gz 2024-04-25T13:44:18.427 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.37396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35785.log 2024-04-25T13:44:18.427 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.37396.log.gz 2024-04-25T13:44:18.428 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34399.log 2024-04-25T13:44:18.428 INFO:teuthology.orchestra.run.smithi123.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38591.log.gz 2024-04-25T13:44:18.429 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35785.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.35785.log.gz 2024-04-25T13:44:18.430 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35759.log 2024-04-25T13:44:18.430 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22813.log 2024-04-25T13:44:18.431 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.34399.log: /var/log/ceph/ceph-client.admin.35759.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34399.log.gz 2024-04-25T13:44:18.432 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38669.log 2024-04-25T13:44:18.432 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35759.log.gz 2024-04-25T13:44:18.432 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph.tmp-client.admin.22813.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22813.log.gz 2024-04-25T13:44:18.433 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34159.log 2024-04-25T13:44:18.433 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37692.log 2024-04-25T13:44:18.434 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.34159.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38669.log.gz 2024-04-25T13:44:18.435 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 88.6% --verbose -- replaced with /var/log/ceph/ceph-client.admin.34159.log.gz -- 2024-04-25T13:44:18.435 INFO:teuthology.orchestra.run.smithi123.stderr: /var/log/ceph/ceph-client.admin.34555.log 2024-04-25T13:44:18.435 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37991.log 2024-04-25T13:44:18.436 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.34555.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.37692.log.gz 2024-04-25T13:44:18.437 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36500.log 2024-04-25T13:44:18.437 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34555.log.gz 2024-04-25T13:44:18.438 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37991.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37991.log.gz 2024-04-25T13:44:18.438 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38228.log 2024-04-25T13:44:18.439 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34451.log 2024-04-25T13:44:18.439 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38228.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36500.log.gz 2024-04-25T13:44:18.440 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36833.log 2024-04-25T13:44:18.440 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38228.log.gz 2024-04-25T13:44:18.441 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.34451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34347.log 2024-04-25T13:44:18.441 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34451.log.gz 2024-04-25T13:44:18.442 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39036.log 2024-04-25T13:44:18.442 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.34347.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.36833.log.gz 2024-04-25T13:44:18.443 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35647.log 2024-04-25T13:44:18.443 INFO:teuthology.orchestra.run.smithi123.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34347.log.gz 2024-04-25T13:44:18.444 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.39036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34711.log 87.2% 2024-04-25T13:44:18.444 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39036.log.gz 2024-04-25T13:44:18.445 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37080.log 2024-04-25T13:44:18.446 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35647.log.gz 2024-04-25T13:44:18.446 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.34711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35125.log 2024-04-25T13:44:18.447 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34711.log.gz 2024-04-25T13:44:18.447 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38828.log 87.8% 2024-04-25T13:44:18.447 INFO:teuthology.orchestra.run.smithi123.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37080.log.gz 2024-04-25T13:44:18.448 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34581.log 2024-04-25T13:44:18.449 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38828.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35125.log.gz 2024-04-25T13:44:18.450 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38364.log 2024-04-25T13:44:18.450 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38828.log.gz 2024-04-25T13:44:18.451 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.34581.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T13:44:18.451 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34581.log.gz 2024-04-25T13:44:18.452 INFO:teuthology.orchestra.run.smithi130.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T13:44:18.452 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34958.log 2024-04-25T13:44:18.452 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.3.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.38364.log.gz 2024-04-25T13:44:18.453 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36396.log 2024-04-25T13:44:18.454 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.34958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36474.log 2024-04-25T13:44:18.454 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34958.log.gz 2024-04-25T13:44:18.455 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37914.log 2024-04-25T13:44:18.455 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36396.log.gz 2024-04-25T13:44:18.456 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37054.log 2024-04-25T13:44:18.456 INFO:teuthology.orchestra.run.smithi123.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36474.log.gz 2024-04-25T13:44:18.457 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.37914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36079.log 2024-04-25T13:44:18.457 INFO:teuthology.orchestra.run.smithi123.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.37914.log.gz 2024-04-25T13:44:18.458 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37499.log 2024-04-25T13:44:18.459 INFO:teuthology.orchestra.run.smithi123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37054.log.gz 2024-04-25T13:44:18.459 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34633.log 2024-04-25T13:44:18.460 INFO:teuthology.orchestra.run.smithi123.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36079.log.gz 2024-04-25T13:44:18.461 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35044.log 2024-04-25T13:44:18.461 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37499.log.gz 2024-04-25T13:44:18.462 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.34633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35073.log 2024-04-25T13:44:18.462 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34633.log.gz 2024-04-25T13:44:18.463 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.2.35044.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.2.35044.log.gz --verbose 2024-04-25T13:44:18.463 INFO:teuthology.orchestra.run.smithi123.stderr: -- /var/log/ceph/ceph-client.admin.33671.log 2024-04-25T13:44:18.464 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37574.log 2024-04-25T13:44:18.464 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35073.log.gz 2024-04-25T13:44:18.465 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33541.log 2024-04-25T13:44:18.465 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33671.log.gz 2024-04-25T13:44:18.467 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38124.log 2024-04-25T13:44:18.467 INFO:teuthology.orchestra.run.smithi123.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.37574.log.gz 2024-04-25T13:44:18.467 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39062.log 2024-04-25T13:44:18.468 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33541.log.gz 2024-04-25T13:44:18.469 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36318.log 2024-04-25T13:44:18.469 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38124.log.gz 2024-04-25T13:44:18.470 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.39062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35569.log 2024-04-25T13:44:18.470 INFO:teuthology.orchestra.run.smithi123.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.39062.log.gz 2024-04-25T13:44:18.471 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36001.log 2024-04-25T13:44:18.471 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36318.log.gz 2024-04-25T13:44:18.472 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38260.log 2024-04-25T13:44:18.472 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35569.log.gz 2024-04-25T13:44:18.473 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37447.log 2024-04-25T13:44:18.474 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36001.log.gz 2024-04-25T13:44:18.474 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38260.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T13:44:18.474 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38260.log.gz 2024-04-25T13:44:18.475 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37473.log 2024-04-25T13:44:18.475 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37447.log.gz 2024-04-25T13:44:18.477 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35281.log 2024-04-25T13:44:18.478 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35359.log 2024-04-25T13:44:18.478 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37473.log.gz 2024-04-25T13:44:18.479 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36448.log 2024-04-25T13:44:18.479 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35281.log.gz 2024-04-25T13:44:18.480 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35359.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35359.log.gz 2024-04-25T13:44:18.481 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36448.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36448.log.gz 2024-04-25T13:44:18.482 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36702.log 2024-04-25T13:44:18.483 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35255.log 2024-04-25T13:44:18.484 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33733.log 2024-04-25T13:44:18.484 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36702.log.gz 2024-04-25T13:44:18.485 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35255.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35255.log.gz 2024-04-25T13:44:18.486 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33733.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33733.log.gz 2024-04-25T13:44:18.487 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38880.log 2024-04-25T13:44:18.488 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38021.log 2024-04-25T13:44:18.490 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38880.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38880.log.gz 2024-04-25T13:44:18.490 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38021.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38021.log.gz 2024-04-25T13:44:18.491 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33645.log 2024-04-25T13:44:18.492 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36053.log 2024-04-25T13:44:18.493 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34154.log 2024-04-25T13:44:18.494 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33645.log.gz 2024-04-25T13:44:18.495 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36053.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36053.log.gz 2024-04-25T13:44:18.495 INFO:teuthology.orchestra.run.smithi130.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T13:44:18.496 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.34154.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34154.log.gz 2024-04-25T13:44:18.496 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35229.log 2024-04-25T13:44:18.497 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39088.log 2024-04-25T13:44:18.499 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37596.log 2024-04-25T13:44:18.499 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35229.log.gz 2024-04-25T13:44:18.500 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.39088.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39088.log.gz 2024-04-25T13:44:18.501 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37596.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37596.log.gz 2024-04-25T13:44:18.501 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36993.log 2024-04-25T13:44:18.502 INFO:teuthology.orchestra.run.smithi130.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T13:44:18.502 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39271.log 2024-04-25T13:44:18.504 INFO:teuthology.orchestra.run.smithi130.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T13:44:18.504 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35621.log 2024-04-25T13:44:18.504 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36993.log.gz 2024-04-25T13:44:18.505 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.39271.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39271.log.gz 2024-04-25T13:44:18.506 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35621.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35621.log.gz 2024-04-25T13:44:18.507 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34607.log 2024-04-25T13:44:18.508 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36610.log 2024-04-25T13:44:18.509 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.34607.log: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T13:44:18.509 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38520.log 2024-04-25T13:44:18.510 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34607.log.gz 2024-04-25T13:44:18.510 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35151.log 2024-04-25T13:44:18.511 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36610.log: /var/log/ceph/ceph-client.admin.38520.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36610.log.gz 2024-04-25T13:44:18.511 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38092.log 2024-04-25T13:44:18.512 INFO:teuthology.orchestra.run.smithi123.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T13:44:18.512 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38520.log.gz 2024-04-25T13:44:18.512 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35439.log 2024-04-25T13:44:18.513 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38092.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35151.log.gz 2024-04-25T13:44:18.513 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38958.log 2024-04-25T13:44:18.514 INFO:teuthology.orchestra.run.smithi123.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.38092.log.gz 2024-04-25T13:44:18.514 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35439.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T13:44:18.514 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35439.log.gz 2024-04-25T13:44:18.515 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39295.log 2024-04-25T13:44:18.515 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38958.log.gz 2024-04-25T13:44:18.516 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37344.log 2024-04-25T13:44:18.516 INFO:teuthology.orchestra.run.smithi123.stderr: 85.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T13:44:18.517 INFO:teuthology.orchestra.run.smithi130.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T13:44:18.517 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.39295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34659.log 2024-04-25T13:44:18.517 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39295.log.gz 2024-04-25T13:44:18.518 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35465.log 2024-04-25T13:44:18.518 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37344.log.gz 2024-04-25T13:44:18.519 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.34659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36965.log 2024-04-25T13:44:18.519 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34659.log.gz 2024-04-25T13:44:18.520 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37391.log 2024-04-25T13:44:18.520 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35465.log.gz 2024-04-25T13:44:18.521 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38048.log 2024-04-25T13:44:18.521 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36965.log.gz 2024-04-25T13:44:18.521 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.37391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.37391.log.gz 2024-04-25T13:44:18.522 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33275.log 2024-04-25T13:44:18.522 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39218.log 2024-04-25T13:44:18.523 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38048.log.gz 2024-04-25T13:44:18.524 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38984.log 2024-04-25T13:44:18.524 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33275.log.gz 2024-04-25T13:44:18.525 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.39218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36885.log 2024-04-25T13:44:18.525 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39218.log.gz 2024-04-25T13:44:18.525 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33619.log 2024-04-25T13:44:18.526 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38984.log.gz 2024-04-25T13:44:18.526 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36885.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36885.log.gz 2024-04-25T13:44:18.526 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34916.log 2024-04-25T13:44:18.527 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36214.log 2024-04-25T13:44:18.527 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33619.log.gz 2024-04-25T13:44:18.528 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.34916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.34916.log.gz 2024-04-25T13:44:18.528 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34158.log 2024-04-25T13:44:18.529 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27622.log 2024-04-25T13:44:18.529 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36214.log.gz 2024-04-25T13:44:18.530 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.34158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35049.log 2024-04-25T13:44:18.530 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34158.log.gz 2024-04-25T13:44:18.531 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.27622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33222.log 2024-04-25T13:44:18.531 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.27622.log.gz 2024-04-25T13:44:18.532 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.2.35049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.35049.log.gz 2024-04-25T13:44:18.532 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33751.log 2024-04-25T13:44:18.533 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35177.log 2024-04-25T13:44:18.533 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33222.log.gz 2024-04-25T13:44:18.534 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33958.log 2024-04-25T13:44:18.534 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33751.log.gz 2024-04-25T13:44:18.534 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38802.log 2024-04-25T13:44:18.535 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35177.log.gz 2024-04-25T13:44:18.536 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33943.log 2024-04-25T13:44:18.536 INFO:teuthology.orchestra.run.smithi123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33958.log.gz 2024-04-25T13:44:18.537 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33383.log 2024-04-25T13:44:18.537 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38802.log.gz 2024-04-25T13:44:18.538 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35413.log 2024-04-25T13:44:18.538 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33943.log.gz 2024-04-25T13:44:18.538 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33489.log 2024-04-25T13:44:18.539 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33383.log.gz 2024-04-25T13:44:18.539 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35413.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35413.log.gz 2024-04-25T13:44:18.539 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38468.log 2024-04-25T13:44:18.540 INFO:teuthology.orchestra.run.smithi130.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T13:44:18.541 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34373.log 2024-04-25T13:44:18.541 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33489.log.gz 2024-04-25T13:44:18.542 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36755.log 2024-04-25T13:44:18.542 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38468.log.gz 2024-04-25T13:44:18.542 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.34373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38750.log 2024-04-25T13:44:18.542 INFO:teuthology.orchestra.run.smithi123.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34373.log.gz 2024-04-25T13:44:18.543 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33747.log 2024-04-25T13:44:18.543 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36755.log.gz 2024-04-25T13:44:18.544 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38750.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38750.log.gz 2024-04-25T13:44:18.544 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33301.log 2024-04-25T13:44:18.545 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37112.log 2024-04-25T13:44:18.545 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33747.log.gz 2024-04-25T13:44:18.546 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35811.log 2024-04-25T13:44:18.546 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33301.log.gz 2024-04-25T13:44:18.547 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38546.log 2024-04-25T13:44:18.547 INFO:teuthology.orchestra.run.smithi123.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37112.log.gz 2024-04-25T13:44:18.548 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35920.log 2024-04-25T13:44:18.548 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35811.log.gz 2024-04-25T13:44:18.549 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33030.log 2024-04-25T13:44:18.549 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38546.log.gz 2024-04-25T13:44:18.550 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34797.log 2024-04-25T13:44:18.550 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35920.log.gz 2024-04-25T13:44:18.551 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33030.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T13:44:18.551 INFO:teuthology.orchestra.run.smithi123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33030.log.gz 2024-04-25T13:44:18.552 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.34797.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-25T13:44:18.552 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34797.log.gz 2024-04-25T13:44:18.553 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39192.log 2024-04-25T13:44:18.554 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-mds.c.log: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T13:44:18.554 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34149.log 2024-04-25T13:44:18.555 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.39192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35491.log 2024-04-25T13:44:18.555 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39192.log.gz 2024-04-25T13:44:18.556 INFO:teuthology.orchestra.run.smithi130.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T13:44:18.556 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.34149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36240.log 2024-04-25T13:44:18.556 INFO:teuthology.orchestra.run.smithi123.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34149.log.gz 2024-04-25T13:44:18.557 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35491.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35491.log.gz 2024-04-25T13:44:18.557 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T13:44:18.558 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-04-25T13:44:18.558 INFO:teuthology.orchestra.run.smithi130.stderr:real 0m0.196s 2024-04-25T13:44:18.558 INFO:teuthology.orchestra.run.smithi130.stderr:user 0m0.780s 2024-04-25T13:44:18.558 INFO:teuthology.orchestra.run.smithi130.stderr:sys 0m0.118s 2024-04-25T13:44:18.559 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36807.log 2024-04-25T13:44:18.559 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36240.log.gz 2024-04-25T13:44:18.559 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38390.log 2024-04-25T13:44:18.560 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36807.log: 92.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T13:44:18.560 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35673.log 2024-04-25T13:44:18.561 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36807.log.gz 2024-04-25T13:44:18.561 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33745.log 2024-04-25T13:44:18.562 INFO:teuthology.orchestra.run.smithi123.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38390.log.gz 2024-04-25T13:44:18.563 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33131.log 2024-04-25T13:44:18.563 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35673.log.gz 2024-04-25T13:44:18.564 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37190.log 2024-04-25T13:44:18.564 INFO:teuthology.orchestra.run.smithi123.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33745.log.gz 2024-04-25T13:44:18.564 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36911.log 2024-04-25T13:44:18.565 INFO:teuthology.orchestra.run.smithi123.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33131.log.gz 2024-04-25T13:44:18.566 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37216.log 2024-04-25T13:44:18.566 INFO:teuthology.orchestra.run.smithi123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37190.log.gz 2024-04-25T13:44:18.567 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36911.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36911.log.gz 2024-04-25T13:44:18.567 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38442.log 2024-04-25T13:44:18.568 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35307.log 2024-04-25T13:44:18.568 INFO:teuthology.orchestra.run.smithi123.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37216.log.gz 2024-04-25T13:44:18.569 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39010.log 2024-04-25T13:44:18.569 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38442.log.gz 2024-04-25T13:44:18.570 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35307.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35307.log.gz 2024-04-25T13:44:18.570 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33411.log 2024-04-25T13:44:18.571 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.39010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36578.log 2024-04-25T13:44:18.572 INFO:teuthology.orchestra.run.smithi123.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39010.log.gz 2024-04-25T13:44:18.573 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38070.log 2024-04-25T13:44:18.573 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33411.log.gz 2024-04-25T13:44:18.573 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38643.log 2024-04-25T13:44:18.574 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36578.log.gz 2024-04-25T13:44:18.575 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33959.log 2024-04-25T13:44:18.575 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38643.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.38070.log.gz 2024-04-25T13:44:18.576 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38643.log.gz 2024-04-25T13:44:18.576 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37670.log 2024-04-25T13:44:18.577 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36162.log 2024-04-25T13:44:18.577 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33959.log.gz 2024-04-25T13:44:18.578 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37772.log 2024-04-25T13:44:18.578 INFO:teuthology.orchestra.run.smithi123.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.37670.log.gz 2024-04-25T13:44:18.579 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36110.log 2024-04-25T13:44:18.579 INFO:teuthology.orchestra.run.smithi123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36162.log.gz 2024-04-25T13:44:18.580 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33942.log 2024-04-25T13:44:18.581 INFO:teuthology.orchestra.run.smithi123.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.37772.log.gz 2024-04-25T13:44:18.581 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38854.log 2024-04-25T13:44:18.581 INFO:teuthology.orchestra.run.smithi123.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36110.log.gz 2024-04-25T13:44:18.582 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35595.log 2024-04-25T13:44:18.583 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33942.log.gz 2024-04-25T13:44:18.583 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38906.log 2024-04-25T13:44:18.584 INFO:teuthology.orchestra.run.smithi123.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38854.log.gz 2024-04-25T13:44:18.585 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37745.log 2024-04-25T13:44:18.585 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35595.log.gz 2024-04-25T13:44:18.586 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33593.log 2024-04-25T13:44:18.586 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38906.log.gz 2024-04-25T13:44:18.587 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35868.log 2024-04-25T13:44:18.587 INFO:teuthology.orchestra.run.smithi123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37745.log.gz 2024-04-25T13:44:18.588 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27740.log 2024-04-25T13:44:18.588 INFO:teuthology.orchestra.run.smithi123.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33593.log.gz 2024-04-25T13:44:18.589 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33956.log 2024-04-25T13:44:18.589 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35868.log: /var/log/ceph/ceph-client.admin.27740.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35868.log.gz 2024-04-25T13:44:18.590 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38312.log 2024-04-25T13:44:18.590 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.27740.log.gz 2024-04-25T13:44:18.591 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33327.log 2024-04-25T13:44:18.591 INFO:teuthology.orchestra.run.smithi123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33956.log.gz 2024-04-25T13:44:18.592 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37294.log 2024-04-25T13:44:18.593 INFO:teuthology.orchestra.run.smithi123.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38312.log.gz 2024-04-25T13:44:18.593 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36027.log 2024-04-25T13:44:18.593 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33327.log.gz 2024-04-25T13:44:18.594 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33739.log 2024-04-25T13:44:18.595 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36027.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.37294.log.gz 2024-04-25T13:44:18.595 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34166.log 2024-04-25T13:44:18.595 INFO:teuthology.orchestra.run.smithi123.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36027.log.gz 2024-04-25T13:44:18.596 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35946.log 2024-04-25T13:44:18.596 INFO:teuthology.orchestra.run.smithi123.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33739.log.gz 2024-04-25T13:44:18.597 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.34166.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34166.log.gz 2024-04-25T13:44:18.598 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35707.log 2024-04-25T13:44:18.598 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36859.log 2024-04-25T13:44:18.599 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35707.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35946.log.gz 2024-04-25T13:44:18.599 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33697.log 2024-04-25T13:44:18.600 INFO:teuthology.orchestra.run.smithi123.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35707.log.gz 2024-04-25T13:44:18.601 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37961.log 2024-04-25T13:44:18.601 INFO:teuthology.orchestra.run.smithi123.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36859.log.gz 2024-04-25T13:44:18.601 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35517.log 2024-04-25T13:44:18.603 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37961.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33697.log.gz 2024-04-25T13:44:18.603 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37909.log 2024-04-25T13:44:18.603 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37961.log.gz 2024-04-25T13:44:18.604 INFO:teuthology.orchestra.run.smithi123.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-25T13:44:18.604 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37164.log 2024-04-25T13:44:18.604 INFO:teuthology.orchestra.run.smithi123.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35517.log.gz 2024-04-25T13:44:18.605 INFO:teuthology.orchestra.run.smithi123.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33463.log 2024-04-25T13:44:18.605 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.0.37909.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.37909.log.gz 2024-04-25T13:44:18.606 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.37164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36370.log 2024-04-25T13:44:18.606 INFO:teuthology.orchestra.run.smithi123.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37164.log.gz 2024-04-25T13:44:18.607 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33463.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.33463.log.gz -5 2024-04-25T13:44:18.607 INFO:teuthology.orchestra.run.smithi123.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36781.log 2024-04-25T13:44:18.607 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35387.log 2024-04-25T13:44:18.608 INFO:teuthology.orchestra.run.smithi123.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36370.log.gz 2024-04-25T13:44:18.609 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36292.log 2024-04-25T13:44:18.609 INFO:teuthology.orchestra.run.smithi123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36781.log.gz 2024-04-25T13:44:18.610 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.35387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33749.log 2024-04-25T13:44:18.610 INFO:teuthology.orchestra.run.smithi123.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35387.log.gz 2024-04-25T13:44:18.610 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.36292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33946.log 2024-04-25T13:44:18.611 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36292.log.gz 2024-04-25T13:44:18.611 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33952.log 2024-04-25T13:44:18.611 INFO:teuthology.orchestra.run.smithi123.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33749.log.gz 2024-04-25T13:44:18.612 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34167.log 2024-04-25T13:44:18.612 INFO:teuthology.orchestra.run.smithi123.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33946.log.gz 2024-04-25T13:44:18.613 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39321.log 2024-04-25T13:44:18.613 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33952.log.gz 2024-04-25T13:44:18.614 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.34167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38150.log 2024-04-25T13:44:18.614 INFO:teuthology.orchestra.run.smithi123.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34167.log.gz 2024-04-25T13:44:18.615 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.39321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38617.log 2024-04-25T13:44:18.615 INFO:teuthology.orchestra.run.smithi123.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39321.log.gz 2024-04-25T13:44:18.616 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33355.log 2024-04-25T13:44:18.616 INFO:teuthology.orchestra.run.smithi123.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38150.log.gz 2024-04-25T13:44:18.617 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.38617.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38617.log.gz 2024-04-25T13:44:18.618 INFO:teuthology.orchestra.run.smithi123.stderr:/var/log/ceph/ceph-client.admin.33355.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33355.log.gz 2024-04-25T13:44:18.626 INFO:teuthology.orchestra.run.smithi123.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T13:44:18.652 INFO:teuthology.orchestra.run.smithi123.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T13:44:18.655 INFO:teuthology.orchestra.run.smithi123.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T13:44:18.657 INFO:teuthology.orchestra.run.smithi123.stderr: 2024-04-25T13:44:18.658 INFO:teuthology.orchestra.run.smithi123.stderr:real 0m0.315s 2024-04-25T13:44:18.658 INFO:teuthology.orchestra.run.smithi123.stderr:user 0m1.099s 2024-04-25T13:44:18.658 INFO:teuthology.orchestra.run.smithi123.stderr:sys 0m0.460s 2024-04-25T13:44:18.659 INFO:tasks.ceph:Archiving logs... 2024-04-25T13:44:18.659 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673164/remote/smithi123/log 2024-04-25T13:44:18.660 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T13:44:19.001 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673164/remote/smithi130/log 2024-04-25T13:44:19.002 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T13:44:19.114 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T13:44:19.131 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T13:44:19.132 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T13:44:19.136 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T13:44:19.209 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T13:44:19.220 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T13:44:19.220 DEBUG:teuthology.orchestra.run.smithi123:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:44:19.223 DEBUG:teuthology.orchestra.run.smithi130:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T13:44:19.234 INFO:teuthology.orchestra.run.smithi123.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T13:44:19.234 INFO:teuthology.orchestra.run.smithi123.stdout:============================================================================== 2024-04-25T13:44:19.234 INFO:teuthology.orchestra.run.smithi123.stdout:+hv01.front.sepi 67.205.162.81 3 u 24 64 77 0.101 -2.615 1.748 2024-04-25T13:44:19.234 INFO:teuthology.orchestra.run.smithi123.stdout:+hv02.front.sepi 63.231.80.2 3 u 28 64 77 0.091 -1.928 2.389 2024-04-25T13:44:19.235 INFO:teuthology.orchestra.run.smithi123.stdout:*hv03.front.sepi 74.6.168.72 3 u 32 64 77 0.163 -0.275 3.318 2024-04-25T13:44:19.235 INFO:teuthology.orchestra.run.smithi123.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:44:19.237 INFO:teuthology.orchestra.run.smithi130.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T13:44:19.237 INFO:teuthology.orchestra.run.smithi130.stdout:============================================================================== 2024-04-25T13:44:19.237 INFO:teuthology.orchestra.run.smithi130.stdout:+hv01.front.sepi 67.205.162.81 3 u 29 64 77 0.074 -0.257 1.411 2024-04-25T13:44:19.238 INFO:teuthology.orchestra.run.smithi130.stdout:*hv02.front.sepi 63.231.80.2 3 u 34 64 77 0.130 +0.969 0.701 2024-04-25T13:44:19.238 INFO:teuthology.orchestra.run.smithi130.stdout:+hv03.front.sepi 74.6.168.72 3 u 30 64 77 0.076 -1.917 1.097 2024-04-25T13:44:19.238 INFO:teuthology.orchestra.run.smithi130.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T13:44:19.239 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T13:44:19.250 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T13:44:19.251 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T13:44:19.265 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T13:44:19.280 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T13:44:19.295 INFO:teuthology.task.internal:Duration was 826.424111 seconds 2024-04-25T13:44:19.295 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T13:44:19.307 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T13:44:19.308 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T13:44:19.310 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T13:44:19.402 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T13:44:19.402 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi123.front.sepia.ceph.com 2024-04-25T13:44:19.402 DEBUG:teuthology.orchestra.run.smithi123:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T13:44:19.422 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi130.front.sepia.ceph.com 2024-04-25T13:44:19.422 DEBUG:teuthology.orchestra.run.smithi130:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T13:44:19.442 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T13:44:19.442 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T13:44:19.471 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T13:44:19.519 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T13:44:19.519 DEBUG:teuthology.orchestra.run.smithi123:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T13:44:19.554 DEBUG:teuthology.orchestra.run.smithi130:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T13:44:19.644 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T13:44:19.655 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T13:44:19.655 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T13:44:19.675 DEBUG:teuthology.orchestra.run.smithi130:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T13:44:19.694 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T13:44:19.706 DEBUG:teuthology.orchestra.run.smithi123:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:44:19.719 DEBUG:teuthology.orchestra.run.smithi130:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:44:19.733 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = core 2024-04-25T13:44:19.752 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = core 2024-04-25T13:44:19.770 DEBUG:teuthology.orchestra.run.smithi123:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:44:19.799 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:44:19.800 DEBUG:teuthology.orchestra.run.smithi130:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T13:44:19.818 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T13:44:19.819 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T13:44:19.832 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T13:44:19.834 DEBUG:teuthology.misc:Transferring archived files from smithi123:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673164/remote/smithi123 2024-04-25T13:44:19.834 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T13:44:19.872 DEBUG:teuthology.misc:Transferring archived files from smithi130:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673164/remote/smithi130 2024-04-25T13:44:19.872 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T13:44:19.899 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T13:44:19.901 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T13:44:19.911 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T13:44:19.946 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T13:44:19.959 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T13:44:19.960 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T13:44:19.971 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T13:44:19.971 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T13:44:19.974 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T13:44:19.979 INFO:teuthology.orchestra.run.smithi123.stdout: 658122 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 13:44 /home/ubuntu/cephtest 2024-04-25T13:44:19.999 INFO:teuthology.orchestra.run.smithi130.stdout: 658122 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 13:44 /home/ubuntu/cephtest 2024-04-25T13:44:20.001 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T13:44:20.013 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T13:44:20.041 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 client.1-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/mds-flush} duration: 826.4241106510162 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-04-25T13:44:20.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T13:44:20.113 INFO:teuthology.run:pass